OGSADAI: An Overview

1
OGSA-DAI An Overview Shirley Crompton, BioDA
Project, s.y.crompton_at_dl.ac.uk (With thanks to
others)
2
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• The OGSA-DAI Client Toolkit
• OGSA-DAI Usage
• Is OGSA-DAI for you

3
Points to Note

• OGSA-DAI Release 4.0 April 2004
• Globus Toolkit 3.2 Compliant

4
OGSA-DAI Overview

• What is OGSA-DAI
• Decode OGSA-DAI
• The OGSA-DAI Project
• Describe OGSA-DAI
• Framework
• Tool
• High Level Architecture
• The OGSA-DAI Client Toolkit
• OGSA-DAI Usage
• Is OGSA-DAI for you

5
Decoded

• O p e n
• G r i d
• S e r v i c e s
• A r c h i t e c t u r e -
• D a t a
• A c c e s s
• I n t e g r a t i o n

6
The OGSA-DAI/DAIT Project

• An open-source middleware developed by the
• OGSA-DAI ? DAIT Project
• OGSA-DAI Project partners

• Funded by
• UK e-Science Core Programme
• OMII (DAIT)

7
What is OGSA-DAI

• Both a framework and a tool to
• Grid-enable existing structured data resources
• Extend the grid framework to include database
  interoperability

8
What is OGSA-DAI

• Is a Framework for Grid DAI
• Provides a uniform interface to access disparate,
  distributed, heterogeneous data sources
• to be a reference implementation of the GGF DAIS
  specifications

9
OGSA-DAI and the GRID (source the DAIT team)
10
What is OGSA-DAI

• Is a Tool
• Bundled with a platform independent client
  toolkit
• client API in Java
• a rich component library
• with extension points

11
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• OGSA-DAI Service Architecture
• OGSA-DAI Service Interaction
• OGSA-DAI Services
• GDS Internal
• The OGSA-DAI Client Toolkit
• The OGSA-DAI Usage
• Is OGSA-DAI for you

12
Web Service Architecture
13
OGSA OGSA-DAI

• Web services Open Grid Architecture Grid
  services ? OGSA-DAI services

14
OGSA-DAI Service Architecture
15
OGSA-DAI Services

• Service Registry
• DAI Service Group Registry
• Specialised directory facility for OGSA-DAI
  services
• Service Provider
• Grid Data Service Factory
• Data service creation facility
• Grid Data Service
• Primary service
• Access to one specific physical data resource
• via a document-oriented model

16
OGSA-DAI Services(Source DAIT Team)
17
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• OGSA-DAI Service Architecture
• OGSA-DAI Service Interaction
• OGSA-DAI Services
• GDS Internal
• The OGSA-DAI Client Toolkit
• The OGSA-DAI Usage
• Is OGSA-DAI for you

18
OGSA-DAI Service Interaction Model(source the
DAIT Team)
19
OGSA-DAI Services

• Another look at
• DAI Service Group Registry
• Grid Data Service Factory
• Grid Data Service

20
DAI Service Group Registry

• Persistent service
• Based on OGSI ServiceGroups
• Client access DAISGR to discover
• Resources
• Services
• GDSFs may register with DAISGR

21
Grid Data Service Factory

• Persistent service
• Creates GDS to support client interaction with a
  data resource
• Exposes the data resource
• without hiding the underlying data model
• describes metadata and capabilities

22
GDSF Configuration(Source DAIT Team)
23
Grid Data Service(source DAIT Team)

• Common interface to a single data resource
• Exposes the capabilities of data resource
• SQL Queries
• X-Path Queries
• May provide additional capabilities
• Data transformations
• data integration
• 3rd party data delivery

24
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• OGSA-DAI Service Architecture
• OGSA-DAI Service Interaction
• OGSA-DAI Services
• GDS Internal
• Perform Document
• Activities
• The OGSA-DAI Usage
• The OGSA-DAI Client Toolkit
• Is OGSA-DAI for you

25
Components of the GDS(source DAIT Team)
26
Perform document

• In XML format
• Specifies the activities to be performed
• SQL query, transformation, delivery
• Data can be piped between activities
• Minimise message exchange
• No workflow
• No conditionals, loops or variables

27
Perform document
28
Activities(source DAIT Team)
29
Predefined Activities(Source DAIT Team)
30
Interaction with a GDS(source DAIT Team)

• The client send a request document to the GDS

31
Interaction with a GDS(source DAIT Team)
The GDS processes the request and the outputs are
combined to form a response document.
32
Usage Pattern(Source DAIT Team)
Retrieve
Update/Insert
Pipeline
Data Q - Query D - Delivery S - Status R -
Result U - Update I - Data id
33
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• The OGSA-DAI Client Toolkit
• client API in Java
• minimise specialist knowledge
• stable solution
• The OGSA-DAI user base
• Is OGSA-DAI for you

34
The Client Toolkit API(source DAIT Team)
35
Stable Solution

• Uses a helper class (ServiceFetcher) to help
  instantiate the OGSA-DAI services.

ServiceGroupRegistry registry
ServiceFetcher.getRegistry (registryHandle) Gri
dDataServiceFactory factory ServiceFetcher.getF
actory(factoryHandle) GridDataService service
ServiceFetcher.getGridDataService(handle)
36
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• The OGSA-DAI Client Toolkit
• The OGSA-DAI Usage
• Is OGSA-DAI for you

37
OGSA-DAI Usage

• OGSA-DAI R1.0 Jan 2003
• ?
• OGSA-DAI R4.0 April 2004
• OGSA-DAI capabilities
• Projects using/used OGSA-DAI
• Application domains.

38
Supported Data Resurces(source DAIT Team)
39
Supported Operations
40
Projects using OGSA-DAI(source the DAIT Team)
N2Grid (http//www.cs.univie.ac.at/institute/index
.html?project-8080)
Bridges (http//www.brc.dcs.gla.ac.uk/projects/bri
dges/)
INWA (http//www.epcc.ed.ac.uk/projects/inwa/)
BioSimGrid (http//www.biosimgrid.org/)
AstroGrid (http//www.astrogrid.org/)
BioGrid (http//www.biogrid.jp/)
OGSA-DAI (http//www.ogsadai.org.uk)
GEON (http//www.geongrid.org/)
eDiaMoND (http//www.ediamond.ox.ac.uk/)
MCS (http//www.isi.edu/deelman/MCS/)
myGrid (http//www.mygrid.org.uk/)
OGSA-WebDB (http//www.gtrc.aist.go.jp/dbgrid/)
ODD-Genes (http//www.epcc.ed.ac.uk/oddgenes/)
FirstDig (http//www.epcc.ed.ac.uk/firstdig/)
GridMiner (http//www.gridminer.org/)
GeneGrid (http//www.qub.ac.uk/escience/projects.p
hpgenegrid)
IU RGRBench (http//www.cs.indiana.edu/plale/proj
ects/RGR/OGSA-DAI.html)
41
Project Types(source the DAIT Team)
42
Outline of Talk

• What is OGSA-DAI
• High Level Architecture
• The OGSA-DAI Usage
• The OGSA-DAI Client Toolkit
• Is OGSA-DAI for you

43
The Hard Sale

• Language independence at the client end
• Do not need to use Java
• Platform independence
• Do not have to worry about connection technology,
  drivers, etc
• Can handle XML resources
• Can embed additional functionality at the service
  end
• Transformations
• Third party delivery
• etc
• Avoiding unnecessary data movement
• Provision of Metadata is powerful
• Usefulness of the Registry for service discovery
• Dynamic service binding process

44
Food for Thought

• Standard data access scenarios
• do I need to know about GDSF.
• Performance
• Scalability
• How many activities can I pipe together before
  performance suffer.
• Robustness
• Factory thread dying in the background.
• Not enough metadata
• Eg. To support model mapping .

45
The End

• Any Questions