Title: CIMA Based Remote Instrument and Data Access:
1IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
- CIMA Based Remote Instrument and Data Access
- An Extension into the Australian e-Science
Environment - A collaboration between Indiana University, James
Cook University, State University of New York
(SUNY) at Binghamton - and the University of Sydney.
- Ian M. Atkinson, Douglas du Boulay, Clinton
Chee, Kenneth Chiu, Tristan King, Donald F.
McMullen, Romain Quilici, Nigel G.D. Sim, Peter
Turner, Mathew Wyatt.
2IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
- Goal Develop a comprehensive Web services based
system for - collaborative remote access to scientific
instruments - and their data.
- Why provide remote access?
- Maximise resource use and return on investment
-
- Training
- Community outreach and education
3IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Why build a remote access system around (SOAP)
Web services? The good (in principle at least)
1. SOAP (Simple Object Access Protocol) -
firewall friendly (HTTP) 2. Machine friendly,
discoverable, scalable, extensible 3. Location,
language and language model independent 4.
Flexibility - loose coupling and re-usable
components 5. Supports distributed yet
programmatically accessible components 6. Grid
friendly The bad (in practice at
least) SOAP payload delivery can be slow.
May also be regarded as complex and cumbersome.
4IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Why use the Common Instrument Middleware
Architecture (CIMA) model? Offers a general
and re-usable model for instrument access and
management using Web services adaptable to
different instrument settings Flexible and
extensible with modular use of plug-ins Publish-
subscribe or registration model Basis for a
standardised implementation/deployment
system Grid enablement of instruments
sensors Accessible with web service
protocols Common programmable interface
reusable code base Elegance .
5IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
- Developing JSR 168 (GridSphere) based portal and
browser based tools for collaborative - - remote data access and management (including
processing) - (ii) remote instrument monitoring
- (iii) remote instrument control
-
- James Cook University (JCU) group, led by Ian
Atkinson, is developing a flexible CIMA, SRB and
Kepler based system for data access and
management. - The University of Sydney group is developing
CIMA based remote instrument control together
with some tools for data access and processing
that contribute to the JCU project
6IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Indiana University CIMA Implementation
- 4 componentsInstrument Rep, My Manager, Data
Manager Service, Portal Interface - IR, MM, DM implemented in c, gSoap, Perl
- Storage ext3 file-system, MySQL database
- Portal jrs168 portlets, gridsphere
- Issues My Manager Portal implementations
domain specific i.e. Crystallography vs
oceanographic monitoring
7IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
8JCU Cima Implementation (JAINIS)
IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
9IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Modifications to Data Management
- NFS and MySQL replaced with SRB and MCAT
- Moved from C and Perl to Kepler for data
management handling - Ability to customise data storage via a
visual workflow system - Highly extensible, not restricted to SRB as
repository
10IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Modifications to Portal
- Use of Personal Grid Library (PGL) for SRB data
manipulation - Ability to create metadata schema definitions for
experimental metadata - Stored experimental data is able to be easily
retrieved and annotated - Visual diagnostics for sensors (e.g. Graphs,
Visual Indicators) - Live CCD image analysis (experimental status)
11IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
12IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Deployment Sites in Australia
- Initially Instrument Representatives deployed at
JCU, USyd, UQ , Monash - Initial intention Data Manager for all sites
located _at_JCU with SRB storage facility - Reality check!
- Goal Each site having their own Data Manager
and SRB storage facility which is federated
across sites
13IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
14(No Transcript)
15(No Transcript)
16IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
17(No Transcript)
18IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
19IEEE e-Science and Grid CRL Workshop Amsterdam
Dec 4 2006
Acknowledgements JCU Sydney Uni Indiana and
SUNY Ian M. Atkinson Douglas du Boulay Rick
McMullen Tristan King Clinton Chee Ken Chiu
Nigel G.D. Sim Romain Quilici Mathew
Wyatt Australian Research Council e-Research
Seed Funding Programme and the Research Networks
Programme (MMSN Molecular and Materials Structure
Network). Department of Education Science and
Training Dataset Acquisition, Accessibility, and
Annotation e-Research Technologies (DART)
project GrangeNet The Integration of Scientific
Instruments into the Grid