Grid Workflow within Triana

1
Grid Workflow within Triana

• Ian Wang
• Cardiff University

2
GridLab

• E.U. Funded
• 9 Institutions
• German (x2), Poland, Hungry, Czech, Holland,
  Greece, Italy, U.K.
• 13 Work-Packages
• GAT
• Resource Broker (GRMS)
• Data Management
• Portal (GridSphere)
• Monitoring (Mercury)
• Adaptive Components
• Information Services (iGrid)

3
GridLab GAT

• Application-level API
• Abstract Common Capabilities required by Grid
  Applications
• Resource Discovery
• Job Submission
• File Transfer
• Capabilities extracted through a number of Grid
  Application Scenarios.
• Makes life as a Grid programmer easier
• Motivation for the GGF SAGA research group
  (Simple API for Grid Applications)

4
GAT Architecture
Application (e.g. Triana)
GridLab GAT API
Resource Broker
File
GRMS
GRAM
Local
File Service
GridFTP
HTTP
Local
Adaptors
Services
GRMS
GRAM
Grid FTP
HTTP
File Transfer
iGrid
Mercury
5
Using the GAT

• GATContext context new GATContext()
• Preferences prefs new Preferences()
• prefs.put("ResourceBroker.adaptor.name", "grms")
• URI exe new URI("file////bin/hostname")
• File outFile GAT.createFile(context, prefs, new
  URI("file///out")
• SoftwareDescription sd new SoftwareDescription()
  
• sd.setLocation(exe)
• sd.setStdout(outFile)
• ResourceDescription rd new HardwareResourceDescr
  iption()
• rd.put("hostname", "bouscat.cs.cf.ac.uk")
• JobDescription jd new JobDescription(sd, rd)
• ResourceBroker broker GAT.createResourceBroker(c
  ontext, prefs)
• Job job broker.submitJob(jd)

6
Visual GAT

• GAT Primitives represented as Workflow Objects
• Job Tasks
• File Tasks
• Grid Data Flow implicit in Workflow Connections
• File Task -gt File Task Data Transfer
• File Task -gt Job Task Pre-Stage File
• File Task -gt Local Task File Read
• Grid Operations handled by GAT Adaptors
• Grid File -gt Grid File GridFTP
• HTTP File -gt Local Task HTTP
• Grid File -gt GRMS Job GRMS Pre-Stage

7
Grid Workflow in Triana
File (Local/Remote)
Temporary File
Job (Local/Remote)
File Write
Pre-Stage
Post-Stage
File Read
Local Java Unit
8
Visual GAT Alternative

• Grid Operations Expressed Explicitly
• GridFTP Tasks
• File Write Tasks
• File Read Tasks
• Not Intuitive
• Not Future Proof

9
File Input (HTTP)
Triana
WaveToy.par
www. gridlab. org
10
File Staging (GridFTP)
Triana
GridLab GAT
File CPI
Resource Broker CPI
GridFTP Adaptor
HTTP Adaptor
Data Movement
Local Adaptor
GRMS Adaptor
GRAM Adaptor
Local Adaptor
WaveToy.par
www. gridlab. org
Testbed
11
Job Submission 1
Triana
GridLab GAT
File CPI
Resource Broker CPI
GridFTP Adaptor
HTTP Adaptor
Data Movement
Local Adaptor
GRMS Adaptor
GRAM Adaptor
Local Adaptor
GAS
GRMS
Cactus
www. gridlab. org
Testbed
Data Mvment
Testbed
WaveToy.par
Mercury
Delphoi
iGrid
12
Job Submission 2
Triana
GridLab GAT
File CPI
Resource Broker CPI
Instant Mess
GridFTP Adaptor
HTTP Adaptor
Data Movement
Local Adaptor
GRMS Adaptor
GRAM Adaptor
Local Adaptor
Portal
GAS
GRMS
Cactus
www. gridlab. org
Testbed
Data Mvment
Testbed
Mercury
Delphoi
iGrid
13
Job Submission (GRAM)
Triana
GridLab GAT
File CPI
Resource Broker CPI
Instant Mess
GridFTP Adaptor
HTTP Adaptor
Data Movement
Local Adaptor
GRMS Adaptor
GRAM Adaptor
Local Adaptor
Portal
Cactus
GRAM
www. gridlab. org
Testbed
Testbed
14
GridMonSteer
Resource Broker (e.g. GRMS)
Grid Side
submit
run
User Side
Application (e.g. Triana)
GridMonSteer (gms)
gms http//www.xyx.org4802/axis/gms cactus
monitor
cactus
phi_xy.jpg phi_yz.jpg
phi_xy.jpg
phi_yz.jpg
rundir
http//www.xyz.org/axis/gms
invoke using SOAP
15
Triana Grid Workflow Summary

• GridLab GAT
• Application-level API
• Abstracts Common Capabilities required by Grid
  Applications such as Triana
• Visual GAT
• GAT Primitives represented in Triana as Workflow
  Objects
• Grid Data Flow implicit in Workflow Connections
• GridMonSteer
• Generic Architecture for Monitoring and Steering
  Legacy Applications