Grid-Ireland

1
Grid-Ireland

• John Morrison, University College Cork (UCC)
• Brian Coghlan, Trinity College Dublin (TCD)
• Andy Shearer, NUI Galway (NUIG)
• Ron Perrott, Queens University Belfast (QUB)

Grid-Ireland
Armagh 26-NOV-2002
2
Grid-Ireland

• Grid-Ireland
• Enterprise Ireland funded from Oct- 2000
• TCD, UCC, NUIG, QUB
• CosmoGrid first virtual organization
• HEA Funded from Oct-2002
• Dublin Institute for Advanced Studies with UCD,
  NUI, G, UCC, HEAnet, DCU, TCD, Met Office
  Armagh Observatory
• VO supported by Grid-Ireland HEAnet

3
CosmoGrid
4
Grids
What are they?
coordinated resource sharing and problem solving
in dynamic, multi-institutional virtual
organizations Ian Foster and Carl Kesselman
(1998)
Beowulf clusters and Grid computing technology
will likely merge in the next decade and
together they form the Grid Gordon Bell and
Jim Gray (Feb-2002)
5
Grids what are they ?

• an architecture
• IF a system acts as a unified resource
• THEN we say it presents a single system image
  (SSI)
• conceptual model computer architecture
• NOT client/server model
• gives each user the illusion of a single machine
• SSI components
• hardware / OS / services
• SSI services
• login / user interface / admin / time /
  filesystem /

6
The Holy Grid Grail
Available sometime in the next 15 years

• Submit a problem at a high level to the Grid
• The grid will ?
• Analyse the problem what code data are
  available, where are they ?
• Dynamically allocate tasks to available
  computational tasks
• Determine the distribution and degree of
  parallelisation given the current grid resources
• Security is automatic
• Monitor remotely
• Concentrate upon the problem NOT how to compute
  it.

7
Current Grid Architecture Space
8
Grid Musicians
9
Grid Symphony
Replica Catalog
DB
DB
Resource Broker
Information Service
Job Status
Logging Bookkeeping
10
Current Grid Architectures

• European CrossGrid X
• 11 countries / 21 instutions
• European DataGrid EDG
• 11 countries / 21 instutions
• Globus
• Argonne Labs ISI

Lets look at these, starting with Globus
11
Globus Execution Flows single entry point
12
Globus Execution Flows multiple entry points
13
Grid-Ireland Architecture, 2001/2002
14
DataGrid Execution Flows
15
Grid-Ireland Architecture, 2002/2003
16
CrossGrid Execution Flows
17
Grid-Ireland Architecture, 2003/2004
18
WebCom-G Project
Core Contribution Condensed Graphs Grid
Middleware A NEW execution model for the Grid
19
Execution Models

• Execution can be described by an acyclic graph
• Execution models may be classified by their
  FIRING RULE
• control driven ? thread of control
• data driven ? opportunism
• demand driven ? laziness
• Concepts eager and lazy evaluation

• Condensed graphs are a chameleon
• can execute a dynamic mix of all 3 models
• can dynamically mix eager lazy evaluation

20
Condensed Graphs Firing Rule
21
WebCom-G DataGrid Use-case Execution Flows
22
Grid-Ireland WebCom-G Architecture, 2003/2004
23
WebCom-G Pure CG Use-case Execution Flows
24
Grid-Ireland WebCom-G Architecture, 2005/2006
25
WebCom-G Stress Testing
26
Grid-Ireland WebCom-G Grid Architecture Space
Core Contribution Condensed Graphs Grid
Middleware
27
Grids 10 outstanding questions

• Why dont grids have more functionality yet ?
• Why arent there more application developers and
  users ?
• Where are the grid software development tools ?
• Where are the grid system management tools ?
• How do we make grids more secure ?
• How do we define standard interfaces and
  definitions ?
• How do we manage variance on the grid ?
• How can the grid R D be funded ?
• What cost models are needed by the grid ?
• What are the benefits to motivate sharing on the
  grid ?
• THESE ARE JUST THE FIRST 10
  QUESTIONS

28
Grid-Ireland
THE END