Introduction to Grid Computing: Trends, Challenges, Technologies, Applications

1
Introduction to Grid ComputingTrends,
Challenges, Technologies, Applications

• Dr. Rajkumar Buyya

Grid Computing and Distributed Systems (GRIDS)
LaboratoryDept. of Computer Science and Software
EngineeringThe University of Melbourne,
Australiawww.buyya.comwww.gridbus.org
2
Thank you for inviting me to Osaka
3
I already started enjoying my visit!
4
Lecture Schedule and Slides

• Part I July 10
• Introduction to Grid Computing
• http//www.buyya.com/talks/GridbusOsaka1.ppt
• Part II July 12
• Gridbus Middleware Powering e-Science and
  e-Business Applications
• http//www.buyya.com/talks/GridbusOsaka2.ppt

5
GRIDS Lab _at_ Melbourne
Education
R D

• Youngest and one of the rapidly growing research
  labs in our School/University
• Founded in 2002
• Houses
• Research Fellows (3)
• Research Programmers (3)
• PhD candidates (10)
• Honours/Masters students (5)
• Funding
• National and International organizations
• Australian Research Council
• Many industries (Sun, StorageTek, Microsoft, IBM,
  Microsoft)
• University-wide collaboration
• Faculties of Science, Engineering, and Medicine
• Many national and international collaborations.
• Academics
• Industries
• Software
• Widely in academic and industrial users.
• Publication

Community Services e.g., IEEE TC for Scalable
Computing
6
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Conclusion

7
4 Essential Utilities and Delivery Networks
8
(5) Computing Grid Delivery IT services as the
5th utility (Power Grid inspiration)
eScience eBusiness eGovernment eHealth Multilingua
l eEducation
9
Power Grid Inspiration Seamlessly delivering
electricity as a utility to users
10
Why Grid Computing Now?Let us look at the
Evolution of ICT
11
Computer Systems Single -gt Global
Computer Systems
Distributed Systems
Single System
(multiple systems)
PC/Workstation
SMP/NUMA
Vector
Mainframe
Client Server
Clusters
Grids
Peer-to-Peer
Control and Management
Centralised
Decentralised
12
Grid-like Vision

• In 1969, Leonard Kleinrock, one of the chief
  scientists of the original ARPA project which
  seeded the Internet, wrote
• "As of now, computer networks are still in their
  infancy, but as they grow up and become
  sophisticated, we will probably see the spread of
  "computer utilities", which, like present
  electric and telephone utilities, will service
  individual homes and offices across the country
• Despite major advances in hardware and software
  systems over the past 35 years, we are yet to
  realise this vision. How far are we still from
  delivering computing as a utility?
• Let us look into the ICT evolution and project
  the future.

13
Computing and Communication Technologies
Evolution 1960-2010!

HTC

P2P

PDAs
Minicomputers


PCs

Workstations

Mainframes

Grids
COMPUTING

PC Clusters
Computing as Utility

Crays

MPPs

WS Clusters

XEROX PARC worm
e-Science
e-Business
IETF
W3C
TCP/IP
Ethernet
Communication
Mosaic
HTML
Web Services
Email
Sputnik
SocialNet
Internet Era
WWW Era
XML
ARPANET
1960
1970
1975
1980
1985
1990
1995
2000
2010
Control
Centralised
Decentralised
14
Performance, Capability, Value of ICT asdefined
by the three Laws of Computing

• Moores Law.
• Transistors on a single chip doubles every
  1824 months.
• Gilders Law.
• Aggregate bandwidth triples every year.
• Metcalfes Law.
• The value of a network may grow exponentially
  with the number of participants.

Source Cambridge Energy Resource Associates
15
Computing is Scaling Towards
Inter-Planetary Level
SERV ICES PERFORMANCE
Administrative Barriers

• Individual
• Group
• Department
• Campus
• State
• National
• Globe
• Inter Planet
• Universe

Personal Device
SMPs or SuperComputers
Local Cluster
Global Grid
Inter Planet Grid
Enterprise Cluster/Grid
16
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Conclusion

17
What is Grid? (It means different things to
different people)

• IBM
• On Demand Computing
• Microsoft
• .NET
• Oracle
• 10g
• Sun
• N1 Sun Grid Engine
• HP
• Adaptive Enterprise
• United Devices and related companies
• Harvesting Unused Desktop resources

18
What is Grid?Buyya et. al

• A type of parallel and distributed system that
  enables the sharing, exchange, selection,
  aggregation of geographically distributed
  autonomous resources
• Computers PCs, workstations, clusters,
  supercomputers, laptops, notebooks, mobile
  devices, PDA, etc
• Software e.g., ASPs renting expensive special
  purpose applications on demand
• Catalogued data and databases e.g. transparent
  access to human genome database
• Special devices/instruments e.g., radio
  telescope SETI_at_Home searching for life in
  galaxy.
• People/collaborators.
• depending on their availability, capability,
  cost, and user QoS requirements.

Widearea
19
How does Grids look like?A Bird Eye View of a
Global Grid
Grid Information Service
Grid Resource Broker
Application
R2
R3
R4
R5
RN
Grid Resource Broker
R6
R1
Resource Broker
Grid Information Service
20
How Are Grids Used?
Utility computing
High-performance computing
Collaborative design
Financial modeling
High-energy physics
E-Business
Drug discovery
Life sciences
Data center automation
E-Science
Natural language processing Data Mining
Collaborative data-sharing
21
Classes of Grid Services / Types of Grids

• Computational Services CPU cycles
• Pooling computing power SETI_at_Home, TeraGrid,
  AusGrid, ChinaGrid, IndiaGrid, UK Grid,
• Data Services
• Collaborative data sharing generated by
  instruments, sensors, persons LHC Grid, Napster
• Application Services
• Access to remote software/libraries and license
  managementNetSolve
• Interaction Services
• eLearning, Virtual Tables, Group Communication
  (Access Grid), Gaming
• Knowledge Services
• The way knowledge is acquired, processed and
  manageddata mining.
• Utility Computing Services
• Towards a market-based Grid computing Leasing
  and delivering Grid services as ICT utilities.

Utility Grid
Users
Knowledge Grid
Interaction Grid
ASP Grid
Data Grid
infrastructure
Computational Grid
22
Worldwide Grid Spending 2005 to 2010 in
billion dollars

• After the year 2007, business popularity of Grid
  computing is expected to be accelerate
• Especially, the financial services and ERP
  services is expected to take major parts in the
  expense

Billions
Source Insight Research Corp.
23
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Summary and Conclusion

24
Grid Related Paradigms

• Cluster
• Tightly coupled
• Homogeneous
• Cooperative working

• Distributed Computing
• Loosely coupled
• Heterogeneous
• Single Administration

• Grid Computing
• Large scale
• Cross-organizational
• Geographical distribution
• Distributed Management

Hiro Kishimoto
25
Some Characteristics of Grids
Numerousresources
Owned by multiple organizations individuals
Connected by heterogeneous, multi-level networks
Different security requirements policies
Different resource management policies
Geographically distributed
Unreliable resources and environments
Resources are heterogeneous
Slide by Hiro
26
Grid Challenges
27
Some Grid Initiatives Worldwide

• Australia
• Nimrod-G
• Gridbus
• GrangeNet.
• APACGrid
• ARC eResearch
• Brazil
• OurGrid, EasyGrid
• LNCC-Grid many others
• China
• ChinaGrid Education
• CNGrid - application
• Europe
• UK eScience
• EU Grids..
• and many more...
• India
• Garuda
• Japan

• USA
• Globus
• GridSec
• AccessGrid
• TeraGrid
• Cyberinfrasture
• and many more...
• Industry Initiatives
• IBM On Demand Computing
• HP Adaptive Computing
• Sun N1
• Microsoft - .NET
• Oracle 10g
• Infosys Enterprise Grid
• Satyam Business Grid
• StorageTek Grid..
• and many more
• Public Forums
• Open Grid Forum

27 million
1.3 billion 3 yrs
2? billion
120million 5 yrs
450million 5 yrs
486million 5 yrs
1.3 billion (Rs)
1 billion 5 yrs
http//www.gridcomputing.com
28
mix-and-match
Object-oriented
Internet/partial-P2P
Grid Computing Approaches
Network enabled Solvers
Economic-based Utility / Service-Oriented
Computing
Nimrod-G
29
Open-Source Grid Middleware Projects
30
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Conclusion

31
Grid Realization Steps/Requirements

• Step 1
• The integration of individual s/w h/w
  components into a combined networked resource
  (single system image cluster).
• Step 2
• Low-level middleware to provide a secure and
  uniform access to services provided by different
  resources.
• Step 3
• User-level middleware to support application
  development and aggregation of distributed
  resources.
• Step 4
• The construction of Grid applications and Web
  portals.

32
Layers of Grid Architecture
Grid applications Web Portals, Applications,
User level
Grid programming environment and tools Languages,
API, libraries, compilers, parallelization tools
User-LevelMiddleware
Resource management and scheduling
Adaptive Management
Job submission, info services, Storage access,
Trading, Accounting, License
CoreMiddleware
Security Services Authentication, Single sign-on,
secure communication
Grid resources Desktops, servers, clusters,
networks, applications, storage, devices
resource manager monitor
System level
33
Layers of Grid Architecture
Grid applications Web Portals, Applications,
User level
Grid programming environment and tools Languages,
API, libraries, compilers, parallelization tools
Application Development and Deployment Environment
User-LevelMiddleware
Resource management and scheduling
Autonomic/ Grid Economy
Adaptive Management
Job submission, info services, Storage access,
Trading, Accounting, License
CoreMiddleware
Distributed Resources Coupling Services
Security Services Authentication, Single sign-on,
secure communication
Grid resources Desktops, servers, clusters,
networks, applications, storage, devices
resource manager monitor
System level
34
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Conclusion

35
Grid Middleware Technologies

• Globus Argonne National Lab and ISI
• Gridbus University of Melbourne
• Unicore European Project (Germany)
• Legion University of Virginia

36
Globus Toolkitwww.globus.org
37
Globus Toolkit Services

• Security (GSI)
• PKI-based Security (Authentication) Service
• Job submission and management (GRAM)
• Uniform Job Submission
• Information services (MDS)
• LDAP-based Information Service
• Remote file management (GASS)
• Remote Storage Access Service
• Remote Data Catalogue and Management Tools
• Recently move to
• WSRF (Web Services Resource Framework)

38
GRAM Components
MDS client API calls to locate resources
Client
MDS Grid Index Info Server
Site boundary
MDS client API calls to get resource info
GRAM client API calls to request resource
allocation and process creation.
MDS Grid Resource Info Server
Query current status of resource
GRAM client API state change callbacks
Globus Security Infrastructure
Local Resource Manager
Allocate create processes
Request
Job Manager
Create
Gatekeeper
Process
Parse
Monitor control
Process
RSL Library
Process
39
Sample of High-Level Services

• Resource brokers and co-allocators
• DUROC, Nimrod-G, Gridbus, Condor-G, AppLeS PST
• Communication I/O libraries
• MPICH-G, RIO (MPI-IO)
• Parallel languages
• HPC, CC
• Collaborative environments
• CAVERNsoft, ManyWorlds
• Others
• MetaNEOS, NetSolve, LSA, AutoPilot, WebFlow

40
The Nimrod-G Grid Resource Broker(from Monash
University)

• A resource broker for managing, steering, and
  executing task farming (parameter sweep/SPMD
  model) applications on the Grid based on deadline
  and computational economy.
• Based on users QoS requirements, our Broker
  dynamically leases services at runtime depending
  on their quality, cost, and availability.
• Key Features
• A single window to manage control experiment
• Persistent and Programmable Task Farming Engine
• Resource Discovery
• Resource Trading
• Scheduling Predications
• Generic Dispatcher Grid Agents
• Transportation of data results
• Steering data management
• Accounting
• Uses Globus MDS, GRAM, GSI, GASS

41
Condor-G Condor for the Grid(from University of
Wisconsin)

• Condor is a high-throughput scheduler
• Condor-G uses Globus Toolkit libraries for
• Security (GSI)
• Managing remote jobs on Grid (GRAM)
• File staging remote I/O (GSI-FTP)
• Grid job management interface scheduling
• Robust replacement for Globus Toolkit programs
• Globus Toolkit focus is on libraries and
  services, not end user vertical solutions
• Supports single or high-throughput apps on Grid
• Personal job manager which can exploit Grid
  resources

42
The Gridbus Project _at_ MelbourneEnable Leasing
of ICT Services on Demand
WWG
Gridbus
Pushes Grid computing into mainstream computing
43

44
Gridbus Architecture Layer
Adaptive Management
45
On Demand Assembly of Services Putting Them All
Together
46
(No Transcript)
47
Alchemi .NET-based Enterprise Grid Platform
Web Services
Alchemi Manager
Web Services
Internet
Alchemi Users
Internet

• SETI_at_Home like Model
• General Purpose
• Dedicated/Non-dedicate workers
• Role-based Security
• .NET and Web Services
• C Implementation
• GridThread and Job Model Programming
• Easy to setup and use
• Widely in use!

Alchemi Worker Agents
48
Some Users of Alchemi
Tier Technologies, USA Large scale document
processing using Alchemi framework
Satyam Computers Applied Research Laboratory,
India Micro-array data processing using Alchemi
framework
CSIRO, Australia Natural Resource Modeling
The University of Sao Paulo, Brazil The Alchemi
Executor as a Windows Service
stochastix GmbH, Germany Serving clients in
International Banking/Finance sector
The Friedrich Miescher Institute (FMI) for
Biomedical Research, Switzerland Patterns of
transcription factors in mammalian genes
Many users in Universities See next for an
example.
49
                           
Students' project gives old computers new life  - 1/25/2005
50
(No Transcript)
51
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Conclusion

52
Collaborative Science and Global Grid

E-Scientist
Peers sharing ideas and collaborative

interpretation of data/results



Global Grid
Distributed data
Remote
Visualization

2100

2100

2100

2100

Distributed computation

2100

21
00

2100

2100

Distributed instruments

Data Compute Service

53
Some e-Science Grid Applications
Bioinformatics Drug Design / Protein
Modelling
Natural Language Engineering
Ecological Modelling Control Strategies for
Cattle Tick
Sensitivityexperiments on smog formation
Data Mining
Electronic CAD Field Programmable Gate Arrays
High Energy Physics Searching for Rare Events
Computer Graphics Ray Tracing
Finance Investment Risk Analysis
VLSI Design SPICE Simulations
Civil Engineering Building Design
Network Simulation
Automobile Crash Simulation
Aerospace Wing Design
astrophysics
54
1. Grid Use in Science Online Medical
Instrumentation and Neuroscience
DV transfer
Osaka Univ.

• Virtual Laboratory
• for medicine and brain science
• Knowledge sharing
• MEG sharing?
• Data Sharing

Data Generation
Osaka Univ. Hospital
Data Analysis
Life-electronics laboratory, AIST
Cybermedia Center

• Provision of MEG
• Provision of expertise in
• the analysis of brain function

A
55
2 Grid in Data Sharing Physics Collaboration
(fundamental investigation on the origin of mass)
56
LHC Grid Computing Model
PBytes/sec
100 MBytes/sec
Offline Processor Farm 20 TIPS
There is a bunch crossing every 25 nsecs. There
are 100 triggers per second Each triggered
event is 1 MByte in size
100 MBytes/sec
Tier 0
CERN Computer Centre
622 Mbits/sec
Asia Pacific Centre 4 TIPS
France Regional Centre
US Regional Centre
Italy Regional Centre
Tier 1
622 Mbits/sec
Tier 2
622 Mbits/sec
Melbourne0.25TIPS
Tier 3
Institute
Institute
Institute
Physics data cache
10 to 100 Mbits/sec
Tier 4
Physicist desktop computers
57
3. Grid Use in Business Enterprise Computing
Application

• Traditional Model

• Grid-based Model

Service Virtualization Layer Load Balancing
Email server
Web server
Database server
Apps server
Upgrade to a new server to handle more users
Utilise IT infrastructure effectively
58
Outline

• Introduction
• Utility Networks, Trends, and Grid Computing
• Defining Grids
• What is Grid?, Types of Grid Services,
• Global Grids and Challenges
• Characteristics, Security, resource management,
  pricing,
• Grid Architecture
• Layered architecture
• Grid Technologies
• Globus from USA and Gridbus from Australia
• Grid Applications
• E-Science and e-Business
• Conclusion

59
Alessandro Volta in Paris in 1801 inside French
National Institute shows the battery while in the
presence of Napoleon I

• Fresco by N. Cianfanelli (1841)
• (Zoological Section "La Specula" of National
  History Museum of Florence University)

60
.and in the future, I imagine a Worldwide Power
(Electrical) Grid ...
Oh, mon Dieu !
What ?!?! This is a mad man
61
2006 - 1801 205 Years(Recent RD Delivering
Internet services via Electric cables).
2006
62
When are we going get IT as the 5th
utility?(water, electricity, gas, telephone, IT)
eScience eBusiness eGovernment eHealth Multilingua
l eEducation
63
Summary and Conclusion

• Grid computing is our greatest hope for
  delivering computing as utility to homes and
  offices.
• Grids exploit synergies that result from
  cooperation of autonomous entities
• Resource sharing, dynamic provisioning, and
  aggregation at global level ?Great Science and
  Great Business!
• Several open source middleware technologies such
  as Gridbus exist demonstrating Grid potentail.
• Grid computing offers enormous opportunities for
  realizing e-Science and e-Business at global
  level.
• Use our Gridbus technology to realise this and
  make money!

64
Some References

• Mark Baker, Rajkumar Buyya, and Domenico
  Laforenza, Grids and Grid Technologies for
  Wide-Area Distributed Computing, International
  Journal of Software Practice and Experience,
  Volume 32, Issue 15, Wiley Press, USA, Nov. 2002.
  
• Madhu Chetty and Rajkumar Buyya, Weaving
  Computational Grids How Analogous Are They with
  Electrical Grids?, Computing in Science and
  Engineering (CiSE), Vol. 4, Issue 4, IEEE CS
  Press, USA, July-August 2002.
• Ian Foster, Carl Kesselman, Steve Tuecke, The
  Anatomy of the Grid Enabling Scalable Virtual
  Organizations, International J. Supercomputer
  Applications, 15(3), 2001.
• Parvin Asadzadeh, Rajkumar Buyya, Chun Ling Kei,
  Deepa Nayar, and Srikumar Venugopal, Global Grids
  and Software Toolkits A Study of Four Grid
  Middleware Technologies, High Performance
  Computing Paradigm and Infrastructure, Wiley
  Press, New Jersey, USA, June 2005.
• Grid Computing Course Material from the
  University Melbourne
• http//www.cs.mu.oz.au/678/

65
Thanks for your attention!
We Welcome Cooperation in Research and
Commercialisation! http/www.gridbus.org
http//www.gridbus.com
66
Books at a Glance Co-authored edited
67
Big Question?

• Can computational grids drive the economy of the
  21st century similar to the electric power grid
  that drove the economy of the 20th century?

68
Comparison of Middleware Technologies
Middleware Property UNICORE Globus Legion Gridbus
Focus High level Programming models Low level services High level Programming models Abstractions and market models
Category Mainly uniform job submission and monitoring Generic computational Generic computational Generic computational
Architecture Vertical multi tiered system Layered and modular toolkit Vertically integrated system Layered component and utility model
Implementation Model Abstract Job Object Hourglass model at system level Object-oriented metasystem Hourglass model at user level
Implementation Technologies Java C and Java C C, Java, C and Perl
Runtime Platform Unix Unix Unix Unix and Windows with .NET
Programming Environment Workflow environment Replacement libraries for Unix C libraries. Special MPI library (MPICH G), CoG (Commodity Grid) kits in Java, Python, CORBA, Matlab, Java Server Pages, Perl and Web Services Legion Application Programming Interfaces (API). Command line utilities Broker Java API XML-based parameter-sweep language Grid Thread model via Alchemi.
Some Users and Applications EuroGrid, Grid Interoperability Project, OpenMolGrid and Japanese NAREGI. AppLeS, Ninf, Nimrod-G, NASA IPG, Condor-G, Gridbus Broker, UK eScience Project, GriPhyN, and EU Data Grid. NPACI Testbed, Nimrod-L, and NCBioGrid. Additionally, it has been used in the study of axially symmetric steady flow and protein folding applications. ePhysics, Belle Analysis Data Grid, NeuroGrid, Natural Language Engineering, HydroGrid, and Amsterdam Private Grid.