Grid Computing at Intel current Status and Outlook

1
Grid Computing at Intelcurrent Status and Outlook

• Ralf Ratering
• Senior Software Engineer
• Intel
• Parallel and Distributed Solutions Division (PDSD)

2
Agenda

• What is the Grid?
• Overview of Grid Community
• A real-world example UNICORE
• Outlook on Grid Programming Environment

3
What is the Grid?
sharing distributed resources
single sign-on
security
The Grid is a new infrastructure that addresses
the industrys need for computing power and data
storage.
reliability
load balancing
open standards
hardware software
4
The Grid Community
Grid End Users
Grid Solutions Enterprise Grid Alliance (EGA),
Globus Alliance, IBM, HP, Platform, etc.
Grid Building Blocks Intel, Globus Toolkit,
UNICORE, Platform, Oracle, DataSynapse, IBM, HP,
Dell, etc.
Grid Standards Global Grid Forum (GGF), W3C,
IETF, OASIS, etc.
Other names and brands may be claimed as the
property of others
5
Grid Software Taxonomy
Grid Software
Development
Applications
Middleware
Tools
Userware
Science
Enterprise
Collaboration
Globus UNICORE Legion Cactus LSF PBSPro SGE Condor
...
Web Services HPC Grid Tools CA Tools ...
HE Physics Biology Chemistry Meteorology CFD FEA .
..
Oracle 10g United Devices DataSynapse Avaki Platfo
rm ...
Web Portals Client Apps ...
Access Grid
Names and brands may be claimed as the property
of others
6
Service Oriented Architecture (SOA)
SOA is the Grand Synthesis
Grid Computing (scheduling and coordinating
multiple/diverse compute and information
resources)
Virtualization (aggregation, and physicallogical
mgnt)
Web Services (std app interaction, publish,
discover, invoke)
Utility Computing (metering, accounting, billing)
P2P (Internet edge-resource interaction)
Autonomic Computing (self-aware, self-optimizing,
self-healing, self-managing)
The Insight Research Corporation, Grid
Computing a Vertical Market Perspective
2003-2008
7
Grid Standards
The Grid will not succeed without open standards
defined by the community
Wrappers around existing applications or
completely new Grid applications
Define which Grid Services and functionalities
are needed
Mechanisms to manage Grid Services
Messaging, security, transport, tooling
Interface to different servers, storages or
networks
8
UNICORE
Grid Computing is real and available now!

• UNICORE connects Supercomputers and Clusters to a
  Computing Grid
• Developed in German research projects by Pallas
  (now Intel PDSD) and Fujitsu
• Heavily used in European and Asian Grid projects
• Available as Open Source from UNICORE Forum
  (www.unicore.org)

9
UNICORE Architecture in a Nutshell
Specify platform- independent job signed with
user certificate
Client
Gateway Adresses
XML File
Firewall
INTERNET
Run platform specific script
Certificate-Login Mapping
Platform-specific information
10
Intel PDSD Grid
Nizhny Novgorod, Russia
Champaign, Illinois
4 Node Xeon Cluster
4 Node Xeon Cluster
4 Node Xeon Cluster
Cologne, Germany
2 Node Xeon Cluster
4 x Itanium 2
DEMO
11
The next stepGrid Programming Environment (GPE)
Bringing applications to the Grid...
Visual Grid SDK
GridBeans
Client Framework
Grid Programming Language
12
Use Case Expert User
Grid
Application GS
Grid Client
Broker GS
WSRF
Application GS
Application Grid Service
Database GS
Information GS
User Keystore
Fully-fledged Java Application

• Run multiple applications in complex workflows
• Get all information from the Grid

13
Use Case Application User
Grid
Application Client
Application Grid Service
WSRF
User Certificate
Lightweight Java Application

• Only one application
• Get only application specific information
• Run lightweight client on mobile devices

14
Use Case Unaware User
User DB
Authenticate using server certificate
Web Browser
JSP
Grid
Server
Application Grid Service
Register
WSRF
Request/ Response
Server Certificate
Service Provider
Presentation oriented user interface
User

• What is a "Grid"?
• Service provider offers a service on the web

15
The Grid Developer
Grid
Visual Grid SDK
Application GS
Information GS
Web Client
Database GS
Application Client
Broker GS
Grid Client

• GridBeanGrid ServiceClient Plug-in
• Wrap existing applications
• Write new Grid applications
• Plug-in for Eclipse

16
Grid Service Backends
UNICORE Network Job Supervisor
UNICORE GS
Globus Job Manager
Application GS
Globus GS
WSRF
Native Protocols
DRMAA GS
Condor
Sun Grid Engine

• GPE will provide Grid services to wrap different
  server types

17
GPE The Big Picture
Visual Grid SDK Eclipse Plugin
Deploy Plug-Ins
Developer Workstation
Grid Client
Deploy GS
Plugins
Plugins
G-API
Plug-Ins
Grid
Keystore
Application GS
User Workstation
UNICORE
Application Client
Database GS
WSRF
Broker GS
Plug-In
G-API
Globus
User Certificate
Mobile Device
Application GS
DRMAA
Application Service
Web Client
JSP
Information GS
Plug-In
G-API
Web Browser
Service Certificate
Service Provider
18
Intel Development Tools
GPE
Intel already has industry leading node tools
Engage here
Enhancing here
19
Summary

• The Grid is a new infrastructure that addresses
  the industries need for computing power and
  interoperability
• It will not succeed without open standards
  defined by the community
• Grid Computing is real and available now!
• Download at www.unicore.org
• The Grid Programming Environment (GPE) enables
  developers to deploy applications on the Grid

20
BACKUP
21
Using Grid Services in UNICORE
XML File
Registry Handle
UNICORE Server