Middleware for Grid Computing

1
Middleware for Grid Computing On Virtual Machines
Renato Figueiredo José A.B. Fortes Peter A. Dinda
Ivan Krsul, Sumalatha Adabala, Vineet Chadha, Andrea Matsunaga, Ziad Saleh, Mauricio Tsugawa, Jian Zhang, Liping Zhu, Xiaomin Zhu Ivan Krsul, Sumalatha Adabala, Vineet Chadha, Andrea Matsunaga, Ziad Saleh, Mauricio Tsugawa, Jian Zhang, Liping Zhu, Xiaomin Zhu Ananth Sundararaj, Ashish Gupta
Advanced Computing and Information Systems (ACIS) Elec. and Comp. Eng., University of Florida Advanced Computing and Information Systems (ACIS) Elec. and Comp. Eng., University of Florida Prescience Lab Comp. Sci., Northwestern University

• Middleware challenges
• Virtual Machine process (VM monitor) data (VM
  image and user files)
• Image and Data Management
• Creation, storage, and transfer of VM images for
  dynamic instantiation, and user data
• Resource Management
• Application and resource perspectives
• Virtual Networks

Computing In-VIGO (In Virtual Grid
Organizations)

• Data management Grid virtual file systems
• Seamless access to decentralized storage services
  of a grid
• User-transparent virtual file systems created
  on-demand on top of NFS (V2,3)
• Supports unmodified binary applications and
  native O/S clients, servers

• Virtualization
• Polymorphism
• Manifolding
• Multiplexing

Virtual resources
Physical resources

• Resource management
• Relational database queries
• Resource control via real-time schedules

• Classic Virtual Machines (VMs)
• Many, distinct O/Ss that multiplex a physical
  resource
• E.g. VMware (x86), IBM z/VM (S/390)

• Prototype and applications
• InVIGO middleware beta (Spring 2003)
• Java, Globus, SQL, Apache, VFS
• Netcare, nCn, Digital Government, BMI, LSS

• Grid computing with VMs1
• Security, isolation
• Customization, legacy support
• Resource control, site independence

Wide-area Testbed
Architecture
Users nCn, Netcare,
A
Virtual back-ends
B
A
Service provider S
X
Y
C
B
V1
V2
V3
V4
C
Internet
64-processor IBM xSeries, VMware
Internet (Abilene)
Data Server D
P1
P2
64-processor IBM xSeries, VMware
User X
Front end F
Physical server P
IBM z800
middleware
VM startup
Information service
data session
Image Server I
3.4TB IBM Shark
1 A Case for Grid Computing on Virtual
Machines, R. Figueiredo, P. Dinda, J. Fortes,
Proceedings of ICDCS 2003
Northwestern University
University of Florida
Sponsors Research grants by the National Science
Foundation ANIR NSF Middleware Initiative (NMI),
EIA CISE-RR, and by IBM