UCoMS: Grid Computing Framework for Petroleum Engineering

1
UCoMS Grid Computing Framework for Petroleum
Engineering
2
UCoMS

• Ubiquitous Computing and Monitoring System for
  Discovery and Management of Energy Resources.
• UCoMS, sponsored by Department of Energy and the
  Louisiana Board of Regents, is a project to
  research and develop new Grid computing and
  sensor network technologies for the management of
  energy resources.
• Three Louisiana Universities are involved in this
  project Louisiana State University (LSU),
  University of Louisiana at Lafayette (ULL) and
  Southern University at Baton Rouge (SUBR).

3
UCoMS Project Goals

• Investigate UCOMS scenarios and map to
  Grid/distributed computing architecture.
• Develop general components and building blocks.
• Build testbeds/Grids for UCOMS applications.

4
UCoMS Application Areas

• Reservoir simulation on computing grids.
• Real-time well surveillance.
• Drilling performance analysis with high-rate data
  coming from real time drilling.

5
ResGrid

• Massive reservoir simulation tool for uncertainty
  analysis.
• Leveraging data archiving tool, condor-based task
  farming framework and Information service, and
  GridSphere.
• Basic functions implemented.

6
Why ResGrid?

• Reservoir simulation is one of the largest users
  of computing power
• Large, complex, uncertainty models
• High risks and high rewards
• Where is the gain?
• Moderate-sized jobs can be farmed out onto a
  heterogeneous grid.
• Large jobs can be run in parallel on a grid.
• Efficiency gains can help to assess risks,
  estimate parameters, run larger and more complex
  models.

7
Computational Details

• Two Parts of the Problem
• constructing grid blocks as input for reservoir
  simulation.
• The Reservoir simulation itself.
• Geostatic Modeling is used to generate input
  data.
• UTChem is the reservoir simulation app.
• Computational complexity can be increased by
  increasing the granularity of the grid,
  increasing number of simulations for better
  estimates and increasing the complexity of the
  algorithm itself.
• Currently a typical problem requires 55 days on a
  single 3GHz P4 system.
• UTChems memory requirement is small.
• GSLIB is memory intensive. Typical run needs 8GB
  of RAM. Trying to move to algorithms using sparse
  matrices to reduce the memory requirement.

8
Typical Reservoir Simulation Workflow
9
ResGrid Workflow
10
UCoMS Grid Enabled WorkFlow
11
Grid Computing in UCOMS

• Grid Application Toolkit/Simple API for Grid
  Applications (GAT/SAGA)
• Many new adaptors/examples
• Grid portals using GridSphere
• Data Archiving Toolkit based on GAT
• Task Farming Framework using Condor.
• Information service based on MDS/GPIR
• Mobile Grid Computing (Migration)
• ResGrid a tool for reservoir uncertainty
  analysis.

• General Components
• APIs
• Replica location
• Job submission
• Data transfer
• Metadata
• Workflow
• Task-farming
• Visualization

12
Grid Application Toolkit (GAT)

• Abstract programming interface between
  applications and Grid services
• Designed for applications (move file, run remote
  task, migrate, write to remote file)
• Led to GGF Simple API for Grid Applications

www.gridlab.org/GAT
13
Grid Portals

• GridSphere Portal used to provide portal
  interfaces
• HPC Portal to monitor and submit to HPC resources
  at CCT and other national and international Grids.

14
Data Archiving

• Grid-enabled data archiving tool (server and
  clients) for large scale data management.
• Based on GAT.
• Essential for large-scale reservoir simulations
  and drilling applications.

15
Task Farming

• Need flexible mechanisms for scheduling and
  deploying our applications
• Fault tolerance, scheduling, data integration,
• Two approaches
• Cactus-based task farming framework.
• Condor-based task farming framework.

16
Current Status

• ResGrid running locally.
• Using Two Grids CCT Grid and ULL Grid.
• Also Running on KISTI machines in Korea.
• Interested in Connections to other external Grids.

17
Grid Infrastructure CCT Grid
18
Grid Infrastructure Services

• CCT Certificate Authority
• GSI Open SSH access to all machines
• GridSphere portals
• PBSPro, Maui
• Condor, GAT, Globus
• GridHub
• Grid Services Server hosting various Grid
  Services
• GridLab Resource Management System (GRMS)
• iGrid
• MDS
• RLS
• GPIR

19
Requirements from Sites

• Users in GridMap files.
• C and Fortran compilers.
• Globus 3.x/4.x
• GridFTP Server
• GRAM

20
Other Applications/Services from CCT

• SCOOP WW3 Wave Watch 3
• SURA Archive Can provide the archiving service
  and getdata clients based on GAT for facilitating
  storage and retrieval of data for various
  applications. Also provides metadata and logical
  file services. ADCIRC can already use the SCOOP
  Archive we have.

21
Credits

• Investigators
• Edward Seidel (CCT)
• Gabrielle Allen (CCT)
• Christopher D. White (PE)
• John R. Smith (PE)
• Zhou Lei (CCT)
• Hartmut Kaiser (CCT)
• Archit Kulshrestha (CCT)
• Ph. D. Candidates
• Richard Duff (PE)
• Xin Li (PE)
• Dayong Huang (CS)
• Santiago Pena (CS)
• Promita Chakraborty (CS)
• M. S. Students
• Chongjie Zhang (CS)
• Undergraduate Students
• John Lewis (CS)
• Yunan Yuan (EE)