Earth Science Activity in EGEEII and DEGREE

1
Earth Science Activity in EGEEII and DEGREE

• M. Petitdidier (IPSL/CETP),
• monique.petitdidier_at_cetp.ipsl.fr
• In collaboration with EGEE and DEGREE EU-project
  partners

2
Planet Earth a complex system
GOME total ozone assimilation
Stratospheric Ozone
Industrial Emissions
Atmospheric profiles
10 y displacement of Etna 1992-01
3
Acute Questions for Earth Science
Forecasting of meteorological events Extreme
events storm, tornado, hurricane, earthquake,
tsunami Water management precipitations, flood,
aquifer.. Pollution,, gt To provide real time
information real time data access, data
assimilation and modelling Long term prediction
Climate Change Climatology i.e. trend of
parameter variations like temperature,
precipitations. Polar ozone hole Impact on
agriculture, weather gt Long series of multiple
data sets, Intense processing, Discoveries and
Dissemination of the knowledge How it works,
Why. These are Questions for
Operational and Science organisations
4
GRID a solution

• GRID infrastructure
• Considered an open platform for handling
  computing resources, data, tools not limited to
  high-performing computing
• Partner can use a lot more resources than the
  ones he (she) brings in
• Impressive number of shared resources
• EGEEII around 32,000 CPUS distributed in 200
  sites
• 13 PB storage
• A collaborative possible platform among teams
  and/or countries
• interactive collaboration to avoid effort
  duplication
• Secure and restricted access to resources, data,
  tools
• Same data and software policy as outside Grid
• Grid will open new fields of investigation
• on Earth Science

5
GRID Nearly world-wide deployment

• European Union
• BalticGrid
• EELA
• EUChinaGrid
• EUIndiaGrid
• EUMedGrid
• SEE-GRID
• NorduGrid
• USA
• OSG
• Japan
• Naregi
• Africa- Unesco Programme
• Algeria, Ghana, Nigeria,
• Senegal, Zimbabwe

6
EGEEII ES VO

• 2 Virtual Organisations
• Due to different data policy for Academic and
  private research
• VO ESR (Earth Science research)
• As an average around 30 not always the same
  persons
• Mainly scientists, few tests carried out by
  Company
• Bulgaria, Finland, France, Germany, Greece,
  Italy, Russia, Slovakia,Switzerland, The
  Netherlands
• Around 1500CPUs/day for ESR
• VO EGEODE (Expanding GEOsciences on DEmand)
• centered around Geocluster (software from
  Compagnie Générale de Géophysique) around 10-20
  persons
• Recently French Academic institutes already using
  Geocluster join the VO

7
Earth Science Applications in EGEEII
Flood of a Danube river-Cascade of models
(meteorology,hydraulic ,hydrodynamic.) UISAV(SK)-
ESA, UTV(IT), KNMI(NL), IPSL(FR)- Production and
validation of 7 years of Ozone profiles from GOME
Rapid Earthquake analysis (mechanism and
epicenter) 50- 100CPUs IPGP(FR)
Geocluster for Academy and industry CGG(FR)-
Data mining Meteorology Space Weather (GCRAS,
RU)
Modelling seawater intrusion in costal aquifer
(SWIMED) CRS4(IT),INAT(TU),Univ.Neuchâtel(CH)-
DKRZ(DE)- Data access studies, climate impacts on
agriculture
Specfem3D Seismic application. Benchmark for MPI
(2 to 2000 CPUs) (IPGP,FR)
Air Pollution model- BAS(BG)
Mars atmosphere CETP( FR)
8
Earthquake Characteristics
Fast Determination of mechanisms of important
earthquakes (IPGP E. Clévédé, G. Patau IPSL D.
Weissenbach)

• Application to run on alert
• Collect data of 30 seismic stations from
  GEOSCOPE worldwide network
• Select stations and data
• Define a spatial 3D grid time based on the
  assumed earthquake location
• Run for each grid point or group of grid points a
  job gt 50-100jobs

Results obtained 6hr after the
earthquake Important for emergency action and
other related researches
All major earthquakes so treated 21/24 in 2006
gt catalogue
9
Cellular automaton for geomorphological research
IPGP C. Narteau , O. Rozier

• Objective understanding landscapes formation
  and evolution
• Examples erosion of the mountains, dynamic of
  dunes ...
• Algorithm very simple transition rules between
  cells of different states (transport, deposition
  ...).

• Computationnal resources needed
• CPU time processing (one simulation 4 hours)
• RAM requirements (200x200x200 cells)

10
Landscape Evolution
11
SpecFEM3D 1 (moguilny_at_ipgp.jussieu.fr)

• Resolution of regional scale seismic wave
  propagation problems to model wave propagation at
  high frequencies and for complex geological
  structures, with use of the spectral-element
  method.
• Application first written by D. Komatitsch
  (Université de Pau), used in more than 75
  laboratories in the world,especially for the
  study of earthquakes.
• Very scalable application using F90 MPI needing
  NFS mounted homes and requiring the successive
  launch of two mpirun on the SAME nodes,
  allocated in the SAME order.
• Project to be distributed on EGEEII to
  authorized users

12
Hydrology
Management of water resources in Mediterranean
area (SWIMED) G. Lecca (CRS4 Italy), P. Renard
(Unine, CH), J. Kerrou (INAT, Tunisia), R. Ababou
(IMFT, Fr)
CODESA-3D Density-dependent 3D coupled
groundwater flow and transport simulations Data
requirement Geology, Topography, Meteorology,
Water extraction by the farmer, Aquifer
properties (Soil maps, Land use)

• GRID Impacts
• Enhancing the data sharing among the field
  geologists, modelers, and water managers
• Allowing the water managers in Tunisia to
  investigate the potential impacts of management
  decision through a remote use of the grid web
  interface - EUMEDGrid

13
Final remarks

• In EGEEII improvement and/or implementation of
  functionalities more adapted to Earth Science
• License server
• Data management
• Workflow
• Portal
• New tools needed to use the whole Grid potential
• Due to Change in scale of computing power
• Need of Exploration of huge data sets
• Creation of Platform integrating web services,
  computing power, information systems.
• New conceptual approach of Earth Science
• Role of Scientist
• Interactive collaboration -gt less duplication of
  development and/or adaptation
• More time for new ideas, new research
• Confidentiality of the research
• Application development ( access to several large
  data sets, more CPUs)

DEGREE EU project is preparing the future
14

• Strategic objectives
• Bridge the ES and GRID communities throughout
  Europe
• Ensure that ES requirements are satisfied in next
  Grid generation
• Ensure the integration of emerging technologies
  for managing ES knowledge

http//www.eu-degree.eu
The DEGREE team IISAS, Slovakia
(Coordinator) CNRS, France KNMI, The Netherlands
UNINE, Switzerland CRS4, Italy SCAI, Germany
GCRAS, Russia ESA-ESRIN, Italy CGG, France Dutch
Space, The Netherlands
Project Vision
Build a bridge linking the ES and Grid communities
15
ESA Earth Observation Grid

• GRID infrastructure dedicated to Earth Science
  applications at ESA
• 150 CPUs, around 100 TBytes storage
• Earth Science dedicated portal
• 40 applications demonstrated in ESRIN
• Environment integrates specialized ESA developed
  toolboxes (BEAM, BEST, BEAT)
• Recently opened to selected external PIs via Call
  for Proposals
• Infrastructure is used to support GRID
  processing/data access applications as well as to
  support new technologies (Digital Libraries,
  e-collaboration )

16
Example of ESA GRID Applications (1)
(A)ATSR volcano monitoring Extract time series
in large data archives (1 volcano, 3 years of
data 1h using 20 CPU)

• Operational global MERIS, (A)ATSR, and SAR large
  scale mapping Land, ocean, and atmosphere

Automatic coregistration of (A)SAR time series
Extract time series in large data archives
Large scale (A)SAR / Landsat ortomapping Multi
resolution data storage many hundred images
processing / integration
17
First work

• Collect Earth Science applications already or not
  ported on a grid infrastructure not super
  computer
• Classification as a function of their complexity
• Analysis of the requirements
• Catalogue of requirements

Other applications are welcome ..
18
Role of the other Workpackages

• Focus on specific tools or functionalities
• data management
• job control,workflow,..
• portals, etc,
• gt to provide a cross overview of what exists in
  the ES community and in Grid projects.
• gt to provide a list of potential tools adapted
  to ES requirements

DEGREE is a SSA gt tests to be done by other
partners or in other projects like EGEE
19
DEGREE Objectives

• Roadmap and New Challenges
• Develop the concept and specify the technology
  base for an Earth Sciences Grid Services
  Platform, taking inputs from the DEGREE technical
  WPs
• ES Application requirements on the Grid
  middleware and services
• ES Application requirements for Grid data
  management
• ES Application management workflows and job
  control
• ES Portals requirements
• Identify new technical challenges and make
  recommendations for future actions
• Particular emphasis on supporting and meeting the
  needs of
• ES Data Assimilation Application
• Knowledge Infrastructures
• Develop the roadmap for building and promoting a
  Grid Services Platform for new ES applications
  and value added services
• Portals, workflow, data management
• Identify new challenges
• ES Community Outreach
• Generate new contacts through existing Earth
  Science research and industry bodies
• Promote and advance complementary technologies
  for providing application services based on Grid,
  e-Collaboration, SOA, and Semantic Web

20
Earth Science Expectations

• Pushing frontiers of scientific discovery by
  exploiting advanced computational methods.

www.eu-degree.eu News
Letter, example of ES applications
EGEEII User Forum, Manchester, UK 9-11 May 2006
(www.eu-egee.org/uf2