PRISM

1
PRISM
ESMF 3rd Community Meeting, Boulder, July 15, 2004

• An Infrastructure Project for Climate Research in
  Europe

by Nils Wedi _at_ ECMWF Contributions by A. Caubel,
P. Constanza, D. Declat, J. Latour, V. Gayler, E.
Guilyardi, C. Larsson, S. Legutke, R. Redler, H.
Ritzdorf, T. Schoenemeyer, S. Valcke, R.
Vogelsang and many others in the PRISM community
...
2
Overview

• What is PRISM?
• European Interest, partners
• PRISM Objectives
• PRISM Model Components
• PRISM Approach
• Architecture and User Interface
• Current Status and Perspective

3
What is PRISM?

• PRogram for Integrated Earth System Modelling
• A European project for climate modelling
  involving 22 partners, 12/2001 12/2004
• Funded by the European Commission (4.8 M)
• Involves state-of-the-art atmosphere, ocean,
  sea-ice, atmospheric chemistry, land-surface and
  ocean-biogeochemistry models

4
PRISM partners

• MPI-M, Germany (Guy Brasseur, coordinator)
• KNMI, The Netherlands (Gerbrand Komen,
  co-coordinator)
• MPI-MD, Germany
• MetOffice, United Kingdom
• UREADMY, United Kingdom
• IPSL, France
• Météo-France, France
• CERFACS, France
• DMI, Denmark
• SHMI, Sweden
• NERSC, Norway

• CSCS/ETH, Switzerland
• INGV, Italy
• MPI-BGC, Germany
• PIK, Germany
• ECMWF
• UCL-ASTR, Belgium
• NEC-ESS, Germany
• FECIT/Fujitsu, France
• SGI, Germany
• SUN, Germany
• NEC-CCRLE, Germany

5
Help scientists to spend more time on science

• Provide software infrastructure to
• easily assemble earth system coupled models based
  on existing state-of-art components models
• launch/monitor complex/ensembles earth system
  simulations
• access, analyse and share results across wide
  community
• Define and promote technical and scientific
  standards for Earth System modelling

6
Technical and scientific standards

• Scientific
• Global parameters
• Physical interfaces
• Technical
• Coupler and I/O
• Data format and grids
• Architecture and User Interface
• Diagnostics and visualization
• Coding and quality

7
PRISM model components
8
ESMF - PRISM
Running environment
PRISM
Superstructure
User code
ESMF
Code Infrastructure
9
Coupling software and its evolution in PRISM

• Coupler OASIS 3.0/4.0 (10 years experience)
• Prism system model interface library PSMILe
• MPI1 or MPI2 direct communication between models
  with same grid otherwise repartitioning using a
  transformer
• modularity prism_put() and prism_get() to
  implement in existing models

10
OASIS coupler Ocean Atmosphere Sea Ice Soil

• Historical review Developed since 1991 in
  CERFACS to couple existing GCMs. At the time
• Models at relatively low resolution (10000-20000
  pts)
• Small number of 2D coupling fields (10)
• Low coupling frequency (once/day)
• flexibility was very important, efficiency not so
  much!
• 1991 2001
• --? ---
  PRISM ?
• OASIS 1 ? OASIS 2 ? OASIS3 ?
• 
  ? OASIS4 ?

11
OASIS community

• CGAM-Reading (UK) HadAM3 - ORCA2
• Southampton University (UK) Inter. Atm
  - OCCAM lite
• UCL (Belgium) LMDz - CLIO
• SMHI (Sweden) ECHAM - RCA RCA(region.)
  RCO(region.)
• U. of Bergen (Norway) MM5 - ROMS
• KNMI (Netherlands) ECHAM5 - MPI-OM
• DMI (Danemark) ECHAM - HIRLAM
• INGV (Italy) ECHAM5 MPI-OM
• IRI (USA) ECHAM4 - MOM3
• JAMSTEC (Japan) ECHAM4 - OPA 8.2
• BMRC (Australia) BAM - MOM4 BAM3 -
  ACOM2
• U. of Tasmania (Australia) Data Atm. - MOM4
• CAS,IIT Delhi (India) MM5 - POM

12
OASIS community

• CERFACS (France) ARPEGE3 - ORCA2LIM
  ARPEGE3 - OPA 8.1 ARPEGE3 -
  OPAICE
• METEO-FRANCE (France) ARPEGE4 -
  ORCA2 ARPEGE medias -OPAmed ARPEGE3 -
  OPA8.1 ARPEGE2 - OPA TDH
• IPSL- LODYC, LMD, LSCE (France) LMDz -
  ORCA2LIM LMDz - ORCA4 LMDz
  - OPA ATL3/ATL1 IFS - OPA
  8.1 ECHAM4 - ORCA2
• MERCATOR (France) PAM(OPA)
• MPI - MD (Germany) ECHAM5
  - MPI-OM ECHAM5 - C-HOPE PUMA
  - C-HOPE EMAD - E-HOPE ECHAM5
  - E-HOPE ECHAM4 - E-HOPE
• ECMWF (UK) IFS Cy23r4 - E-HOPE IFS
  Cy15r8 - E-HOPE

13
Oasis2 and Oasis3

• Flexibility, modularity
• ? Coupler and PSMILe act according to
  user-defined coupling configuration (text file)
• number of models and coupling fields
• coupling frequencies and transformations for each
  field
• I/O or coupling mode (transparent for model)

14
Oasis4 new demands

• Higher resolution, parallel and scalable models
• Higher coupling frequencies desirable
• Higher number of models and (3D) coupling fields
• Massively parallel platforms

15
OASIS4

• is composed of
• a Driver
• a Transformer
• a new PRISM System Model Interface Library

16

• Interface and data flow

17
OASIS4

• MPI parallel communication including
  repartitioning
• parallel multigrid 3D neighbourhood search and
  calculation of communication patterns in each
  source process PSMILe
• extraction of useful part of source field only

• parallel I/O single file, distributed files
  GFDL mpp_io parallel file parNetCDF
• parallel Transformer loops over PSMILe requests
• flexibility and modularity same as Oasis3

18
(No Transcript)
19
Oasis Current status

• OASIS3_prism_2-2 available
• OASIS4 prototype available
• OASIS4 final PRISM version due 12/2004

20
File formats and grids

• NetCDF for grid and restart auxiliary files
• CF convention under development, extending the
  COARDS conventions
• XML for model and script meta-data input (Fortran
  namelist and shell replacement)

21
System Architecture and User Interface

• PRISM architecture to provide an efficient
  climate modelling infrastructure to users and
  developers through
• Standardised interfaces
• Remote functionality
• Centralised administration
• Distributed resources

22
(No Transcript)
23
(No Transcript)
24
Standard compile (SCE) and run environment (SRE)

• Finalizing the SCE and SRE for the PRISM models
• The system comprises 15 models (arpege_climat4
  echam5 hamocc lim lmdz mozart mpi-om oasis3
  opa orchidee pisces toy4opa toyatm toyche
  toyoce) which are adapted to a varying degree to
  the PRISM standards and can run in several
  combinations.
• Most of the models have been tested on a variety
  of platforms (NEC (SX), SGI (MIPS or IA64SGI),
  FUJITSU (VPP), IBM (power4))

A tedious task without flashy graphics but very
useful !!!
25
PrepIFS
26
PrepIFS earth system modeling via the Internet
27
OASIS4 GUI support
XML designed to be read by machines not humans
!!!
28
SMS/WebCdp job scheduling and monitoring

• Complex automated scheduling
• Macro-parallelism
• Flexible inter-dependencies
• Interactive control
• Visual structure of large systems
• Used for all operational and research activities
  at ECMWF ( 10 years)

29
Further tools

• Diagnostics Prism processing and visualization
  software (COCO, CDAT/VCS and VTK), at ECMWF
  MARS/Vis5D/Metview
• Web GUI database and diagnostics web interface
  using web-access server technology, (DODS and
  LAS), at ECMWF Web-MARS

30
A PRISM sustained team

• Document by PRISM Steering Group proposing
  establishment of a PRISM sustained team of 7
  people sent to European Climate modelling
  Community (June 04)
• First preparation meeting August 17th, 2004
• Target Signature of Consortium Agreement
  01/2005
• MPI (Germany), CERFACS (France), ECMWF (EU), CNRS
  (France), MetOffice (UK), NCAS(UK), CCRLE
  (Germany) already expressed strong interest.
• Additional FP6 funding (March 2005)?

Enthusiasm is still high !!!
31
Further information

• http//prism.enes.org

32
Oasis4 in the prototype (05/2004)

• Access and use of XML information
• Coupling and I/O of n parallel applications with
  m components.
• Coupling exchange with repartitioning, direct or
  through the Transformer
• Interpolations
• PSMILe (non-exact) parallel neighbourhood search
• 3D 2D nearest-neighbour, 3D linear, 2D linear
• I/O
• single and parallel mode
• Coupling and I/O exchange from one source to many
  targets
• Local transformations (scatter, gather, add or
  mult scalar, statistics)
• Basic time transformation (average, accumul, min,
  max)

33
Oasis4 still to be done

• PSMILe API for model access to SCC and SMIOC
  information
• Interpolation
• More schemes (conservative, 3D, etc.)
• Exact parallel neighbour search
• Transformer parallelisation (almost completed)
• Field reduction, combination
• Full support of vector and bundle fields (I/O OK)
• I/O distributed mode (parNetCDF)
• Adaptive grids
• Unstructured grids