NASA Experiment Designer and Workflow Tools

1
NASA Experiment Designer and Workflow Tools

• NASA SIVO Code 610.3
• Curator Workshop
• October 19, 2007
• Presented By
• Brice Womack

2
Background - GEOS-5

• Contains many sub-components
• Generally one or more option for each component

3
Background - GEOS-5

• GMAO created MAPL to automate routine aspects of
  ESMF component creation and coupling
• Uses MAPL to create components
• Import State and associated Fields
• Export State and associated Fields
• Internal State and associated Fields
• Uses MAPL to specify component coupling and data
  exchange
• Uses MAPL to specify the run sequence of
  components
• Does not support concurrent execution mode of ESMF

4
Prototype Workflow Tool Components

• Runs completely within NCCS environment
• Borrows workflow tools already in use at ECMWF
• SMS as scheduler
• XCDP as view/control GUI
• NED (NASA Experiment Designer) replaces PrepIFS
• GEOS-5 workflow, based on Larry Takacs scripts

5
Workflow Tool System Flow
6
NED GUI
7
NED Features

• Experiment search
• Inside experiment configurations
• Or the collection of previously run experiments
• NED architecture
• Client/service model, easily extensible
  components
• Suitable for wide range of workflows

• Design experiment templates
• Experiment configuration persistence
• Save to file or database for any user to recall
  later
• Difference experiments for subtle changes
• Version-controlled experiment templates

8
NED Features - Experiments

• Experiments are defined as units of execution
  with dependencies
• Build/compile
• Input data retrieval from archive
• Model run
• To end Date/Time
• For x timesteps/hours/days
• Ensembles 1-x
• Etc
• Post Processing - diagnostic generation,
  visualization, etc
• Archival of experiment output data

9
NED Features - Continued

• Experiments are read/written as XML
• Each unit of work has a corresponding XML
  description
• New units of work can be added dynamically
• Variables defined in a unit of work can be
  customized
• Variable type
• Min/Max value
• Display method (list, checkbox, etc)
• Uses XSLT to allow export of multiple file types
  including
• CSH, BASH, KSH, etc
• ESMF Config/Attribute file
• Fortran Namelists

10
NED Next Steps

• Consider Alternative Workflow tools (Enhydra)
• Parse MAPL.RC files to integrate model metadata
• Auto-Generate MAPL.RC files to specify
• components used in model
• coupling of model component
• Synchronize NED schemas with Curator/METAFOR