BEST : final presentation

1
BEST final presentation

• Frascati, 21st April 2005

2
BEST FINAL PRESENTATION CONTENTS

• Welcome (A. Ciarlo)
• DEBAT project short history (A. Ciarlo)
• Applied standards (CCSDS / ISO) (D. Minguillon)
• Tools vs. Data life cycle (F. Berriri, J.
  Ferreira) - Demonstration
• XML improvements (D. Minguillon) Demonstration
• Success story (D.Minguillon)
• Near future (A. Ciarlo, D.Minguillon)
• Contacts
• Conclusion (A. Ciarlo)

3
Welcome
4
Applied standards
5
Applied standards

• EAST (Enhanced Ada subset)
• The data description language EAST specification
• CCSDS recommendation CCSDS 644.0-B-2 (nov 2002)
• ISO standard ISO 158892003
• Used to describe data structure on its medium
• Not to be mastered thanks to the description tool
• Makes I/O software easy to maintain thanks to the
  EAST I/O library
• EAST V3 Standard will include DEBAT evolutions

6
Applied standards (2)

• DEDSL
• Data Entity Dictionary Specification Language
• XML/DTD Syntax
• CCSDS recommendation CCSDS 647.3-B-1(jan 2002)
• Used to describe data semantics
• Each data field or type is described through
  attributes (standard ones or user purpose ones)
• Based on XML syntax
• Produced by the same description tool than EAST

7
Applied standards (3)

• Tools before DEBAT project

User application
Write
Read
EAST description
EAST I/O library
OASIS V4 or previous
Read/Write
DEDSL description
DATA
ICD
Document Editor
8
Tools presentation
9
Data life cycle

• The data life cycle can be summarised as
• Modelling syntactic and semantic data
  description
• Generating / Simulating data generation for
  test or validation
• Processing editing, checking, extracting
• Post processing data transformation
• Distribution CDROM, Internet

10
Data life cycle
11
BEST

• BEST framework offers a direct access to the
  tools.
• Easy way to add plug-ins sharing models and data.
• Project managing facilities.

12
Modelling
Modelling
Model
13
OASIS Modeller

• Modelling of data through a performing graphical
  user interface.
• A XML internal format.
• Several output formats
• EAST,
• DEDSL (PVL and XML),
• XML schemas,
• RTF, PDF and HTML documentation.
• Library concept available

14
OASIS Modeller
15
OASIS Modeller

• Demonstration
• Modelling from scratch, using a documentation of
  CRYOSAT.
• Finishing a model making some fields optional.
• File generation EAST and DEDSL-XML.

16
Generating Simulating
Data
17
DPE (Data Producer Editor)

• Displaying the tree-view of the Model
• Generation of Data according to a Model
• Custom generation default value, degraded
  value, computed value and random value.
• Modification of an existing Data
• Displaying the Data
• Navigation through the Data
• Search for particular elements

18
DPE (Data Producer Editor)
19
DPE (Data Producer Editor)

• Demonstration
• Opening existing data product
• Generating from scratch a new data product

20
Processing
21
DEQ (Data Extractor Querying)

• Displaying the tree-view of the Model
• Displaying the Data
• Navigation through the Data
• Search for particular elements
• Extraction
• Definition of the extraction made thanks to a
  wizard
• Storage of the extracted Data
• Batch processing

22
DEQ (Data Extractor Querying)
23
DEQ (Data Extractor Querying)

• Demonstration
• Opening existing data product
• Extracting subset from the edited data product

24
Utilities

• Data Checker
• Checks a Data against a Model.
• ASCII Dump
• Generates an ASCII representation of Data with
  possibility of XML structure.
• Comparison Tool
• Compares two versions of a Model and displays the
  difference in a tree-view.

25
ASCII Dump

• Demonstration
• Generating a simple text file
• Generating a flat XML file
• Generating a hierarchical XML file

26
Post Processing
Processed Data
27
PPT (Post Processing Tools)

• XML Tagging
• Generates a XML file from any Data
• Quick Look
• Smart presentation of extracted Data
• Visu2d
• Draws some graphs from Data

28
Quick Look

• Demonstration
• Quick visualisation of an image included in the
  data

29
Distribution
30
Distribution

• Packaging
• Creates an archive for diffusion
• WEB services
• Model Reading
• Data Reading
• Data Checking
• Data Extraction
• XML Tagging

31
XML improvements
32
XML improvements

• Just before the start of DEBAT project XML became
  very used
• As a data format
• As a data description format (DTD or schemas)
• The modeller was very suitable to design data
  (why not XML ones?)
• The output were easy to enhance with schema
  production

33
XML improvements (2)

• CNES had just issued an internal recommendation
  for XML data ICDs
• The PLEIADES project (Earth observation) had just
  decided to have all its interfaces in XML
• So, we decided to enhance the modeller with XML
  schema production facilities and to take some
  PLEIADES interfaces as use-cases applying the
  recommendation

34
XML improvements (3)

• 2 additional plug-ins based on XML
• ALADIN XML description comparisons
• SCRIBE XML post processor transforming XML data
  descriptions into ICDs (Word or HTML)
• Both are in test in PLEIADES context to produce
  and compare ICD versions
• SCRIBE is already operational on Helios project

35
Success story
36
Success story

• The list of project using EAST and DEDSL is now
  quite long...
• SPOT (Earth observation) was the historical first
  one, describing and checking its metadata with
  OASIS and EAST Ascii dump tool.
• then SSALTO (altimetry) was the first one to use
  the EAST I/O library in its operational software.

37
Success story (2)

• CDPP (data centre for plasma physics) made the
  EAST/DEDSL description mandatory accept the data
  he hosted. Based on these generic descriptions it
  offers some extraction facilities.
• PHARAO (embedded atomic clock) designed all its
  telemetry with OASIS, then made a simulation for
  instrument tests purpose with EAST I/O library
  and produced its documentation with SCRIBE and
  ALADIN

38
Success story (3)

• Helios II described all its ground segment
  interfaces with OASIS and used te EAST I/O
  libraries to read and write the corresponding
  files. The ICDs are managed with SCRIBE. From
  that experience we learnt a lot comparing with
  Helios I... The sub-system integration faced much
  less problems due to the formal definition of the
  interfaces. That was the initial goal and it was
  reached.

39
Near future
40
Near future

• Even if we still propose EAST technology for
  binary telemetries (most difficult cases of COROT
  telemetry for instance) we are investing a lot on
  the XML part of BEST.
• Generic XML tools offer an XML grammar but do not
  support any domain skills.
• The modeller could help in designing data and
  producing the documentation.

41
Contacts
42
Contacts

• For any EAST/DEDSL question there is a hot-line
  at
• eastcnes.fr
• To get BEST version 1.0 and related information
  
• http//debat.c-s.fr
• To get the previous versions
• logiciels.cnes.fr

43
Conclusion