Panel 2 Focus and Results

1
Panel 2 Focus and Results

• David Giaretta

2
Consultative Committee for Space Data Systems
http//www.ccsds.org
MANAGEMENT COUNCIL
ISO/TC20/SC13
Industry Associates
Standards Liaisons
Secretariat
Technical Steering Group
PANEL 2
PANEL 3
PANEL 1
INFORMATION INTERCHANGE
SPACE DATA COMMUNICATIONS
CROSS SUPPORT
Observer
Agencies ASA/Austria ISAS/Japan CAST/China ISRO/
India CRC/Canada KARI/Korea CRL/Japan KFKI/Hunga
ry CSIR/South Africa MOC/Israel CSIRO/Australia
NOAA/USA CTA/Brazil NSPO/Taipei DSRI/Denmark SSC
/Sweden EUMETSAT/Europe SSTC/Belgium EUTELSAT/Euro
pe TsNIIMash/Russia HNSC/Greece
USGS/USA IKI/Russia
Member Agencies ASI/Italy ESA/Europe
BNSC/UK INPE/Brazil CNES/France NASA/USA CSA/Cana
da NASDA/Japan DLR/Germany RSA/Russia
3
International Space Standards Groups
ISO Member Countries - National Standards Bodies
Technical Committee 20 (ISO/TC20) Aircraft and
Space Vehicles
(Secretariat U.S. Aero. Industries Assoc.)
Subcommittee 14 (ISO/TC20/SC14) Space
Systems and Operations
Subcommittee 13 (ISO/TC20/SC13) Space Data
and Information Transfer Systems
(Secretariat NASA)
(Secretariat AIAA)
CCSDS
Space Information Interchange
Design Engineering Production
Space Data Communications
Space Mission Cross Support
Environment (natural induced)
4
CCSDS Standardisation Service Domains
Near Earth
Deep Space
Space Data Communications Services
Space Mission Cross Support Services
Space Information Interchange Services
5
Space Information Interchange Services

• that facilitate the preservation, access, and
  exchange of space mission-related information
  across the Global Information Infrastructure and
  the space mission information systems
  infrastructurethese services will increase the
  value of information gathered from space by
  enabling it to be transparently used by current
  and future users of the information infrastructure

6
Space Data vs ordinary data

• Space Data does NOT limit the scope of the
  panel
• The Standards and associated tools developed by
  the Panel are applicable to ALL types of
  information
• However the panel has tended to focus on binary
  data with complex metadata e.g.
• Earth Observation images
• Space Plasma datasets
• Astronomical images
• i.e. not just text

7
Information leakage
8
(No Transcript)
9
Projects using Panel 2 standards
ACE AXAF-I Cassini/Huygens Clementine Cluster
II ENVISAT-1 EO-1 (NMP-2) ERS-1 ERS-2 FAST FUSE Ga
lileo GOES (multiple)
Geotail IMAGE (MIDEX-01) IMP 8 Interball IRAS ISIS
Magellan Mariner MAP (MIDEX-02) Mars Global
Surveyor Mars Pathfinder Mars Surveyor-Lander
98 Mars Surveyor-Orbiter 98
PHOBOS 2 Polar Rossi XTE SAMPEX SOHO TOPEX/Poseido
n TRACE TRMM UARS Ulysses Viking 1 2 Voyager 1
2 WIND
10
Metadata Management
11
CCSDS Panel 2 Overview

• Data Description languages
• EAST plus related tools
• Parameter Value Language (PVL)
• XML-based
• JAVA-based
• Data Dictionary Specification Language
• Abstract, XML and PVL syntax

12

• Structures for data transfer
• Conceptual as well as concrete
• For data and metadata
• Metadata registry
• For long-term access to metadata
• Procedures standardised
• Tools available

13
Long-term Preservation of Information

• Open Archival Information Systems (OAIS)
  Reference Model
• Standards arising from OAIS
• Ingest
• standard ingest forms
• standard ingest methodology
• Certification
• Data Identification for Archival Information
  Packages
• Access Dissemination

14
Context other developments

• Global Information Infrastructure
• W3C
• OMG
• Other ISO standards bodies
• GRID

15
Collaborations

• Avoid reinventing the wheel
• Liase with other groups
• Influence their developments
• Adopt what they have done
• Adapt what they have done
• As a last resort, develop standards ourselves

16
Workplan
17
Road Map
Data Administration
Control Authority Services
Metadata Registry Interoperability
CA Software
Open Archival Information Systems (OAIS)
Reference Model
Archive Standards
Archive Accreditation Procedures
Data description languages and tools
DDL (EAST)
Data Dictionary Specification
Interoperable Dictionaries
Objects modeling
Information Packaging
Naming Conventions
Internet SFDU
Object Templates
Referencing Environment
18
END
19
Relationship to Global Information Infrastructure

• GII needs permanent metadata archives
• CA procedures applicable to overall
  management/preservation
• OAIS applicable to preservation of information
  including metadata
• GII needs more complex metadata capture and
  transfer
• Data Description languages and techniques
• SFDU CONCEPT applicable to these

20
relationship to GII

• GII needs permanent Information Stores
• OAIS forms the basis for this
• Certification is central to this
• Ingest standards could have an immediate impact
• for Space Agencies when applied to Mission
  Archives
• Long-term archives

21
What is the GRID

• The Grid refers to an infrastructure that enables
  the integrated, collaborative use of high-end
  computers, networks, databases, and scientific
  instruments owned and managed by multiple
  organizations. Grid applications often involve
  large amounts of data and/or computing and often
  require secure resource sharing across
  organizational boundaries, and are thus not
  easily handled by todays Internet and Web
  infrastructures.

22
Online Instruments
tomographic reconstruction
23
Collaborative Engineering
Manipulate shared virtual space, with Simulation
components Multiple flows Control, Text, Video,
Audio, Database, Simulation, Tracking, Haptics,
Rendering Issues (un)reliable uni/multicast Secur
ity Reservation QoS
CAVERNsoft UIC, Electronic Visualization
Laboratory
24
The Grid

• Dependable, consistent, pervasive access
  tohigh-end resources
• Dependable Can provide performance and
  functionality guarantees
• Consistent Uniform interfaces to a wide variety
  of resources
• Pervasive Ability to plug in from anywhere

25
GRID user view

• A user or the software may come across a wide
  variety of information and have to deal with it
• Format
• Metadata
• The data may be from any source, obtained at any
  time in the past
• Yet it must be dealt with correctly

26
Problems

• Complex non-text data with associated semantics
• Where to find the metadata?
• How to extract information?
• How to understand interrelationships
• Archives
• How can one be sure that the information has been
  properly curated?

27
Information Layers
28
Problems

• For Information Producers
• acquisition curation of very large valuable
  collections of primary data is a big problem
• The cost of data collection may be many time 100
  Million
• The provenance of the information needs to be
  known
• This involves a level of QA way beyond database
  management

29
Where CCSDS (S)IIS fits in (1)

• Standards for Open Archival Information Systems
  (OAIS)
• Reference Model will shortly be an ISO standard
• Follow on standards planned include
• archive certification
• information ingest
• These Standards can form the basis for
  information curation and information reliability

30
Open Archival Information Systems Reference Model
31
Where CCSDS SIIS Fits in (2)

• Data Description Languages e.g. EAST
• Can describe complex data to the BIT level
• Sophisticated tools available
• Data Entity Dictionary Specification Languages
• Allows the capture of complex semantics in an
  extensible way
• Thereby allows one to deal with unfamiliar
  complex data

32
Where CCSDS SIIS fits in (3)

• Complex logical data packaging
• Allows interrelationships to be captured easily
• Metadata repositories
• Allows metadata to be located and accessed easily

33
Conclusion

• In the next generation of internet applications
  ways must be found for handling large amounts of
  unfamiliar complex data
• Standards (and tools) from CCSDS on Information
  Interchange could provide at least part of the
  solution

34
Document Tree/Status
Colour of box indicates target of book
(yellow/blue/green etc). Gray indicates software.
Border denotes state e.g. red/white. Black
indicates work in progress
35
Increase usage

• Wider so that more different types of
  information are available
• Deeper so that with any particular dataset more
  information can be extracted and understood
• Longer so that information is available over a
  longer period

36
Widening

• Multi-disciplinary studies require access to data
  from many sources in many formats e.g.
• Climate studies
• Solar Terrestrial Physics studies
• BUT
• Although there are well supported formats used in
  particular scientific disciplines and
  sub-disciplines
• Software tool support hides much of the semantics
• These tools are not well known in other
  disciplines
• It is difficult to combine software environments
• THEREFORE
• An unfamiliar dataset may be difficult to use

37
.to widen we need

• Ability to know what software can be used to
  access the data
• Associate tools with data
• BUT
• Also need to be able to remove reliance on
  specific software
• Describe the data in great detail
• Difficult for complex formats
• Describe interrelationship between elements

38
Deepening

• For any particular dataset one wants more
  information to be extracted and understood
• BUT
• One needs to be clear about the meaning of
  different data items
• One needs to increase the ability to combine the
  information with other sources

39
..to deepen we need

• Definitions for elements
• important especially for multi-disciplinary work
• Additional information e.g.
• Supplementary information
• Production information
• Catalogue information
• Interrelationships with other datasets

40
Lengthening

• Information must be accessible over long periods
  of time
• Future generations
• Larger audience
• BUT
• Digital information is fragile over any extended
  time period
• Formats and metadata are not documented
• Human resources disappear
• Timescales as short as a few years
• E.g. hardware changes

41
to lengthen access we need

• Need to use standards appropriate to Long-term
  preservation of information
• Open Archival Information Systems (OAIS)
  Reference Model
• ISO review underway
• will lead on to other standards
• see other presentation

42
Space Information Interchange Services

• enable the long-term preservation of space
  mission-related information and facilitate access
  to and exchange of that information across the
  Global Information Infrastructure and the space
  mission information systems infrastructure-these
  services will increase the value of information
  gathered from space by enabling it to be
  transparently used by current and future users of
  the information infrastructure.

43
(No Transcript)