Title: Producer-Archive Interface Methodology Abstract Standard
1Producer-Archive Interface MethodologyAbstract
Standard PAIMAS
C. Huc/CNES, D. Boucon/CNES-SILOGIC,D.M.
Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon
2Contents
- Why a new standard?
- Space data archiving
- Needs for standardization
- What standardization will bring
- Abstract standard status
- Proposed methodology
- Context - description
- The 4 phases
- Specialization
- Aid Tool for the use of the Methodology
- Towards an implementation standard
- Conclusions
3Why a new standard?Space data archiving archive
types
4Why a new standard?Space data archiving key
roles and players
- Data Producers
- the operating systems of each mission
- the mission processing and archiving centres
- the scientific teams in the laboratories
- Archive
- specialized independent organizations (CDS)
- specialized services within the agencies (NSSDC)
- services common to several organizations (CDPP)
-
5Why a new standard?Needs for standardization
problems
- The relations between archives and data
Producers are rarely simple and easy - nonconformity of received data
- unclear and imprecise definition of the data to
be delivered, - failure to meet delivery schedule,
- late detection of errors in archived data,
- non-management of modifications
- gt Can be detrimental to archived information
quality and the cost of the operation. - Ever increasing diversity of the producers
- Data complexity
- Each project develops its own methodology on the
basis of a process that is roughly the same from
one project to another - gt Work duplicated, no generality, excessively
high costs, etc.
6Why a new standard?Needs for standardization
multiple standards
PAIMAS Generic abstract standard
Approved by the CCSDS
PAIMAS Implementation standard
Community abstract standard
Development in progress
7Why a new standard?What standardization will
bring
- Ease some typical problems (as noted earlier)
- Make it easier to follow schedules and
commitments - Help with human resources turnover
- Anticipate new problems
- Address the legal aspects early
- Increase data quality of archive holdings
- Have weight and credibility for adoption
- And finally, save time (and money)
8Why a new standard?Abstract standard status
- Today CCSDS standard (blue book) and
standardization with ISO in progress - Various communities have helped produce this
document - space agencies (CNES, NASA, ESA, )
- archivists (NARA, ) and
- librarians (BNF -French National Library,
RLG-Research Library Group).
9Contents
- Why a new standard?
- Space data archiving
- Needs for standardization
- What standardization will bring
- Abstract standard status
- Proposed methodology
- Context - description
- The 4 phases
- Specialization
- Aid Tool for the use of the Methodology
- Towards an implementation standard
- Conclusion
10MethodologyContext OAIS environment
11MethodologyContext PAIMAS focus
AIP Archival Information Package, SIP
Submission Information Package, DIP
Dissemination Information package
12MethodologyContext PAIMAS focus
Ingest
AIP Archival Information Package, SIP
Submission Information Package, DIP
Dissemination Information package
13MethodologyDescription
-
- The archive project is broken down into 4 main
phases - Preliminary Phase,
- Formal Definition Phase,
- Transfer Phase,
- Validation Phase.
- Each phase has extensive action tables.
-
- Specification for a community.
14MethodologyThe phases relationships
- Negotiate the Submission
- Develop agreement (data to
- be delivered, complementary
- elements, schedule)
- Identification and preliminary
- agreement
- Define the information
- to be archived
- resources estimation
- Actual transfer of the data
- Actual transfer of the
- objects
Validate the transferred objects
Phase objective
Transferred object files
Preliminary Phase
Formal Definition Phase
Validation agreement
Preliminary Agreement
Dictionary Formal model Submission Agreement
Anomalies
Data ready to archive
15Methodology Preliminary phase context
Producer
Preliminary Phase
Preliminary Agreement
Archive
16MethodologyPreliminary phase sub-phases
17MethodologyFormal Definition Phase context
Preliminary Agreement
Formal Definition Phase
Dictionary Data Model Submission Agreement
18MethodologyFormal Definition Phase sub-phases
and action table
19MethodologyTransfer Phase
Data Model of object files to deliver Schedule
Transfer Phase
- Actual transfer of the objects
- carry out the transfer test
- manage the transfer
Transferred object files
20MethodologyValidation Phase
Transferred object files
Data ready to archive
Validation Phase
- Validate the transferred objects
- carry out the validation test
- manage the validation
Anomalies
Validation acknowledgement
Producer
21Contents
- Why a new standard?
- Space data archiving
- Needs for standardization
- What standardization will bring
- Abstract standard status
- Proposed methodology
- Context - description
- The 4 phases
- Specialization
- Aid Tool for the use of the Methodology
- Towards an implementation standard
- Conclusion
22Specialization
- Adapt the generic standard to a particular
community (which can range from an international
organization to a simple archive service) - Steps involved to define a community standard
- terminology,
- data dictionary and information model,
- standards,
- common tools.
- Analyze each action of the generic standard (add
actions if necessary)
23Specialization Example
- Example (CDPP -Plasma Physics Data Center-
Archive) -
Generic Action (Methodology)
F-4 Define the formats, coding rules, and
standards to be applied for the objects
to be delivered
24Contents
- Why a new standard?
- Space data archiving
- Needs for standardization
- What standardization will bring
- Abstract standard status
- Proposed methodology
- Context - description
- The 4 phases
- Specialization
- Aid Tool for the use of the Methodology
- Towards an implementation standard
- Conclusion
25Aid Tool
A methodology application and archive project aid
tool would be a real advantage for both the
Producer and the Archive. First mockups produced
26Aid Tool
27Contents
- Why a new standard?
- Space data archiving
- Needs for standardization
- What standardization will bring
- Abstract standard status
- Proposed methodology
- Context - description
- The 4 phases
- Specialization
- Aid Tool for the use of the Methodology
- Towards an implementation standard
- Conclusion
28Towards an implementation standardContext
Methodology application aid
PAIMAS Generic abstract standard
Implementation standard
Languages Tools
Archive project
29Towards an implementation standardApproach
- generic data model
- transfer data model (generic objects)
- transfer data dictionary (generic descriptors)
- community dictionary
- diagram of data to transfer for the
- archive project
-
- transfer sequencing and chronology
- transfer session
Implementation standard
DEDSL
XML Schema
XML
Languages Tools
UML XMLScheme
DTD XMLScheme
XFDU
30Towards an implementation standardRelationships
CLUSTER
CIS
CODIF
HIA
CLUS-CIS-CODIF-EAST
CLUS-CIS-HIA-EAST
CLUS-CIS-CODIF-Jm
CLUS-CIS-HIA-Jn
31Towards an implementation standardSchema
- Delivery plan
- all the elements to be delivered
- easy to understand from the Producer side
- expression of constraints
32Conclusion
- PAIMAS identifies
- the phases in the process of transferring
information, - the objective of the phases,
- the actions that must be carried out,
- the expected results.
-
- PAIMAS is a basis
- for the identification of standards and
implementation guides, - for identification and development of a set of
software tools.
33End of presentation