NOAA IOOS Program DIF

1
NOAA IOOS Program DIF Standards


23 October 2007 CAPT Chris Moore Charles
Alexander Marcia Weaks Rebecca Shufford Rob
Ragsdale
2
Need a plan!
3
Documentation
NOAA Integrated Ocean Observing System (IOOS)
Program Office Data Integration Framework
(DIF) DIF As-Is Baseline Systems Document (DRAFT
Version 0.6) September 19, 2007
NOAA Integrated Ocean Observing System (IOOS)
Program Office Data Integration Framework
(DIF) Functional Requirements Document Version
0.1 September 17, 2007
NOAA Integrated Ocean Observing System (IOOS)
Program Data Integration Framework (DIF) Master
Project Plan (Draft Version 0.1) September 12,
2007
4
NOAAs Data Integration Framework (DIF) Project
Management Structure
John H. Dunnigan, NOS Assistant Administrator
Advisory/ Consultation
NOAA Chief Information Officer (CIO)
NOAA Ocean Council (NOC)
Zdenka Willis, IOOS Program Director
NOAA Observing Systems Council (NOSC)
Program Support Contractor
NOAA IOOS Program Senior Staff
Captain Christopher Moore, IOOS DIF Project
Manager/ Deputy Director
Project Review Team
NOAA IOOS Operations Division Chief
Integrated Products Team (IPT)
NWS System Engineering Center Contractor
Technical Support Contractor(s)
Project Staff
Concept of Operations Working Group
Data Standards Working Group
Working Group N
5
IPT and Working Groups
6
Teams
IPT Data Standards CONOPS
DIF Team
DATA
DIF
CUSTOMERS
LMI
Skjei Telecom
IOOS Program
Project Review Team NOAA Oversight Council
7
Temperature Test May/ June 2007
DATA
NCDDC OGC WFS WFS version 1.0.0
Color
NWS OGC WFS WFS version 1.
CORMP OPeNDAP
Currents
OGC WFS
W3C SOAP Web services
Temperature CSC Jim Boyd, John Ulmer, Daniel
Martin
Sea level
CO-OPS W3C SOAP
GoMOOS OPeNDAP
OPeNDAP
Salinity
NERRS/ CDMO W3C SOAP
Temp
SEACOOS OPeNDAP DRDS
Status Report Complete

• Data
• Incompatible data formats
• Inconsistent Data structures
• Sources Queries
• Different forms of temporal/spatial expressions
• All different data dictionaries/vocabularies.
• Varying formats for lat/long

• Metadata
• Metadata generally missing
• Information Technology
• OPeNDAP servers unavailable
• Transport protocols generally correct, some
  outdated.
• Data not integratable

8
Alternatives

• Do Nothing
• Hardwire
• Do Something

9
Something
Common Data Sharing Infrastructure

• Data Content
• Data Transport
• Metadata
• QA/QC

10
Data Content
(Who, what, where, when)

• Vocabulary/Dictionary
• Location Convention (Decimal Degrees, etc)
• Date-Time Convention (JD/Year, UTC, etc.)
• Station ID
• Vertical Datum
• Vertical Position
• Units

2007-05-25T12000000 ltncddcioos.madis_last.ddmm
myyyygt25-May-2007lt/ncddcioos.madis_last.ddmmmyyyy
gt ltncddcioos.madis_last.hourgt11lt/ncddcioos.m
adis_last.hourgt ltncddcioos.madis_last.minutegt5
6lt/ncddcioos.madis_last.minutegt 05/29/07
0745 1180695640 52342.000011574 Seconds
since January 1, 1970 Decimal days since
November 17, 1858
11
Data Content Standard example
12
Candidate systems
13