coriolis ftp and www servers

1
Diffusion de données Coriolis WEB et FTP

2
Principaux acteurs de Coriolis-données

• Météo-FranceInterface SMTBouées de surface
• IfremerFlotteurs profilantsDonnées des navires
  océanographiques (xbt, ctd, thermosalinomètre)Dif
  fusion WWW et FTP
• IRDDonnées des navires dopportunité (xbt,
  thermosalinomètre)Réseau Pirata

3
Flux de données coriolis-données

12h
quotidien2
météo-france smt
dynamique
web
contrôles temps réel toga temps différé scoop
12h
quotidien
ftp
quotidien
base coriolis-données
argo
hebdo
mercator godae
1 mois
1 an
1 semaine
produitsanalyses, graphiques, cartesvecteurs de
vitesse dérives de capteurs (en cours)
quotidien
soap shom, marine
48h
48h
annuel
woce/clivarcd-rom
6 mois
1 an
annuel
gtspp
4
FTP Coriolis objectifs

• Diffusion des données en temps réel
• Mode quotidien
• Mode Hebdomadaire
• Données de bouées, flotteurs, XBT, CTD
• Diffusion des données Argo
• Quotidien
• Temps réel et temps différé
• Format de données actuel
• Profils NetCDF CoriolisMulti-profils,
  multi-plateformes
• Trajectoires ASCII
• Format de données évolution
• Profils profils NetCDF Argo
• Trajectoires trajectoires NetCDF Argo

5
Structure FTP ftp.ifremer.fr/ifremer/corio
lis
ftp coriolis
dailyun fichier quotidienpar type de
donnéesdes 30 derniers joursCO_YYYYMMDD_HHMMSS_X
X.ncexemple CO_20020923_200000_TE.ncCO_200209
23_200000_BA.ncCO_20020923_200000_PF.nc
mercatorun fichier hebdomadairepar type de
donnéesdes 3 derniers moisCO_XX_YYYYMMDD_HHMM_YY
YYMMDD_YYYYMMDD.ncexemple CO_TE_20020917_1610_
20020820_20020916.ncCO_BA_20020917_1610_20020820_
20020916.ncCO_PF_20020917_1610_20020820_20020916.
ncCO_CT_20020917_1610_20020820_20020916.nc
weeklyun fichier hebdomadairepar type de
donnéesdes 3 derniers moisCO_YYYY_WW_XX.ncexemp
le CO_2002_38_TE.ncCO_2002_38_BA.ncCO_2002_38
_XB.ncCO_2002_38_PF.nc
lagrangian_buoyun fichier hebdomadaireCO_003801-
YYYYMMDDHHMMSS.txtexemple CO-003801-2002092313
4500.txt
6
Types de données

• PFA PF profile is performed by a lagrangian
  float. It is a full resolution profile.
• XBAn XB profile is performed by an XBT probe. It
  is a full resolution profile.
• CTA CT profile is performed by a CTD
  equipement.The vertical resolution of the
  profile is decimated to 10 meters.It is
  therefore a high resolution profile, but not a
  full resolution profile (a full resolution
  profile has a vertical resolution of less than 1
  meter).
• BAA BA (bathy) profile is a low resolution
  profile received from the GTS network.It is a
  real-time profile. The measurements are performed
  by XBT, CTD, profilers, buoys or moorings.A BA
  profile contains only temperature measurements
  with a resolution of 1/10.When a profile with
  full resolution is available, the corresponding
  BA low resolution profile is removed from the
  database.
• TEA TE (tesac) profile is a low resolution
  profile received from the GTS network.It is a
  real-time profile. The measurements are performed
  by XBT, CTD, profiler, buoys or moorings.A TE
  profile contains temperature measurements with a
  resolution of 1/100A TE message may also contain
  salinity measurements with a resolution of
  1/100.When a profile with full resolution is
  available, the corresponding TE low resolution
  profile is removed from the database.

7
Argo data data flow
ftp 24 hoursweb 12 hours
gts 24 hours
24 hours
5 hours
5 months
24 hours
1 year
24 hours
1 day toseveral years
aic argo information center
long term archiveusnodc
8
GDAC FTP structure
global FTP server
geo
latest_data
2002
atlantic
pacific
indian
05
12
2002

01
12
One file per day containing all of the profiles
processed that day

One file per day containing all of the profiles
acquired that day
9
Index files
10
Dac view
11
Web Coriolis outils de visualisation

• Accès aux instruments de mesures
• Listes de flotteurs, campagnes
• Description détaillée de flotteurs et des mesures
  réalisées
• Cartes globales et individuelles
• Sélection de données multi-critères
• Géographie
• Type dinstruments
• Type de mesures
• Cartes de trajectoires, de stations

12
WWW global servers global map
13
WWW global servers argo floats list
14
WWW global servers individual float informations
15
WWW global servers individual float geographic
map
16
WWW global servers individual float measurements
17
WWW global servers individual float section and
pressure chart
18
WWW global servers individual float meta-data
19
WWW global servers individual float profiles
20
WWW global servers individual float immersion
drifts
21
WWW global servers individual measurements
22
WWW global servers selection tools

• Tools for choosing subsets/formats
• Temporal, geographical and drift-level criteria
• Full resolution profiles or interpolated on
  standard levels
• Submerged or surface or total displacements
• Parameters (T, S, positions, deep/surface
  velocities, ...)
• Experiment/Cruise , PI , accuracy/error level
• Format
• ASCII, netCDF
• One file per profile, day, week, month, ocean,.

23
WWW global servers selection tool
24
WWW global servers selection tool
25
WWW global servers selection tool
26
WWW global servers products ?
27
GDAC global FTP servers goals

• Provide FTP sites containing the best profiles
  for all the Argo floats
• Centralized access to float metadata and
  trajectories
• Not in charge of the archiving of the different
  versions of float profiles

28
Data management actors

• Regional Data CentresData centres in charge of
  the delayed mode quality control on float data.
  This QC is made on regional basis.
• Argo Information Centre (AIC)Centre located in
  Toulouse/France, in charge of informing on the
  Argo program status and to provide all necessary
  information to users.
• Argo long term archiveData centre located in
  NODC/USA in charge of the long term archive of
  all Argo data.

29
Data management actors

• Pis principal investigatorsThe scientists who
  deploy the floats, then carry out delayed mode QC
  and return data to DAC Centres within 5 months of
  observations.
• DAC the data assembly centresThey operate at a
  national level.
• They collect, control and distribute the float
  data they are responsible for.
• Data are distributed to PIs and the GTS within 24
  hours of the float surfacing.
• They also send the data to the Global Data
  Centres.
• GDAC Global Data CentresTwo central points of
  Argo data distribution on Internet for all the
  float data located in Coriolis/Ifremer/France and
  US GODAE/FNMOC/USA.Coordination between these
  centres occurs daily.

30
Data transfer to global FTP sites

• Principles
• Each national center has an account on the
  global data servers
• National centers transfer a new profile , to
  both global servers, in netCDF, simultaneously to
  the transfer to GTS
• For new floats Metadata must be transferred
  first

31
GDAC data formats (1/2)

• On the FTP site, for each float, four types of
  informations are recorded
• metadata information general information on the
  float that do not change during float life.
• Profile files a file can contain either one
  or more profiles.
• Trajectory file one file containing the
  complete trajectory of the float as well as the
  measurements collected while drifting.
• Technical file one file containing the
  technical information provided by the float.
• On the web site, users will be able to aggregate
  data into one or more files of theur choice.

32
Data format (2/2)

• Formats
• metadata information NetCdf or ASCII files ?
• Profile file(s) ,Trajectory file ,Technical file
  NetCdf files containing a subset of the
  metadata necessary for users to manipulate the
  files,
• Profile files contain both original data
  acquired by the float and the best available
  profile(s) together with quality flags.