Data Management Workshop

1
More Data Center Tools

• Rick Benson
• IRIS DMC

2
SHAPE SoftwareSEED Header Assembly and
Preparation Engine

• SHAPE - Build dataless SEED files from SEED RESP
  and other info
• Controlled with a Header Assembly Template (HAT)
  file in XML format wherein SHAPE finds the needed
  details for building a SEED file including names
  of RESP files and blockette field values
• Easily used in scripts, good for batch creation
  of dataless SEED, complimentary to PDCC at this
  point
• Good for templating (common components defined
  once)
• Java, runs anywhere a JVM is available
• Available from http//www.isti.com/sid/shape/

3
SHAPE HAT Examples

• SHAPE Header Assembly Template examples

Field substitution
Very simple example
4
Portable SEED File Reading

• Jrdseed - Java port of the IRIS-DMCs rdseed
• Reads full SEED, dataless SEED and
  Mini-SEEDdataless
• Writes SEED, SAC, AH, CSS, SEGY, SEED RESP
• Time-window and other output selection possible
• Runs anywhere a JVM is available
• Based on generic JavaSeed classes available
  separately
• Not as complete as rdseed yet

5
libmseed - Mini-SEED Library

• Allows reading and writing of Mini-SEED records
• Written in C
• Supports all structures of SEED 2.4 with a few
  minor caveats (blockette 2000 and blockette 405)
• Supports all valid record lengths and big or
  little endian
• Supports ASCII, int-16, int-32, float-32,
  float-64, Steim-1 and Steim-2 encoding formats
  for reading and writing supports SRO/ASRO,
  DWWSSN and GEOSCOPE encoding formats read-only
• Manages arbitrarily long continuous trace
  segments and groups of continuous trace segments
  composed, for example, of many Mini-SEED records
• Tested on Solaris, Linux, Mac OSX and MS-Windows
• Available from http//www.iris.edu/pub/programs/

6
Example libmseed programs

• msi - Mini-SEED Inspector
• Parse and print useful information about
  Mini-SEED in one or many files. Including
  continuous segment construction, data sample
  printing, etc.
• msstat - Calculate minimum, maximum, arithmetic
  mean, standard deviation and RMS for Mini-SEED in
  one or many files.
• msrouter - Sort Mini-SEED records based on one or
  many format details (network, station, location,
  start time, sample rate, quality, etc.), for
  example s-c.mseed
• PQLII/PQLX - Data visualization/analysis program
  using libmseed.

7
Example converters

• seisan2mseed - SeisAn to Mini-SEED converter
• mars2mseed - MARS 88/lite to Mini-SEED converter
• gse2mseed - GSE 2.0/2.1 or IMS 1.0 to Mini-SEED
  converter, supports both INT and CM6 data
  encoding
• sac2mseed - SAC to Mini-SEED converter
• mseed2sac - Mini-SEED converter to SAC converter
• All run on Linux, Solaris, Mac OSX and MS-Windows
• Available from http//www.iris.edu/pub/programs/c
  onverters/
• Many other converters are available at the
  IRIS-DMC, IRIS-PASSCAL, ORFEUS, etc.

8
PQLII/PQLX Software

• The evolution of the PASSCAL Quick Look software
  for data viewing and analysis
• Key new features
• - Data display organized as continuous time
  series (by channel), large data sets
• - User-defined filters
• - Integrate and differentiate time series
• - Remove mean from trace
• - Read "RESP" format metadata
• - PDF plots
• Coming soon
• - Compute cross-correlation coefficient between
  selected traces
• - PSD plots for selected data
• - Remove instrument response
• - Event-orient analysis predicted arrivals,
  alignment, sorting
• PQLII http//www.passcal.nmt.edu/software/softwar
  e.html
• PQLX http//geohazards.cr.usgs.gov/staffweb/mcnam
  ara/Software/PQLX.html

9
Real-time Data Exchange

• A number of open-source and commercial data
  exchange systems exist, the bridges between them
  are illustrated below.

? Earthworm SeedLink NRTS LISS Antelope NAQS Scream!
Earthworm Yes Yes Yes
SeedLink Yes Possible Yes
NRTS Yes Yes
LISS Yes Yes Yes
Antelope Yes Yes
NAQS Yes Yes
Scream! Yes Yes
10
IRIS-DMC Contact Information

• Administration, cooperative agreements, etc.
• Tim Ahern, Program Manager, Data Management
  System tim_at_iris.washington.edu
• Operations submitting and/or requesting data and
  metadata
• Rick Benson, Director of Operations
• rick_at_iris.washington.edu
• Software details
• Robert Casey, Director of Software engineering
  rob_at_iris.washington.edu
• Quality control and related bits
• Chad Trabant, USArray Lead Data Control Analyst
  chad_at_iris.washington.edu