Eulogy for our dear friend

1
Eulogy for our dear friend

• The Data Collection Center

2
The Data Collection Center, DCC

• 1997 2001
• She lived her life as if a candle, burning at
  both ends

3
Her humble beginnings

• She and I both were born in NC, she in a computer
  room at MCNC
• EPA New England (Region 1) raised her in her
  infancy, teaching her to walk, then quickly to
  run
• EPA-RTP adopted her and saw her through her
  troublesome teenage years
• At EPA, she grew into a mature, and some might
  say, beautiful, data collection system

4
Significant moments in her journey

• March 1998 EPA files papers to adopt DCC from
  her childhood home, New England.
• May 1998 DCC debuts for ozone season in her
  new hometown of Research Triangle Park, NC.
• May 1998 January 2000 DCC enters what has
  come to be known as her renaissance period, an
  almost 2 year run of nearly flawless performance.
• February 2000 EPAs firewall threatens to cut
  off her very lifeblood, but she prevails after
  EPA develops the famous mirror. However, her
  will to fight is damaged in the encounter.

5
More significant moments

• April 2000 EPA begins discussing a new DCC with
  Sonoma Technologies. Despite facing her imminent
  demise, DCC continues to valiantly process data.
• June 2001 EPA staff travel to Petaluma, CA to
  preview the redesigned DCC, christening it the
  Data Management Center (DMC)
• October 30, 2001 DCC ends what will be her
  final ozone season, processing her last OBS file.

6
DCC is Survived By. . .

• Her children
• MapGen a quirky young mapping program,
  responsible for the ozone movies
• The Forecast System about to be redesigned by
  Sonoma
• Her Parents
• EPA Region I, MCNC, et al

7
Warning! Violent Content

• The following video contains subject matter that
  may prove disturbing to IT professionals. Viewer
  discretion is advised. This video is rated CV
  for Computer Violence.

8
Her shocking last day, caught on tape
9
So many memories. . .

• Poring through OBS files
• Double checking her QA routine, but always
  finding out she was right
• After the firewall, trying to satisfy her
  insatiable appetite for real-time data.
• Updating her quirky station location file
• Trying to understand her TCL/TK scripts, but
  finally just letting her be herself.

10
But Seriously, Folks
11
Since the last time we met. . .

• Sonoma Technologies completed the DCC redesign
• The new DCC, or DMC, was tested at EPA last
  summer
• Our Lockheed-Martin Task Order was terminated on
  December 12, 2001
• The contract to operate the new DMC was awarded
  to Sonoma on February 1, 2002.

12
The basics of DMC
AirNow Administrative Interface
All yall
MapCon NT Service
FTP server
Oracle DB
13
The Admin Interface, in all its glory
14
The Agency Screen
15
The Site Screen
16
The Site Screen
17
System Monitor Screen
18
System Monitor Screen
19
Airnow Status Website
20
How does this affect you?

• Polling
• Simply change your FTP site
• Polling window has been shattered
• DMC is designed for hourly polling (who cant?)
• No 8AM previous days data poll
• Maps based on data completeness
• Map produced when enough data comes in
• First in, first out rewards early submittal

21
How does this affect you?

• PM-Fine
• DMC can, and has, processed and MAPPED it
• Need QA/QC routines, real time surrogates

22
The future is bright

• The power of a database, combined with the
  accessibility of the web, will allow us to
• Let you update your own settings QA/QC
  criteria, monitor locations, etc.
• Let all partners perform advanced queries on the
  database, including real-time data and forecasts
• Quickly and simply process, or reprocess, your
  data

23
EPAs Goal for the DMC
The Maytag Repairman
24
Stop by our Interacts Session

• Today at 330
• Meet Craig Anderson of Sonoma
• John White of EPA
• Me
• Pay your last respects to the DCC