HTB data collection

1
HTB data collection

• Mesoscale Atmospheric Network Workshop
• University of Helsinki, 12 February 2007
• Heikki Turtiainen

2
Developments in observation network communications
conventional data collection system
data transmission to database
sensor bus
sensor 1
two-way data connection to database / network
management system - always on
TCP/IP communications unit (with data buffer)
GPRS, ADSL, WLAN, WiMax...
sensor n
3
Helsinki Testbed data collection
Surface observations
CO2
Ceilometers
ADSL
FMI APN
GSM/GPRS
IP (VPN)
Mobile observation platforms
ADSL
LAN
Soundings
Wind Profiler
GPS
4
Data collection interface to CDW
Surface obs, soundings, WP
FMML - XML schema
SOA interface
TestbedMetMan
IP
CDW
IP
http
IP
CL31
Existing FMI data streams
5
Testbed data collection application platforms

• Surface observation stations
• Aplicom 12 GSM engine with Java (J2Me)
  environment
• Network control interface adapter for various
  observation equipment
• TCP/IP based communications middleware for
  transporting data over GSM/GPRS network to / from
  MetMan and other network management systems
• Same software (with some platform dependent
  libraries) can be run for example in MetMan PC to
  provide similar interface for directly connected
  devices, ex. ceilometers with DXE 421 com server.
• Soundings, Wind Profiler
• Microsoft Windows based measurement and data
  processing applications with native IP
  connectivity
• Utilize the same communications middleware than
  J2Me application

6
Data collection application platforms contd.

• Vaisala MetMan
• Vaisala Solutions product for observation data
  management
• Microsoft Windows operating environment
• Collecting the data from observation stations
• Data conversion to FMML and html posting to
  central data warehouse

7
HTB data flow - original architecture
8
HTB data flow - current architecture (temporary)