CASU Data Centre

1
CASU Data Centre

• Jim Lewis
• Cambridge Astronomy Survey Unit
• Institute of Astronomy, Cambridge

2
CASU Data Collection (1)

• Isaac Newton Group of Telescopes
• JKT, INT and WHT
• Over 20 years of raw data ( 20Tb mostly online)
• United Kingdom Infrared Telescope
• Over 10 years of raw data on hard disc ( 1 Tb)
• Anglo-Australian Telescope
• Over 15 years of raw data on hard disc ( 2Tb)

3
CASU Data Collection (2)

• INT Wide Field Survey and IPHAS
• Raw data stored as part of INT archive
• Data processed and put on line as soon as they
  reach CASU (10 Tb images, 600 Gb catalogues)
• WFS used in an Astrogrid federation exercise.
• Ingested into MS SQL-Server with Personal Sky
  Survey
• SkyNode Web service (Szalay, et. al) implemented
  to federate this data with SDSS, 2MASS, FIRST
  (transatlantic)

4
CASU Data Collection (3)

• WFCAM raw data archive.
• Data from roughly end March 2005
• 10 Tb of raw data so far
• Limited release
• Reduced data available through WFAU
• UKIDSS raw data also available through ESO
• VISTA raw data archive
• Reduced data available through ESO and WFAU

5
CASU Data Collection (4)

• Repository for the APM Catalogues
• Serve many other catalogues
• USNO-B, Hipparcos, Tycho, CMT
• The UK mirror for CDS VizieR Service
• Full interface all of over 3700 catalogues.

6
VISTA Data Flow System (1)

• Raw data will come to CASU for pipeline
  processing (all data from WFCAM and VISTA).
• CASU pipeline system is flexible and gives high
  throughput conversion of raw to science products.
• INT WFC (4), ESO WFI (8), AAO WFI (8), ESO NTT
  EMMI (2), KPNO 4m MOSAIC-1 (8), CTIO 4m MOSAIC-2
  (8)
• INT/WHT INGRID (1), INT CIRSI (4), UKIRT UFTI (4)
• The same pipeline system will be used for
  pipeline processing of WFCAM, VST, VISTA and GAIA
  in the future.

7
VISTA Data Flow System (2)

• CASU will stream high quality science products to
  distributed archives (e.g. WFAU and ESO).
• Advance processing can be done either at WFAU
  (using the science archive) or at CASU using the
  archived raw data (possibly using the Astrogrid
  infrastructure).
• Large processed science products can be delivered
  on demand

8
Future Support

• Continued support for all UK ground-based
  optical/IR telescope archives
• Continued support for INT Wide Field Survey and
  IPHAS.
• Planned support for ESO VST image processing
• Processing for all UK led public surveys on VST