Yohkoh Galileo: To Infinity and Beyond

1
Yohkoh Galileo
To Infinity! and Beyond!

• Lockheed Martins Role
• in the Yohkoh Galileo Project
• 10 July 2002

2
Introduction

• Purpose of the Yohkoh Galileo Project
• The Yohkoh Galileo project will complete
  higher-level data preparations and will archive
  the required calibration and technical
  information necessary for the extended use of the
  archive by scientists now and in the future.

3
Lockheed Martin Tasks

• Production of Level 0 data products
• Retains original Yohkoh (Mons Morrison) format
• Final delivery to SDAC (GSFC)
• Publication of Level 1 data products
• Publication of Level 2 data products
• Publication of additional (Level 2) products
• Production of final calibration data products

4
Definition of Data Products

• Level 0 Data (original format)
• Level 1 Data
• FITS format - Maintain compatibility with latest
  FITS header definitions
• FFI set - Uncompressed, despiked, dark
  subtracted, leak subtracted (but not spatially
  coaligned)
• PFI (OR) set - Uncompressed, despiked, dark
  subtracted, leak subtracted and assembled

5
Definition of Data Products (continued)

• Level 2 Data (SXT)
• Desaturated (composited)
• SSC (SXT Science Composite set) Uncompressed
• SSS (Full disk movie version)
• Replaces SFDs
• Logarithmic compression and intensity normalized
• Coaligned

6
Definition of Data Products (continued)

• Level 2 Data (SXT)
• Descattering of SSC and SSS sets
• Synoptic maps, coronal hole maps, active region
  catalog, flare catalog
• Mission light curve data

7
Notes on FITS Definition

• Final generation of FITS format
• Format to be compatible with all standard fits
  headers available at that time (e.g., include
  observer position information)
• Header content under review
• Separate revision control for format and content
• Files will contain only one solar image per file

8
Notes on FITS Content

• Content definition of the SXT FITS header
• Will be led by Freeland with input from others.
• Expect first draft of header to be released
  August 1.
• Comments will be solicited. We strongly urge the
  other instrument teams to adopt a similar
  standard.
• Expect the final version of the header to be
  released October 1.

9
Notes on FITS Definition

• Open issues concerning FITS definition
• Make use of binary extensions features or avoid?
• How to include history information? (Probably
  standardize a format using the comment field)
• How to handle uncertainties
• Separate archives or files (provides format
  longevity)?
• or
• Two images per file (minimizes overhead)?

10
Notes on FITS Definition

• Data format and content should be compatible with
  VSO/EGSO standards
• SXT calibration data and certain generic data
  (e.g., ATT, FEM, etc) will be archived in FITS
  format

11
Status of Level 0 Tasks

• Delivery of reformatted raw data (Level 0) to the
  SDAC
• On schedule for completion by July 31, 2002.

12
Status of Level 1 Tasks

• Leak subtraction software
• This is the major open calibration task.
• Current algorithm (Metcalf/Acton) uses a two step
  correction procedure
• Subtraction of interpolated leak images
• Removal of any residual component that remains
  correlated with the interpolated leak image.

13
Status of Level 1 Tasks

• Leak subtraction algorithms (continued)
• Leak subtraction is handled separately for each
  epoch of the mission (each epoch is defined to
  be the period between two successive SXT entrance
  filter failures)
• Within each epoch there must be a sufficient set
  of valid terminator (leak) images for leak image
  interpolation
• Currently, there are two short (2 month) epoches
  in 1999 for which leak image sampling was
  insufficient to allow leak image interpolation.
  The leak image algorithms for these periods have
  yet to be developed.

14
Status of Level 2 Tasks

• Software is ready
• Major outstanding task is ATT finalization

15
Status of Level 2 Tasks

• Descatter - MSU
• Synoptic map - Slater
• 75 complete expect 100 by 1 Oct 2002
• Catalogs - In progress

16
Status of Calibration Tasks

• Final calibration tasks
• Dark Subtraction algorithms Completed.
• Composite image generation techniques Completed
  (three exposure composites now incorporated).
• SSC/SSS generation pipeline
• In place and in use.
• Currently implementing distributed processing
  (GLOBUS) on ISAS and LMSAL computers.

17
SXT data production pipeline

• Data products beyond level 0 are in some cases
  interdependent. However, some of the calibration
  products (ATT, leak subtraction) are currently
  open-ended. Therefore, it is important to have
  data pipelines set up for regenerating various
  data products multiple times over the course of
  the Galileo project

18
SXT data production pipeline

• We propose to establish a cycling queue for
  each data product (e.g., SSC set) which will run
  automatically as updates to software or
  calibration sets become available
• In this way we can be assured that when the
  project nears completion we will not be caught
  without adequate to complete all data products

19
SXT data production pipeline

• As part of the pipeline, we are devloping a
  GLOBUS system on the ISAS/LMSAL/MSU? Computers,
  to decrease the turn around times for data
  product versions

20
Additional Lockheed tasks

• Update SXT emissivity software to incorporate new
  abundance and ionization data (with application
  to SXT temperature and emission measure
  calculations sxt_teem)
• GOES-12 SXI /SXT cross calibration
• Yohkoh scientific campaign catalog
• Improvement of user interface to SXT data
  (including full mission events access)

21
Additional Lockheed tasks

• Improvement of ATT (spacecraft pointing) database
• SXT uncertainties
• Generate for FFI
• Seek to preserve photon statistics through the
  calibration process
• Radiation Belt Monitor (RBM) Level-1 generation
• Combined SXT/HXT/BCS flare catalog

22
Timeline

• Level 0 complete by 31-Jul-02
• Level 1 ongoing
• Level 2 ongoing
• Level 2 ongoing

23
LMSAL team

• Primary
• S. Freeland, T. Metcalf, N. Nitta, G. Slater
• Supporting
• D. Alexander, M. Aschwanden, F. Friedlaender, J.
  Lemen, P. Shirts
• Transitional
• J. Bartus, H. Hudson, A. Takeda