25 th 29 th Jan 2010 SPIRE Pipeline Data Products and Visualization Tools in HIPE (NHSC/IPAC) page 1
List of Topics Overview of SPIRE Pipeline Data Processing and SPIRE Pipeline Data Product Levels Demo on Inspection of SPIRE Data Products in HIPE page 2
SPIRE Observation Sequence A SPIRE observation is divided into Building Blocks: Init PCAL flash Move BSM FTS Scans Move BSM FTS scans Calib. End Initialization of instrument Calibrator flashes to track detector responsivity Science data Reconfigure instrument, SMEC back to HOME etc. Each basic instrument operation is contained in a separate building block (with a unique BBID#). Pipeline processing is per building block (to Level 1). page 3
SPIRE Pipelines Common Part RAW Telemetry Level-0 Product (Raw Re-formatted digital telemetry) Level-0.5 Product [Detector timeline in V, house keeping (HK) time line, BSM timeline, etc.] Calibration Files: Conversion to Engineering Units (ADU Volts, Kelvins,...) Photometer or Spectrometer Pipeline AOT dependent page 4
SPIRE Pipelines Photometer Level-0.5 Product Calibration 1 (AOT independent) page 5
SPIRE Pipelines Spectrometer Level-0.5 Product Calibrate Detector Timelines Create Interferogram Calibrate Interferogram Fourier Transform Level 1 products: average spectra raw interferogram Calibrate Spectra (Volts Jy) Mapping -> Spectral Cubes Level 2 product (to be implemented): spectral cubes page 6
What Data do You Get? When your observation is done, you download the data from Herschel Science Archive (HSA) to a local pool" on your computer containing one Observation Context: auxiliary product (e.g., pointing, Siam, etc.) browse image product browse product calibration products level 0 (raw) data level 0.5 level 1 level 2 (for photometer only for now) log quality page 7
Photometer Observation Context These are all contexts! Auxiliary data: Pointing, siam, uplink info, etc Browse image product: Simple representation of final map Browse product: Another browse product Calibration data: Products used for processing Level 0: Raw unprocessed reformatted data Level 0.5: Data converted to engineering units Level 1: Calibrated flux timelines Level 2: Highest proc., images, PSF fit results Reduction Log: Data reduction history Quality control data: Tells whether things went O.K. page 8
Spectrometer Observation Context Auxiliary data: Pointing, siam Browse image product: Simple representation of final map Browse product: Another browse product Calibration data: Products used for processing Level 0: Raw unprocessed reformatted data Level 0.5: Data converted to engineering units Level 1: Spectra in Jy + raw interferogram Level 2: Spectral cube (not available yet) Reduction Log: Data reduction history Quality control data: Tells whether things went O.K. page 9
Data Visualization in HIPE Display/plotting/table tools are available in HIPE for visual inspection or quick look of SPIRE data products: Level 2 -- Maps or point-source fluxes (photometer only for now) Level 1 -- Flux time lines (for photometer) or averaged spectra & raw interferograms (for spectrometer) Level 0.5 Various detector time lines (for both photometer & spectrometer). page 10
List of Topics Overview of SPIRE Pipeline Data Processing and SPIRE Pipeline Data Product Levels Demo on Inspection of SPIRE Data Products in HIPE We ll load a photometer scan or spectrometer observation context into HIPE using the following scrip: https://nhscsci.ipac.caltech.edu/workshop/jan_2010_nhscwksprepository/ Jan_2010_NHSCwkspRepository/Data_Scripts/SPIRE_SPEC/SCRIPTS/ SPIRE_dataProducts_get_data_jan2010.py page 11
Load an Observation Context into HIPE Appears in "Variables" window page 12
Level 2: Phot. Scan map in Std Image Viewer double click analysis page 13
Level 2: Photometer Scan Map Elements PSW map Image Dataset Metadata page 14
Level 2: Photometer -- Point Source Photometry Table Dataset Metadata 7 point jiggle (point source) Datasets single step ~ 6 Flux differences for each band from PSF fit page 15
Level 1: Spectrometer -- Plot Channel Spectrum page 16
Level 1: Spectrometer -- Plot all Channel Spectra page 17
Level 0.5: Spectrometer Detector Time Lines page 18