SPIRE Pipeline Data Products and Visualization Tools in HIPE
|
|
|
- Jasmine Cobb
- 9 years ago
- Views:
Transcription
1 25 th 29 th Jan 2010 SPIRE Pipeline Data Products and Visualization Tools in HIPE (NHSC/IPAC) page 1
2 List of Topics Overview of SPIRE Pipeline Data Processing and SPIRE Pipeline Data Product Levels Demo on Inspection of SPIRE Data Products in HIPE page 2
3 SPIRE Observation Sequence A SPIRE observation is divided into Building Blocks: Init PCAL flash Move BSM FTS Scans Move BSM FTS scans Calib. End Initialization of instrument Calibrator flashes to track detector responsivity Science data Reconfigure instrument, SMEC back to HOME etc. Each basic instrument operation is contained in a separate building block (with a unique BBID#). Pipeline processing is per building block (to Level 1). page 3
4 SPIRE Pipelines Common Part RAW Telemetry Level-0 Product (Raw Re-formatted digital telemetry) Level-0.5 Product [Detector timeline in V, house keeping (HK) time line, BSM timeline, etc.] Calibration Files: Conversion to Engineering Units (ADU Volts, Kelvins,...) Photometer or Spectrometer Pipeline AOT dependent page 4
5 SPIRE Pipelines Photometer Level-0.5 Product Calibration 1 (AOT independent) page 5
6 SPIRE Pipelines Spectrometer Level-0.5 Product Calibrate Detector Timelines Create Interferogram Calibrate Interferogram Fourier Transform Level 1 products: average spectra raw interferogram Calibrate Spectra (Volts Jy) Mapping -> Spectral Cubes Level 2 product (to be implemented): spectral cubes page 6
7 What Data do You Get? When your observation is done, you download the data from Herschel Science Archive (HSA) to a local pool" on your computer containing one Observation Context: auxiliary product (e.g., pointing, Siam, etc.) browse image product browse product calibration products level 0 (raw) data level 0.5 level 1 level 2 (for photometer only for now) log quality page 7
8 Photometer Observation Context These are all contexts! Auxiliary data: Pointing, siam, uplink info, etc Browse image product: Simple representation of final map Browse product: Another browse product Calibration data: Products used for processing Level 0: Raw unprocessed reformatted data Level 0.5: Data converted to engineering units Level 1: Calibrated flux timelines Level 2: Highest proc., images, PSF fit results Reduction Log: Data reduction history Quality control data: Tells whether things went O.K. page 8
9 Spectrometer Observation Context Auxiliary data: Pointing, siam Browse image product: Simple representation of final map Browse product: Another browse product Calibration data: Products used for processing Level 0: Raw unprocessed reformatted data Level 0.5: Data converted to engineering units Level 1: Spectra in Jy + raw interferogram Level 2: Spectral cube (not available yet) Reduction Log: Data reduction history Quality control data: Tells whether things went O.K. page 9
10 Data Visualization in HIPE Display/plotting/table tools are available in HIPE for visual inspection or quick look of SPIRE data products: Level 2 -- Maps or point-source fluxes (photometer only for now) Level 1 -- Flux time lines (for photometer) or averaged spectra & raw interferograms (for spectrometer) Level 0.5 Various detector time lines (for both photometer & spectrometer). page 10
11 List of Topics Overview of SPIRE Pipeline Data Processing and SPIRE Pipeline Data Product Levels Demo on Inspection of SPIRE Data Products in HIPE We ll load a photometer scan or spectrometer observation context into HIPE using the following scrip: Jan_2010_NHSCwkspRepository/Data_Scripts/SPIRE_SPEC/SCRIPTS/ SPIRE_dataProducts_get_data_jan2010.py page 11
12 Load an Observation Context into HIPE Appears in "Variables" window page 12
13 Level 2: Phot. Scan map in Std Image Viewer double click analysis page 13
14 Level 2: Photometer Scan Map Elements PSW map Image Dataset Metadata page 14
15 Level 2: Photometer -- Point Source Photometry Table Dataset Metadata 7 point jiggle (point source) Datasets single step ~ 6 Flux differences for each band from PSF fit page 15
16 Level 1: Spectrometer -- Plot Channel Spectrum page 16
17 Level 1: Spectrometer -- Plot all Channel Spectra page 17
18 Level 0.5: Spectrometer Detector Time Lines page 18
The PACS Software System. (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1.
The PACS Software System (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1.0 PICC-ME-DS-003 1. Introduction The PCSS, the PACS ICC Software System, is the
Visualization and Analysis of Spectral Data Cubes an Hipe toolbox
Visualization and Analysis of Spectral Data Cubes an Hipe toolbox Madrid 4-5 December 2008 Alain Gueguen MPE-Garching [email protected] 1 Goal of the tool Display and analysis toolbox for the spectral
Function Guide for the Fourier Transformation Package SPIRE-UOL-DOC-002496
Function Guide for the Fourier Transformation Package SPIRE-UOL-DOC-002496 Prepared by: Peter Davis (University of Lethbridge) [email protected] Andres Rebolledo (University of Lethbridge) [email protected]
SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center)
SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center) SITools 2 SITools2 is a CNES generic tool performed by a joint effort between CNES and scienefic
An Introduction to the MTG-IRS Mission
An Introduction to the MTG-IRS Mission Stefano Gigli, EUMETSAT IRS-NWC Workshop, Eumetsat HQ, 25-0713 Summary 1. Products and Performance 2. Design Overview 3. L1 Data Organisation 2 Part 1 1. Products
Cell Phone Vibration Experiment
Objective Cell Phone Vibration Experiment Most cell phones are designed to vibrate. But at what frequency do they vibrate? With an accelerometer, data acquisition and signal analysis the vibration frequency
Shimadzu UV-1700 UV/Vis Spectrometer Updated July 13, 2010
Shimadzu UV-1700 UV/Vis Spectrometer Updated July 13, 2010 Instrument instructions can be found at: http://academic.bowdoin.edu/chemistry/resources/instructions.shtml If you have any problems with the
Assessments of LEDs IESNA LM-79, LM-80 & LM-82
Assessments of LEDs IESNA LM-79, LM-80 & LM-82 by Rolf S. Bergman Consultant 4/30/2012 1 ALA M Outline of Presentation Background Information EPA Energy Star specifications NVLAP Accreditation IESNA Technical
Database Searching Tutorial/Exercises Jimmy Eng
Database Searching Tutorial/Exercises Jimmy Eng Use the PETUNIA interface to run a search and generate a pepxml file that is analyzed through the PepXML Viewer. This tutorial will walk you through the
Shimadzu UV-VIS User s Guide
Shimadzu UV-VIS User s Guide 1) Push the F4 button on the UV-VIS instrument keypad. This will enable PC control. Push the F4 Button 2) Log into the UV-VIS software with your username and password. 3) After
How To Use Arxiver
arxiver Dealing with the big data of scientific literature Vanessa Moss and Aidan Hotan 1 Why is the literature important? Science is fundamentally built upon previous work - astrophysics is no exception
Learning Objectives:
Proteomics Methodology for LC-MS/MS Data Analysis Methodology for LC-MS/MS Data Analysis Peptide mass spectrum data of individual protein obtained from LC-MS/MS has to be analyzed for identification of
Using WINK to create custom animated tutorials
Using WINK to create custom animated tutorials A great way for students and teachers alike to learn how to use new software is to see it demonstrated and to reinforce the lesson by reviewing the demonstration.
FTIR Instrumentation
FTIR Instrumentation Adopted from the FTIR lab instruction by H.-N. Hsieh, New Jersey Institute of Technology: http://www-ec.njit.edu/~hsieh/ene669/ftir.html 1. IR Instrumentation Two types of instrumentation
Tutorial 9: SWATH data analysis in Skyline
Tutorial 9: SWATH data analysis in Skyline In this tutorial we will learn how to perform targeted post-acquisition analysis for protein identification and quantitation using a data-independent dataset
GroupWise Archive Migration Instructions
GroupWise Archive Migration Instructions Migration Machine Setup 1. Install GroupWise Client 2. Copy GroupWise archives you wish to migrate locally or to a network location you have access to from the
Hybrid OLAP, An Introduction
Hybrid OLAP, An Introduction Richard Doherty SAS Institute European HQ Agenda Hybrid OLAP overview Building your data model Architectural decisions Metadata creation Report definition Hybrid OLAP overview
Accessing the Online Meeting Room (Blackboard Collaborate)
Step 1: Check your System and Install Required Software NOTE: Make sure you are on the computer you will be using to access the online meeting room AND that you are using the internet browser (ie: firefox,
Reduced data products in the ESO Phase 3 archive (Status: 15 May 2015)
Reduced data products in the ESO Phase 3 archive (Status: 15 May 2015) The ESO Phase 3 archive provides access to reduced and calibrated data products. All those data are stored in standard formats. The
Introduction to ACD version 12 NMR Software
ACD v12 guidebook 2011 pg 1 Introduction to ACD version 12 NMR Software The ACD NMR software provides a complete set of software tools for processing and visualisation of 1D and 2D NMR data, for spectrum
This feature allows you to convert a collection of PDFs into EndNote references using the Digital Object Identifier (DOI).
Add and organise PDF files in your Endnote Library Contents Import PDF files to create new references Import a folder of PDF files to create new references Organise folders of PDFs into Groups during PDF
Labs in Bologna & Potenza Menzel. Lab 3 Interrogating AIRS Data and Exploring Spectral Properties of Clouds and Moisture
Labs in Bologna & Potenza Menzel Lab 3 Interrogating AIRS Data and Exploring Spectral Properties of Clouds and Moisture Figure 1: High resolution atmospheric absorption spectrum and comparative blackbody
WeatherView TM User s Installation Manual
NOTE: WeatherView should NOT be installed together with any softwares that uses C-MAP charts! Dear WeatherView TM user! This is an illustrated user s guide. It is easy to use and it provides quick references
Background Information
1 Gas Chromatography/Mass Spectroscopy (GC/MS/MS) Background Information Instructions for the Operation of the Varian CP-3800 Gas Chromatograph/ Varian Saturn 2200 GC/MS/MS See the Cary Eclipse Software
2. A typical business process
I. Basic Concepts on ERP 1. Enterprise resource planning (ERP) Enterprise resource planning (ERP) is the planning of how business resources (materials, employees, customers etc.) are acquired and moved
Seagate File Recovery for MAC. Seagate Recovery Services
Seagate File Recovery for MAC Seagate Recovery Services The Seagate File Recovery for Mac support includes:: - these specific error messages: broken file name; file already exists; bad sectors option;
How To Process Data From A Casu.Com Computer System
CASU Processing: Overview and Updates for the VVV Survey Nicholas Walton Eduardo Gonalez-Solares, Simon Hodgkin, Mike Irwin (Institute of Astronomy) Pipeline Processing Summary Data organization (check
Getting Started with Tableau Server 6.1
Getting Started with Tableau Server 6.1 Welcome to Tableau Server. This guide will walk you through the basic steps to install and configure Tableau Server. Then follow along using sample data and users
RECON-4 Portable Multi-gas Detector Software Manual
ENMET Corporation PO Box 979 Ann Arbor, MI 48106-0979 www.enmet.com RECON-4 Portable Multi-gas Detector Software Manual Version:HW091211001 Manual Part Number 80006-034 January, 2011 Brief Introduction
WHAT S NEW IN MS EXCEL 2013
Contents Excel... 1 Filling empty cells using Flash Fill... 1 Filtering records using a Timeline... 2 Previewing with Quick Analysis... 4 Using Chart Advisor recommendations... 5 Finding errors and issues
AERONET Web Data Access and Relational Database
ÓPTICA PURA Y APLICADA Vol. 37, núm. 3, - 2004 AERONET Web Data Access and Relational Database David Giles (1,2) 1. 1 Science Systems and Applications, Inc. (SSAI), Lanham, MD, USA 2. 2 NASA Goddard Space
Introduction. What Can an Offline Desktop Processing Tool Provide for a Chemist?
Increasing Chemist Productivity in an Open-Access Environment Ryan Sasaki, Graham A. McGibbon, Steve Hayward Featuring ACD/Spectrus Processor and Aldrich Library for ACD/Labs Advanced Chemistry Development,
Herschel PACS Test Procedure STM PACS-KT-PR-011 Issue: 1 Revision: -
CASE GmbH Westendstrasse 125 80339 München Herschel PACS Test Procedure STM 1 Revision: - i Document Approval Sheet Title: Herschel PACS Subtitle: Test Procedure STM Doc. No: 1 Revision: - Prepared:......
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio
Bulk Downloader. Call Recording: Bulk Downloader
Call Recording: Bulk Downloader Contents Introduction... 3 Getting Started... 3 Configuration... 4 Create New Job... 6 Running Jobs... 7 Job Log... 7 Scheduled Jobs... 8 Recent Runs... 9 Storage Device
NMR Processing on PCs outside the NMR laboratory
NMR Processing on PCs outside the NMR laboratory There is now a server that stores the NMR data from all spectrometers and can be accessed from PCs anywhere. For processing, we have a campus license for
Supervised Classification workflow in ENVI 4.8 using WorldView-2 imagery
Supervised Classification workflow in ENVI 4.8 using WorldView-2 imagery WorldView-2 is the first commercial high-resolution satellite to provide eight spectral sensors in the visible to near-infrared
SCORE Data Display and Analysis Software
SCORE Data Display and Analysis Software S. Giordano Rapporto nr.116 22/01/2009 SCORE DATA DISPLAY and ANALYSIS SOFTWARE SCORE Project prepared by S. Giordano authors S. Giordano reference issue 1.0 revision
COMPENSATION MIT Flow Cytometry Core Facility
COMPENSATION MIT Flow Cytometry Core Facility Why do we need compensation? 1) Because the long emission spectrum tail of dyes causes overlap like with the fluorophores FITC and PE. 2) For sensitivity reasons,
Setting up a Quantitative Analysis MS ChemStation
Setting up a Quantitative Analysis MS ChemStation Getting Ready 1. Use the tutorial section "Quant Reports" on the MSD Reference Collection CD-ROM that came with your ChemStation software. 2. Know what
Getting Started With SPSS
Getting Started With SPSS To investigate the research questions posed in each section of this site, we ll be using SPSS, an IBM computer software package specifically designed for use in the social sciences.
For Mac User Directions, see page 5
Windows Vista, Windows 7, and Windows XP with Service Pack 3 Remote Desktop Access For Mac User Directions, see page 5 This instruction allows district staff and students to access the Commack UFSD network
7-zip Encryption Instructions
1. In a simple text editor (Notepad, Notepad++, jedit, etc.) create a text file (SendToTAP) that contains your sensitive data information. [Note the location where the file is stored on your computer.]
Replacing a MealTime Point of Sale Computer
Meal service solutions that work! Replacing a MealTime Point of Sale Computer Overview Use these instructions only when you are replacing the MealTime Point of Sale computer that hosts the MealTime database
WFC3 Image Calibration and Reduction Software
The 2010 STScI Calibration Workshop Space Telescope Science Institute, 2010 Susana Deustua and Cristina Oliveira, eds. WFC3 Image Calibration and Reduction Software Howard A. Bushouse Space Telescope Science
CLAS12 Offline Software Tools. G.Gavalian (Jlab)
CLAS12 Offline Software Tools G.Gavalian (Jlab) Overview Data formats I/O gemc data reader raw data reader detector hit decoder ET ring data reader Geometry Package implementation of all baseline detectors
USER MANUAL Detcon Log File Viewer
USER MANUAL Detcon Log File Viewer DETCON, Inc. 4055 Technology Forest Blvd., The Woodlands, Texas 77381 Ph.281.367.4100 / Fax 281.298.2868 www.detcon.com January 29, 2013 Document #4482 Revision 1.00
GX/GP Firmware Upgrade Procedure
GX/GP Firmware Upgrade Procedure This document describes the procedure for upgrading the GX/GP firmware. Please read this document before proceeding with the upgrade. Applicable Products GX10/GX20/GP10/GP20
How to configure an Advanced Expert Probe as NetFlow Collector
created by: Rainer Bemsel Version 1.0 Dated: Jan/31/2012 There are two types of NetFlow collectors in Observer. In most cases, it will likely be the NetFlow Trending collector being configured. The Trending
Capturing Material. Section 3
Section 3 Capturing Material Duration: 60 minutes Capturing material is the process of creating media files from video or audio source material. This section describes how to capture material from different
Outlook 2010 and 2013
Outlook 2010 and 2013 Email Setup Account Types 2 Exchange account 3 POP account 5 Maintenance Setting up an Email signature 7 Checking Email Storage 8 Archiving Emails 9 Sharing Calendars Giving Access
TopSpin Users Guide W. Dale Treleaven, Ph.D. Louisiana State University
TopSpin Users Guide W. Dale Treleaven, Ph.D. Louisiana State University Starting TopSpin Method (1): Click on: the TopSpin Icon on the desktop Method (2): Open a Linux Shell/Terminal Window Type: topspin
Using INZight for Time series analysis. A step-by-step guide.
Using INZight for Time series analysis. A step-by-step guide. inzight can be downloaded from http://www.stat.auckland.ac.nz/~wild/inzight/index.html Step 1 Click on START_iNZightVIT.bat. Step 2 Click on
How To Install the Virtual Learning App
Table of Contents Installation Instructions... 2 MAC: Using Firefox... 2 MAC: Using Chrome... 6 Disabling PepperFlash... 9 MAC: Using Safari Unsafe Mode We Can t Control So Use Firefox or Chrome... 11
Print Audit 6 - How to Move Print Audit 6 and a SQL Server 2005 Express Database to a New Server
Print Audit 6 - How to Move Print Audit 6 and a SQL Server 2005 Express Database to a New Server Overview This document includes the steps to move Print Audit 6 and a SQL Server 2005 Express database to
Beginner s Matlab Tutorial
Christopher Lum [email protected] Introduction Beginner s Matlab Tutorial This document is designed to act as a tutorial for an individual who has had no prior experience with Matlab. For any questions
Lab #8: Introduction to ENVI (Environment for Visualizing Images) Image Processing
Lab #8: Introduction to ENVI (Environment for Visualizing Images) Image Processing ASSIGNMENT: Display each band of a satellite image as a monochrome image and combine three bands into a color image, and
Raptor-CAN User Manual
CONTROL SYSTEM SOLUTIONS Raptor-CAN User Manual Last Updated: 3/31/2015 Contents 1. Introduction...3 2. Installation...4 2.1 Dongle license...6 2.2 Node-locked license...6 3. Using Raptor-CAN...7 3.1 CAN
EViews supports online access to EIA data via the EIA web server as well as offline access to data downloaded in the EIA Bulk File format.
EIA Database Overview The EIA database is a large collection of energy and related economic data made available by the U.S. Energy Information Administration as a free public service. EViews supports online
SR2000 FREQUENCY MONITOR
SR2000 FREQUENCY MONITOR THE FFT SEARCH FUNCTION IN DETAILS FFT Search is a signal search using FFT (Fast Fourier Transform) technology. The FFT search function first appeared with the SR2000 Frequency
AST 4723 Lab 3: Data Archives and Image Viewers
AST 4723 Lab 3: Data Archives and Image Viewers Objective: The purpose of the lab this week is for you to learn how to acquire images from online archives, display images using a standard image viewer
Tools for Viewing and Quality Checking ARM Data
Tools for Viewing and Quality Checking ARM Data S. Bottone and S. Moore Mission Research Corporation Santa Barbara, California Introduction Mission Research Corporation (MRC) is developing software tools
Technical Note. Roche Applied Science. No. LC 19/2004. Color Compensation
Roche Applied Science Technical Note No. LC 19/2004 Purpose of this Note Color The LightCycler System is able to simultaneously detect and analyze more than one color in each capillary. Due to overlap
Secunia CSI integrated with WSUS (SCCM)
Secunia CSI integrated with WSUS (SCCM) A how to documentation 1 Requirement: 1.1 CSI GUI/console requirements The CSI Console must be launched by a user with Domain Admin privileges https://secunia.com
OSKAR 2.4.0 Example Revision: 8
OSKAR Example Version history: Revision Date Modification 1 2012-04-24 Creation 2 2012-05-15 Updated figures and text for correct polarisation order. 3 2012-06-13 Updated figures and text to reflect changes
Introduction to Fourier Transform Infrared Spectrometry
Introduction to Fourier Transform Infrared Spectrometry What is FT-IR? I N T R O D U C T I O N FT-IR stands for Fourier Transform InfraRed, the preferred method of infrared spectroscopy. In infrared spectroscopy,
Informatics for Integrating Biology & the Bedside. i2b2 Workbench Developer s Guide. Document Version: 1.0 i2b2 Software Release: 1.3.
Informatics for Integrating Biology & the Bedside i2b2 Workbench Developer s Guide Document Version: 1.0 i2b2 Software Release: 1.3.2 Table of Contents About this Guide iii Prerequisites 1 Downloads 1
Structural Health Monitoring Tools (SHMTools)
Structural Health Monitoring Tools (SHMTools) Getting Started LANL/UCSD Engineering Institute LA-CC-14-046 c Copyright 2014, Los Alamos National Security, LLC All rights reserved. May 30, 2014 Contents
Create a PDF File. Tip. In this lesson, you will learn how to:
Create a PDF File Now that you ve seen what an ETD looks like and how to browse the contents, it s time to learn how to convert your own thesis or dissertation into a PDF file. There are several different
Tektronix RSA306 USB Spectrum Analyzer
Tektronix RSA306 USB Spectrum Analyzer Simple Demos The Demo of the RSA306 is easy. Even you do not have signal generators, devices under test, or demo boards, using the whip antenna provided in box, you
Troubleshooting steps for Oracle Financials and Markview. Jan 2015
Troubleshooting steps for Oracle Financials and Markview Jan 2015 RU-VPN... 3 RECOMMENDED BROWSERS AND BROWSER SETTINGS... 4 Mozilla Firefox... 4 Internet Explorer... 5 CHROME... 7 Verify JAVA Version...
Review and Approve Results in Empower Data, Meta Data and Audit Trails
Review and Approve Results in Empower Data, Meta Data and Audit Trails 2013 Waters Corporation 1 What is an audit trail? Systematic story of the data from creation, through interpretation and final assessment
Kepler Data and Tools. Kepler Science Conference II November 5, 2013
Kepler Data and Tools Kepler Science Conference II November 5, 2013 Agenda Current and legacy data products (S. Thompson) Kepler Science Center tools (M. Still) MAST Kepler Archive (S. Fleming) NASA Exoplanet
Windows Movie Maker 2012
Windows Movie Maker 2012 Open Windows Movie Maker A shortcut for Movie Maker should be on the desktop, but if it is not, you can search for the program by touching the right edge of the screen and swiping
1. Central Monitoring System Software
1. Central Monitoring System Software 1-1. General information CMS program is an application with which users not only watch and control remote DVRs, but also receive video/audio data or alarm signals
Centurion C4 Transfer Guide using C4 File Transfer Utility
Centurion C4 Transfer Guide using C4 File Transfer Utility 1010536 02 23 11 Section 50 1.0 Background: 1.1 A valid configuration is required for the Centurion system. Configuration files are downloaded
Microsoft Exchange 2007
Microsoft Exchange 2007 On September 14, 2009 the College will convert its employee email system to Exchange 2007. This affects the email that you send and receive via your bucks.edu account. This conversion
Microsoft Windows Macros and Visual Basic Signing User Guide
Entrust Certificate Services Microsoft Windows Macros and Visual Basic Signing User Guide Date of Issue: March 2016 Document issue: 1.0 Microsoft Windows Macros and Visual Basic Signing 11.8 User Guide
4 Other useful features on the course web page. 5 Accessing SAS
1 Using SAS outside of ITCs Statistical Methods and Computing, 22S:30/105 Instructor: Cowles Lab 1 Jan 31, 2014 You can access SAS from off campus by using the ITC Virtual Desktop Go to https://virtualdesktopuiowaedu
DropSend Getting Started Guide
DropSend Getting Started Guide DropSend Ltd. 2012 Step 1: How to send a file without registration If you want to quickly send a large file, you can do it from the homepage in just a couple of clicks. Here
