The Planck Legacy Archive: current status, contents and future development. Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain

Similar documents
EChO Ground Segment: Overview & Science Operations Assumptions

TDRS / MUST. and. what it might do for you

SGS System Requirements Review

The PACS Software System. (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November, Issue 1.

Summary of Data Management Principles South Pole Telescope

How To Understand And Understand The Science Of Astronomy

Archival Science with the ESAC Science Archives and Virtual Observatory

Fermi LAT and GBM Data Access, File Structure and the Standard Tools. Fermi Solar Analysis Workshop GSFC, August 2012 Elizabeth Ferrara - FSSC 1

Observing with Herschel: practical issues

MAST: The Mikulski Archive for Space Telescopes

SPIRE Pipeline Data Products and Visualization Tools in HIPE

AGILE Data Center at ASDC: Overview, Catalogs and Science Tools

LSST Resources for Data Analysis

Norwegian Satellite Earth Observation Database for Marine and Polar Research USE CASES

WBL - 1. AAS Miami, FL 24 May 2010

Cosmological Analysis of South Pole Telescope-detected Galaxy Clusters

Portal Version 1 - User Manual

Perennisation et Valorisation Nov 7, 2002

7th Agile Meeting & The Bright Gamma-Ray Sky Frascati, 29 September - 1 October, Carlotta Pittori, on behalf of the ADC

AERONET Web Data Access and Relational Database

INSPIRE Dashboard. Technical scenario

CU9 Science Enabling Applications Development Work Package Software Requirements Specification (WP970)

Low noise millimeter wave receivers for Cosmic Microwave Background radiometers

The USGS Landsat Big Data Challenge

OECD.Stat Web Browser User Guide

Task AR-09-01a Progress and Contributions

The Multimission National Center of the Italian Space Agency

What is the Museum Alliance? Last Updated 1/23/07

WFC3 Image Calibration and Reduction Software

ALMA Overview. Leonardo Testi (European Southern Observatory)

Bringing Big Data to the Solar System. Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling)

Data Integration Project

Development, deployment and validation of an oceanographic virtual laboratory based on Grid computing

Software challenges in the implementation of large surveys: the case of J-PAS

Services d Observation IRAP

NaviCell Data Visualization Python API

Copernicus Space Component ESA Data Access Overview J. Martin (ESA), R. Knowelden (Airbus D&S)

NOS for Data Analysis (802) September 2014 V1.3

telemetry Rene A.J. Chave, David D. Lemon, Jan Buermans ASL Environmental Sciences Inc. Victoria BC Canada I.

ALMA Operations the role of the European ALMA Regional Centre Plans for cycle 1

Community HSC

A User s Guide to ALMA Scheduling Blocks (Cycle 3)

EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK

NASA s Big Data Challenges in Climate Science

The ISO Data Archive

Autonomy for SOHO Ground Operations

Adding Web 2.0 features to a Fleet Monitoring Dashboard

MrSID Plug-in for 3D Analyst

The Gaia Archive. Center Forum, Heidelberg, June 10-11, Stefan Jordan. The Gaia Archive, COSADIE Astronomical Data

FreeForm Designer. Phone: Fax: POB 8792, Natanya, Israel Document2

Observer Access to the Cherenkov Telescope Array

A DISTRIBUTED CATALOG AND DATA SERVICES SYSTEM FOR REMOTE SENSING DATA

The Mantid Project. The challenges of delivering flexible HPC for novice end users. Nicholas Draper SOS18

ESA Sky. Bruno Merín Sara Nieto Elena Racero Jesús Salgado María Henar Sarmiento Pilar de Teodoro

Reduced data products in the ESO Phase 3 archive (Status: 15 May 2015)

OpenEMR: Achieving DICOM Interoperability using Mirth

Addressing Risk Data Aggregation and Risk Reporting Ben Sharma, CEO. Big Data Everywhere Conference, NYC November 2015

Organization of VizieR's Catalogs Archival

Galaxy Survey data analysis using SDSS-III as an example

software for laser & rotary engraving machines

Helpdesk Ticketing User Guide


Guidelines for Development of a DATA MANAGEMENT PLAN (DMP) Earth Science Division NASA Science Mission Directorate

GEOCOMPUTATIONS AND RELATED WEB SERVICES

The MODIS online archive and on-demand processing

Ganzheitliches Datenmanagement

DAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID

Ad-Hoc Task Force on Big Data NAC Science Committee

Collaboration. Michael McCabe Information Architect black and white solutions for a grey world

Planck Early Results: New light on Anomalous Microwave Emission from Spinning Dust Grains

GRAPHICAL USER INTERFACE, ACCESS, SEARCH AND REPORTING

RESIDENT ARCHIVE SERVICES OF THE YOHKOH LEGACY DATA ARCHIVE

Canadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre

Quality Assurance Subsystem Design Document

QUALITY CONTROL OF THE IUE FINAL ARCHIVE

NASA Workflow Tool. User Guide. September 29, 2010

Data centres in the. Virtual Observatory. F. Genova, IVOA Small Project meeting, September

Data Mining Challenges and Opportunities in Astronomy

Yukikatsu Terada (Saitama Univ, Japan), on behalf of the Astro-H Software Calibration board

PROGRAMMING FOR BIOLOGISTS. BIOL 6297 Monday, Wednesday 10 am -12 pm

2015 Workshops for Professors

ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)

Exploitation of ISS scientific data

LANDSAT 7 - GROUND SEGMENT ACTIVITIES AT THE GERMAN REMOTE SENSING DATA CENTER. Deutsches Fernerkundungsdatenzentrum (DFD) DLR (*)

ESA Contribution to Astro-H

Plagiarism. Dr. M.G. Sreekumar UNESCO Coordinator, Greenstone Support for South Asia Head, LRC & CDDL, IIM Kozhikode

Generating a Custom Bill of Materials

An introduction to the features of. Google Analytics

Lecture 5b: Data Mining. Peter Wheatley

WHITEPAPER. A Technical Perspective on the Talena Data Availability Management Solution

Automated bibliographic record capturing from web OPAC and online bibliographic database for library cataloguing in LibSys

GSICS Working Group on Data Management

IDS Data Flow Coordination (2009)

The Very High Energy source catalogue at the ASI Science Data Center

Using EMC Documentum with Adobe LiveCycle ES

Data Lab Operations Concepts

IST687 Applied Data Science

International coordination for continuity and interoperability: a CGMS perspective

Using Metadata Manager for System Impact Analysis in Healthcare

Class Climate Sample Report Package

Transcription:

The Planck Legacy Archive: current status, contents and future development Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain

Outline Introduction Schedule Scientific contents of the PLA Additional contents of the PLA PLA main page PLA Java interface Special functionalities on the Java interface Future special functionalities on the Java interface PLA Inter-Operability interface PLA Explanatory Supplement PLA Helpdesk Summary Planck Legacy Archive X. Dupac ESAC Page 2

Introduction The Planck Legacy Archive (PLA) of ESA is the official repository for all Planck mission data, from raw material to highly-processed data The development of the PLA software is performed by the Science Archive Team (M. Fernández, M. Henar, P. Osuna) at ESAC Maintenance of documentation, requirements, testing and interface between Planck community and SAT are performed by the Archive Scientist (X. Dupac) and the Community-Support Scientist (R. Leonardi) with support from the Planck Science Office under Project Scientist (J. Tauber) supervision Full acceptance testing is performed by Planck Science Office for all major software releases Load tests have been successfully performed as well PLA Users Group is asked to provide feedback on the PLA interface Planck Legacy Archive X. Dupac ESAC Page 3

Mission schedule Planck Legacy Archive X. Dupac ESAC Page 4

Planck Legacy Archive schedule 2010 2011 2012 2013 2014 Nominal mission Extended mission LFI-only / post-ops phase Archive phase DR-1 DR-2 DR-3 R-0 pdr-2 ERCSC-A DR-4 DR-5 PLA 1 15-m PLA 2 27-m End Survey 2 End Survey 4 HFI e.o.l. Now LFI e.o.l. Planck Legacy Archive X. Dupac ESAC Page 5

Future releases PLA2 mid-2014 (exact date TBC) Five surveys for HFI Eight surveys for LFI (incl. deep rings) Includes polarization data (I, Q, U) Time-ordered data + pointing included, for all detectors PLA3, mid-2015 TBC Same as PLA2 with better processed data Planck Legacy Archive X. Dupac ESAC Page 6

Scientific contents of the PLA - Frequency maps (high-res.) I for PLA1 (2013) and I, Q, U for PLA2 (2014) The database currently contains the nine Planck frequency maps from the nominal mission period, together with a number of other maps useful for data characterization (e.g. Survey maps, Half-Ring maps, Masks) - Component maps (CMB, Galactic foregrounds, CO), component parameter maps, zodiacal light differences, lensing potential, etc - CMB angular power spectra, cosmological parameter tables, likelihood files Planck Legacy Archive X. Dupac ESAC Page 7

Scientific contents of the PLA - Early Release Compact Source Catalogue (from Jan. 2011) - Planck Catalogue of Compact Sources (Legacy Catalogue) Includes a Sunyaev-Zel dovich candidate cluster list - Time-ordered data for each detector, both semi-raw and processed (calibrated) data (for PLA2) - Pointing time-ordered data for each detector (for PLA2) - Documentation associated to above products Planck Legacy Archive X. Dupac ESAC Page 8

Operational / additional contents of the PLA The PLA contains a large number of mission-related time-ordered information, e.g. spacecraft attitude and orbital information, instrument data quality information, operational state history, radiation environment data, as well as software and associated documentation. Operational files - PSO operational products (Pre-Programmed Pointing Lists, Filtered Attitude History Files) - DPC operational products (Daily Quality Reports, Weekly Health Report, Satellite- Instrument Alignment Matrix) - MOC operational products (APPL Summary Files, Attitude History Files, Orbit file, Orbit Events file) Planck Operational Survey History (P.O.S.H.) Contains mission events and state vector, per pointing Planck Legacy Archive X. Dupac ESAC Page 9

Additional contents of the PLA Software: - likelihood package provided as such - effective beams are delivered to the users via the PLA interface through geometrical search House-keeping timelines (for PLA2) Ancillary data from Radiation monitor (SREM) Raw telemetry not available in PLA interface, only on demand (for PLA2) Planck Legacy Archive X. Dupac ESAC Page 10

PLA main page PLA main page is here: http://www.sciops.esa.int/index.php?project=planck&page=planck_lega cy_archive From this page one may access the PLA Java interface and the PLAIO web interface Planck Legacy Archive X. Dupac ESAC Page 11

PLA Java interface Data may be browsed, searched, selected, processed and downloaded online through a Java user interface, which also provides online technical help The PLA Java interface can be accessed via: http://pla.esac.esa.int/pla/pla.jnlp Planck Legacy Archive X. Dupac ESAC Page 12

Current PLA interface functionalities The main functionalities present in the PLA interface include: 1. Data search and retrieval 2. Data direct download 3. Map projection into a flat map (using gnomonic projection, drizzling) with map viewer 4. Effective beam retrieval and re-projection 5. Inter-operability with Aladin for map visualization and manipulation 6. Inter-operability with Topcat for catalog visualization and manipulation 7. Technical help pages 8. Links from the interface to the Explanatory Supplement, for each product category 9. Internal Archive repository, with the same functionalities as PLA for the Planck coll. 10. Possibility to sign up for new users tool can remember user sessions Planck Legacy Archive X. Dupac ESAC Page 13

PLA Java interface: the map search panel Planck Legacy Archive X. Dupac ESAC Page 14

PLA Java interface: map result panel Planck Legacy Archive X. Dupac ESAC Page 15

PLA Java interface: map cutout Planck Legacy Archive X. Dupac ESAC Page 16

PLA Java interface: cosmology products Planck Legacy Archive X. Dupac ESAC Page 17

PLA Java interface: Legacy Catalogue Planck Legacy Archive X. Dupac ESAC Page 18

PLA Java interface: Operational State History Planck Legacy Archive X. Dupac ESAC Page 19

PLA inter-operability (here with TopCat) Planck Legacy Archive X. Dupac ESAC Page 20

PLA inter-operability (here with Aladin) Planck Legacy Archive X. Dupac ESAC Page 21

Additional data and functionalities for PLA2 (2014) Maps will be provided with polarization data for the whole Planck mission (5 surveys HFI, 8 surveys LFI) Calibrated timelines will be provided for each detector Pointing information will be provided for each detector Some house-keeping timelines will be provided It will be possible to retrieve and cut out timelines based on time search and on geometrical search (e.g. around a source) A proposal for more added-value functionalities on the PLA is on the table: 1. Modification of Planck products: map information extraction, unit conversion, color correction 2. Interactive use of the Planck Sky Model 3. Map-making (e.g. for high resolution and/or limited time window around a compact source) 4. Component separation (focused on small areas, e.g. CMB removal) Implementation of all or part of these requirements is under discussion and subject to additional resources Planck Legacy Archive X. Dupac ESAC Page 22

Planck Legacy Archive Inter-Operability system PLAIO is primarily a machine interface allowing users to submit scripts to the database and retrieve all data present in there http://pla.esac.esa.int/pla/aio/index.html A basic human interface is also provided by the PLAIO http://pla.esac.esa.int/pla/aio/planckproducts.html Additional functionalities are provided by the PLA Inter-Operability tool for any query of data and meta-data this allows quick retrieval of any data through scripts, etc Planck Legacy Archive X. Dupac ESAC Page 23

PLAIO: web pages explaining the machine interface Planck Legacy Archive X. Dupac ESAC Page 24

PLAIO: simple web interface for users Planck Legacy Archive X. Dupac ESAC Page 25

PLA Explanatory Supplement The Explanatory Supplement is a set of wiki web pages http://www.sciops.esa.int/wikisi/planckpla/index.php?instance=planck_public_pla PDF book of the ES also available (beta version) http://www.rssd.esa.int/doc_fetch.php?id=3168869 Planck Legacy Archive X. Dupac ESAC Page 26

Planck Legacy Archive X. Dupac ESAC Page 27 Links to chapters

Planck Legacy Archive X. Dupac ESAC Page 28 Direct links to products via PLAIO

PLA Helpdesk A Helpdesk service is provided by the Planck Science Office since the beginning of the Planck Internal Archive (2009) The Planck Legacy Archive makes use of the same system It uses a Kayako software to register requests via a web interface The same software is used to manage tickets and assign them to support groups or individual scientists Different types of requests go to different help centers : PSO (default), SAT (software), HFI + LFI teams (for specific issues and requests on the science products) Planck Legacy Archive X. Dupac ESAC Page 29

PLA Helpdesk To submit a ticket: http://www.sciops.esa.int/helpdesk_pia/ Planck Legacy Archive X. Dupac ESAC Page 30

Summary The Planck Legacy Archive provides official repository for all Planck data, including science data (maps, catalogues, power spectra, etc) and operational data Added value functionalities on the PLA interface allow users to search, select, process and retrieve data online PLA is a large success in the community (since March 2013 release > 2100 accesses) Additional data will come in 2014: maps with polarization information for the whole Planck mission, plus calibrated time-ordered data and full pointing info Additional functionalities shall be present (for timeline retrieval and cutting) Planck Legacy Archive X. Dupac ESAC Page 31