Releasing ESO Public Survey Data through the Phase 3
|
|
- Charles Campbell
- 8 years ago
- Views:
Transcription
1 Releasing ESO Public Survey Data through the Phase 3 Jörg Retzlaff European Southern Observatory Data Management and Operations Division, Archive Science Group (ASG)
2 Outline Releasing ESO Public Survey Data through the Phase Why? The context ESO Public Surveys: projects & progress Phase 3 Policies How? Who does what? Process & responsibilities Types of products & ESO Science Data Products Standard System components User support Monitoring Phase 3 Results Status of Public Survey Phase 3 Data Submissions Catalogue Facility ESO Science Archive Facility Data Access Conclusions Interoperability and the role of VO standards 2
3 ESO Public Surveys VISTA: 6 surveys started Apr 2010 (P85) VHS deg 2 YJHKs (Ks<20 AB) VIKING deg 2 ZYJHKs (Ks<21.2 AB) VIDEO - 3 Deep Extragalactic Fields Ultra-VISTA - Ultra-deep ZYJHKs + NB118 in the COSMOS field VVV - Variability study of 520 deg 2 in bulge+plane plus multi-color map VMC - Magellanic Survey VLT Survey Telescope: 3 surveys, started 15 Oct 2011 (P88) VST-Atlas 4500 deg 2 UVRIz, like SDSS KIDS 1500 deg 2 UVRI, 2.5 mag deeper than SDSS VPHAS deg 2 UVHaRI in the Southern Galactic Plane Spectroscopic Surveys: started 1 Jan 2012 PESSTO: 30+60n on NTT (SOFI+EFOSC) Gaia-ESO: 30+30n on VLT-UT2 (FLAMES) 3
4 Progress of Public Surveys Courtesy: M. Arnaboldi/ESO Survey Team Ø Max. fraction of completion: 56% for VHS, 55% for VST-ATLAS Ø Significant progress for all surveys (though at a different rate) Ø 30+ publications resulting from PSs; 11 ESO PRs; see also: Survey Science in October
5 ESO Phase 3 Policies The ESO archive is the collection point for the survey products and the primary point of publication/ availability of these products to the ESO community. (Cou104, Dec 2004) Phase 3 PIs of ESO observing programmes return data products to ESO Storage in the ESO Archive (long-term data preservation) Data publication/distribution to the scientific community ESO s policies governing Phase 3 are specific to the type of observing programme. Phase 3 is mandatory for ESO Public Surveys and for ESO Large Programmes since period 75; available also for other ESO observations(!) Further allocation of telescope time for ESO PSs is subject to the completion of the Phase 3. 5
6 Phase 3 Process & Responsibilities Phase 3 denotes the process of preparation, submission, validation and ingestion of science data products for storage in the ESO Science Archive Facility, and subsequent data publication to the scientific community. 1. Data preparacon 8. Data publicacon 2. User s data validacon 7. Archival storage 3. Data release definicon 6. Content validacon 4. Data transfer to ESO 5. AutomaCc release validacon Closing the data release P.I. Data provider The survey P.I. is responsible for the quality of the reduced data products and the associated documentation ( data release description ). ESO defines the required data format ( ESO Science Data Products Standard ), provides dedicated tools, user documentation and direct support for Phase 3 data providers. 6
7 Types of Data Products Survey Tile Image Astrometrically & photometrically calibrated FITS image with associated confidence map; Quality params. (limiting magnitude, PSF size, etc.) Generally: processing provenance (keyword PROVi) to trace back to the original (raw) data. 1-dim. extracted wavelength-calibrated spectrum FITS binary table format Support for 2d spectral frames as ancillary files Exposure map of the VISTA survey tile. Compliant to IVOA Spectral Data Model (v1) Survey Source List Single-band source catalogues directly extracted from the (tile) image associated to its originating image (provenance keyword PROVi) Based on nightly calibrations, degenerate w.r.t. physical sources Science Catalogues Homogeneous merged multi-band catalogue for each survey (possibly per region) Global astrometry/photometry; cross-calibrated using overlapping tiles and across bands Multiple detections merged, i.e. unique entries (ultimately) Uniform tabular structure including content descriptors (employing UCDs) Supports variability surveys: multi-epoch photometric catalogues (i.e. light curves) Tile-by-tile scheme supported for data delivery Dedicated query interface: ESO Catalogue Facility 7
8 ESO Science Data Products Standard European Organisation for Astronomical Research in the Southern Hemisphere Data Management and Operations Division Prepared: Phase 3 User Documentation ESO Science Data Products Standard Doc. No.: GEN-SPE-ESO Issue: 5 Date: 11/01/2013 J. Retzlaff, N. Delmotte Name Date Signature Approved: M. Arnaboldi Released: Organisation Européenne pour des Recherches Astronomiques dans l Hémisphère Austral Name Date Signature M. Romaniello Name Date Signature ESO, Karl-Schwarzschild-Str. 2, Garching bei München, Germany Europäische Organisation für astronomische Forschung in der südlichen Hemisphäre Identification of product types and their data formats depending on instrument/mode. Definition of relevant keywords for data characterization, quality, provenance etc. Issue 1: EDP Standard, Date: 27/11/2010 Evolution driven by: the data to be handled (e.g. VISTA, VST, SPS s, catalogues), i.e. by the data release schedule for PSs; Archive services to be offered (example: Catalogue Facility); Led to Issue 2 (07/03/2011), Issue 3 (22/05/2012), Issue 4 (15/10/2012) Current Issue: #5, Date 11/01/2013 covering all PS data products: imaging & spectroscopy 8
9 Role of the ESO Science Data Products Standard Content validacon ESO DICD p3ck Metadata interface P3 User support P3 User doc. ESO/SDP Standard P3 web pages Catalogue facility Validator OCA rules IngesCon tool Basis for the data provider (pipeline development) Implemented in the Phase 3 data flow in terms of programmed rules (OCA) Many dependencies of infrastructure components Central role to Phase 3 operations; Any change is expensive ESO/SAF user Query forms 9
10 Phase 3 System Components The Phase 3 Validator is a command- line applicacon that verifies the data s compliance with the format standard and the validity of the FITS header keywords against predefined rules. Start of operacons: March 2011 The Phase 3 Release Manager is a web applicacon that allows the P.I. to define data colleccons and releases and to manage the Phase 3 delegacon to co- invescgators. hwp:// Any FTP client like l[p, filezilla etc. Note: the requirement for SSL/TLS was dropped (Jun 2012). The P.I. or a delegate transfers the data via standard FTP to the dedicated staging area at ESO headquarters. 10
11 Workshop for Phase 3 users Documentation Phase 3 Tools Helpdesk Phase 3 User Support 11
12 Monitoring the Phase 3 Progress The ESO Archive Science Group is monitoring the Phase 3 process and reports to Public Survey Panels/OPC 12
13 ESO Public Survey Data Products PHASE 3 RESULTS
14 Status of 1 st Phase 3 Data Submissions for VISTA Public Surveys The VISTA Public Survey data products released in 2011/2012 cover almost 2500 square degrees of the Southern Hemisphere. VHS- green VVV- red VMC- yellow VIDEO- pink UltraVISTA- black (EnCre survey footprints are shown in light blue.) Total data volume: ~5.5 TB 112,296 files 14
15 Catalogue Facility Query Interface 15
16 ESO Phase 3 Data Release Documentation Example: Ultra-VISTA Release descrip7on Provide short broad overview of the program, with an overview/layout of the observacons EssenCal input for data content validacon. Release content - Extended liscng for each sky posicon, filters, exposure Cmes, seeing Release notes ReducCon method used, calibracon procedures, data quality Data format DescripCon of files in this data release, associated files, and naming convencons Acknowledgements Bibliographic reference to be included when using these data. p.16 Phase 3 Process 36 th UC MeeCng, ESO Garching,
17 Current Status of Public Survey Phase 3 Submissions VISTA PSs 2 nd Phase 3: in total ca. 6.5 TB of data uploaded. q VIDEO: 80 GB, feedback on content validation q VMC: 30 GB, to be archived q VHS: 4.6 TB, archiving q VVV: 1.4 TB, data archived q VIKING: 477 GB uploaded, to be archived q Ultra-VISTA agreed to submit in 2013 VST/OmegaCAM started operations on Oct 15, First Phase 3 submissions for VST Public Surveys (Mar-Apr 2013): VST-ATLAS: 3.09 TB KIDS: 718 GB VPHAS+: 766 GB In total: ca. 4.6 TB - data content validation is currently taking place. 18
18 ESO Science Archive Facility Data Access Statistics (1) Courtesy: M. Arnaboldi/ESO Survey Team/ASG 19
19 Data Access Statistics (2) Number of files downloaded per data product type Ø 5.6 TB of data products, >2x10 4 files downloaded from the ESO SAF since December
20 Impact of Data Products Source: ESO Telescope Bibliography Ø In 2012: 874 publicacons based on ESO data, Ø 25% thereof using archival data. 21
21 Internal Data Products UC36.R.3: The ESO data archive should contain calibrated data where at least instrumental signatures are removed to increase the value of the archive for the ESO users. Science-grade DPs to be produced and integrated for seamless access of internal and external data products through the ESO archive user interfaces. Timeline: Publication of UVES Echelle data in Q (backlog+stream of new data), then (very preliminary): X-Shooter-Echelle, FLAMES- MEDUSA, and HAWK-I and VIMOS imaging (UK in-kind contribution) 22
22 Conclusions q The currently on-going eleven ESO public survey projects are progressing very well. q The ESO Science Archive Facility is being populated with resulting science-grade data products including calibrated images, spectra, and catalogues. q Start of the regular production and publication of pipelineprocessed science-grade data products from UVES/Echelle in 2013/Q4. q The Phase 3 process, implementing ESO s policies for public surveys, relies on the ESO Science Data Products Standard. q VO standards are being considered when applicable (examples: UCDs, spectrum data format è A. Micol s talk). q Collaborations on s/w being developed in the VO-context (VOview, OpenCADC libs). 23
Reduced data products in the ESO Phase 3 archive (Status: 15 May 2015)
Reduced data products in the ESO Phase 3 archive (Status: 15 May 2015) The ESO Phase 3 archive provides access to reduced and calibrated data products. All those data are stored in standard formats. The
More informationReport on the 91 st ESO OPC Meeting. What Matters in an ESO Proposal
Report on the 91 st ESO OPC Meeting What Matters in an ESO Proposal Rainer Schoedel, IAA-CSIC Weekly Scientific Seminar of the IAA, 13.12.2012 General Information Video streams ESO@50 available on ESO
More informationESO Archive Data and Metadata Model
ESO Archive Data and Metadata Model Adam Dobrzycki, Cristiano Da Rocha, Ignacio Vera, Mỹ Hà Vuong, Thomas Bierwirth, Vincenzo Forchì, Nathalie Fourniol, Christophe Moins and Stefano Zampieri European Southern
More informationDescription of the Dark Energy Survey for Astronomers
Description of the Dark Energy Survey for Astronomers May 1, 2012 Abstract The Dark Energy Survey (DES) will use 525 nights on the CTIO Blanco 4-meter telescope with the new Dark Energy Camera built by
More informationData Flow Software Configuration Control Board
European Organisation Organisation Européenne Europäische Organisation for Astronomical pour des Recherches für astronomische Research in the Astronomiques Forschung in der Southern Hemisphere dans l Hérmisphère
More informationLSST Resources for Data Analysis
LSST Resources for the Community Lynne Jones University of Washington/LSST 1 Data Flow Nightly Operations : (at base facility) Each 15s exposure = 6.44 GB (raw) 2x15s = 1 visit 30 TB / night Generates
More informationALMA Technical Support. George J. Bendo UK ALMA Regional Centre Node University of Manchester
ALMA Technical Support George J. Bendo UK ALMA Regional Centre Node University of Manchester Overview ALMA organisation and services Websites o Web portal o Helpdesk Documentation Software o CASA o Observing
More informationHow To Understand And Understand The Science Of Astronomy
Introduction to the VO Christophe.Arviset@esa.int ESAVO ESA/ESAC Madrid, Spain The way Astronomy works Telescopes (ground- and space-based, covering the full electromagnetic spectrum) Observatories Instruments
More informationOrganization of VizieR's Catalogs Archival
Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Table of Contents Foreword...2 Environment applied to VizieR archives...3 The archive... 3 The producer...3 The user...3
More informationHow To Process Data From A Casu.Com Computer System
CASU Processing: Overview and Updates for the VVV Survey Nicholas Walton Eduardo Gonalez-Solares, Simon Hodgkin, Mike Irwin (Institute of Astronomy) Pipeline Processing Summary Data organization (check
More informationESO scalable architecture for operational databases
ESO scalable architecture for operational databases I. Vera, A. Dobrzycki, A. M. Chavan, P. Nass, J. S. Lockhart European Southern Observatory, Karl-Schwarzschild-Str 2, D-85748 Garching, Germany ABSTRACT
More informationSoftware challenges in the implementation of large surveys: the case of J-PAS
Software challenges in the implementation of large surveys: the case of J-PAS 1/21 Paulo Penteado - IAG/USP pp.penteado@gmail.com http://www.ppenteado.net/ast/pp_lsst_201204.pdf (K. Taylor) (A. Fernández-Soto)
More informationVirtual Observatory tools for the detection of T dwarfs. Enrique Solano, LAEFF / SVO Eduardo Martín, J.A. Caballero, IAC
Virtual Observatory tools for the detection of T dwarfs Enrique Solano, LAEFF / SVO Eduardo Martín, J.A. Caballero, IAC T dwarfs Low-mass (60-13 MJup), low-temperature (< 1300-1500 K), low-luminosity brown
More informationObserver Access to the Cherenkov Telescope Array
Observer Access to the Cherenkov Telescope Array IRAP, Toulouse, France E-mail: jknodlseder@irap.omp.eu V. Beckmann APC, Paris, France E-mail: beckmann@apc.in2p3.fr C. Boisson LUTh, Paris, France E-mail:
More informationArchival Science with the ESAC Science Archives and Virtual Observatory
Archival Science with the ESAC Science Archives and Virtual Observatory Deborah Baines Science Archives and VO Team Scientist European Space Agency (ESA) European Space Astronomy Centre (ESAC) Science
More informationALMA Operations the role of the European ALMA Regional Centre Plans for cycle 1
ALMA Operations the role of the European ALMA Regional Centre Plans for cycle 1 Paola Andreani ALMA Operations Sites in Chile Antenna Operations Site (AOS) Operation Support Facility (OSF) 60 MB/s (peak)
More informationData Management and Operations Division
European Organisation for Astronomical Research in the Southern Hemisphere Organisation Européenne pour des Recherches Astronomiques dans l Hémisphère Austral Europäische Organisation für astronomische
More informationLecture 5b: Data Mining. Peter Wheatley
Lecture 5b: Data Mining Peter Wheatley Data archives Most astronomical data now available via archives Raw data and high-level products usually available Data reduction software often specific to individual
More informationData centres in the. Virtual Observatory. F. Genova, IVOA Small Project meeting, September 2006 1
Data centres in the Virtual Observatory F. Genova, IVOA Small Project meeting, September 2006 1 VO status (1) Many national projects Very different contexts/financing agencies A really world-wide, global
More informationThis work was done in collaboration with the Centre de Données astronomiques de Strasbourg (CDS) and in particular with F. X. Pineau.
Chapter 5 Database and website This work was done in collaboration with the Centre de Données astronomiques de Strasbourg (CDS) and in particular with F. X. Pineau. 5.1 Introduction The X-shooter Spectral
More informationASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio
More informationCanadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre
Canadian Astronomy Data Centre Séverin Gaudet David Schade Canadian Astronomy Data Centre Data Activities in Astronomy Features of the astronomy data landscape Multi-wavelength datasets are increasingly
More informationVLT(I) instrument operations and maintenance at the Paranal Observatory
VLT(I) instrument operations and maintenance at the Paranal Observatory A. Kaufer a, J. L. Alvarez a, E. Bendek a, F. Caruso a, R. Castillo a, J. Jimenez a, G. Gillet a, N. Haddad a, A. Leiva a, M. Marchesi
More informationDatamanagement at the European Southern Observatory: Strategies and Challenges. Michael Sterzik, ESO Datamanagement and Operations Division
Datamanagement at the European Southern Observatory: Strategies and Challenges Michael Sterzik, ESO Datamanagement and Operations Division European Southern Observatory - builds and operates state-of-the-art
More informationQueued Service Observations with MegaPrime Phase 1 Proposal Submission for Semester 2010A
CFHT, Instruments, Queue Scheduling Queued Service Observations with MegaPrime Phase 1 Proposal Submission for Semester 2010A Updated 08/24/09 Table of Contents A - Introduction The QSO Project Document
More informationThe Planck Legacy Archive: current status, contents and future development. Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain
The Planck Legacy Archive: current status, contents and future development Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain Outline Introduction Schedule Scientific contents of the PLA Additional contents
More informationThe Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory
The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory Astronomy in the XXI century The Internet revolution (the dot com boom ) has transformed
More informationData Management Plan Extended Baryon Oscillation Spectroscopic Survey
Data Management Plan Extended Baryon Oscillation Spectroscopic Survey Experiment description: eboss is the cosmological component of the fourth generation of the Sloan Digital Sky Survey (SDSS-IV) located
More informationTitle. Herschel data-mining tools enabling Herschel-ALMA science. Pedro García-Lario, Head of Herschel Science Centre & Herschel Mission Manager
Title Herschel data-mining tools enabling Herschel-ALMA science Pedro García-Lario, Head of Herschel Science Centre & Herschel Mission Manager Herschel Science Centre WWW http://www.cosmos.esa.int/web/herschel/
More informationThe ESO/ST-ECF Science Archive Facility An overview of our services
The ESO/ST-ECF Science Archive Facility An overview of our services INDEX AT THE FOREFRONT OF INNOVATION... 3 OVERVIEW... 4 WEB QUERY... 6 AVAILABLE OBSERVATIONS... 8 ASSOCIATION OF EXPOSURES... 10 ON
More informationIndiana University Science with the WIYN One Degree Imager
Indiana University Science with the WIYN One Degree Imager Katherine Rhode (Indiana University, WIYN SAC member) Indiana University Department of Astronomy Nine faculty members, plus active emeritus faculty
More informationGuidelines for HARPS observations
Guidelines for HARPS observations This is a general introduction to observe with the HARPS instrument attached at the 3.6m telescope from the new control room located in the former library building in
More informationCAUP s Astronomical Instrumentation and Surveys
CAUP s Astronomical Instrumentation and Surveys CENTRO DE ASTROFÍSICA DA UNIVERSIDADE DO PORTO www.astro.up.pt Sérgio A. G. Sousa Team presentation sousasag@astro.up.pt CAUP's Astronomical Instrumentation
More informationJ-PAS: low-resolution (R 50) spectroscopy over 8000 deg 2
J-PAS: low-resolution (R 50) spectroscopy over 8000 deg 2 C. López-Sanjuan J. Cenarro, L. A. Díaz-García, J. Varela, K. Viironen, & the J-PAS team Centro de Estudio de Física del Cosmos de Aragón 10th
More informationBringing Big Data to the Solar System. Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling)
Bringing Big Data to the Solar System Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling) pp.penteado@gmail.com http://www.ppenteado.net What is Big Data and why do we care?
More informationData management and archiving
Data management and archiving for COP / GOP / D_PHASE 4 th COPS Workshop 25./26.09. 2006 Stuttgart Claudia Wunram Hannes Thiemann 25.-26.09.06 / 1 Data archive Long term data archive for COPS, GOP and
More informationHow To Use The Wynn Odi
WIYN ODI: Observing Process, Data Analysis and Archiving Pierre Martin Yale Survey Workshop, October 2009 ODI: Scientific Challenges ODI is designed to take advantage of the best seeing conditions at WIYN.
More informationThe astronomical Virtual Observatory : lessons learnt, looking forward. Françoise Genova - Forum VO-PDC d après ADASS XXI, Paris, nov.
The astronomical Virtual Observatory : lessons learnt, looking forward Examples taken from the European view, but other projects have followed similar paths The VO aim Enable seamless access to the wealth
More information7th Agile Meeting & The Bright Gamma-Ray Sky Frascati, 29 September - 1 October, 2009. Carlotta Pittori, on behalf of the ADC
7th Agile Meeting & The Bright Gamma-Ray Sky Frascati, 29 September - 1 October, 2009 The AGILE Data Center and the First AGILE Catalog Carlotta Pittori, on behalf of the ADC AGILE GS Architecture Fucino,
More informationDFS Software. NGAS Acceptance Test Plan & Hands-On Tutorial VLT-PLA-ESO-19400-3100. Issue 2 2003-11-26 28 pages. Name Date Signature
E U R O P E A N S O U T H E R N O B S E R V A T ORY Organisation Européenne pour des Recherches Astronomiques dans l'hémisphère Austral Europäische Organisation für astronomische Forschung in der südlichen
More informationSummary of Data Management Principles Dark Energy Survey V2.1, 7/16/15
Summary of Data Management Principles Dark Energy Survey V2.1, 7/16/15 This Summary of Data Management Principles (DMP) has been prepared at the request of the DOE Office of High Energy Physics, in support
More informationThe Bamberg photographic plate archive
The Bamberg photographic plate archive The digitizing project H. Edelmann, N. Jansen, U. Heber, H. Drechsel, J. Wilms, I. Kreykenbohm Dr. Karl Remeis-Observatory & ECAP Astronomical Institute Friedrich-Alexander-University
More informationConstructing the Subaru Advanced Data and Analysis Service on VO
Constructing the Subaru Advanced Data and Analysis Service on VO Yuji Shirasaki on behalf of ADC National Astronomical Observatory of Japan Astronomy Data Center Contents Subaru Telescope and Instruments
More informationData analysis of L2-L3 products
Data analysis of L2-L3 products Emmanuel Gangler UBP Clermont-Ferrand (France) Emmanuel Gangler BIDS 14 1/13 Data management is a pillar of the project : L3 Telescope Caméra Data Management Outreach L1
More informationMultidimensional Data in the Virtual Observatory
IX Reunión Científica de la SEA Madrid- 15/09/2010 Red Temática SVO Multidimensional Data in the Virtual Observatory José Enrique Ruiz Grupo AMIGA Instituto de Astrofísica de Andalucía CSIC Contextual
More informationAST 4723 Lab 3: Data Archives and Image Viewers
AST 4723 Lab 3: Data Archives and Image Viewers Objective: The purpose of the lab this week is for you to learn how to acquire images from online archives, display images using a standard image viewer
More informationVIKING (VISTA Kilo-degree Infrared Galaxy Survey) Data Release 1.
VIKING (VISTA Kilo-degree Infrared Galaxy Survey) Data Release 1. Release date (will be set by ESO) Alastair Edge and Will Sutherland, for the VIKING team Abstract: The VIKING survey with VISTA (ESO programme
More informationObserving with Herschel: practical issues
Observing with Herschel: practical issues Pedro García-Lario European Space Astronomy Centre Herschel Science Centre Herschel as an observatory Herschel will be operated as an observatory-type facility
More informationQUALITY CONTROL OF THE IUE FINAL ARCHIVE
QUALITY CONTROL OF THE IUE FINAL ARCHIVE N. Loiseau 1, E. Solano 1,M.Barylak 2 1 INSA/ESA IUE Observatory, Apdo. 50727, Villafranca del Castillo, 28080 Madrid (Spain). 2 ESA IUE Observatory, Apdo. 50727,
More informationThe ALMA Proposal Submission Process
The ALMA Proposal Submission Process How to get started, and what to expect Presenter: Andrew McNichols Authors: Harvey Liszt, Tony Remijan, Andrew McNichols Atacama Large Millimeter/submillimeter Array
More informationMAST: The Mikulski Archive for Space Telescopes
MAST: The Mikulski Archive for Space Telescopes Richard L. White Space Telescope Science Institute 2015 April 1, NRC Space Science Week/CBPSS A model for open access The NASA astrophysics data archives
More informationThe VHE future. A. Giuliani
The VHE future A. Giuliani 1 The Cherenkov Telescope Array Low energy Medium energy High energy 4.5o FoV 7o FoV 10o FoV 2000 pixels 2000 pixels 2000 pixels ~ 0.1 ~ 0.18 ~ 0.2-0.3 The Cherenkov Telescope
More informationThe Very High Energy source catalogue at the ASI Science Data Center
The Very High Energy source catalogue at the ASI Science Data Center a,b, F. Lucarelli a,b, L. A. Antonelli a,b, P. Giommi b E-mail: alessandro.carosi@oa-roma.inaf.it a INAF, National Institute for Astrophysics,
More informationSummary of Data Management Principles South Pole Telescope
Summary of Data Management Principles South Pole Telescope Experiment description - Where it is: The South Pole Telescope (SPT) is a 10-meter-diameter telescope located at the Amundsen-Scott South Pole
More informationThis document is intended as a quick reference guide for processing meteor data using UFO Analyzer.
2013 UKMON TABLE OF CONTENTS INTRODUCTION...3 INSTALLING UFO ANALYSER...3 CREATING A PROFILE...4 Add source directory (see Annex A):...4 Set location and ID information...5 Define the camera setup...5
More informationArchive I. Metadata. 26. May 2015
Archive I Metadata 26. May 2015 2 Norstore Data Management Plan To successfully execute your research project you want to ensure the following three criteria are met over its entire lifecycle: You are
More informationData Centre Alliance - Science
Data Centre Alliance - Science Mark ALLEN, Jonathan TEDDS & DCA IST Nov 2008 IST Internal Science Team Activities of the IST are being rounded off for end of project Coordinated by IST telecon IST: T2-DCA-IST
More informationA User s Guide to ALMA Scheduling Blocks (Cycle 3)
Doc 3.19, ver. 1 September, 2015 A User s Guide to ALMA Scheduling Blocks (Cycle 3) ALMA, an international astronomy facility, is a partnership of ESO (representing its member states), NSF (USA) and NINS
More informationPROP: ESO s portal for reporting of operational problematics
PROP: ESO s portal for reporting of operational problematics S. Marteau *a, S. Rahimpour a, J. Lockhart a a European Southern Observatory, Karl-Schwarzschild-Str. 2, 85748 Garching-bei-München, Germany
More informationBaltic Marine Environment Protection Commission
Baltic Marine Environment Protection Commission Project on Development of a HELCOM Pollution Load User System Helsinki, Finland, 26-27 February 2014 PLUS 5-2014, 2-2 Document title Hosting and Application
More informationALMA Overview. Leonardo Testi (European Southern Observatory)
ALMA Overview Leonardo Testi (European Southern Observatory) The ALMA Project Status Timeline towards Early and Full Science Operations Future Developments Atacama Large Millimeter Array At least 50x12m
More informationSpecifications for spectra eligible for BeSS
Specifications for spectra eligible for BeSS (Be Stars Spectra Database) A collaboration between LESIA (Paris-Meudon Obervatory) and the ARAS group (amateur astronomers) Version Date Author Revision 1,3
More informationThe VO-Dance web application at the IA2 data center
The VO-Dance web application at the IA2 data center Marco Molinaro, Cristina Knapic and Riccardo Smareglia Istituto Nazionale di Astrofisica - Osservatorio Astronomico di Trieste, via G.B. Tiepolo 11,
More informationFollow-up Observations of SPY White Dwarf + M-Dwarf Binaries
15 th European Workshop on White Dwarfs ASP Conference Series, Vol. 372, 2007 R. Napiwotzki and M. R. Burleigh Follow-up Observations of SPY White Dwarf + M-Dwarf Binaries P. F. L. Maxted Astrophysics
More informationPlanning and Scheduling Software for the Hobby Eberly Telescope. Niall I. Gaffney Hobby Eberly Telescope Mark E. Cornell McDonald Observatory
Planning and Scheduling Software for the Hobby Eberly Telescope Niall I. Gaffney Hobby Eberly Telescope Mark E. Cornell McDonald Observatory What is the HET project?! Joint Project: University of Texas
More informationThe NOAO Science Archive and NVO Portal: Information & Guidelines
The NOAO Science Archive and NVO Portal: Information & Guidelines Mark Dickinson, 14 March 2008 Orig. document by Howard Lanning & Mark Dickinson Thank you for your help testing the new NOAO Science Archive
More informationKepler Data and Tools. Kepler Science Conference II November 5, 2013
Kepler Data and Tools Kepler Science Conference II November 5, 2013 Agenda Current and legacy data products (S. Thompson) Kepler Science Center tools (M. Still) MAST Kepler Archive (S. Fleming) NASA Exoplanet
More informationand the VO-Science Francisco Jiménez Esteban Suffolk University
The Spanish-VO and the VO-Science Francisco Jiménez Esteban CAB / SVO (INTA-CSIC) Suffolk University The Spanish-VO (SVO) IVOA was created in June 2002 with the mission to facilitate the international
More informationCMEMS user requirements and user uptake strategy
CMEMS Service Evolution & User Uptake Workshop CMEMS user requirements and user uptake strategy Dominique Obaton Mercator Océan CMEMS Service Evolution & User Uptake Workshop The Copernicus Marine service
More informationA Preliminary Summary of The VLA Sky Survey
A Preliminary Summary of The VLA Sky Survey Eric J. Murphy and Stefi Baum (On behalf of the entire Science Survey Group) 1 Executive Summary After months of critical deliberation, the Survey Science Group
More informationEChO Ground Segment: Overview & Science Operations Assumptions
EChO Ground Segment: Overview & Science Operations Assumptions Matthias Ehle & the Science Ground Segment Working Group EChO Science Operations Study Manager ESA-ESAC, Madrid Science Operations Department/Division
More informationTable of Contents. Page 2 of 9
Table of Contents 1 List of Acronyms 3 2 Introduction and Scope 4 3 Overview on the data 4 4 The error 4 5 The data quality information 4 6 Organization of the FITS file 5 7 Identification of data sets
More informationESSENCE: Determining the Nature of Dark Energy with High-z Supernovae
ESSENCE: Determining the Nature of Dark Energy with High-z Supernovae Ryan Foley UC Berkeley ESSENCE Team Equation of State: SupErNovae trace Cosmic Expansion C. Aguilera (NOAO/CTIO) B. Barris (IfA/UH)
More informationCommunity Support @ HSC
Community Support @ HSC HUG#6 8-9 April 2013 Pedro García-Lario HSC Community Support Group Lead Leo Metcalfe Herschel Science Operations Manager (HSCOM) SRE-OAH - page 1 Community Support : Notable Events
More informationSecond EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data
Second EUDAT Conference, October 2013 Workshop: Digital Preservation of Cultural Data Scalability in preservation of cultural heritage data Simon Lambert Scientific Computing Department STFC UK Types of
More informationMigrating a (Large) Science Database to the Cloud
The Sloan Digital Sky Survey Migrating a (Large) Science Database to the Cloud Ani Thakar Alex Szalay Center for Astrophysical Sciences and Institute for Data Intensive Engineering and Science (IDIES)
More informationEuro-VO DCA. Board Meeting #1 Oct 2-3, 2006. Nic Walton for Mike Watson. CDS Strasbourg
Euro-VO DCA Board Meeting #1 Oct 2-3, 2006 Nic Walton for Mike Watson CDS Strasbourg AstroGrid AstroGrid: UK's Virtual Observatory Empowerment of scientists Improve the quality, ease, speed and cost effectiveness
More informationUsage statistics and archiving process of VizieR data in the VO context
Usage statistics and archiving process of VizieR data in the VO context VO Implementation status VO Implementation status Application VOTable (1.1 1.2 1.3) Semantic Data Access Layer Data Model MOC SAMP
More informationAnalysis One Code Desc. Transaction Amount. Fiscal Period
Analysis One Code Desc Transaction Amount Fiscal Period 57.63 Oct-12 12.13 Oct-12-38.90 Oct-12-773.00 Oct-12-800.00 Oct-12-187.00 Oct-12-82.00 Oct-12-82.00 Oct-12-110.00 Oct-12-1115.25 Oct-12-71.00 Oct-12-41.00
More informationConcept of long term data archive
Concept of long term data archive for COP / GOP / DPHASE 1 st MAP DPHASE scientific meeting 6.-8. November 2006, Vienna Claudia Wunram Hannes Thiemann cops@zmaw.de 6.-8. Nov 06 / 1 Data archive Long term
More informationInformation integration and retrieval: the CDS hub
Information integration and retrieval: the CDS hub Françoise Genova a, François Bonnarel a, Pascal Dubois a, Daniel Egret a, Pierre Fernique a, Gerard Jasniewicz b, Soizick Lesteven a, François Ochsenbein
More informationCAM DIPLOMA IN DIGITAL MARKETING (MOBILE)
ONLINE LONDON CAM DIPLOMA IN MARKETING (MOBILE) A practical introduction to good practice in mobile marketing The direct study centre of CAM DIPLOMA IN MARKETING (MOBILE) i OUR PROFESSIONAL QUALIFICATIONS:
More informationVirtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010
Virtual Observatories Virtual Observatories 1%%&'&$#-&6!&9:#,*3),!#,6!6#$C!&,&$D2 *:#%&+-3;& D&);&-$2!!"! "!" &,&$D2 %),-&,-!"#$%&'&#()*! $#%&!(!!! $ '!%&$ $! (% %)'6!6#$C!;#--&$G $! '!!! $#63#-3),G $!
More informationOne Degree Imager Pipeline Software and Archive Science Requirements Document
One Degree Imager Pipeline Software and Archive Science Requirements Document Version 1.5: 7/23/09!Ian!Dell(Antonio-!Daniel!Durand-!Daniel!1arbeck-!5nut!Olsen-!8ohn!Sal;er! Final!Draft!>dition?!Pierre!Aartin!
More informationAstrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research
Astrophysics with Terabyte Datasets Alex Szalay, JHU and Jim Gray, Microsoft Research Living in an Exponential World Astronomers have a few hundred TB now 1 pixel (byte) / sq arc second ~ 4TB Multi-spectral,
More informationData Pipelines & Archives for Large Surveys. Peter Nugent (LBNL)
Data Pipelines & Archives for Large Surveys Peter Nugent (LBNL) Overview Major Issues facing any large-area survey/search: Computational power for search - data transfer, processing, storage, databases
More informationThe Astronomical Data Warehouse
The Astronomical Data Warehouse Clive G. Page Department of Physics & Astronomy, University of Leicester, Leicester, LE1 7RH, UK Abstract. The idea of the astronomical data warehouse has arisen as the
More informationAstronomy & Teaching Programs at UCT
Astronomy & Teaching Programs at UCT Prof. Renée C. Kraan-Korteweg Astronomy Department (UCT) Co-Director Astrophysics, Cosmology and Gravity Centre (ACGC) Astronomy Departmental Profile Developments (mostly
More informationRelease Management Report
ALMA Integrated Compu2ng Team Coordina2on & Planning Mee2ng #4 San2ago, 19-21 November 2014 Release Management Report Ruben Soto ICT Release Manager Releases (since June 2014) 4 incremental releases have
More informationRemote sensing of precipitable water vapour and cloud cover for site selection of the European Extremely Large Telescope (E-ELT) using MERIS
Remote sensing of precipitable water vapour and cloud cover for site selection of the European Extremely Large Telescope (E-ELT) using MERIS H. Kurlandczyk 1 M.Sarazin 1 1 European Organisation for Astronomical
More informationThe Gaia Archive. Center Forum, Heidelberg, June 10-11, 2013. Stefan Jordan. The Gaia Archive, COSADIE Astronomical Data
The Gaia Archive Astronomisches Rechen-Institut am Zentrum für Astronomie der Universität Heidelberg http://www.stefan-jordan.de 1 2 Gaia 2013-2018 and beyond Progress with Gaia 3 HIPPARCOS Gaia accuracy
More informationGalaxy Survey data analysis using SDSS-III as an example
Galaxy Survey data analysis using SDSS-III as an example Will Percival (University of Portsmouth) showing work by the BOSS galaxy clustering working group" Cosmology from Spectroscopic Galaxy Surveys"
More informationLibraries and Large Data
Libraries and Large Data Super Computing 2012 Elisabeth Long University of Chicago Library What is the Library s Interest in Big Data? Large Data and Libraries We ve Always Collected Data Intellectual
More informationDATA QUALITY VISUALIZATION TOOLS ON ARCHIVED HISTORICAL FREEWAY TRAFFIC DATA
DATA QUALITY VISUALIZATION TOOLS ON ARCHIVED HISTORICAL FREEWAY TRAFFIC DATA Jothan P. Samuelson, Maricopa Association of Governments TRB NATMEC Conference June 6, 2012 2012, All Rights Reserved 1 Project
More informationConquering the Astronomical Data Flood through Machine
Conquering the Astronomical Data Flood through Machine Learning and Citizen Science Kirk Borne George Mason University School of Physics, Astronomy, & Computational Sciences http://spacs.gmu.edu/ The Problem:
More informationALMA Science Operations
ALMA Science Operations Lars-Åke Nyman a, Paola Andreani b, John Hibbard c, Sachiko K. Okumura d a JAO, Alonso de Cordova 3107, Vitacura, Santiago, Chile b ESO, Karl-Schwarzschild-Strasse 2, D-85748 Garching
More informationLSST Data Management plans: Pipeline outputs and Level 2 vs. Level 3
LSST Data Management plans: Pipeline outputs and Level 2 vs. Level 3 Mario Juric Robert Lupton LSST DM Project Scien@st Algorithms Lead LSST SAC Name of Mee)ng Loca)on Date - Change in Slide Master 1 Data
More informationGSSC Report. David Band for the GLAST SSC. GLAST Science Support Center
GSSC Report David Band for the GLAST SSC GLAST Users Committee Meeting Outline User Support Documents Testing Ingest and Databases Observing Timelines GUC Meeting 2 USER SUPPORT GUC Meeting 3 Source Detectability
More informationSELECTING AND SCHEDULING OBSERVING PROGRAMMES AT ESO
Organizations, People and Strategies in Astronomy 2 (OPSA 2), 231-256 Ed. A. Heck, SELECTING AND SCHEDULING OBSERVING PROGRAMMES AT ESO FERDINANDO PATAT AND GAITEE A.J. HUSSAIN Observing Programmes Office
More informationData providers technical feedback
Data providers technical feedback DCA WP 3.2 (LU) Report May 2007 Anita Richards (JBO) & Jonathan Tedds (LU) Terms of reference Activities up to 1 st PCT meeting Thurs Session 1 Plans Thurs Session 3 WP
More information