SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center)
|
|
|
- Brian Greene
- 10 years ago
- Views:
Transcription
1 SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center)
2 SITools 2 SITools2 is a CNES generic tool performed by a joint effort between CNES and scienefic laboratories. It offers common services through an easy- to- use open source web plalorm. The aim of SITools is to provide a self- manageable data access layer deployed on already exiseng scienefic laboratory databases. hmp://sitools2.sourceforge.net/ hmps://github.com/sitools2 Contact: jean- [email protected] 3
3 SITools2 General Architecture 4
4 Herschel in a nutshell Herschel was the fourth cornerstone mission in the European Space Agency science programme. It has performed photometry and spectroscopy in the far infrared and submillimetre part of the spectrum, covering approximately the µm range. Objec3ves: the formaeon of stars and galaxies, and the interrelaeon between the two, the physics of the interstellar medium, astrochemistry, and solar system studies. Two cameras and two medium resolueon spectrometers (PACS and SPIRE) and a very high resolueon heterodyne spectrometer (HIFI) It was launched in mai 2009, and run out of helium in april
5 HESIOD (HErSchel IdOc Database) Portal IDOC = Integrated Data and Operation Center K. Dassas CoSADIE Astronomical Data Center Forum
6 Interstellar medium guaranteed time key project (SAG-4) in HESIOD K. Dassas CoSADIE Astronomical Data Center Forum
7 Interstellar medium guaranteed time key project (SAG-4) from HESIOD in VO Level 2 and L2.5 PACS (60 or ) and SPIRE (250, 350, 500 micrometers) Public Maps Reprocessed at IAS with the latest ESA pipeline (last release only) and with home made pipeline (SANEPIC) 8
8 HESIOD General Architecture PACS Photometer pipeline SANEPIC (IAS) C++ SPIRE Photometer PACS Spectrometer SPIRE Spectrometer pipelines HIPE (ESA) Jython FITS IDOC Fichiers FITS psycopg2 Pywcs pyfits BDD METADATA BDD 9
9 SITools2 SIAP Module
10 SITools2 SIA Module dataset columns 11
11 SITools2 SIA Module dictionnary 12
12 HESIOD through Aladin K. Dassas CoSADIE Astronomical Data Center Forum
13 HESIOD through Aladin 14
14 VO Issues or questions RegistraEon was not so straighlorward Not always easy to know which fields to fill in to display informaeon in Aladin (for instance sortorder in the votable) CommunicaEon between eurovo and VAO? 15
15 To be done Extension of SIAP to other HESIOD programs CuLits SSAP (cubes?) Stats on Data usage (disenceon from VO and from direct access) 16
16 ANNEXES 17
17 SITools2 General Architecture: REST 18
18 SITools2 SIA Module spoly def calculatespoly(filepath=""):! hdulist=pyfits.open(filepath)! try:! Image = hdulist['image']! wcs = pywcs.wcs(image.header)! hdr1=hdulist[1].header! except:! try:! ###### for SCANAMORPHOS fits files! Image=hdulist['PrimaryImage']! PrimaryHeader=hdulist['Primary'].header! wcs = pywcs.wcs(primaryheader)! hdr1=image.header! print wcs! print hdr1! except KeyError:! print "EE - No 'Image' extension in "+os.path.basename(inputimage)! return 2! poly1=wcs.wcs_pix2sky([[0.5,0.5]],0)! print poly1! poly2=wcs.wcs_pix2sky([[0.5+hdr1['naxis1'],0.5]],0)! print poly2! poly3=wcs.wcs_pix2sky([[0.5+hdr1['naxis1'],0.5+hdr1['naxis2']]],0)! print poly3! poly4=wcs.wcs_pix2sky([[0.5,0.5+hdr1['naxis2']]],0)! print poly4!! poly1="("+str(poly1[0,0])+"d,"+str(poly1[0,1])+"d)"! poly2="("+str(poly2[0,0])+"d,"+str(poly2[0,1])+"d)"! poly3="("+str(poly3[0,0])+"d,"+str(poly3[0,1])+"d)"! poly4="("+str(poly4[0,0])+"d,"+str(poly4[0,1])+"d)"! poly="{"+poly4+","+poly3+","+poly2+","+poly1+"}"! #poly="("+poly1+","+poly3+")"! return poly! 19
19 SIA EuroVO registry 20
20 SIA EuroVO registry 21
SPIRE Pipeline Data Products and Visualization Tools in HIPE
25 th 29 th Jan 2010 SPIRE Pipeline Data Products and Visualization Tools in HIPE (NHSC/IPAC) page 1 List of Topics Overview of SPIRE Pipeline Data Processing and SPIRE Pipeline Data Product Levels Demo
Visualization and Analysis of Spectral Data Cubes an Hipe toolbox
Visualization and Analysis of Spectral Data Cubes an Hipe toolbox Madrid 4-5 December 2008 Alain Gueguen MPE-Garching [email protected] 1 Goal of the tool Display and analysis toolbox for the spectral
The PACS Software System. (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1.
The PACS Software System (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1.0 PICC-ME-DS-003 1. Introduction The PCSS, the PACS ICC Software System, is the
How To Understand And Understand The Science Of Astronomy
Introduction to the VO [email protected] ESAVO ESA/ESAC Madrid, Spain The way Astronomy works Telescopes (ground- and space-based, covering the full electromagnetic spectrum) Observatories Instruments
The astronomical Virtual Observatory : lessons learnt, looking forward. Françoise Genova - Forum VO-PDC d après ADASS XXI, Paris, nov.
The astronomical Virtual Observatory : lessons learnt, looking forward Examples taken from the European view, but other projects have followed similar paths The VO aim Enable seamless access to the wealth
Multidimensional Data in the Virtual Observatory
IX Reunión Científica de la SEA Madrid- 15/09/2010 Red Temática SVO Multidimensional Data in the Virtual Observatory José Enrique Ruiz Grupo AMIGA Instituto de Astrofísica de Andalucía CSIC Contextual
Organization of VizieR's Catalogs Archival
Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Table of Contents Foreword...2 Environment applied to VizieR archives...3 The archive... 3 The producer...3 The user...3
Index. Registry Report
2013.1-12 Registry Report 01 02 03 06 19 21 22 23 24 25 26 27 28 29 31 34 35 Index Registry Report 02 Registry Report Registry Report 03 04 Registry Report Registry Report 05 06 Registry Report Registry
SGS System Requirements Review
SGS System Requirements Review John Hoar Lausanne 09/06/2015 Quick recap The Science Ground Segment transforms measurements made by the Euclid instruments into data products ready for scientific use. This
Mission Operations and Ground Segment
ESA Earth Observation Info Days Mission Operations and Ground Segment ESA EO Ground Segment and Mission Operations department (EOP-G) May 2013 EOEP 2013 Page 1 ESA Unclassified For Official Use MISSION
Exploring Gaia data with TOPCAT and the Virtual Observatory
Exploring Gaia data with TOPCAT and the Virtual Observatory Mark Taylor (University of Bristol) Gaia and the Unseen Brown Dwarf Question GREAT-ESF Workshop Torino University 26 March 2014 $Id: tcvo.tex,v
CU9 Science Enabling Applications Development Work Package Software Requirements Specification (WP970)
Science Enabling Applications Development Work Package Software Requirements Specification (WP970) prepared by: approved by: reference: issue: revision: 1 X. Luri, P.M. Marrese, F.Julbe, H. Enke, N. Walton,
The StrikeIron API Management Solution
The StrikeIron API Management Solution Your data and software assets can provide your organization with new market opportunities and give you a competitive edge by sharing them through APIs. This technology
DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE
DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE Introduction - The EuroVO-DCA Census questionnaire The Euro-VO Data Centre Alliance (http://www.euro-vo.org/pub/dca/overview.html)
Light Telescopes. Grade Level: 5. 2-3 class periods (more if in-depth research occurs)
Light Telescopes Grade Level: 5 Time Required: Suggested TEKS: Science - 5.4 Suggested SCANS Information. Acquires and evaluates information. National Science and Math Standards Science as Inquiry, Earth
How To Set Up A Rov-Dfd (Rov Zero Point) Du)
DU640 Radial Velocity Zero-Point Software Requirement Specifications prepared by: approved by: reference: issue: 4 revision: 1 date: 28-03-2008 status: Issued G. Jasniewicz, F. Crifo, D. Hestroffer, A.
Astrophysical Techniques. C R Kitchin
Astrophysical Techniques C R Kitchin University of Hertfordshire Observatory Third Edition SUB Gottingen 7 210 119 268 99 A 8843 Institute of Physics Publishing Bristol and Philadelphia Contents Preface
2009 CAP Grant Kickoff USGS, Reston, VA May 21, 2009
Leveraging GOS Map and Data Services for Search and Rescue Operations using NASA WorldWind Open Source 3D Visualization Platform Nadine Alameh, Ph.D. MobiLaps LLC 2009 CAP Grant Kickoff USGS, Reston, VA
Project Icarus: A Technical Review of the Daedalus Propulsion Configuration and Some Engineering Considerations for the Icarus Vehicle.
Project Icarus: A Technical Review of the Daedalus Propulsion Configuration and Some Engineering Considerations for the Icarus Vehicle. Richard Obousy Ph.D Icarus Project Leader Talk Outline Introduction
Implementing Data Models and Reports with Microsoft SQL Server 2012 MOC 10778
Implementing Data Models and Reports with Microsoft SQL Server 2012 MOC 10778 Course Outline Module 1: Introduction to Business Intelligence and Data Modeling This module provides an introduction to Business
A long time ago, people looked
Supercool Space Tools! By Linda Hermans-Killam A long time ago, people looked into the dark night sky and wondered about the stars, meteors, comets and planets they saw. The only tools they had to study
Chang e-3 s Progress and Achievement 2/2014
Chang e-3 s Progress and Achievement 2/2014 Main content 1. Chinese Lunar Exploration Program 2. Chang e-3 s Progress 3. Chang e-3 s Achievement Chinese Lunar Exploration Program Phase I Orbital missions
MAST: The Mikulski Archive for Space Telescopes
MAST: The Mikulski Archive for Space Telescopes Richard L. White Space Telescope Science Institute 2015 April 1, NRC Space Science Week/CBPSS A model for open access The NASA astrophysics data archives
Lost in Space? Methodology for a Guided Drill-Through Analysis Out of the Wormhole
Paper BB-01 Lost in Space? Methodology for a Guided Drill-Through Analysis Out of the Wormhole ABSTRACT Stephen Overton, Overton Technologies, LLC, Raleigh, NC Business information can be consumed many
Introduction to LSST Data Management. Jeffrey Kantor Data Management Project Manager
Introduction to LSST Data Management Jeffrey Kantor Data Management Project Manager LSST Data Management Principal Responsibilities Archive Raw Data: Receive the incoming stream of images that the Camera
Fundamental Concepts and Models
Fundamental Concepts and Models 1 1. Roles and Boundaries Could provider The organization that provides the cloud based IT resources Cloud consumer An organization (or a human) that has a formal contract
PRESENTATION SPACE MISSIONS
GENERAL PRESENTATION SPACE MISSIONS CONTENTS 1. Who we are 2. What we do 3. Space main areas 4. Space missions Page 2 WHO WE ARE GENERAL Multinational conglomerate founded in 1984 Private capital Offices
Constructing the Subaru Advanced Data and Analysis Service on VO
Constructing the Subaru Advanced Data and Analysis Service on VO Yuji Shirasaki on behalf of ADC National Astronomical Observatory of Japan Astronomy Data Center Contents Subaru Telescope and Instruments
Oracle Warehouse Builder 10g
Oracle Warehouse Builder 10g Architectural White paper February 2004 Table of contents INTRODUCTION... 3 OVERVIEW... 4 THE DESIGN COMPONENT... 4 THE RUNTIME COMPONENT... 5 THE DESIGN ARCHITECTURE... 6
Course Syllabus. 2553A: Administering Microsoft SharePoint Portal Server 2003. Key Data. Audience. At Course Completion.
Key Data Course #: 2553A Number of Days: 3 Format: Instructor-Led This course syllabus should be used to determine whether the course is appropriate for the students, based on their current skills and
EO data hosting and processing core capabilities and emerging solutions
EO data hosting and processing core capabilities and emerging solutions Andrew Groom 4 th March 2015 Contents An introduction to Airbus Defence and Space, Geo-Intelligence Elements of the C3S vision EO
IT Service Management with System Center Service Manager
Course 10965B: IT Service Management with System Center Service Manager Course Details Course Outline Module 1: Service Management Overview Effective IT Service Management includes process driven methodologies
CMS & ehr - An Update
Health Informatics in Hong Kong CMS & ehr - An Update Dr NT Cheung HA Convention 2010 CMS / epr is essential in the HA Each Day... 12,000 users 90,000 patients 8M CMS transactions 700,000 epr views In
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio
The Murchison Widefield Array Data Archive System. Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia
The Murchison Widefield Array Data Archive System Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia Agenda Dataflow Requirements Solutions & Lessons learnt Open solution
Cloud-based Infrastructures. Serving INSPIRE needs
Cloud-based Infrastructures Serving INSPIRE needs INSPIRE Conference 2014 Workshop Sessions Benoit BAURENS, AKKA Technologies (F) Claudio LUCCHESE, CNR (I) June 16th, 2014 This content by the InGeoCloudS
FRACTAL S.L.N.E. A private company for engineering of scientific projects. Instrumentation and Software for Astronomy
FRACTAL S.L.N.E A private company for engineering of scientific projects Instrumentation and Software for Astronomy 1 Introducing FRACTAL FRACTAL S.L.N.E. is a private technological company funded in 2005.
Lecture 5b: Data Mining. Peter Wheatley
Lecture 5b: Data Mining Peter Wheatley Data archives Most astronomical data now available via archives Raw data and high-level products usually available Data reduction software often specific to individual
Statistical Metadata System based on SDMX
Statistical Metadata System based on SDMX Petko I. Yanev; Jean-François Fracheboud Federal Statistical Office Switzerland Statistical Metadata System : Content Challenges Vision / Metadata Strategy Architecture
<Insert Picture Here> Enhancing the Performance and Analytic Content of the Data Warehouse Using Oracle OLAP Option
Enhancing the Performance and Analytic Content of the Data Warehouse Using Oracle OLAP Option The following is intended to outline our general product direction. It is intended for
PERAGO360. Trust and Innovation in Business Critical Solutions
PERAGO360 Trust and Innovation in Business Critical Solutions PERAGO360 Trust and Innovation in Business Critical Solutions Traditional IT implementations have been hampered by the inability to execute
Working of Call Center. Sanad centers, Investors, Regional Offices, MOCI staff can contact the Support Call Center for their queries and issues
Customer Support Channels Multiple channels available to the public: Support phone (working hours) E-mail (24/7) Social media (Twitter, Facebook) Self service desk in Muscat and Salalah front offices 2
Top 10 Discoveries by ESO Telescopes
Top 10 Discoveries by ESO Telescopes European Southern Observatory reaching new heights in astronomy Exploring the Universe from the Atacama Desert, in Chile since 1964 ESO is the most productive astronomical
Momentum offers you free training, webinars and much more to: help you understand the power of your current LANDESK products
LANDESK Momentum Momentum offers you free training, webinars and much more to: help you understand the power of your current LANDESK products improve your ROI Upcoming Webinars: Visit: www.landesk.com/momentum
esa-star Registration User Manual
esa-star Registration User Manual CHANGE LOG REASON FOR CHANGE VERSION DATE PARAGRAPH(S) First Issue 1.0 01/03/2016 All Updated Bank account creation procedure. Added par 2.9 1.1 12/05/2016 2.7, 2.9 1
Planning, Deploying, and Managing an Enterprise Project Management Solution
Planning, Deploying, and Managing an Enterprise Project Management Solution Course 2732 Five days Instructor-led Introduction The goal of this five-day, instructor-led course is to provide systems engineers
License Metrics and User Definitions
License Metrics and User Definitions 1. Client Access Licenses To connect to a QlikView Server (QVS), each client needs a Client Access License (CAL). The CALs are purchased with QlikView Server(s) and
SOFTWARE DEVELOPMENT AND MIDDLEWARE FOR VIRTUAL ORGANISATIONS. By Pedro Omar Contreras Albornoz. Licenciado
SOFTWARE DEVELOPMENT AND MIDDLEWARE FOR VIRTUAL ORGANISATIONS By Pedro Omar Contreras Albornoz. Licenciado MASTER OF PHILOSOPHY SCHOOL OF ELECTRONICS, ELECTRICAL ENGINEERING AND COMPUTER SCIENCE THE QUEEN
ALMA Overview. Leonardo Testi (European Southern Observatory)
ALMA Overview Leonardo Testi (European Southern Observatory) The ALMA Project Status Timeline towards Early and Full Science Operations Future Developments Atacama Large Millimeter Array At least 50x12m
SQL Server 2012 Business Intelligence Boot Camp
SQL Server 2012 Business Intelligence Boot Camp Length: 5 Days Technology: Microsoft SQL Server 2012 Delivery Method: Instructor-led (classroom) About this Course Data warehousing is a solution organizations
Mirjam van Olst. Best Practices & Considerations for Designing Your SharePoint Logical Architecture
Mirjam van Olst Best Practices & Considerations for Designing Your SharePoint Logical Architecture About me http://sharepointchick.com @mirjamvanolst [email protected] Agenda Introduction Logical Architecture
AST 4723 Lab 3: Data Archives and Image Viewers
AST 4723 Lab 3: Data Archives and Image Viewers Objective: The purpose of the lab this week is for you to learn how to acquire images from online archives, display images using a standard image viewer
