Multidimensional Data in the Virtual Observatory
|
|
|
- Julius Osborne
- 10 years ago
- Views:
Transcription
1 IX Reunión Científica de la SEA Madrid- 15/09/2010 Red Temática SVO Multidimensional Data in the Virtual Observatory José Enrique Ruiz Grupo AMIGA Instituto de Astrofísica de Andalucía CSIC
2 Contextual History AMIGA Catalogue Archives Software CONTENT Multidimensional Data MultiD Astronomy Data: Typed vs. Generic Services: Discovery vs. Access Virtual Data B0DEGA Archive Scientific Workflows Description Proposals
3 AMIGA Analysis of the interstellar Medium of Isolated GAlaxies PI : Lourdes Verdes-Montenegro IAA-CSIC, IRAM Obs. Marseille, Obs. Paris, CfA, ASIAA, MPIfA, IAC, Univ. Alabama, Mc Donald Observatory, Arcetri, UNAM, Kapteyn Astronomical Institute, ESO Coordinated projects with IRAM Granada since 2005 Statistical baseline of isolated galaxies to compare with the behaviour of galaxies in denser environments Multiλ study ~1000 galaxies
4 AMIGA CATALOGUE Frequently updated Search criteria and properties Source name, coordinated, velocity, distance, morphology, magnitudes, isolation parameters, FIR fluxes, radio emission, activity Output format HTML, ASCII, VOTable, VOTools Access from VOTools Aladin, Topcat ConeSearch Service Euro-VO DCA Census of European Data Centres IVOA Registry
5 AMIGA CATALOGUE
6 Data Models: RADAMS ARCHIVES Radio Astronomy DAta Model for Single-dish telescopes First model for radio VO compliant archives Based on existing IVOA standard models Initially conceived for DSS-63 antenna Revised and improved for IRAM 30m RADAMS VO Archives Robledo DSS-63 TAPAS IRAM 30m Interest ATCA: Radiocuasars Archive LOFAR: Radiointerferometric extension - IVOA Note J. D. Santander-Vela et al Building a VO compliant Radio Astronomical DAta Model for Single-dish radio telescopes 2010 J. D. Santander-Vela et al. A&A submitted. - TAPAS, a VO radio archive at the IRAM-30m telescope S. Leon et al. A&A submitted.
7 Robledo DSS-63 ARCHIVES Antenna Madrid Deep Space Communication Complex" (MDSCC) Deep Space Network (DSN) of JPL-NASA 70m in Robledo de Chavela (Madrid) 5% operational time for observations K band Spectra (18-26 GHz) H 2 O Masers, methanol, NH 3,.. Datafiller Python scripting FITS Headers parsing FITS Conversion Archive Maintenance LAEFF-INTA
8 ARCHIVES TAPAS - IRAM 30m VO Archive Telescope Archive for Public Access System Antenna IGN (Spain), CNRS (France), MPI (Germany) Bolometric observations, maps, spectra Rotational molecular transitions ~200 scientific projects / year, 1TB Datafiller BDD insertions in real time Python scripting XML parsing Archive Maintenance Web Interface for Data Management IRAM 30m
9 ARCHIVES TAPAS - IRAM 30m VO Archive Telescope Archive for Public Access System
10 SOFTWARE MOVOIR MOdular VO Interface for Radio astronomy applications J.D. Santander-Vela What is it? API for adding VO functionality to legacy software How? Combines open source VO Tools Astrogrid Runtime SAMP Client Library Starlink Tables Infrastructure Library Where? MASSA: MAdrid Simple Spectral Analysis MADCUBA: MADrid CUBe Analysis Jesús Martín Pintado DAMIR - CSIC
11 SOFTWARE GIPSY Groningen Image Processing SYstem Connectivity ALMA/CASA VO Archives VO Software Accessible Usability GUI VO 3D Services Specifications Web Survey 3D Multiλ community Kinematical 3D Analysis Kapteyn Institute IAA CSIC
12 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility
13 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible
14 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible Improved user-friendliness Contextual help Use Cases recipes
15 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible Improved user-friendliness Contextual help Use Cases recipes Structured session work
16 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible Improved user-friendliness Contextual help Use Cases recipes Structured session work Workflow oriented
17 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible Improved user-friendliness Contextual help Use Cases recipes Structured session work Workflow oriented VO Connection: software and archives
18 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible Improved user-friendliness Contextual help Use Cases recipes Structured session work Workflow oriented VO Connection: software and archives No reduction tasks Allows edition of datasets GIPSY modeling tasks strength Integration of legacy GUIs
19 GIPSY GUI SOFTWARE Python development CASA connection data format compatibility Modular and extensible Improved user-friendliness Contextual help Use Cases recipes Structured session work Workflow oriented VO Connection: software and archives No reduction tasks Allows edition of datasets GIPSY modeling tasks strength Integration of legacy GUIs
20 MULTI-D ASTRONOMY Observational Techniques Radiointerferometry Integral Field Spectroscopy Multi Object Spectroscopy Fabry-Perot Instruments Tunable Filters OTF Imaging Credit Stephen Todd and Douglas Pierce-Price
21 MULTI-D ASTRONOMY Observational Techniques Radiointerferometry Integral Field Spectroscopy Multi Object Spectroscopy Fabry-Perot Instruments Tunable Filters OTF Imaging + POLARIZATION Credit Stephen Todd and Douglas Pierce-Price
22 MULTI-D ASTRONOMY Observational Techniques Radiointerferometry Integral Field Spectroscopy Multi Object Spectroscopy Fabry-Perot Instruments Tunable Filters OTF Imaging + POLARIZATION + TIME Credit Stephen Todd and Douglas Pierce-Price
23 DATA: TYPED VS. GENERIC Typed Data Tabular Data 1D Spectra 2D Images 3D Cubes Time series DAL Protocols Parameter based queries Models Complete characterization
24 DATA: TYPED VS. GENERIC Typed Data Tabular Data 1D Spectra 2D Images 3D Cubes Time series DAL Protocols Parameter based queries Models Complete characterization Generic / MultiTyped Dataset Complex data associations of different individual types Survey Field - spectral data cube - 2D projections/extractions of the cube - source catalog computed from the 2-D continuum - some extracted spectra of objects in the field
25 SERVICES: DISCOVERY VS. ACCESS Discovery ConeSearch QueryData Method in DAL protocols Parameter based queries RA, DEC, SR, POS, SIZE, BAND, TIME, POL Output: List of results fulfilling the filter criteria
26 SERVICES: DISCOVERY VS. ACCESS Discovery ConeSearch QueryData Method in DAL protocols Parameter based queries RA, DEC, SR, POS, SIZE, BAND, TIME, POL Output: List of results fulfilling the filter criteria Access AccessData Method in DAL2 protocols On-line processing and analysis services Provide on-the-fly generated data They should provide self-descriptive methods in order to be used as components of internet-based workflows (universal access) Implemented in GRID environments
27 VIRTUAL DATA Cutout Resample Spectrum extraction 2D slice extraction Dimensional reduction Filtering/Flagging Moments Complex transformations Solve latency transfer issues ALMA, LOFAR, EVLA produce GB spectral cubes
28 B0DEGA ARCHIVE Below 0 DEgrees GAlaxies PI: D. Espada Spectral cubes of a sample of ~100 galaxies Observed with SMA radio interferometer Molecular gas properties in the circumnuclear regions Southern galaxies Migration of GIPSY kinematical modeling tasks to AccessData methods for 3D VO Services
29 WORKFLOWS Wf4Ever Advanced Workflow Preservation Technologies for Enhanced Science Funded as STREP proposal under FP7 ICT isoco, UPMadrid, U. Manchester, Poznan PSNC, U. Oxford, Leiden U. Medical Center Scientific workflow Describes a reliably sequence of operations to compose and execute a series of computational or data manipulation steps connecting data and processes (scientific methodology) Standards for workflow digital descriptions allow the existence of software that Create/Edit/Open/Run workflows, which ensures: Reproducibility Community Sharing Extremely Formative
30 WORKFLOWS J.E. Ruiz -IX Reunión Científica de de la la SEA Madrid- 15/09/2010
31 WORKFLOWS
32 WORKFLOWS
33 WORKFLOWS
34 WORKFLOWS
35 WORKFLOWS
36 WORKFLOWS
37 WORKFLOWS
38 WORKFLOWS
How To Understand And Understand The Science Of Astronomy
Introduction to the VO [email protected] ESAVO ESA/ESAC Madrid, Spain The way Astronomy works Telescopes (ground- and space-based, covering the full electromagnetic spectrum) Observatories Instruments
Organization of VizieR's Catalogs Archival
Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Table of Contents Foreword...2 Environment applied to VizieR archives...3 The archive... 3 The producer...3 The user...3
ALMA Overview. Leonardo Testi (European Southern Observatory)
ALMA Overview Leonardo Testi (European Southern Observatory) The ALMA Project Status Timeline towards Early and Full Science Operations Future Developments Atacama Large Millimeter Array At least 50x12m
Lecture 5b: Data Mining. Peter Wheatley
Lecture 5b: Data Mining Peter Wheatley Data archives Most astronomical data now available via archives Raw data and high-level products usually available Data reduction software often specific to individual
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio
ALMA Technical Support. George J. Bendo UK ALMA Regional Centre Node University of Manchester
ALMA Technical Support George J. Bendo UK ALMA Regional Centre Node University of Manchester Overview ALMA organisation and services Websites o Web portal o Helpdesk Documentation Software o CASA o Observing
CURRICULUM VITAE PERSONAL DATA. ID/Passport: (NIE) Y0265573-Y Date of birth: 08-19-1979 Gender: Female Nationality: Mexican ACADEMIC BACKGROUND
CURRICULUM VITAE PERSONAL DATA Family name: Rodríguez Martínez Forename: Mónica Ivette ID/Passport: (NIE) Y0265573-Y Date of birth: 08-19-1979 Gender: Female Nationality: Mexican E-mail: [email protected] ACADEMIC
EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK
EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK Prepared by James O. Chibueze NAOJ Chile Observatory Purpose of this handbook: This handbook is aimed at providing fundamental information on how and where to access
The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory
The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory Astronomy in the XXI century The Internet revolution (the dot com boom ) has transformed
Software Development for Virtual Observatories
Software Development for Virtual Observatories BRAVO Workshop February 2007 Rafael Santos 1 Warning! This presentation is biased. I'll talk about VO software development, including some under the hood
CASA Analysis and Visualization
CASA Analysis and Visualization Synthesis... 1 Current Status... 1 General Goals and Challenges... 3 Immediate Goals... 5 Harnessing Community Development... 7 Synthesis We summarize capabilities and challenges
ALMA: Stato, Early Science,, ARC
ALMA: Stato, Early Science,, ARC Leonardo Testi INAF Osservatorio Astrofisico di Arcetri Il progetto ALMA Stato attuale e schedula Piani per Early Science e Science Operations Supporto utenti: Alma Regional
Archival of raw and analysed radar data at EISCAT and worldwide
Archival of raw and analysed radar data at EISCAT and worldwide Carl-Fredrik Enell, EISCAT Scientific Association COOPEUS workshop and EGI-CC kickoff, 11 March 2015 C-F Enell, EISCAT Radar data archival
The Murchison Widefield Array Data Archive System. Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia
The Murchison Widefield Array Data Archive System Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia Agenda Dataflow Requirements Solutions & Lessons learnt Open solution
and the VO-Science Francisco Jiménez Esteban Suffolk University
The Spanish-VO and the VO-Science Francisco Jiménez Esteban CAB / SVO (INTA-CSIC) Suffolk University The Spanish-VO (SVO) IVOA was created in June 2002 with the mission to facilitate the international
SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center)
SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center) SITools 2 SITools2 is a CNES generic tool performed by a joint effort between CNES and scienefic
D. Briukhov, L. Kalinichenko, i D. Martynov, N. Skvortsov, S.Stupnikov, A. Vovchenko, V. Zakharov, O. Zhelenkova
APPLICATION DRIVEN MEDIATION MIDDLEWARE GRID-INFRASTRUCTUREINFRASTRUCTURE FOR PROBLEM SOLVING OVER MULTIPLE HETEROGENEOUS DISTRIBUTED INFORMATION RESOURCES The Third International Conference "Distributed
CU9 Science Enabling Applications Development Work Package Software Requirements Specification (WP970)
Science Enabling Applications Development Work Package Software Requirements Specification (WP970) prepared by: approved by: reference: issue: revision: 1 X. Luri, P.M. Marrese, F.Julbe, H. Enke, N. Walton,
DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE
DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE Introduction - The EuroVO-DCA Census questionnaire The Euro-VO Data Centre Alliance (http://www.euro-vo.org/pub/dca/overview.html)
The Astronomical Data Warehouse
The Astronomical Data Warehouse Clive G. Page Department of Physics & Astronomy, University of Leicester, Leicester, LE1 7RH, UK Abstract. The idea of the astronomical data warehouse has arisen as the
This work was done in collaboration with the Centre de Données astronomiques de Strasbourg (CDS) and in particular with F. X. Pineau.
Chapter 5 Database and website This work was done in collaboration with the Centre de Données astronomiques de Strasbourg (CDS) and in particular with F. X. Pineau. 5.1 Introduction The X-shooter Spectral
The astronomical Virtual Observatory : lessons learnt, looking forward. Françoise Genova - Forum VO-PDC d après ADASS XXI, Paris, nov.
The astronomical Virtual Observatory : lessons learnt, looking forward Examples taken from the European view, but other projects have followed similar paths The VO aim Enable seamless access to the wealth
Datamanagement at the European Southern Observatory: Strategies and Challenges. Michael Sterzik, ESO Datamanagement and Operations Division
Datamanagement at the European Southern Observatory: Strategies and Challenges Michael Sterzik, ESO Datamanagement and Operations Division European Southern Observatory - builds and operates state-of-the-art
Silviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania)
Silviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania) Outline Introduction EO challenges; EO and classical/cloud computing; EO Services The computing platform Cluster -> Grid -> Cloud
Teaching Astronomy in the University of Granada. Eduardo Battaner Departamento de Física Teórica y del Cosmos
Teaching Astronomy in the University of Granada Eduardo Battaner Departamento de Física Teórica y del Cosmos Some history University created by Charles V in the XVI century (An arabic Madraza was created
FRACTAL S.L.N.E. A private company for engineering of scientific projects. Instrumentation and Software for Astronomy
FRACTAL S.L.N.E A private company for engineering of scientific projects Instrumentation and Software for Astronomy 1 Introducing FRACTAL FRACTAL S.L.N.E. is a private technological company funded in 2005.
Data Mining Challenges and Opportunities in Astronomy
Data Mining Challenges and Opportunities in Astronomy S. G. Djorgovski (Caltech) With special thanks to R. Brunner, A. Szalay, A. Mahabal, et al. The Punchline: Astronomy has become an immensely datarich
QUALITY CONTROL OF THE IUE FINAL ARCHIVE
QUALITY CONTROL OF THE IUE FINAL ARCHIVE N. Loiseau 1, E. Solano 1,M.Barylak 2 1 INSA/ESA IUE Observatory, Apdo. 50727, Villafranca del Castillo, 28080 Madrid (Spain). 2 ESA IUE Observatory, Apdo. 50727,
VisIVO, an open source, interoperable visualization tool for the Virtual Observatory
Claudio Gheller (CINECA) 1, Ugo Becciani (OACt) 2, Marco Comparato (OACt) 3 Alessandro Costa (OACt) 4 VisIVO, an open source, interoperable visualization tool for the Virtual Observatory 1: [email protected]
DAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID
DAME Astrophysical DAta Mining & Exploration on GRID M. Brescia S. G. Djorgovski G. Longo & DAME Working Group Istituto Nazionale di Astrofisica Astronomical Observatory of Capodimonte, Napoli Department
Canadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre
Canadian Astronomy Data Centre Séverin Gaudet David Schade Canadian Astronomy Data Centre Data Activities in Astronomy Features of the astronomy data landscape Multi-wavelength datasets are increasingly
MAST: The Mikulski Archive for Space Telescopes
MAST: The Mikulski Archive for Space Telescopes Richard L. White Space Telescope Science Institute 2015 April 1, NRC Space Science Week/CBPSS A model for open access The NASA astrophysics data archives
Testing maser-based evolutionary schemes: a new search for 37.7-GHz methanol masers
MNRAS 429, 3501 3516 (2013) doi:10.1093/mnras/sts621 Testing maser-based evolutionary schemes: a new search for 37.7-GHz methanol masers S. P. Ellingsen, 1 S. L. Breen, 2 M. A. Voronkov 2 andj.r.dawson
The human pipeline: distributed data reduction for ALMA
The human pipeline: distributed data reduction for ALMA Scott L. Schnee *a, Crystal Brogan a, Daniel Espada b,c,d, Elizabeth Humphries e, Shinya Komugi c, Dirk Petry e, Baltasar Vila-Vilaro b, and Eric
Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research
Astrophysics with Terabyte Datasets Alex Szalay, JHU and Jim Gray, Microsoft Research Living in an Exponential World Astronomers have a few hundred TB now 1 pixel (byte) / sq arc second ~ 4TB Multi-spectral,
LOFAR Software Development Roadmap
Netherlands Institute for Radio Astronomy LOFAR Software Development Roadmap LOFAR User Meeting 01/06/2015, Hanno Holties The team: Adriaan Renting, Arno Schoenmakers, Arthur Coolen, Jan David Mol, Jan
Planning and Scheduling Software for the Hobby Eberly Telescope. Niall I. Gaffney Hobby Eberly Telescope Mark E. Cornell McDonald Observatory
Planning and Scheduling Software for the Hobby Eberly Telescope Niall I. Gaffney Hobby Eberly Telescope Mark E. Cornell McDonald Observatory What is the HET project?! Joint Project: University of Texas
John C. Vernaleo, Ph.D.
Curriculum Vitae John C. Vernaleo, Ph.D. 121 Burt Ave Northport, NY 11768 Cell: (917)-538-4209 [email protected] http://www.netpurgatory.com Employment 2014-Present Senior Developer, Company 0, LLC
CASA the science data analysis package for ALMA
CASA the science data analysis package for ALMA Dirk Petry (ESO), April 2010 Outline What is CASA? - main features of CASA Who develops CASA? - development team What are the main requirements and how does
The Bamberg photographic plate archive
The Bamberg photographic plate archive The digitizing project H. Edelmann, N. Jansen, U. Heber, H. Drechsel, J. Wilms, I. Kreykenbohm Dr. Karl Remeis-Observatory & ECAP Astronomical Institute Friedrich-Alexander-University
THE CCLRC DATA PORTAL
THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: [email protected], [email protected] Abstract: The project aims
Exploring Gaia data with TOPCAT and the Virtual Observatory
Exploring Gaia data with TOPCAT and the Virtual Observatory Mark Taylor (University of Bristol) Gaia and the Unseen Brown Dwarf Question GREAT-ESF Workshop Torino University 26 March 2014 $Id: tcvo.tex,v
LLAMA Long Latin American Millimeter Array
LLAMA Long Latin American Millimeter Array The possibility of installing radio telescope(s) for millimeter and sub-millimeter wavelengths, in the Argentinean side of the Atacama desert at distances of
Charting the Transient Radio Sky on Sub-Second Time-Scales with LOFAR
Charting the Transient Radio Sky on Sub-Second Time-Scales with LOFAR Jason Hessels (ASTRON / UvA) with the LOFAR Pulsar Working Group (Stappers, van Leeuwen, Kramer, Karastergiou, Alexov, Hassall, Noutsos,
Data-Intensive Science and Scientific Data Infrastructure
Data-Intensive Science and Scientific Data Infrastructure Russ Rew, UCAR Unidata ICTP Advanced School on High Performance and Grid Computing 13 April 2011 Overview Data-intensive science Publishing scientific
A User s Guide to ALMA Scheduling Blocks (Cycle 3)
Doc 3.19, ver. 1 September, 2015 A User s Guide to ALMA Scheduling Blocks (Cycle 3) ALMA, an international astronomy facility, is a partnership of ESO (representing its member states), NSF (USA) and NINS
Visualization and Analysis of Spectral Data Cubes an Hipe toolbox
Visualization and Analysis of Spectral Data Cubes an Hipe toolbox Madrid 4-5 December 2008 Alain Gueguen MPE-Garching [email protected] 1 Goal of the tool Display and analysis toolbox for the spectral
Visualization of Semantic Windows with SciDB Integration
Visualization of Semantic Windows with SciDB Integration Hasan Tuna Icingir Department of Computer Science Brown University Providence, RI 02912 [email protected] February 6, 2013 Abstract Interactive Data
A Critical Review of Scientific Visualization in Astronomy
A Critical Review of Scientific Visualization in Astronomy Christopher Fluke & Amr Hassan Those not properly initiated into the mysteries of visualization research often seek to understand the images rather
The Data Quality Monitoring Software for the CMS experiment at the LHC
The Data Quality Monitoring Software for the CMS experiment at the LHC On behalf of the CMS Collaboration Marco Rovere, CERN CHEP 2015 Evolution of Software and Computing for Experiments Okinawa, Japan,
PI. Lourdes Verdes-Montenegro PM. Juande Santander-Vela Support: Julián Garrido (Instituto de Astrofísica de Andalucía-CSIC)
Spanish technological participation in the Square Kilometer Array (SKA) design: VIA-SKA project Feasibility study of the Spanish Technological Participation in the SKA (Subprograma Actuaciones Infraestructuras
Data analysis of L2-L3 products
Data analysis of L2-L3 products Emmanuel Gangler UBP Clermont-Ferrand (France) Emmanuel Gangler BIDS 14 1/13 Data management is a pillar of the project : L3 Telescope Caméra Data Management Outreach L1
A brief introduction to the Measurement Set and the ALMA Science Data Model
A brief introduction to the Measurement Set and the ALMA Science Data Model Dirk Petry (ESO), November 2014 Outline: Radio Data The Measurement Set The ASDM For the ALMA Cycle 2 PI - from the point of
Galaxy Morphological Classification
Galaxy Morphological Classification Jordan Duprey and James Kolano Abstract To solve the issue of galaxy morphological classification according to a classification scheme modelled off of the Hubble Sequence,