Introduction to the VO. ESAVO ESA/ESAC Madrid, Spain

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Introduction to the VO. Christophe.Arviset@esa.int ESAVO ESA/ESAC Madrid, Spain"

Transcription

1 Introduction to the VO ESAVO ESA/ESAC Madrid, Spain

2 The way Astronomy works Telescopes (ground- and space-based, covering the full electromagnetic spectrum) Observatories Instruments (telescope/band dependent) Observatories/Consortia Data analysis software (instrument dependent) Observatories/Consortia/Researchers Active Archives Observatories/Agencies Publications Journals Data curation (metadata + tables & catalogues) Data curators and Public Outreach Observatories/Agencies Euro-VO AIDA Workshop, 22/06/2009, page 2

3 Data Headers Processed Data Outreach Products Observatories Calibrations Raw Data Software Logs Instruments Analysis Data Products Telescope control Publications Catalogues Tables Papers Figures Computing Euro-VO AIDA Workshop, 22/06/2009, page 3

4 The VO Concept for Astronomy WEB : all documents in the world virtually on your computer VO : all astronomical data in the world virtually on your computer What the VO is NOT: A centralized database of all astronomical data A monolith software system A peer-to-peer system The VO framework Agreed standards Inter-operable data collections Inter-operable software modules Euro-VO AIDA Workshop, 22/06/2009, page 4

5 VO : What is needed? Global standards Transparent inter-operability for the end users Well funded data centres Space agencies, Ground based telescope, Labs Working data services Data remains the key! Purpose of this Workshop! VO aware client tools and portals Bring the data to the users VO aware data mining services New way of making science Euro-VO AIDA Workshop, 22/06/2009, page 5

6 IVOA : International Virtual Observatory Alliance including 17* National & International Partners Projects *Brazil just joined Euro-VO AIDA Workshop, 22/06/2009, page 6

7 IVOA IVOA Mission: To facilitate the international coordination and collaboration necessary for the development and deployment of the tools, systems and organizational structures necessary to enable the international utilization of astronomical archives as an integrated and interoperating virtual observatory Mainly about defining Interoperability standards Links to Data Centres Links to other communities IVOA Newsletter 2 interoperability meetings per year Mailing lists Wiki Euro-VO AIDA Workshop, 22/06/2009, page 7

8 Structure of IVOA Working Groups Data Access Layer Data Modeling Semantics Registry VOEvent VO Query Language VOTable Web & Grid Services Applications IVOA Executive Committee Technical Coordination Group Interest Groups Theory Data Curation and Preservation OGF Astro-RG IVOA exec Reps from each project Chair rotating every 18 months WGs Produces IVOA standards IGs Euro-VO AIDA Workshop, 22/06/2009, page 8

9 EURO-VO : ESA ESO France UK Italy Spain Germany The Netherlands VO Outreach (web, helpdesk, ) Science Advisory Committee VO Research Initiatives Science and Tech. Workshops User Support Registry of VO Resources Network of Data Centres in Europe VO technology take-up Publish data and metadata through VO services VO R&D Technologies for new projects and facilities Participation in IVOA WG/IGs Euro-VO AIDA Workshop, 22/06/2009, page 9

10 Euro-VO AIDA Project The Astronomical Infrastructure for Data Access (AIDA) project is funded by the EC FP7 through the Infrastructure call INFRA Scientific Digital Repositories Same partners as the EURO-VO 2.7M from EC Started Feb 2008 up to July Euro-VO AIDA aims at unifying the digital data collection of European astronomy, integrating their access mechanisms with evolving e- technologies and enhancing the science extracted from these data-sets Combination of DCA, VOTC, and FC activities One of Euro-VO AIDA goals is to support the European Data Centres in publishing their data through the VO framework Euro-VO AIDA Workshop, 22/06/2009, page 10

11 Publishing Data on the Internet Publish Document WEB SERVER Create document Robots makes Inventory Server Euro-VO AIDA Workshop, 22/06/2009, page 11

12 Publishing Data in the VO SSA SERVER S Create VO Service DALToolKit Produce Data Find List of VO Services Register VO Service Euro-VO AIDA Workshop, 22/06/2009, page 12

13 Data Providers in the VO Era The VO needs data Astronomical data providers lie at its foundation Data quality is the responsibility of the data providers The VO is more than a system; it s also a frame of mind Common access to more and heterogeneous data The VO also bring added value for data providers: Broadens data user base as data available through VO tools Allows cross correlation with similar data Allows remote computing, analysis and storage of data Foster new science Euro-VO AIDA Workshop, 22/06/2009, page 13

14 VO-compliant Archives The VO cannot (and does not) dictate how to manage an archive Data centres still need to produce data Data centres still require their own archive and access tools The VO requires data centres to have a VO layer to: translate their own model into the VO common language translate any locally defined metadata to the standard (IVOA compliant) ones (e.g., RA can be called in many different ways) hide any observatory/telescope/instrument specific detail and work in astronomical units: e.g., wavelength range/band (not grism or filter name), spectral resolution, signal-to-noise ratio, field of view, limiting magnitude Euro-VO AIDA Workshop, 22/06/2009, page 14

Data centres in the. Virtual Observatory. F. Genova, IVOA Small Project meeting, September 2006 1

Data centres in the. Virtual Observatory. F. Genova, IVOA Small Project meeting, September 2006 1 Data centres in the Virtual Observatory F. Genova, IVOA Small Project meeting, September 2006 1 VO status (1) Many national projects Very different contexts/financing agencies A really world-wide, global

More information

The astronomical Virtual Observatory : lessons learnt, looking forward. Françoise Genova - Forum VO-PDC d après ADASS XXI, Paris, nov.

The astronomical Virtual Observatory : lessons learnt, looking forward. Françoise Genova - Forum VO-PDC d après ADASS XXI, Paris, nov. The astronomical Virtual Observatory : lessons learnt, looking forward Examples taken from the European view, but other projects have followed similar paths The VO aim Enable seamless access to the wealth

More information

Euro-VO DCA. Board Meeting #1 Oct 2-3, 2006. Nic Walton for Mike Watson. CDS Strasbourg

Euro-VO DCA. Board Meeting #1 Oct 2-3, 2006. Nic Walton for Mike Watson. CDS Strasbourg Euro-VO DCA Board Meeting #1 Oct 2-3, 2006 Nic Walton for Mike Watson CDS Strasbourg AstroGrid AstroGrid: UK's Virtual Observatory Empowerment of scientists Improve the quality, ease, speed and cost effectiveness

More information

Canadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre

Canadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre Canadian Astronomy Data Centre Séverin Gaudet David Schade Canadian Astronomy Data Centre Data Activities in Astronomy Features of the astronomy data landscape Multi-wavelength datasets are increasingly

More information

Data Centre Alliance - Science

Data Centre Alliance - Science Data Centre Alliance - Science Mark ALLEN, Jonathan TEDDS & DCA IST Nov 2008 IST Internal Science Team Activities of the IST are being rounded off for end of project Coordinated by IST telecon IST: T2-DCA-IST

More information

The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory

The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory Astronomy in the XXI century The Internet revolution (the dot com boom ) has transformed

More information

Observer Access to the Cherenkov Telescope Array

Observer Access to the Cherenkov Telescope Array Observer Access to the Cherenkov Telescope Array IRAP, Toulouse, France E-mail: jknodlseder@irap.omp.eu V. Beckmann APC, Paris, France E-mail: beckmann@apc.in2p3.fr C. Boisson LUTh, Paris, France E-mail:

More information

ALMA Technical Support. George J. Bendo UK ALMA Regional Centre Node University of Manchester

ALMA Technical Support. George J. Bendo UK ALMA Regional Centre Node University of Manchester ALMA Technical Support George J. Bendo UK ALMA Regional Centre Node University of Manchester Overview ALMA organisation and services Websites o Web portal o Helpdesk Documentation Software o CASA o Observing

More information

Organization of VizieR's Catalogs Archival

Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Table of Contents Foreword...2 Environment applied to VizieR archives...3 The archive... 3 The producer...3 The user...3

More information

Multidimensional Data in the Virtual Observatory

Multidimensional Data in the Virtual Observatory IX Reunión Científica de la SEA Madrid- 15/09/2010 Red Temática SVO Multidimensional Data in the Virtual Observatory José Enrique Ruiz Grupo AMIGA Instituto de Astrofísica de Andalucía CSIC Contextual

More information

on the establishment of a Brazilian Science Data Center (BSDC) General Guidelines

on the establishment of a Brazilian Science Data Center (BSDC) General Guidelines on the establishment of a Brazilian Science Data Center (BSDC) General Guidelines 1 Introduction Since the entrance of Brazil in ICRANet a variety of projects have been started to be developed a) in the

More information

THE US NATIONAL VIRTUAL OBSERVATORY. IVOA WebServices. William O Mullane The Johns Hopkins University

THE US NATIONAL VIRTUAL OBSERVATORY. IVOA WebServices. William O Mullane The Johns Hopkins University THE US NATIONAL VIRTUAL OBSERVATORY IVOA WebServices William O Mullane The Johns Hopkins University 1 What exactly is a WS? FROM http://dev.w3.org/cvsweb/~checkout~/2002/ws/arch/wsa/wd-wsaarch.html#whatisws

More information

DRIVER Providing value-added services on top of Open Access institutional repositories

DRIVER Providing value-added services on top of Open Access institutional repositories DRIVER Providing value-added services on top of Open Access institutional repositories Dr Dale Peters Scientific Technical Manager : DRIVER SUB Goettingen Germany Gaining the momentum: Open Access and

More information

Usage statistics and archiving process of VizieR data in the VO context

Usage statistics and archiving process of VizieR data in the VO context Usage statistics and archiving process of VizieR data in the VO context VO Implementation status VO Implementation status Application VOTable (1.1 1.2 1.3) Semantic Data Access Layer Data Model MOC SAMP

More information

Bringing Big Data to the Solar System. Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling)

Bringing Big Data to the Solar System. Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling) Bringing Big Data to the Solar System Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling) pp.penteado@gmail.com http://www.ppenteado.net What is Big Data and why do we care?

More information

Archival Science with the ESAC Science Archives and Virtual Observatory

Archival Science with the ESAC Science Archives and Virtual Observatory Archival Science with the ESAC Science Archives and Virtual Observatory Deborah Baines Science Archives and VO Team Scientist European Space Agency (ESA) European Space Astronomy Centre (ESAC) Science

More information

Title. Herschel data-mining tools enabling Herschel-ALMA science. Pedro García-Lario, Head of Herschel Science Centre & Herschel Mission Manager

Title. Herschel data-mining tools enabling Herschel-ALMA science. Pedro García-Lario, Head of Herschel Science Centre & Herschel Mission Manager Title Herschel data-mining tools enabling Herschel-ALMA science Pedro García-Lario, Head of Herschel Science Centre & Herschel Mission Manager Herschel Science Centre WWW http://www.cosmos.esa.int/web/herschel/

More information

AAA for IMOS: Australian Access Federation & related components

AAA for IMOS: Australian Access Federation & related components AAA for IMOS: Australian Access Federation & related components James Dalziel Professor of Learning Technology, and Director, Macquarie E-Learning Centre Of Excellence (MELCOE) Macquarie University james@melcoe.mq.edu.au

More information

The Virtual Observatory in Action

The Virtual Observatory in Action The Virtual Observatory in Action VO drivers VO vision VO progress World AstroGrid VO Desktop demo Oxford erc Andy Lawrence Jan 2008 VO drivers : science science services several trends lead to science

More information

The Astronomical Data Warehouse

The Astronomical Data Warehouse The Astronomical Data Warehouse Clive G. Page Department of Physics & Astronomy, University of Leicester, Leicester, LE1 7RH, UK Abstract. The idea of the astronomical data warehouse has arisen as the

More information

THE CCLRC DATA PORTAL

THE CCLRC DATA PORTAL THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: g.j.drinkwater@dl.ac.uk, s.a.sufi@dl.ac.uk Abstract: The project aims

More information

and the VO-Science Francisco Jiménez Esteban Suffolk University

and the VO-Science Francisco Jiménez Esteban Suffolk University The Spanish-VO and the VO-Science Francisco Jiménez Esteban CAB / SVO (INTA-CSIC) Suffolk University The Spanish-VO (SVO) IVOA was created in June 2002 with the mission to facilitate the international

More information

Lecture 5b: Data Mining. Peter Wheatley

Lecture 5b: Data Mining. Peter Wheatley Lecture 5b: Data Mining Peter Wheatley Data archives Most astronomical data now available via archives Raw data and high-level products usually available Data reduction software often specific to individual

More information

DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE

DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE DCA QUESTIONNAIRE V0.1-1 INTRODUCTION AND IDENTIFICATION OF THE DATA CENTRE Introduction - The EuroVO-DCA Census questionnaire The Euro-VO Data Centre Alliance (http://www.euro-vo.org/pub/dca/overview.html)

More information

Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing.

Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing. Exploring the roles and responsibilities of data centres and institutions in curating research data a preliminary briefing. Dr Liz Lyon, UKOLN, University of Bath Introduction and Objectives UKOLN is undertaking

More information

Exploitation of ISS scientific data

Exploitation of ISS scientific data Cooperative ISS Research data Conservation and Exploitation Exploitation of ISS scientific data Luigi Carotenuto Telespazio s.p.a. Copernicus Big Data Workshop March 13-14 2014 European Commission Brussels

More information

Datamanagement at the European Southern Observatory: Strategies and Challenges. Michael Sterzik, ESO Datamanagement and Operations Division

Datamanagement at the European Southern Observatory: Strategies and Challenges. Michael Sterzik, ESO Datamanagement and Operations Division Datamanagement at the European Southern Observatory: Strategies and Challenges Michael Sterzik, ESO Datamanagement and Operations Division European Southern Observatory - builds and operates state-of-the-art

More information

EChO Ground Segment: Overview & Science Operations Assumptions

EChO Ground Segment: Overview & Science Operations Assumptions EChO Ground Segment: Overview & Science Operations Assumptions Matthias Ehle & the Science Ground Segment Working Group EChO Science Operations Study Manager ESA-ESAC, Madrid Science Operations Department/Division

More information

EUDAT. Towards a pan-european Collaborative Data Infrastructure

EUDAT. Towards a pan-european Collaborative Data Infrastructure EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland EISCAT User Meeting, Uppsala,6 May 2013 2 Exponential growth Data trends Zettabytes

More information

Grant Agreement N 215483. Updated Project Web Portal. Eric Schmieders (UniDue) Deliverable #PO-SoE-1.2.9. Version: 1.0.

Grant Agreement N 215483. Updated Project Web Portal. Eric Schmieders (UniDue) Deliverable #PO-SoE-1.2.9. Version: 1.0. Grant Agreement N 215483 Title: Authors: Editor: Reviewers: Identifier: Type: Updated Project Web Portal UniDue Eric Schmieders (UniDue) Neil Maiden (CITY) Deliverable #PO-SoE-1.2.9 Deliverable Version:

More information

The Knowledge Sharing Infrastructure KSI. Steven Krauwer

The Knowledge Sharing Infrastructure KSI. Steven Krauwer The Knowledge Sharing Infrastructure KSI Steven Krauwer 1 Why a KSI? Building or using a complex installation requires specialized skills and expertise. CLARIN is no exception. CLARIN is populated with

More information

Sustainability Models for Digital Preservation Federations

Sustainability Models for Digital Preservation Federations Sustainability Models for Digital Preservation Federations Robert H. McDonald San Diego Supercomputer Center mcdonald@sdsc.edu Tyler O. Walters Georgia Institute of Technology tyler@gatech.edu Governance

More information

Towards a New Model for the Infrastructure Grid

Towards a New Model for the Infrastructure Grid INTERNATIONAL ADVANCED RESEARCH WORKSHOP ON HIGH PERFORMANCE COMPUTING AND GRIDS Cetraro (Italy), June 30 - July 4, 2008 Panel: From Grids to Cloud Services Towards a New Model for the Infrastructure Grid

More information

Virtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010

Virtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010 Virtual Observatories Virtual Observatories 1%%&'&$#-&6!&9:#,*3),!#,6!6#$C!&,&$D2 *:#%&+-3;& D&);&-$2!!"! "!" &,&$D2 %),-&,-!"#$%&'&#()*! $#%&!(!!! $ '!%&$ $! (% %)'6!6#$C!;#--&$G $! '!!! $#63#-3),G $!

More information

ESO scalable architecture for operational databases

ESO scalable architecture for operational databases ESO scalable architecture for operational databases I. Vera, A. Dobrzycki, A. M. Chavan, P. Nass, J. S. Lockhart European Southern Observatory, Karl-Schwarzschild-Str 2, D-85748 Garching, Germany ABSTRACT

More information

WP8: SA Multi-messenger Data Access Service (HEAP-way)

WP8: SA Multi-messenger Data Access Service (HEAP-way) WP8: SA Multi-messenger Data Access Service (HEAP-way) Javier Rico (ICREA/IFAE, Spain) + Giovanni Lamanna (CNRS, France) + Daniele Martello (INFN Lecce, Italy) + Uli Katz (Universität Erlangen-Nürnberg,

More information

Web Services and other IVOA GWS works, Workflow,

Web Services and other IVOA GWS works, Workflow, OV France Theory Meeting 5-6 April 2006 Web Services and other IVOA GWS works, Workflow, André Schaaff, CDS André Journée Schaaff Calculs OV et France Données Theory distribués Meeting Web Services : a

More information

Software Development for Virtual Observatories

Software Development for Virtual Observatories Software Development for Virtual Observatories BRAVO Workshop February 2007 Rafael Santos 1 Warning! This presentation is biased. I'll talk about VO software development, including some under the hood

More information

Efficient and Scalable Climate Metadata Management with the GRelC DAIS

Efficient and Scalable Climate Metadata Management with the GRelC DAIS Efficient and Scalable Climate Metadata Management with the GRelC DAIS G. Aloisio, S. Fiore CMCC Scientific Computing and Operations Division University of Salento, Lecce Context : countdown of the Intergovernmental

More information

The ALMA Proposal Submission Process

The ALMA Proposal Submission Process The ALMA Proposal Submission Process How to get started, and what to expect Presenter: Andrew McNichols Authors: Harvey Liszt, Tony Remijan, Andrew McNichols Atacama Large Millimeter/submillimeter Array

More information

SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center)

SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center) SITools2 as VO service provider: an example with Herschel at IDOC (Integrated Data and Operation Center) SITools 2 SITools2 is a CNES generic tool performed by a joint effort between CNES and scienefic

More information

Constructing the Subaru Advanced Data and Analysis Service on VO

Constructing the Subaru Advanced Data and Analysis Service on VO Constructing the Subaru Advanced Data and Analysis Service on VO Yuji Shirasaki on behalf of ADC National Astronomical Observatory of Japan Astronomy Data Center Contents Subaru Telescope and Instruments

More information

ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)

ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio

More information

Wide-Field Plate Database: Service for Astronomy

Wide-Field Plate Database: Service for Astronomy Wide-Field Plate Database: Service for Astronomy Milcho K. Tsvetkov To cite this version: Milcho K. Tsvetkov. Wide-Field Plate Database: Service for Astronomy. IMCCE. International Workshop NAROO-GAIA

More information

Big Data, Big Challenges and new Paradigm for the Gaia Archive

Big Data, Big Challenges and new Paradigm for the Gaia Archive Big Data, Big Challenges and new Paradigm for the Gaia Archive Christophe Arviset Head of ESAC Science Data Centre 15/03/2016 Issue/Revision: 1.0 Reference: Gaia Archive's big data challenges Status: Issued

More information

The Very High Energy source catalogue at the ASI Science Data Center

The Very High Energy source catalogue at the ASI Science Data Center The Very High Energy source catalogue at the ASI Science Data Center a,b, F. Lucarelli a,b, L. A. Antonelli a,b, P. Giommi b E-mail: alessandro.carosi@oa-roma.inaf.it a INAF, National Institute for Astrophysics,

More information

OpenAIRE Research Data Management Briefing paper

OpenAIRE Research Data Management Briefing paper OpenAIRE Research Data Management Briefing paper Understanding Research Data Management February 2016 H2020-EINFRA-2014-1 Topic: e-infrastructure for Open Access Research & Innovation action Grant Agreement

More information

The Planck Legacy Archive: current status, contents and future development. Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain

The Planck Legacy Archive: current status, contents and future development. Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain The Planck Legacy Archive: current status, contents and future development Xavier Dupac ESA-ESAC Villanueva de la Cañada, Spain Outline Introduction Schedule Scientific contents of the PLA Additional contents

More information

CoSADIE Data Centre Forum. Summary and conclusions

CoSADIE Data Centre Forum. Summary and conclusions CoSADIE Data Centre Forum Summary and conclusions A forum for the data centre community Tell the story of what they do and of their relationship with the VO Know each other better Community building Communication

More information

EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK

EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK Prepared by James O. Chibueze NAOJ Chile Observatory Purpose of this handbook: This handbook is aimed at providing fundamental information on how and where to access

More information

Certification of Electronic Health Record systems (EHR s)

Certification of Electronic Health Record systems (EHR s) Certification of Electronic Health Record systems (EHR s) The European Inventory of Quality Criteria Georges J.E. DE MOOR, M.D., Ph.D. EUROREC EuroRec The «European Institute for Health Records» A not-for-profit

More information

Open Access to publications and research data in Horizon 2020

Open Access to publications and research data in Horizon 2020 Open Access to publications and research data in Horizon 2020 Celina Ramjoué Head of Sector Open Access to Scientific Publications and Data Digital Science Unit CONNECT.C3 4 December 2013 Meeting of National

More information

Australian Virtual Observatory

Australian Virtual Observatory Australian Virtual Observatory International Astronomical Union GA 2003 Joint Discussion 08 17th-18th July 2003 Sydney David Barnes The University of Melbourne Our take on virtual observatories bring legacy

More information

earthnet online The ESA Earth Observation Multi-Mission User Information Services

earthnet online The ESA Earth Observation Multi-Mission User Information Services r bulletin 93 february 1998 earthnet online The ESA Earth Observation Multi-Mission User Information Services G. Landgraf & L. Fusco Remote Sensing Exploitation Department, ESA Directorate of Application

More information

Digital libraries of the future and the role of libraries

Digital libraries of the future and the role of libraries Digital libraries of the future and the role of libraries Donatella Castelli ISTI-CNR, Pisa, Italy Abstract Purpose: To introduce the digital libraries of the future, their enabling technologies and their

More information

Virtual Archive as a prototype distributed data system for scientific knowledge base

Virtual Archive as a prototype distributed data system for scientific knowledge base Virtual Archive as a prototype distributed data system for scientific knowledge base A.I.Osin E.P.Trushkina V.D.Kuznetsov osin@izmiran.ru elena@izmiran.ru kvd@izmiran.ru Pushkov Institute of Terrestrial

More information

MAST: The Mikulski Archive for Space Telescopes

MAST: The Mikulski Archive for Space Telescopes MAST: The Mikulski Archive for Space Telescopes Richard L. White Space Telescope Science Institute 2015 April 1, NRC Space Science Week/CBPSS A model for open access The NASA astrophysics data archives

More information

Releasing ESO Public Survey Data through the Phase 3

Releasing ESO Public Survey Data through the Phase 3 Releasing ESO Public Survey Data through the Phase 3 Jörg Retzlaff European Southern Observatory Data Management and Operations Division, Archive Science Group (ASG) Outline Releasing ESO Public Survey

More information

Standard Big Data Architecture and Infrastructure

Standard Big Data Architecture and Infrastructure Standard Big Data Architecture and Infrastructure Wo Chang Digital Data Advisor Information Technology Laboratory (ITL) National Institute of Standards and Technology (NIST) wchang@nist.gov May 20, 2016

More information

Energy Efficient Systems

Energy Efficient Systems Energy Efficient Systems Workshop Report (September 2014) Usman Wajid University of Manchester United Kingdom Produced as a result of Workshop on Energy Efficient Systems @ ICT4S conference, Stockholm

More information

Using the Parkes Pulsar Data Archive

Using the Parkes Pulsar Data Archive JART http://www.jart.ac.cn Using the Parkes Pulsar Data Archive J. Khoo 1, G. Hobbs 1, R. N. Manchester 1, D. Miller 2, J. Dempsey 2 1 CSIRO Astronomy and Space Science, Australia Telescope National Facility,

More information

Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot

Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot www.etidaho.com (208) 327-0768 Data Mining, Predictive Analytics with Microsoft Analysis Services and Excel PowerPivot 3 Days About this Course This course is designed for the end users and analysts that

More information

QUALITY CONTROL OF THE IUE FINAL ARCHIVE

QUALITY CONTROL OF THE IUE FINAL ARCHIVE QUALITY CONTROL OF THE IUE FINAL ARCHIVE N. Loiseau 1, E. Solano 1,M.Barylak 2 1 INSA/ESA IUE Observatory, Apdo. 50727, Villafranca del Castillo, 28080 Madrid (Spain). 2 ESA IUE Observatory, Apdo. 50727,

More information

The Bamberg photographic plate archive

The Bamberg photographic plate archive The Bamberg photographic plate archive The digitizing project H. Edelmann, N. Jansen, U. Heber, H. Drechsel, J. Wilms, I. Kreykenbohm Dr. Karl Remeis-Observatory & ECAP Astronomical Institute Friedrich-Alexander-University

More information

A User s Guide to ALMA Scheduling Blocks (Cycle 3)

A User s Guide to ALMA Scheduling Blocks (Cycle 3) Doc 3.19, ver. 1 September, 2015 A User s Guide to ALMA Scheduling Blocks (Cycle 3) ALMA, an international astronomy facility, is a partnership of ESO (representing its member states), NSF (USA) and NINS

More information

nestor - Network of Expertise in Long-Term Storage and Long-Term availability of Digital Resources in Germany

nestor - Network of Expertise in Long-Term Storage and Long-Term availability of Digital Resources in Germany nestor - Network of Expertise in Long-Term Storage and Long-Term availability of Digital Resources in Germany 1. The challenge We still do not know how to archive digital scientific publications, works

More information

DAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID

DAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID DAME Astrophysical DAta Mining & Exploration on GRID M. Brescia S. G. Djorgovski G. Longo & DAME Working Group Istituto Nazionale di Astrofisica Astronomical Observatory of Capodimonte, Napoli Department

More information

Pan-European infrastructure for management of marine and ocean geological and geophysical data

Pan-European infrastructure for management of marine and ocean geological and geophysical data Pan-European infrastructure for management of marine and ocean geological and geophysical data By Dick M.A. Schaap Geo-Seas Technical Coordinator March 2010 Supported by the European Commission FP7 - Research

More information

TextGrid Research Infrastructure for the e-humanities

TextGrid Research Infrastructure for the e-humanities TMS - Text Mining Services Leipzig, 25.03.2009 TextGrid Research Infrastructure for the e-humanities Martina Kerzel Goettingen State and University Library Research & Development Department kerzel@sub.uni-goettingen.de

More information

IO Informatics The Sentient Suite

IO Informatics The Sentient Suite IO Informatics The Sentient Suite Our software, The Sentient Suite, allows a user to assemble, view, analyze and search very disparate information in a common environment. The disparate data can be numeric

More information

"Service Lifecycle Management strategies for CIOs"

Service Lifecycle Management strategies for CIOs "Service Lifecycle strategies for CIOs" Ralf Hart, Sales Manager CEE Europe FrontRange Solutions 10th December 2008 Agenda FrontRange Solutions The challenges the IT community faces What is the solution?

More information

Long-term preservation in Europe. The strategy of the Alliance for Permanent Access

Long-term preservation in Europe. The strategy of the Alliance for Permanent Access Long-term preservation in Europe The strategy of the Alliance for Permanent Access Hans Jansen Director R&D, National Library of the Netherlands Rome, 29 October 2007 The first objective of the i2010 strategy

More information

Cloud Computing Actionable Standards An Overview of Cloud Specifications

Cloud Computing Actionable Standards An Overview of Cloud Specifications Computing Actionable Standards An Overview of Specifications Computing Broker Inter- Computing IaaS PaaS SaaS IaaS PaaS SaaS Web Data Web Data Michael Behrens, CTO, R2AD, LLC Eugene Luster, Standards Architect,

More information

EDG Project: Database Management Services

EDG Project: Database Management Services EDG Project: Database Management Services Leanne Guy for the EDG Data Management Work Package EDG::WP2 Leanne.Guy@cern.ch http://cern.ch/leanne 17 April 2002 DAI Workshop Presentation 1 Information in

More information

Impact of Big Data in Oil & Gas Industry. Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India.

Impact of Big Data in Oil & Gas Industry. Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India. Impact of Big Data in Oil & Gas Industry Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India. New Age Information 2.92 billions Internet Users in 2014 Twitter processes 7 terabytes

More information

An IDL for Web Services

An IDL for Web Services An IDL for Web Services Interface definitions are needed to allow clients to communicate with web services Interface definitions need to be provided as part of a more general web service description Web

More information

SRS BIO OPTICAL WORKFLOW

SRS BIO OPTICAL WORKFLOW SRS BIO OPTICAL WORKFLOW Version 2.0 22 nd March 2013 Data Workflows emii, the data management facility for IMOS, has developed workflows for each IMOS sub facility to describe the flow of IMOS data from

More information

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen Concepts and Architecture of Grid Computing Advanced Topics Spring 2008 Prof. Robert van Engelen Overview Grid users: who are they? Concept of the Grid Challenges for the Grid Evolution of Grid systems

More information

XSEDE Overview John Towns

XSEDE Overview John Towns April 15, 2011 XSEDE Overview John Towns XD Solicitation/XD Program extreme Digital Resources for Science and Engineering (NSF 08 571) Extremely Complicated High Performance Computing and Storage Services

More information

Global Scientific Data Infrastructures: The Big Data Challenges. Capri, 12 13 May, 2011

Global Scientific Data Infrastructures: The Big Data Challenges. Capri, 12 13 May, 2011 Global Scientific Data Infrastructures: The Big Data Challenges Capri, 12 13 May, 2011 Data-Intensive Science Science is, currently, facing from a hundred to a thousand-fold increase in volumes of data

More information

The NOAO Science Archive and NVO Portal: Information & Guidelines

The NOAO Science Archive and NVO Portal: Information & Guidelines The NOAO Science Archive and NVO Portal: Information & Guidelines Mark Dickinson, 14 March 2008 Orig. document by Howard Lanning & Mark Dickinson Thank you for your help testing the new NOAO Science Archive

More information

IVOA Single-Sign-On Profile: Authentication Mechanisms Version 2.0

IVOA Single-Sign-On Profile: Authentication Mechanisms Version 2.0 International Virtual Observatory Alliance IVOA Single-Sign-On Profile: Authentication Mechanisms Version 2.0 IVOA Proposed Recommendation 20151029 Working group http://www.ivoa.net/twiki/bin/view/ivoa/ivoagridandwebservices

More information

VAO Single Sign-on with OpenID

VAO Single Sign-on with OpenID VAO Single Sign-on with OpenID Ray Plante VAO NCSA 20 October 2011 IVOA Interoperability 20 Meeting October -- Pune 2011 IVOA Interoperability Meeting -- Pune Common Identities across the VO VAO Single

More information

Data Lab System Architecture

Data Lab System Architecture Data Lab System Architecture Data Lab Context Data Lab Architecture Astronomer s Desktop Web Page Cmdline Tools Legacy Apps User Code User Mgmt Data Lab Ops Monitoring Presentation Layer Authentication

More information

European activities in the area of Big Data

European activities in the area of Big Data Connecting Europe for New Horizon European activities in the area of Big Data Márta Nagy-Rothengass DG CONNECT, Head of Unit "Data Value Chain" META-Forum 2013, 19 September 2013, Berlin OUTLINE 1. Data

More information

EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling

EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling Miguel Cárdenas-Montes on behalf of Euforia collaboration Ibergrid 2008 May 12 th 2008 Porto Outline Project Objectives Members

More information

General concepts: DDI

General concepts: DDI General concepts: DDI Irena Vipavc Brvar, ADP SEEDS Kick-off meeting, Lausanne, 4. - 6. May 2015 How to describe our survey What we learned so far: If we want to use data at some point in the future,

More information

The Multimission National Center of the Italian Space Agency

The Multimission National Center of the Italian Space Agency The Multimission National Center of the Italian Space Agency L. Garramone - ASI GSCB Workshop, ESA/ESRIN Frascati Table of contents Multimission National Center (CNM): status of the activities; Main functions

More information

Shibbolized irods (and why it matters)

Shibbolized irods (and why it matters) Shibbolized irods (and why it matters) 3 rd TERENA Storage Meeting, Dublin, February 12 th -13 th 2009 David Corney, for Jens Jensen, e-science centre, Rutherford Appleton Lab, UK Overview Introduction

More information

Silviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania)

Silviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania) Silviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania) Outline Introduction EO challenges; EO and classical/cloud computing; EO Services The computing platform Cluster -> Grid -> Cloud

More information

Image Data, RDA and Practical Policies

Image Data, RDA and Practical Policies Image Data, RDA and Practical Policies Rainer Stotzka and many others KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association www.kit.edu Data Life Cycle Lab

More information

A New Data Visualization and Analysis Tool

A New Data Visualization and Analysis Tool Title: A New Data Visualization and Analysis Tool Author: Kern Date: 22 February 2013 NRAO Doc. #: Version: 1.0 A New Data Visualization and Analysis Tool PREPARED BY ORGANIZATION DATE Jeff Kern NRAO 22

More information

Data providers technical feedback

Data providers technical feedback Data providers technical feedback DCA WP 3.2 (LU) Report May 2007 Anita Richards (JBO) & Jonathan Tedds (LU) Terms of reference Activities up to 1 st PCT meeting Thurs Session 1 Plans Thurs Session 3 WP

More information

Data Management in NeuroMat and the Neuroscience Experiments System (NES)

Data Management in NeuroMat and the Neuroscience Experiments System (NES) Data Management in NeuroMat and the Neuroscience Experiments System (NES) Kelly Rosa Braghetto Department of Computer Science Institute of Mathematics and Statistics - University of São Paulo 1st NeuroMat

More information

Introduction Recall of the Theory Group context and SimDM Accessing theoretical data The SimDAL proposal Remarks Conclu.

Introduction Recall of the Theory Group context and SimDM Accessing theoretical data The SimDAL proposal Remarks Conclu. SimDAL proposals Observatoire de Paris / VO-Paris Data Centre David Languignon, Franck Le Petit Poona, India October 25, 2011 1 Introduction Table of Content 2 Recall of the Theory Group context and SimDM

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

SGS System Requirements Review

SGS System Requirements Review SGS System Requirements Review John Hoar Lausanne 09/06/2015 Quick recap The Science Ground Segment transforms measurements made by the Euclid instruments into data products ready for scientific use. This

More information

This vision will be accomplished by targeting 3 Objectives that in time are further split is several lower level sub-objectives:

This vision will be accomplished by targeting 3 Objectives that in time are further split is several lower level sub-objectives: Title: Common solution for the (very-)large data challenge Acronym: VLDATA Call: EINFRA-1 (Focus on Topic 5) Deadline: Sep. 2nd 2014 This proposal complements: Title: e-connecting Scientists Call: EINFRA-9

More information

The Future Astronomical Software Environment progress

The Future Astronomical Software Environment progress Mem. S.A.It. Suppl. Vol. 13, 111 c SAIt 2009 Memorie della Supplementi The Future Astronomical Software Environment progress L. Paioro 1, B. Garilli 1, P. Grosbøl 2, D. Tody 3,4, C. Surace 5, T. Fenouillet

More information

Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research

Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research Astrophysics with Terabyte Datasets Alex Szalay, JHU and Jim Gray, Microsoft Research Living in an Exponential World Astronomers have a few hundred TB now 1 pixel (byte) / sq arc second ~ 4TB Multi-spectral,

More information