The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team

Size: px
Start display at page:

Download "The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team"

Transcription

1 The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team Photo courtesy Andrew Mahoney

2 NSF Vision What is AON? a system of atmospheric, land- and ocean-based environmental monitoring capabilities--from ocean buoys to satellites--that will significantly advance our observations of Arctic environmental conditions. Data from the AON will enable the interagency U.S. government initiative--the Study of Environmental Arctic Change (SEARCH)--to get a handle on the wide-ranging series of significant and rapid changes occurring in the Arctic. Vision for an AON data portal a portal through which scientists can find all data relevant to a location or process; all data have browse imagery and complete documentation; time series or fields can be plotted online; and all metadata are in a relational database so that multiple data sets and sources can be queried. Toward an Integrated Arctic Observing Network, NAS, Data Management chapter. (www.nap.edu/catal og/11607.html)

3 AON at present (Google AON Arctic EOL for more info)

4 The Cooperative Arctic Data and Information Service (CADIS) A joint NCAR, NSIDC, UCAR project to meet AON data management challenges Challenges include Multidisciplinary data, in many formats Diversity of archiving and access needs Meeting PI s expectations Coordinating with/leveraging other EO CI and DM interoperability efforts

5 Meeting PI and Community Expectations Enter metadata quickly, efficiently, and without confusion Find my own data and display it Display it over or with other data sets of interest (that may or may not be in the CADIS system) Mathematically manipulate data Export in a choice of formats Easy to use, graphical interfaces Examples to emulate ArcticRIMS - NOAA ESRL PSD -

6 Coordinating With Other Earth Observation CI and Data Management Projects NSF funded data portals Marine Geoscience Data System Geosciences Network (GEON) National Ecological Observatory Network (NEON) Other portals of note Alaska Ocean Observing System (part of IOOS/GCOS) ESA s soon to be Group on Earth Observations GEOPortal The Marine Metadata Initiative DAMOCLES, with links to WMO information system if efforts are not coordinated, the observatory communities will continue to expend great resources developing their CI in isolation.while numerous CI tools and services already exist that can be leveraged, they represent different architectural approaches, typically targeted at a very narrow set of requirements, and are not well integrated with each other. -- Shared Cyberinfrastructure for Environmental Observatories: Identifying Common Needs, Barriers, and Solutions. Whitepaper by Minsker and Butler, NCSA

7 Time pressure demands a pragmatic approach First priority: A user friendly data and metadata entry tool Build on existing tools NCAR s Community Data Portal for PI-managed data management GCMD Doc-builder as a rough model for a metadata entry tool Metadata A CADIS profile Incorporates the International Polar Year profile: Compatible with GCMD DIF, FGDC CSDGM and eventually, with ISO19115/19139 Adds fields for improved discovery

8 AON Metadata Entry Form at CDP PIs enter metadata Context sensitive help Controlled vocabulary where possible Fields pre-populated where possible Can start with metadata from a data set that is like yours What happens to the metadata after its entered? In a metadata db In a directory exposed to Web crawlers Can be mapped to other standards Native format is NCAR THREDDS

9 CADIS Data Hierarchy on the CDP Nested Collections

10 Individual Dataset PIs determine what constitutes a data set

11 Data in a standard format where possible NetCDF with CF conventions Many existing tools for subsetting and mathematically manipulating large multidimensional data sets in NetCDF Less experience with station or point data in netcdf Translators to get data into NetCDF from EASE-Grid, GRIB, and other formats are in development Request for data in BUFR (Arctic Reanalysis)

12 Visualization Work toward addressing the basic use case Locate data Map server Google Earth or other virtual globe Google-type search Faceted search Visualize data Visualization tools will build on NOAA PMEL s Live Access Server (LAS/Ferret) and NCAR s Integrated Data Viewer (IDV) Virtual globes and/or GIS may be used

13 Summary Just completing first year of CADIS development Data/Metadata entry Portal testing underway Datasets into the archive beginning in early 2008 CADIS features will evolve with improvements in the Community Data Portal interface

14 The CADIS Team = NCAR CISL, NCAR EOL, UCAR, and NSIDC Grant PIs

15 Engineering Roadmap

16 Definitions The Community Data Portal (CDP) integrates a suite of technologies including THREDDS and OPeNDAP (described below), Open Archive Initiative (OAI) metadata sharing, transparent access to NCAR s Mass Storage System, and a number of other resources. Under CDP architecture, data, metadata and services may be hosted on a system of separate servers interacting over the network, and metadata can be shared with other cooperating data centers and virtual organizations. CDP is Java-based and accessed via both browsers and applications. The AON portal will be a customization of the CDP running on an NSIDC server. Thematic Realtime Environmental Distributed Data Services (THREDDS) is for publishing and accessing data in netcdf or other self describing formats. Data services include: an OPeNDAP data server; an Open Geospatial Consortium Web Coverage Server, and a catalog that describes what data sets are available from a given THREDDS data server. THREDDS is written in Java, It works with data in many formats (e.g. netcdf, GRIB, HDF, ASCII etc.) and allows them to be described with many metadata standards (e.g. DIF, Dublin Core, and Climate and Forecast). THREDDS-aware desktop clients, such as IDL, MatLAB, or IDV, can access data in THREDDS catalogs (reached though the AON portal) directly.

17 Definitions (Con t) Open-source Project for a Network Data Access Protocol (OPeNDAP) is a protocol for requesting and transferring data over the Web using HTTP to frame requests and responses. Data are accessible remotely regardless of their local storage format. OPeNDAP is used to serve data in a variety of different formats, including NetCDF, GRIdded Binary (GRIB), and Hierarchical Data Format (HDF). (PMEL has a utility that allows in situ data like buoy data to be served via OPeNDAP as well). OPeNDAP servers (also known as DODS servers) located at institutions around the world provide model data, climatic data, satellite imagery, and ocean sensor results. The Internet Data Distribution (IDD) system makes data available in real-time. The user "subscribes" to data streams from a variety of sources and networks. The IDD then delivers the data as soon as they are available from each source using the Local Data Manager (LDM) software package to relay data from the source to the end user sites. The LDM supports flexible, site-specific configuration. We are envisioning the IASOA observatories using this technology as a trial for possible use by other AON observing systems. Currently IDD/LDM is used by 175 institutions for, e.g., satellite imagery, and National Weather Center output. The Unidata Integrated Data Viewer (IDV) is a software client for visualizing data (satellite imagery, gridded data, surface observations) within a single interface. IDV can display data that are in NetCDF, and will in the future handle data in HDF-5 as well. The Geosciences Network (GEON) is using IDV as its primary visualization tool.

Data Management in Science and the Legacy of the International Polar Year

Data Management in Science and the Legacy of the International Polar Year Data Management in Science and the Legacy of the International Polar Year Ellsworth LeDrew Mark Parsons Taco de Bruin Peter Yoon Christine Barnard Scott Tomlinson Warwick Vincent http://www.earthzine.org/2008/03/27/securing-the-legacy-of-ipy/

More information

Insights from 40 years of data services at NCAR s Research Data Archive. Douglas Schuster and Steven Worley

Insights from 40 years of data services at NCAR s Research Data Archive. Douglas Schuster and Steven Worley Insights from 40 years of data services at NCAR s Research Archive Douglas Schuster (schuster@ucar.edu) and Steven Worley (worley@ucar.edu) Highlights What is the? Evolution of Services User Registration

More information

Data Management Perspective for an International Arctic Observing Network: Preserving the Legacy Promoting Exchange

Data Management Perspective for an International Arctic Observing Network: Preserving the Legacy Promoting Exchange Data Management Perspective for an International Arctic Observing Network: Preserving the Legacy Promoting Exchange James A. Moore 1 Molly McCammon 2 Rob Bochenek 3 1 National Center for Atmospheric Research,

More information

Integrated Data Viewer (IDV) a visualization framework Yuan Ho Unidata Program Center Boulder, CO Presentation Outline Integrated Data Viewer (IDV) overview The IDV features IDV examples and customized

More information

13.2 THE INTEGRATED DATA VIEWER A WEB-ENABLED APPLICATION FOR SCIENTIFIC ANALYSIS AND VISUALIZATION

13.2 THE INTEGRATED DATA VIEWER A WEB-ENABLED APPLICATION FOR SCIENTIFIC ANALYSIS AND VISUALIZATION 13.2 THE INTEGRATED DATA VIEWER A WEB-ENABLED APPLICATION FOR SCIENTIFIC ANALYSIS AND VISUALIZATION Don Murray*, Jeff McWhirter, Stuart Wier, Steve Emmerson Unidata Program Center, Boulder, Colorado 1.

More information

PART 1. Representations of atmospheric phenomena

PART 1. Representations of atmospheric phenomena PART 1 Representations of atmospheric phenomena Atmospheric data meet all of the criteria for big data : they are large (high volume), generated or captured frequently (high velocity), and represent a

More information

Rosetta. A white paper on the challenges of sharing observational datasets. The Challenges of Sharing Observational Data

Rosetta. A white paper on the challenges of sharing observational datasets. The Challenges of Sharing Observational Data Rosetta A white paper on the challenges of sharing observational datasets The Challenges of Sharing Observational Data Observational studies are a critical component of geosciences education and research.

More information

The THREDDS Data Repository: for Long Term Data Storage and Access

The THREDDS Data Repository: for Long Term Data Storage and Access 8B.7 The THREDDS Data Repository: for Long Term Data Storage and Access Anne Wilson, Thomas Baltzer, John Caron Unidata Program Center, UCAR, Boulder, CO 1 INTRODUCTION In order to better manage ever increasing

More information

Using Message Brokering and Data Mediation to use Distributed Data Networks of Earth Science Data to Enhance Global Maritime Situational Awareness.

Using Message Brokering and Data Mediation to use Distributed Data Networks of Earth Science Data to Enhance Global Maritime Situational Awareness. Using Message Brokering and Data Mediation to use Distributed Data Networks of Earth Science Data to Enhance Global Maritime Situational Awareness. Conor Delaney, Alfredo Alessandrini & Harm Greidanus

More information

Real-time and Archived Antarctic. Interactive Processing Tools

Real-time and Archived Antarctic. Interactive Processing Tools Real-time and Archived Antarctic Meteorological Data via a Synergy of Interactive Processing Tools Mark W. Seefeldt Department of Atmospheric and Oceanic Sciences University it of Colorado at Boulder,

More information

The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA

The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA Dr. Conor Delaney 9 April 2014 GeoMaritime, London

More information

A DISTRIBUTED CATALOG AND DATA SERVICES SYSTEM FOR REMOTE SENSING DATA

A DISTRIBUTED CATALOG AND DATA SERVICES SYSTEM FOR REMOTE SENSING DATA A DISTRIBUTED CATALOG AND DATA SERVICES SYSTEM FOR REMOTE SENSING DATA Ramachandran Suresh *, Liping Di *, Kenneth McDonald ** * NASA/RITSS 4500 Forbes Blvd, Lanham, MD 20706, USA suresh@rattler.gsfc.nasa.gov

More information

Nevada NSF EPSCoR Track 1 Data Management Plan

Nevada NSF EPSCoR Track 1 Data Management Plan Nevada NSF EPSCoR Track 1 Data Management Plan August 1, 2011 INTRODUCTION Our data management plan is driven by the overall project goals and aims to ensure that the following are achieved: Assure that

More information

NOAA Environmental Data Management Update for Unidata SAC 2014-10-08

NOAA Environmental Data Management Update for Unidata SAC 2014-10-08 NOAA Environmental Management Update for Unidata SAC 2014-10-08 Jeff de La Beaujardière, PhD NOAA Management Architect +1 301-713-7175 NOAA data are unique, valuable, and irreplaceable Many observing systems:

More information

Advancement of the NOMADS for Observational Data and Model Intercomparisons and the Establishment of a NCDC NOMADS Team and HelpDesk

Advancement of the NOMADS for Observational Data and Model Intercomparisons and the Establishment of a NCDC NOMADS Team and HelpDesk Advancement of the NOMADS for Observational Data and Model Intercomparisons and the Establishment of a NCDC NOMADS Team and HelpDesk A NOMADS Collaboration White Paper 5/5/2003 This white paper is intended

More information

THREDDS. THematic Real-time Environmental Distributed Data Services. Connecting people, documents and data

THREDDS. THematic Real-time Environmental Distributed Data Services. Connecting people, documents and data THREDDS THematic Real-time Environmental Distributed Data Services Connecting people, documents and data Ben Domenico, John Caron, Ethan Davis, Robb Kambic, Stefano Nativi Unidata Program Center and University

More information

Introduction to the NOAA Earth Information System (NEIS)

Introduction to the NOAA Earth Information System (NEIS) Introduction to the NOAA Earth Information System (NEIS) Climate Diagnostics and Prediction Workshop October 23 rd, 2012 Jebb Q Stewart CIRA in collaboration with NOAA/OAR/ESRL/GSD Concept Take advantage

More information

The ORIENTGATE data platform

The ORIENTGATE data platform Seminar on Proposed and Revised set of indicators June 4-5, 2014 - Belgrade (Serbia) The ORIENTGATE data platform WP2, Action 2.4 Alessandra Nuzzo, Sandro Fiore, Giovanni Aloisio Scientific Computing and

More information

Environmental Data Management:

Environmental Data Management: Environmental Data Management: Challenges & Opportunities Mohan Ramamurthy, Unidata University Corporation for Atmospheric Research Boulder CO 25 May 2010 Environmental Data Management Workshop Silver

More information

National Snow and Ice Data Center A brief overview and data management projects

National Snow and Ice Data Center A brief overview and data management projects Cooperative Institute for Research in Environmental Sciences University of Colorado National Snow and Ice Data Center A brief overview and data management projects Walt Meier, Mark Parsons, and Mark Serreze

More information

GeoSUR Architecture and System Design. GeoSUR Program Architecture Development Guideline

GeoSUR Architecture and System Design. GeoSUR Program Architecture Development Guideline GeoSUR Program Architecture and System Design Title Creator Reviewer GeoSUR Program Architecture Development Guideline Michelle Anthony. USGS. Eric van Praag, CAF Jesus Suniaga, CAF Date 1 September 2008

More information

Unidata s Vision for Transforming Geoscience by Moving Data Services and Software to the Cloud

Unidata s Vision for Transforming Geoscience by Moving Data Services and Software to the Cloud Unidata s Vision for Transforming Geoscience by Moving Data Services and Software to the Cloud The WWOSC 2014 17 August 2014 Montreal, CA Dr. Mohan Ramamurthy Unidata Program Center University Corporation

More information

McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data

McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data Thomas Achtor, Thomas Rink, Thomas Whittaker, David Parker and David Santek Space Science

More information

StormSurgeViz: A Visualization and Analysis Application for Distributed ADCIRC-based Coastal Storm Surge, Inundation, and Wave Modeling

StormSurgeViz: A Visualization and Analysis Application for Distributed ADCIRC-based Coastal Storm Surge, Inundation, and Wave Modeling : A Visualization and Analysis Application for Distributed ADCIRC-based Coastal Storm Surge, Inundation, and Wave Modeling Brian Blanton Renaissance Computing Institute University of North Carolina at

More information

Data-Intensive Science and Scientific Data Infrastructure

Data-Intensive Science and Scientific Data Infrastructure Data-Intensive Science and Scientific Data Infrastructure Russ Rew, UCAR Unidata ICTP Advanced School on High Performance and Grid Computing 13 April 2011 Overview Data-intensive science Publishing scientific

More information

Open Source Visualisation with ADAGUC Web Map Services

Open Source Visualisation with ADAGUC Web Map Services Open Source Visualisation with ADAGUC Web Map Services Maarten Plieger Ernst de Vreede John van de Vegte, Wim Som de Cerff, Raymond Sluiter, Ian van der Neut, Jan Willem Noteboom 1 ADAGUC project Cooperative

More information

HYCOM Data Management -- opportunities & planning --

HYCOM Data Management -- opportunities & planning -- HYCOM Data Management -- opportunities & planning -- Steve Hankin (NOAA/PMEL) Ashwanth Srinivasan, (RSMAS) Peter Cornillon, OPeNDAP PI (URI) Mike Clancy, US GODAE Server (FNMOC) Jon Callahan, Kevin O Brien

More information

PLATA-HIS Hydrologic Information System Central Web Service Registry for the Plata basin in South America

PLATA-HIS Hydrologic Information System Central Web Service Registry for the Plata basin in South America PLATA-HIS Hydrologic Information System Central Web Service Registry for the Plata basin in South America Technical proposal Silvano Pecora Head of Hydrology ARPA Emilia-Romagna, Italy November 2015 Table

More information

Crossing the digital divide: an interoperable solution for sharing time series and coverages in Earth sciences

Crossing the digital divide: an interoperable solution for sharing time series and coverages in Earth sciences doi:10.5194/nhess-12-3013-2012 Author(s) 2012. CC Attribution 3.0 License. Natural Hazards and Earth System Sciences Crossing the digital divide: an interoperable solution for sharing time series and coverages

More information

NetCDF and HDF Data in ArcGIS

NetCDF and HDF Data in ArcGIS 2013 Esri International User Conference July 8 12, 2013 San Diego, California Technical Workshop NetCDF and HDF Data in ArcGIS Nawajish Noman Kevin Butler Esri UC2013. Technical Workshop. Outline NetCDF

More information

CDI/THREDDS Interoperability: the SeaDataNet developments. P. Mazzetti 1,2, S. Nativi 1,2, 1. CNR-IMAA; 2. PIN-UNIFI

CDI/THREDDS Interoperability: the SeaDataNet developments. P. Mazzetti 1,2, S. Nativi 1,2, 1. CNR-IMAA; 2. PIN-UNIFI CDI/THREDDS Interoperability: the SeaDataNet developments P. Mazzetti 1,2, S. Nativi 1,2, 1. CNR-IMAA; 2. PIN-UNIFI Outline Interoperability Issues in SeaDataNet A broker solution for CDI/THREDDS interoperability

More information

IDL. Get the answers you need from your data. IDL

IDL. Get the answers you need from your data. IDL Get the answers you need from your data. IDL is the preferred computing environment for understanding complex data through interactive visualization and analysis. IDL Powerful visualization. Interactive

More information

Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES

Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES The NORMAP Project team has prepared this document to present functionality of the NORMAP portal.

More information

SAMOS, GOSUD. and the Observing System Monitoring Center. Second Joint GOSUD/SAMOS Workshop Seattle, Washington, USA 10-12 June 2008

SAMOS, GOSUD. and the Observing System Monitoring Center. Second Joint GOSUD/SAMOS Workshop Seattle, Washington, USA 10-12 June 2008 SAMOS, GOSUD and the Observing System Monitoring Center Second Joint GOSUD/SAMOS Workshop Seattle, Washington, USA 10-12 Steve Hankin NOAA/PMEL (presenter) Derrick Snowden NOAA/OCO Kevin O Brien JISAO/UW

More information

The ORIENTGATE data platform

The ORIENTGATE data platform Research Papers Issue RP0195 December 2013 The ORIENTGATE data platform SCO Scientific Computing and Operations Division By Alessandra Nuzzo University of Salento and Scientific Computing and Operations

More information

NOMADS. Jordan Alpert, Jun Wang NCEP/NWS. Jordan C. Alpert jordan.alpert@noaa.gov. where the nation s climate and weather services begin

NOMADS. Jordan Alpert, Jun Wang NCEP/NWS. Jordan C. Alpert jordan.alpert@noaa.gov. where the nation s climate and weather services begin An Application for High Availability NOMADS Jordan Alpert, Jun Wang NCEP/NWS Jordan C. Alpert jordan.alpert@noaa.gov DMIT Workshop, Silver Spring, MD 8/13-14//2009 where the nation s climate and weather

More information

REACCH PNA Data Management Plan

REACCH PNA Data Management Plan REACCH PNA Data Management Plan Regional Approaches to Climate Change (REACCH) For Pacific Northwest Agriculture 875 Perimeter Drive MS 2339 Moscow, ID 83844-2339 http://www.reacchpna.org reacch@uidaho.edu

More information

Introduction to IODE Data Management. Greg Reed Past Co-Chair IODE

Introduction to IODE Data Management. Greg Reed Past Co-Chair IODE Introduction to IODE Data Management Greg Reed Past Co-Chair IODE Outline Background - Introduction to IOC and IODE - IODE activities Oceanographic data management - End to end data management - Data stewardship

More information

The NERC DataGrid (NDG)

The NERC DataGrid (NDG) The NERC DataGrid (NDG) Roy Lowry on behalf of the NDG, BADC and BODC. Ray Cramer, Marta Gutierrez, Kerstin Kleese Van Dam, Venkatasiva Kondapalli, Susan Latham, Bryan Lawrence, Kevin O Neill, Ag Stephens,

More information

Arctic Climate and Weather Forecast Model Visualization Scenario Engineering Report GEOSS Architecture Implementation Pilot Version 1.

Arctic Climate and Weather Forecast Model Visualization Scenario Engineering Report GEOSS Architecture Implementation Pilot Version 1. Arctic Climate and Weather Forecast Model Visualization Scenario GEOSS Architecture Implementation Pilot Version 1.0 Content developed by the GEO Architecture Implementation Pilot Licensed under a Creative

More information

The Alabama Metadata Portal: http://portal.gsa.state.al.us

The Alabama Metadata Portal: http://portal.gsa.state.al.us 113 The Alabama Metadata Portal: http://portal.gsa.state.al.us By Philip T. Patterson Geological Survey of Alabama 420 Hackberry Lane P.O. Box 869999 Tuscaloosa, AL 35468-6999 Telephone: (205) 247-3611

More information

EUMETSAT EO Portal. End User Image Access using OGC WMS/WCS services. EUM/OPS/VWG/10/0095 Issue <1> <14/01/2010> Slide: 1

EUMETSAT EO Portal. End User Image Access using OGC WMS/WCS services. EUM/OPS/VWG/10/0095 Issue <1> <14/01/2010> Slide: 1 EUMETSAT EO Portal End User Image Access using OGC WMS/WCS services Slide: 1 Overview Introduction: status of data access and visualization EUMETSAT datasets Architecture Web Map Service implementation

More information

Structure? Integrated Climate Data Center How to use the ICDC? Tools? Data Formats? User

Structure? Integrated Climate Data Center How to use the ICDC? Tools? Data Formats? User Integrated Climate Data Center? Data Formats?? Tools???? visits Structure???? User Contents Which Data Formats do we offer? What is the Structure of our data center? Which Tools do we provide? Our Aims

More information

CEOS Water Portal Status Update

CEOS Water Portal Status Update CEOS Water Portal Status Update Satoko Horiyama MIURA / Atsushi KAWAI JAXA/Mission Operations System Office WGISS-31 Introduction CEOS Water Portal is ; A web based portal system evolved from Distributed

More information

NCDC Strategic Vision

NCDC Strategic Vision NOAA s National Climatic Data Center World s Largest Archive of Climate and Weather Data Presented to: Coastal Environmental Disasters Data Management Workshop September 16, 2014 Stephen Del Greco Deputy

More information

Analysis of Climatic and Environmental Changes Using CLEARS Web-GIS Information-Computational System: Siberia Case Study

Analysis of Climatic and Environmental Changes Using CLEARS Web-GIS Information-Computational System: Siberia Case Study Analysis of Climatic and Environmental Changes Using CLEARS Web-GIS Information-Computational System: Siberia Case Study A G Titov 1,2, E P Gordov 1,2, I G Okladnikov 1,2, T M Shulgina 1 1 Institute of

More information

VISUAL INSPECTION OF EO DATA AND PRODUCTS - OVERVIEW

VISUAL INSPECTION OF EO DATA AND PRODUCTS - OVERVIEW WMS services from the EUMETSAT real-time Image Gallery Uwe Voges (1), Michael Schick (2), Udo Einspanier (1) (1) con terra GmbH Martin-Luther-King-Weg 24, 48155, Münster, Germany EMail: (U.Voges U.Einspanier)@conterra.de

More information

SCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling

SCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling SCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont, Marilyn Drewry, Sara Graves, Ken Keiser, Manil Maskey, Matt Smith The University

More information

DATA MANAGEMENT (DM) - (e.g. codes, monitoring) software offered to WMO Members for exchange

DATA MANAGEMENT (DM) - (e.g. codes, monitoring) software offered to WMO Members for exchange DATA MANAGEMENT (DM) - (e.g. codes, monitoring) software offered to s for exchange Notified to WMO 10/11/2009 United States A library of functions and subroutines which can be used to encode and decode

More information

WCS 2.0 Extension for netcdf-cf; CSW and THREDDS Interoperability

WCS 2.0 Extension for netcdf-cf; CSW and THREDDS Interoperability GEOSS Workshop XLIII: Sharing Climate Information & Knowledge NCAR Center Green, Boulder Colorado, 23 Sept 2011, 8:00am 5:30pm WCS 2.0 Extension for netcdf-cf; CSW and THREDDS Interoperability S.Nativi

More information

GIS Initiative: Developing an atmospheric data model for GIS. Olga Wilhelmi (ESIG), Jennifer Boehnert (RAP/ESIG) and Terri Betancourt (RAP)

GIS Initiative: Developing an atmospheric data model for GIS. Olga Wilhelmi (ESIG), Jennifer Boehnert (RAP/ESIG) and Terri Betancourt (RAP) GIS Initiative: Developing an atmospheric data model for GIS Olga Wilhelmi (ESIG), Jennifer Boehnert (RAP/ESIG) and Terri Betancourt (RAP) Unidata seminar August 30, 2004 Presentation Outline Overview

More information

Development and Support for the USGODAE Server

Development and Support for the USGODAE Server Development and Support for the USGODAE Server Mr. Mike Clancy Fleet Numerical Meteorology and Oceanography Center 7 Grace Hopper Ave, Stop 1 Monterey, CA 93943-5501 phone: (831) 656-4414 fax: (831) 656-4489

More information

Using standards for ocean data

Using standards for ocean data Pan-European infrastructure for marine and ocean data management Using standards for ocean data By Dick M.A. Schaap SeaDataNet Technical Coordinator Vienna, April 09 Supported by the European Commission

More information

Phase 1 Recommendations for a North American Carbon Program Data System NACP Data System Task Force

Phase 1 Recommendations for a North American Carbon Program Data System NACP Data System Task Force Phase 1 Recommendations for a North American Carbon Program Data System NACP Data System Task Force June 10, 2005 The U.S. Carbon Cycle Interagency Working Group (CCIWG) is coordinating the North American

More information

Metadata for Data Discovery: The NERC Data Catalogue Service. Steve Donegan

Metadata for Data Discovery: The NERC Data Catalogue Service. Steve Donegan Metadata for Data Discovery: The NERC Data Catalogue Service Steve Donegan Introduction NERC, Science and Data Centres NERC Discovery Metadata The Data Catalogue Service NERC Data Services Case study:

More information

DATA ACCESS AT EUMETSAT

DATA ACCESS AT EUMETSAT 1 EUM/OPS/VWG/15/793789 v1a DATA ACCESS AT EUMETSAT Copernicus Climate Data Store Workshop ECMWF 3-6 March 2015 Harald Rothfuss Overview of Presentation 1. Introduction to EUMETSAT 2. EUMETSAT Data Access

More information

Global Earth Observation Integrated Data Environment (GEO-IDE) Presentation to the Data Archiving and Access Requirements Working Group (DAARWG)

Global Earth Observation Integrated Data Environment (GEO-IDE) Presentation to the Data Archiving and Access Requirements Working Group (DAARWG) Global Earth Observation Integrated Data Environment (GEO-IDE) Presentation to the Data Archiving and Access Requirements Working Group (DAARWG) Ken McDonald Data Management Integration Architect National

More information

Interoperable Solutions in Web-based Mapping

Interoperable Solutions in Web-based Mapping ISPRS SIPT IGU UCI CIG ACSG Table of contents Table des matières Authors index Index des auteurs Search Recherches Exit Sortir Interoperable Solutions in Web-based Mapping Marta Wojnarowska and Bridget

More information

NetCDF: Data Model, APIs, and Format

NetCDF: Data Model, APIs, and Format NetCDF: Data Model, APIs, and Format Russ Rew Unidata Program Center University Corporation for Atmospheric Research Multidimensional Summit, ESRI, June 8, 2004 www.unidata.ucar.edu Overview What is Unidata?

More information

GOAPP Data Management Policy

GOAPP Data Management Policy Global Ocean-Atmosphere Prediction and Predictability Network GOAPP Data Management Policy Prepared by: GOAPP Data Management Committee (DMC) Jason Chaffey (DFO), Bill Merryfield (GOAPP Investigator),

More information

Use of ISO standards by NERC (a snapshot!)

Use of ISO standards by NERC (a snapshot!) Use of ISO standards by NERC (a snapshot!) Dr Andrew Woolf andrew.woolf@stfc.ac.uk STFC Rutherford Appleton Laboratory Outline NERC overview The NERC SDI Metadata Data Services Standards activities UK/EU

More information

Product Navigator User Guide

Product Navigator User Guide Product Navigator User Guide Table of Contents Contents About the Product Navigator... 1 Browser support and settings... 2 Searching in detail... 3 Simple Search... 3 Extended Search... 4 Browse By Theme...

More information

NASA s Big Data Challenges in Climate Science

NASA s Big Data Challenges in Climate Science NASA s Big Data Challenges in Climate Science Tsengdar Lee, Ph.D. High-end Computing Program Manager NASA Headquarters Presented at IEEE Big Data 2014 Workshop October 29, 2014 1 2 7-km GEOS-5 Nature Run

More information

Interoperable Documentation

Interoperable Documentation Interoperable Documentation Ted Habermann, NOAA/NESDIS/NGDC NCAR Earth Observing Laboratory, June 2010 Links: GEO-IDE Wiki: https://www.nosc.noaa.gov/dmc/swg/wiki/index.php ISO WAF: http://www.ngdc.noaa.gov/metadata/published/19115/isometadatahome.html

More information

Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1

Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1 Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1 Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model Dr.

More information

Sextant. Spatial Data Infrastructure for Marine Environment. C. Satra Le Bris, E. Quimbert, M. Treguer

Sextant. Spatial Data Infrastructure for Marine Environment. C. Satra Le Bris, E. Quimbert, M. Treguer Sextant On-Line information system for marine geographical information E. Quimbert, M. Bellouis, F. Lecuy, M. Treguer Centre de Bretagne BP 70, Plouzané 29280 France E-mail: sextant@ifremer.fr Sextant

More information

USGS Community for Data Integration

USGS Community for Data Integration Community of Science: Strategies for Coordinating Integration of Data USGS Community for Data Integration Kevin T. Gallagher USGS Core Science Systems January 11, 2013 U.S. Department of the Interior U.S.

More information

McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008

McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008 McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008 Tom Achtor, Tom Rink, Tom Whittaker, Dave Parker, Gail

More information

An Esri White Paper June 2011 ArcGIS for INSPIRE

An Esri White Paper June 2011 ArcGIS for INSPIRE An Esri White Paper June 2011 ArcGIS for INSPIRE Esri, 380 New York St., Redlands, CA 92373-8100 USA TEL 909-793-2853 FAX 909-793-5953 E-MAIL info@esri.com WEB esri.com Copyright 2011 Esri All rights reserved.

More information

1. Overview and Status Update (Satoko) : 10min. 2. Demonstration (Yoshi) : 20min. 3. New Architecture (Yoshi): 15min. 4. Q&A, Discussion (All) : 15min

1. Overview and Status Update (Satoko) : 10min. 2. Demonstration (Yoshi) : 20min. 3. New Architecture (Yoshi): 15min. 4. Q&A, Discussion (All) : 15min 1. Overview and Status Update (Satoko) : 10min 2. Demonstration (Yoshi) : 20min 3. New Architecture (Yoshi): 15min 4. Q&A, Discussion (All) : 15min 1 CEOS Water Portal Overview and Status Update WGISS-37

More information

HYCOM Meeting. Tallahassee, FL

HYCOM Meeting. Tallahassee, FL HYCOM Data Service An overview of the current status and new developments in Data management, software and hardware Ashwanth Srinivasan & Jon Callahan COAPS FSU & PMEL HYCOM Meeting Nov 7-9, 7 2006 Tallahassee,

More information

Scientific Data Management and Dissemination

Scientific Data Management and Dissemination Federal GIS Conference February 9 10, 2015 Washington, DC Scientific Data Management and Dissemination John Fry Solution Engineer, Esri jfry@esri.com Agenda Background of Scientific Data Management through

More information

Overview of Data Visualization Tools. (Submitted by the Secretariat) Summary and Purpose of Document

Overview of Data Visualization Tools. (Submitted by the Secretariat) Summary and Purpose of Document WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPEN PROGRAMME AREA GROUP ON INTEGRATED OBSERVING SYSTEMS EXPERT TEAM ON SATELLITE UTILIZATION AND PRODUCTS SCOPE-Nowcasting Ad-hoc Steering

More information

Data Management Framework for the North American Carbon Program

Data Management Framework for the North American Carbon Program Data Management Framework for the North American Carbon Program Bob Cook, Peter Thornton, and the Steering Committee Image courtesy of NASA/GSFC NACP Data Management Planning Workshop New Orleans, LA January

More information

Risk (COs) Outline of current and additional message types and definitions required to meet R2 deliverables. One page design draft for DM data headers

Risk (COs) Outline of current and additional message types and definitions required to meet R2 deliverables. One page design draft for DM data headers WBS Type -ID -ID Iteration Task Description Outcome of task 1.2.3.11 S Data Management The Data Management Subsystem is responsible for providing life cycle management, federation, preservation and presentation

More information

Efficient Metadata Generation to Enable Interactive Data Discovery over Large-scale Scientific Data Collections

Efficient Metadata Generation to Enable Interactive Data Discovery over Large-scale Scientific Data Collections Efficient Metadata Generation to Enable Interactive Data Discovery over Large-scale Scientific Data Collections Sangmi Lee Pallickara 1, Shrideep Pallickara 1, Milija Zupanski 2 Department of Computer

More information

An ESRI White Paper October 2009 ESRI Geoportal Technology

An ESRI White Paper October 2009 ESRI Geoportal Technology An ESRI White Paper October 2009 ESRI Geoportal Technology ESRI 380 New York St., Redlands, CA 92373-8100 USA TEL 909-793-2853 FAX 909-793-5953 E-MAIL info@esri.com WEB www.esri.com Copyright 2009 ESRI

More information

Task AR-09-01a Progress and Contributions

Task AR-09-01a Progress and Contributions Doug Nebert, POC U.S. Geological Survey ddnebert@usgs.gov March 2010 Task AR-09-01a Progress and Contributions Background and scope for AR-09-01a This Task defines the minimum, common technical capabilities

More information

Metadata Hierarchy in Integrated Geoscientific Database for Regional Mineral Prospecting

Metadata Hierarchy in Integrated Geoscientific Database for Regional Mineral Prospecting Metadata Hierarchy in Integrated Geoscientific Database for Regional Mineral Prospecting MA Xiaogang WANG Xinqing WU Chonglong JU Feng ABSTRACT: One of the core developments in geomathematics in now days

More information

Databases & Data Infrastructure. Kerstin Lehnert

Databases & Data Infrastructure. Kerstin Lehnert + Databases & Data Infrastructure Kerstin Lehnert + Access to Data is Needed 2 to allow verification of research results to allow re-use of data + The road to reuse is perilous (1) 3 Accessibility Discovery,

More information

J9.6 GIS TOOLS FOR VISUALIZATION AND ANALYSIS OF NEXRAD RADAR (WSR-88D) ARCHIVED DATA AT THE NATIONAL CLIMATIC DATA CENTER

J9.6 GIS TOOLS FOR VISUALIZATION AND ANALYSIS OF NEXRAD RADAR (WSR-88D) ARCHIVED DATA AT THE NATIONAL CLIMATIC DATA CENTER J9.6 GIS TOOLS FOR VISUALIZATION AND ANALYSIS OF RADAR (WSR-88D) ARCHIVED DATA AT THE NATIONAL CLIMATIC DATA CENTER Steve Ansari * STG Incorporated, Asheville, North Carolina Stephen Del Greco NOAA National

More information

GOSIC NEXRAD NIDIS NOMADS

GOSIC NEXRAD NIDIS NOMADS NOAA National Climatic Data Center GOSIC NEXRAD NIDIS NOMADS Christina Lief NOAA/NESDIS/NCDC GOSIC Program Manager NOAA/NESDIS/NCDC Asheville, NC 28801 GEOSS AIP Phase 2 Workshop September 25-26, 2008

More information

Model examples Store and provide Challenges WCS and OPeNDAP Recommendations. WCS versus OPeNDAP. Making model results available through the internet.

Model examples Store and provide Challenges WCS and OPeNDAP Recommendations. WCS versus OPeNDAP. Making model results available through the internet. Making model results available through the internet. Fedor Baart, Gerben de Boer, Wim de Haas, Gennadiy Donchyts, Marc Philippart, Maarten Plieger September 14, 2011 Introduction Fedor Baart PhD thesis:

More information

I. Interoperable Data Discovery, Access, and Archive

I. Interoperable Data Discovery, Access, and Archive Data Management and Communications Plan for Research and Operational Integrated Ocean Observing Systems I. Interoperable Data Discovery, Access, and Archive Part I: Overview May 10, 2004 9 Contents Preface...11

More information

Steve Ansari *, Stephen Del Greco, Brian Nelson, and Helen Frederick NOAA National Climatic Data Center, Asheville, North Carolina 2.

Steve Ansari *, Stephen Del Greco, Brian Nelson, and Helen Frederick NOAA National Climatic Data Center, Asheville, North Carolina 2. 11.4 THE SEVERE WEATHER DATA INVENTORY (SWDI): SPATIAL QUERY TOOLS, WEB SERVICES AND DATA PORTALS AT NOAA S NATIONAL CLIMATIC DATA CENTER (NCDC) Steve Ansari *, Stephen Del Greco, Brian Nelson, and Helen

More information

INTRODUCTION TO EUMETSAT DATA CENTRE

INTRODUCTION TO EUMETSAT DATA CENTRE Joint COSPAR and WMO Capacity Building Workshop on Satellite Remote Sensing, Water Cycle and Climate Change 29 July,2014 Tver, Russia MONITORING WEATHER AND CLIMATE FROM SPACE INTRODUCTION TO EUMETSAT

More information

MyOcean Copernicus Marine Service Architecture and data access Experience

MyOcean Copernicus Marine Service Architecture and data access Experience MyOcean Copernicus Marine Service Architecture and data access Experience Sophie Besnard CLS, Toulouse, France February 2015 MyOcean Story MyOcean Challenge & Success MyOcean Service MyOcean System MyOcean

More information

EXPLORING AND SHARING GEOSPATIAL INFORMATION THROUGH MYGDI EXPLORER

EXPLORING AND SHARING GEOSPATIAL INFORMATION THROUGH MYGDI EXPLORER EXPLORING AND SHARING GEOSPATIAL INFORMATION THROUGH MYGDI EXPLORER Subashini Panchanathan Malaysian Centre For Geospatial Data Infrastructure ( MaCGDI ) Ministry of National Resources and Environment

More information

UERRA Visualization KNMI UERRA GA 2016, TOULOUSE, FR ADAGUC WEB-BASED VISUALIZATION ELSE VAN DEN BESSELAAR / MAARTEN PLIEGER KNMI R&D

UERRA Visualization KNMI UERRA GA 2016, TOULOUSE, FR ADAGUC WEB-BASED VISUALIZATION ELSE VAN DEN BESSELAAR / MAARTEN PLIEGER KNMI R&D UERRA Visualization WEBSERVICES @ KNMI UERRA GA 2016, TOULOUSE, FR ADAGUC WEB-BASED VISUALIZATION ELSE VAN DEN BESSELAAR / MAARTEN PLIEGER KNMI R&D Visualization - Web Map Services - ESGF Meteorological

More information

GEOCOMPUTATIONS AND RELATED WEB SERVICES

GEOCOMPUTATIONS AND RELATED WEB SERVICES GEOCOMPUTATIONS AND RELATED WEB SERVICES J. A. Rod Blais Dept. of Geomatics Engineering Pacific Institute for the Mathematical Sciences University of Calgary, Calgary, Alberta T2N 1N4 blais@ucalgary.ca

More information

André Karpištšenko, Co-Founder & Chief Scientist, Marinexplore Strata, 2014.02.11

André Karpištšenko, Co-Founder & Chief Scientist, Marinexplore Strata, 2014.02.11 marineos André Karpištšenko, Co-Founder & Chief Scientist, Marinexplore Strata, 2014.02.11 The Ocean's Big Data Platform marineos: a platform for organizing, analyzing and distributing machine data marineos

More information

OGC at KNMI: Current use and plans Available products

OGC at KNMI: Current use and plans Available products OGC at KNMI: Current use and plans Available products Maarten Plieger KNMI R&D Ernst de Vreede, John van de Vegte, Wim Som de Cerff, Ian van der Neut, Raymond Sluiter, Jan Willem Noteboom Contents 1. ADAGUC

More information

HyMeX database. Sophie Cloché, Karim Ramage ESPRI, IPSL, Paris, France

HyMeX database. Sophie Cloché, Karim Ramage ESPRI, IPSL, Paris, France HyMeX database Sophie Cloché, Karim Ramage ESPRI, IPSL, Paris, France Jean-Luc Boichard, Guillaume Brissebrat, Laurence Fleury, Laurence Mastrorillo SEDOO, OMP, Toulouse, France HyMeX data management 2D

More information

SRS BIO OPTICAL WORKFLOW

SRS BIO OPTICAL WORKFLOW SRS BIO OPTICAL WORKFLOW Version 2.0 22 nd March 2013 Data Workflows emii, the data management facility for IMOS, has developed workflows for each IMOS sub facility to describe the flow of IMOS data from

More information

NERACOOS Data Management Plan

NERACOOS Data Management Plan NERACOOS Data Management Plan Version 1.0 2/20/2014 [Extracted from Appendix A of the NOAA EDMC Data Management Planning Procedural Directive (2011): https://geo- ide.noaa.gov/wiki/index.php?title=data_management_planning_pd]

More information

Current Order Tool Experiences Complaints

Current Order Tool Experiences Complaints Current Order Tool Experiences Complaints Log in unadvertised case sensitivity for email address that is used as login id CERES Dataset Info pages are too crowded!! On the Data Products Catalog page, remove

More information

Web-based spatio-temporal visualization and analysis of the Siberian Earth System Science Cluster (SIB-ESS-C)

Web-based spatio-temporal visualization and analysis of the Siberian Earth System Science Cluster (SIB-ESS-C) Web-based spatio-temporal visualization and analysis of the Siberian Earth System Science Cluster (SIB-ESS-C) Roman Gerlach Supervisor: Prof. C. Schmullius (Dept. of Geography, Friedrich-Schiller-University

More information

Data Integration Strategies

Data Integration Strategies Data Integration Strategies International Delta Roundtable November 2007 U.S. Department of the Interior U.S. Geological Survey USGS Data Integration Vision and Drivers USGS Science Strategy: Science in

More information

A standards-based open source processing chain for ocean modeling in the GEOSS Architecture Implementation Pilot Phase 8 (AIP-8)

A standards-based open source processing chain for ocean modeling in the GEOSS Architecture Implementation Pilot Phase 8 (AIP-8) NATO Science & Technology Organization Centre for Maritime Research and Experimentation (STO-CMRE) Viale San Bartolomeo, 400 19126 La Spezia, Italy A standards-based open source processing chain for ocean

More information

Enterprise GIS Solutions to GIS Data Dissemination

Enterprise GIS Solutions to GIS Data Dissemination Enterprise GIS Solutions to GIS Data Dissemination ESRI International User Conference July 13 17, 2009 Wendy M. Turner Senior GIS Engineer & Program Manager Freedom Consulting Group, LLC Building the Enterprise

More information