UERRA Visualization KNMI UERRA GA 2016, TOULOUSE, FR ADAGUC WEB-BASED VISUALIZATION ELSE VAN DEN BESSELAAR / MAARTEN PLIEGER KNMI R&D

Similar documents
Open Source Visualisation with ADAGUC Web Map Services

ADAGUC & PyTROLL. Maarten Plieger Ernst de Vreede. Application of polar orbiter products in weather forecasting Using open source tools and standards

OGC at KNMI: Current use and plans Available products

Model examples Store and provide Challenges WCS and OPeNDAP Recommendations. WCS versus OPeNDAP. Making model results available through the internet.

MSG Cloud Physical Properties retrieval and visualization

DataTube: web services voor data

The ORIENTGATE data platform

PART 1. Representations of atmospheric phenomena

Benchmarking OPeNDAP services for modern ESM data workloads

Structure? Integrated Climate Data Center How to use the ICDC? Tools? Data Formats? User

The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team

StormSurgeViz: A Visualization and Analysis Application for Distributed ADCIRC-based Coastal Storm Surge, Inundation, and Wave Modeling

Jozef Matula. Visualisation Team Leader IBL Software Engineering. 13 th ECMWF MetOps Workshop, 31 th Oct - 4 th Nov 2011, Reading, United Kingdom

NetCDF and HDF Data in ArcGIS

Primary author: Kaspar, Frank (DWD - Deutscher Wetterdienst), Frank.Kaspar@dwd.de

CMIP5 Data Management CAS2K13

Norwegian Satellite Earth Observation Database for Marine and Polar Research USE CASES

NASA's Strategy and Activities in Server Side Analytics

13.2 THE INTEGRATED DATA VIEWER A WEB-ENABLED APPLICATION FOR SCIENTIFIC ANALYSIS AND VISUALIZATION

Interactive Data Visualization with Focus on Climate Research

Overview of Data Visualization Tools. (Submitted by the Secretariat) Summary and Purpose of Document

NASA s Big Data Challenges in Climate Science

Nevada NSF EPSCoR Track 1 Data Management Plan

TerraAmazon - The Amazon Deforestation Monitoring System - Karine Reis Ferreira

Maximising the utility of OpeNDAP datasets through the NetCDF4 API

Real-time and Archived Antarctic. Interactive Processing Tools

The ORIENTGATE data platform

GOSIC NEXRAD NIDIS NOMADS

Introduction to Imagery and Raster Data in ArcGIS

Reprojecting MODIS Images

J9.6 GIS TOOLS FOR VISUALIZATION AND ANALYSIS OF NEXRAD RADAR (WSR-88D) ARCHIVED DATA AT THE NATIONAL CLIMATIC DATA CENTER

Product Description KNMI14 Daily Grids


EUMETSAT EO Portal. End User Image Access using OGC WMS/WCS services. EUM/OPS/VWG/10/0095 Issue <1> <14/01/2010> Slide: 1

WCS 2.0 Extension for netcdf-cf; CSW and THREDDS Interoperability

Data and data product visualization in EMODNET Chemistry

Analysis of Climatic and Environmental Changes Using CLEARS Web-GIS Information-Computational System: Siberia Case Study

The THREDDS Data Repository: for Long Term Data Storage and Access

Visualizing of Berkeley Earth, NASA GISS, and Hadley CRU averaging techniques

Baudouin Raoult, Iryna Rozum, Dick Dee

LSA SAF products: files and formats

CLOUD BASED N-DIMENSIONAL WEATHER FORECAST VISUALIZATION TOOL WITH IMAGE ANALYSIS CAPABILITIES

Visualization with ParaView. Greg Johnson

Cloud-based Geospatial Data services and analysis

GIS Initiative: Developing an atmospheric data model for GIS. Olga Wilhelmi (ESIG), Jennifer Boehnert (RAP/ESIG) and Terri Betancourt (RAP)

NOMADS. Jordan Alpert, Jun Wang NCEP/NWS. Jordan C. Alpert where the nation s climate and weather services begin

Application of Google Earth for flood disaster monitoring in 3D-GIS

VISUAL INSPECTION OF EO DATA AND PRODUCTS - OVERVIEW

Web-based spatio-temporal visualization and analysis of the Siberian Earth System Science Cluster (SIB-ESS-C)

Real Time Flood Alert System (RTFAS) for Puerto Rico

Figure 2: System Flow Diagram for Workflow Management

The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA

GLOBAL CLIMATE MONITOR

SRS BIO OPTICAL WORKFLOW

CEOS Water Portal. Satoko Horiyama MIURA / Atsushi KAWAI. JAXA/Mission Operations System Office

TRMM and Other Global Precipitation Products and Data Services at NASA GES DISC. Zhong Liu George Mason University and NASA GES DISC

Scientific Data Management and Dissemination

Managing Imagery and Raster Data in ArcGIS

MyOcean Copernicus Marine Service Architecture and data access Experience

Geospatial Software Solutions for the Environment and Natural Resources

3rd Annual Earth System Grid Federation and Ultrascale Visualization Climate Data Analysis Tools Face-to-Face Meeting Report December 2013

Working with climate data and niche modeling I. Creation of bioclimatic variables

The NERC DataGrid (NDG)

NCDC's Application of Climate Data to Tourism Business Decision-Making

DFSgc. Distributed File System for Multipurpose Grid Applications and Cloud Computing

Big Data Services at DKRZ

Monitoring Global Crop Condition Indicators Using a Web-Based Visualization Tool

HYCOM Data Management -- opportunities & planning --

How To Write An Nccwsc/Csc Data Management Plan

Vulnerability assessment of ecosystem services for climate change impacts and adaptation (VACCIA)

Leveraging Image Services in JavaScript/HTML5 Applications. Wenxue Ju, Hong Xu

Satellite Products and Dissemination: Visualization and Data Access

Visualization of GIS Data in OCAD

Implementing Geospatial Data in Parametric Environment Elçin ERTUĞRUL*

NEW DIGITAL TERRAIN MODELING (DTM) TOOLS FOR CABLE ROUTE PLANNING by Dr. Jose M. Andres Makai Ocean Engineering Inc.

TUTORIAL - Locations & Mapping. Using the ESdat Environmental Database System. For use with ESDAT version 5

VisIt Visualization Tool

Primary author: van den Besselaar, Else (KNMI - Royal Netherlands Meteorological Institue, Climate Services), besselaar@knmi.nl

WCS as a Download Service for Big (and Small) Data

TEMS PRODUCTS PART IMPROVE IN WHITE EFFICIENCY WITH THE WORLD S MOST VERSATILE DATA PROCESSING TOOL

New challenges of water resources management: Title the future role of CHy

Transcription:

UERRA Visualization WEBSERVICES @ KNMI UERRA GA 2016, TOULOUSE, FR ADAGUC WEB-BASED VISUALIZATION ELSE VAN DEN BESSELAAR / MAARTEN PLIEGER KNMI R&D

Visualization - Web Map Services - ESGF Meteorological and climatological data ADAGUC WMS and WCS Combine data Data Formats and Styling ESGF Climate4Impact UERRA

Satellite, radar, model & observation Observations Observations Every Every 10 10 minutes minutes Precipitation Precipitation Active Active radar radar Harmonie Harmonie Weather Weather model model Suomi Suomi NPP NPP Polar Polar Satellite Satellite Meteosat Meteosat Geostationary Geostationary satellite satellite

Tools for mapping ADAGUC ADAGUC ADAGUC KNMI KNMI development development since since 2009 2009 Serves Serves OPeNDAP, OPeNDAP, WMS WMS and and WCS WCS Server Server (C++) (C++) and and Viewer Viewer (JS) (JS) discoupled discoupled using using WMS WMS standard standard Data Data in in NetCDF NetCDF format format AutoWMS AutoWMS mode mode Automatic Automatic reading reading of of new new data data Combines Combines multiple multiple sources sources into into aa single single WMS WMS layer layer Precipitation Precipitation radar radar is is publicly publicly available available as as WMS, WMS, data data since since 2009, 2009, new new data data each each 55 minutes, minutes, ~70000 ~70000 timesteps, timesteps, fast! fast! http://adaguc.knmi.nl/ (open source + wiki)

Web Map Services From data to image + NetCDF Data (big, 5.5Gb) PNG images (small, 180Kb) Combined geographically

Web Coverage Services for data Download Download what what you you see see Convert Convert to to ASCII, ASCII, Geotiff Geotiff Reproject Reproject and and subset subset Use Use WCS WCS directly directly in in your your script! script! R R Python Python Matlab Matlab Supports Supports time, time, elevation, elevation, WCS WCS client client in in viewer viewer

Combine different sources Share research results Share data via internal network Web Map Services on all workstations Experiment with data without interfering operational systems Precipitation radar Every 5 minutes Observations Every 10 minutes

Data : structured grids Structured Structured grids grids -- Model/satellite/radar Model/satellite/radar Lat/lon Lat/lon and and projected projected data data Regular Regular grids grids

Data : Georeferenced Pictures True True color color data data (RGBA) (RGBA) Background Background maps, maps, meteorological meteorological maps, maps, composites, composites, 44 channels, channels, red, red, green, green, blue blue and and alpha alpha 88 bits bits per per channel channel == 32bits 32bits pp pp

Data : Point measurements / observations Point Point data data // timeseries timeseries Measurements Measurements from from automated automated weather weather stations, stations, timeseries timeseries Seismological Seismological measurements measurements

Data : Curvilinear data Curvilinear Curvilinear data data Models Models Fluid Fluid mechanics mechanics Quads Quads are are linked linked with with irregular irregular shape shape and and size size

Data : Unstructed grids UGRID Unstructured Unstructured grids grids according according the the UGRID UGRID convention convention Land Land boundaries, boundaries, river river catchments, catchments, masks, masks, Data Data stored stored as as mesh: mesh: lines lines and and polygons polygons

Nearest neighbor, bilinear and contour Nearest Nearest neighbour neighbour Bilinear Bilinear Shading Shading ++ Contours Contours

Earth System Grid Federation CMCC DKRZ CEA LASG IPSL FIO NTNU UVIC E-ENIS NOAA BADC PCMDI NCI U-Tokyo NASA DKRZ BADC PCMDI CNRM NCI BCCCSM Climate4Impact UCAR TSINGHUA Robust Robust and and distributed distributed Global Climate Global Climate Model Model Data Data (CMIP5) (CMIP5) Regional Climate Model Data Regional Climate Model Data (CORDEX) (CORDEX) ~3 ~3 Petabyte Petabyte of of data data Search Search API API OpenDAP OpenDAP data data access access THREDDS Catalogs THREDDS Catalogs Climate4impact Climate4impact builds builds on on and and contributes contributes to to this this global global infrastructure infrastructure is installing a data node KNMI KNMI is installing a data node for for UERRA UERRA

http://climate4impact.eu/ Platform Platform for for impact impact researchers researchers to to explore explore climate climate data data and and perform perform analysis analysis Searches Searches ESGF ESGF using using search search API API Visualizes Visualizes ESGF ESGF data data using using OpenDAP OpenDAP Uses Uses ADAGUC ADAGUC WMS WMS visualization visualization Perform Perform calculations calculations Climate Climate indices indices calculation, calculation, data data reduction reduction Personal Personal store store for for processing processing outcomes outcomes Upload Upload and and store store your your own own data data

For UERRA datasets KNMI KNMI can can help help setting setting up up visualization visualization services services Serve Serve your your data data via via OpenDAP OpenDAP Install Install THREDDS THREDDS Install Install ADAGUC ADAGUC server server at at institute institute Make Make your your data data available available through through ESGF ESGF fixed fixed data data format format and and conform conform to to strict strict standard standard KNMI KNMI is is installing installing an an ESGF ESGF data data node node for for UERRA UERRA Climate4Impact Climate4Impact uses uses ESGF ESGF Available Available June June 2016 2016 Visualizes Visualizes OpenDAP OpenDAP resources resources and and WMS WMS services services Automatic Automatic WMS WMS on on files files is is available available http://euro4mvis.knmi.nl/ http://euro4mvis.knmi.nl/

Thanks for listening!!! http://euro4mvis.knmi.nl/ http://adaguc.knmi.nl/ https://climate4impact.eu/ For any questions: Else Else van van den den Besselaar: Besselaar: besselaar@knmi.nl besselaar@knmi.nl Maarten Maarten Plieger: Plieger: maarten.plieger@knmi.nl maarten.plieger@knmi.nl

Data format: NetCDF-CF NetCDF4 NetCDF4 with with Climate Climate and and Forecast Forecast conventions conventions Standard Standard names names and and units units Identify Identify and and compare compare Dimensions, Dimensions, variables variables and and attributes attributes

Drill down search results using available filters

OpenDAP Web Map Automatic visualization of remote data Go to Data discovery / Explore your own catalogs or files File Metadata ADAGUC viewer WMS