1 Making model results available through the internet. Fedor Baart, Gerben de Boer, Wim de Haas, Gennadiy Donchyts, Marc Philippart, Maarten Plieger September 14, 2011
2 Introduction Fedor Baart PhD thesis: Confidence in morpological forecasts This research This research has received funding from the European Community s Seventh Framework Programme (FP7/ ) under grant agreement and the Cornelis Lely foundation.
3 1 Model examples 2 Store and provide 3 Challenges 4 WCS and OPeNDAP 5 Recommendations
4 Outline 1 Model examples 2 Store and provide 3 Challenges 4 WCS and OPeNDAP 5 Recommendations
5 Operational modelling Forecasts Predicting coastal changes 3 days ahead. Figure: Operational model for coastal morphology (Baart et al 2009)
6 Model examples Store and provide Challenges WCS and OPeNDAP Recommendations Open Source models Delft3D Open source modules: FLOW, MOR, WAVE. OpenEarth Collaboration to share data model and tools. Figure: Delft3D simulation of Rhine rofi, source: De Boer, Figure: Visualizations made with OpenEarthTools,
7 Operational modelling Figure: Forecasting water levels and currents nearshore and erosion Figure: Swimmer simulator
8 Figure: XBeach model of Petten met hyperstorm (p < 1 /10000).
9 End users Scientists Can consume data using scripts Analysts Can use programs and click buttons Government Can print a webpage src:xkcd.com/242
10 Goal Make these model results available to end-users.
11 Outline 1 Model examples 2 Store and provide 3 Challenges 4 WCS and OPeNDAP 5 Recommendations
12 Model examples Store and provide Challenges WCS and OPeNDAP Architecture CLIENT viewer smart phone graphics WMS KML work: - CPU - TB executable scripts work done on client tailored data WCS WFS standard data OPeNDAP ODBC/DB API work done on server cloud computing SERVER storage and service browser app web services database raw data ftp http svn files hdf netcdf raw ascii Figure: Provide different users with different access Recommendations
13 Outline 1 Model examples 2 Store and provide 3 Challenges 4 WCS and OPeNDAP 5 Recommendations
14 The gridded view of the modeler Figure: The world is discretized
15 Unstructured grid Figure: Grid consists of triangles, rectangles, pentagons,...
16 Staggering Figure: Not all quantities are stored on the same location.
17 Vertical refererence layers Figure: Different types of vertical coordinates
18 Multidimensionality z wave frequency wave direction y x time Figure: Model results often have more dimensions
19 Outline 1 Model examples 2 Store and provide 3 Challenges 4 WCS and OPeNDAP 5 Recommendations
20 Feature comparison OPeNDAP WCS Querying index coordinate Reprojection no yes Dimensionality n 4 (x,y,z,t) Metadata CF Convention OWS Common Unstructured grids possible, not standardized standardized, possible Response type arrays + attributes xml + file not
21 Performance comparison Setup Geoserver 2.1 rc5 WCS Thredds 4.2 OPeNDAP 760x360 grid, 1 variable Query: All data Response times Geoserver: 2.4s s Thredds: 0.15s s
22 Usability experiment Setup subjects students with 6 months scripting experience exclusion used OPeNDAP or WCS datasets cloud coverage (MSGCPP), altitude map (AHN) servers Thredds OPeNDAP, Adaguc WCS assignment 1 What is the mean cloud coverage at your location? assignment 2 What is the altitude of your location?
23 Usability experiment Results 1 Users want to put a url into a browser. 2 Users get the wrong results. 3 Index based querying is too difficult for users with little programming experience.
24 URL builder Figure: This works.
25 Outline 1 Model examples 2 Store and provide 3 Challenges 4 WCS and OPeNDAP 5 Recommendations
26 storage Use NetCDF as model output format. architecture Use layered approach for different users. performance Custom WCS service for high performance (ADAGUC). unstructured grid Proposol for CF convention (Jagers and van Dam) metadata Inspire in NetCDF convention (ADAGUC) metadata Metadata propogation through the layers. usability Help users with URL builders for services. visualize bitbucket.org/siggyf/html5overlay
DataTube: web services voor data Gerben de Boer Onno van de Akker Gerrit Hendriksen Deltares, Matroos Deltares, FEWS Deltares, NHI FEWS & Matroos: database > viewers VIEWER client 3 rd party viewer Matroos
White Paper BIG DATA-AS-A-SERVICE What Big Data is about What service providers can do with Big Data What EMC can do to help EMC Solutions Group Abstract This white paper looks at what service providers
MASARYK UNIVERSITY FACULTY OF INFORMATICS Best Practices in Scalable Web Development MASTER THESIS Martin Novák May, 2014 Brno, Czech Republic Declaration Hereby I declare that this paper is my original
Developing Fleet and Asset Tracking Solutions with Web Maps Introduction Many organizations have mobile field staff that perform business processes away from the office which include sales, service, maintenance,
Using log-files to identify uses and users of geo-information provision facilities GIMA Thesis Vincent Brunst Using log-files to identify uses and users of geo-information provision facilities Student:
Siebel Email Administration Guide Siebel Innovation Pack 2013 Version 8.1/8.2 September 2013 Copyright 2005, 2013 Oracle and/or its affiliates. All rights reserved. This software and related documentation
Security challenges for internet technologies on mobile devices - Geir Olsen [email@example.com], Senior Program Manager for Security Windows Mobile, Microsoft Corp. - Anil Dhawan [firstname.lastname@example.org],
zen Platform technical white paper The zen Platform as Strategic Business Platform The increasing use of application servers as standard paradigm for the development of business critical applications meant
Rethinking Spatial Processing in Data-Intensive Science Christian Authmann, Christian Beilschmidt, Johannes Drönner, Michael Mattig, Bernhard Seeger Department of Mathematics and Computer Science University
Knowledge-based service architecture for multi-risk environmental decision support applications Stuart E. Middleton and Zoheir A. Sabeur IT Innovation Centre, University of Southampton, Gamma House, Enterprise
Logentries Insights: The State of Log Management & Analytics for AWS Trevor Parsons Ph.D Co-founder & Chief Scientist Logentries 1 1. Introduction The Log Management industry was traditionally driven by
Proceedings of the Fall 2006 Workshop of the HPI Research School on Service-Oriented Systems Engineering Benjamin Hagedorn, Michael Schöbel, Matthias Uflacker, Flavius Copaciu, Nikola Milanovic Technische
1/15 Technical Information Abstract Disclaimer: in no event shall Microarea be liable for any special, indirect or consequential damages or any damages whatsoever resulting from loss of use, data or profits,
Tackling the Big Data Deluge in Science with Metadata The term Big Data has become virtually synonymous with schema on read (where data is applied to a plan or schema as it is ingested or pulled out of
ARGUS Enterprise 10.6 5/29/2015 ARGUS Software An Altus Group Company for ARGUS Enterprise Version 10.6 5/29/2015 Published by: ARGUS Software, Inc. 3050 Post Oak Boulevard Suite 900 Houston, Texas 77056
C O N S U L E N Z A F O R M A Z I O N E E - G O V E R N M E N T S Y S T E M I N T E G R A T I O N BRUNO Broadcasting Feeds Management Application Different sources of information and lack of specialized
BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON Overview * Introduction * Multiple faces of Big Data * Challenges of Big Data * Cloud Computing
The ALife Zoo: cross-browser, platform-agnostic hosting of Artificial Life simulations Simon Hickinbotham, Michael Weeks and James Austin University of York, Computer Science Department, York, UK email@example.com
Database Systems Journal vol. IV, no. 3/2013 31 Big Data Challenges Alexandru Adrian TOLE Romanian American University, Bucharest, Romania firstname.lastname@example.org The amount of data that is traveling across
ON DEVELOPING SPATIAL DATA INFRASTRUCTURE OF CHINA Deren Li, Huayi Wu LIESMARS, Wuhan University Luoyu Road 129, Wuhan, P.R. China, 430079 Email: email@example.com, firstname.lastname@example.org Commission
Siebel Marketing User Guide Siebel Innovation Pack 2013 Version 8.1/8.2 September 2013 Copyright 2005, 2013 Oracle and/or its affiliates. All rights reserved. This software and related documentation are
GeoServer, The Open Source Solution for the interoperable management of geospatial data Ing. Andrea Aime, GeoSolutions Ing. Simone Giannecchini, GeoSolutions Founded in Italy in late 2006 Expertise GeoSolutions
ArcGIS Online School Locator G-Cloud Services RM 1557vi Service Definition Esri UK G-Cloud 6 Lot 3 SaaS Services Crown Commercial Service Acknowledgement Esri and ArcGIS are trademarks, registered trademarks,