DataTube: web services voor data Gerben de Boer Onno van de Akker Gerrit Hendriksen Deltares, Matroos Deltares, FEWS Deltares, NHI
FEWS & Matroos: database > viewers VIEWER client 3 rd party viewer Matroos web viewer FEWS Client DATA BASE server 3 rd party DB Matroos DB: MySQL,OPeNDAP FEWS Server
Client vs. server: scheme CLIENT viewer graphics work done on client tailored data standard data work: - CPU - TB work done on server raw data SERVER database
Client vs. server: scheme Smart phone Browser app Executable Experts CLIENT viewer graphics THIN CLIENT tailored data standard data work done on client work: - CPU - TB work done on server raw data SERVER database Cloud computing Web services DataBase files
Client vs. server: examples CLIENT viewer graphics Smart phone - web browser - google maps Browser app - Matroos viewer - Lizard viewer - ADAGUC viewer Executable - FEWS client - Google Earth - GIS client Experts - Matlab - Python -R work done on client tailored data standard data raw data work done on on server SERVER database Cloud computing - Maptable Web services - Matroos server - FEWS server - GIS server DataBase RDBMS: - MySQL - PostgreSQL - Oracle netcdf files
Web services: examples Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data WCS work done on on server standard data OPeNDAP ODBC work done on client raw data ftp http svn SERVER database Cloud computing Web services DataBase files
ODBC Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data WCS work done on server standard data OPeNDAP ODBC business objects FEWS raw data ftp http svn SERVER database Cloud computing Web services DataBase RDBMS files
ODBC/ JDBC FEWS Third party application Binary SQL OpenDAP FEWS MC Database Compressed Grids Compressed Forecasts Log messages Thresholds External Database RDBMS Observations Locations Parameters Grids ReadOnly
PostgreSQL > PostGIS (> Geoserver) Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data WCS GeoServer PostGIS work done on server standard data OPeNDAP ODBC FEWS PostgreSQL raw data ftp http svn SERVER database Cloud computing Web services DataBase RDBMS files
PostgreSQL > PostGIS > Geoserver: any GIS db1 db2 dbn geoserver PostgreSQL/PostGIS *.shp
OGC netcdf with OPeNDAP interface Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data WCS work done on server standard data OPeNDAP ODBC NOAA ncbrowse netcdf raw data ftp http svn SERVER database Cloud computing Web services DataBase netcdf files
OGC netcdf with OPeNDAP interface
OGC netcdf with OPeNDAP interface Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data WCS work done on server standard data OPeNDAP ODBC Matlab netcdf raw data ftp http svn SERVER database Cloud computing Web services DataBase netcdf files
OGC netcdf with OPeNDAP interface
Matroos : url generates png or data Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML browser tailored data Matroos WCS since 2003 work done on server standard data OPeNDAP ODBC work done on client netcdf raw data ftp http svn SERVER database Cloud computing Web services DataBase files netcdf
Matroos : keyword, value pairs in url http://matroos.deltares.nl/matroos/scripts/matroos.pl? source=swan_dcsm: &color=swellwave_height_hm0 &anal=&from=201106161200 &z=0 &xmin=-19.21&xmax=16.21 &ymin=48.0&ymax=64.1 &smin=0.000&smax=3 &size=640&smincolor=jet &smaxcolor=jet &coords=wgs84 &vx=25&vy=25&vecsize=1 &xn=1&yn=1 &format=png
Matroos : web interface to create url
OGC WMS: standardized url generates png or data Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML browser tailored data KNMI ADAGUC WCS work done on server standard data OPeNDAP ODBC work done on client netcdf raw data ftp http svn SERVER database DataBase Cloud computing Web services files OGC (opengeospatial.org) is a geospatial standards body Matroos was WMS idea avant la lettre WMS = Web Mapping Service: for 2D images WCS = Web coverage Service: for 2D data
OGC WMS: url generates png without axes annotation http://geoservices.knmi.nl/cgi-bin/nmdc_test_opendap.cgi? &LAYERS=OpenEarth/opendap/tno/ahn100m/mv100 &BBOX=-126490,290017,426454,615050 &SERVICE=WMS&VERSION=1.1.1 &REQUEST=GetMap &WIDTH=997&HEIGHT=586 &SRS=EPSG:28992 &STYLES=depth_-16_till_104_m &FORMAT=image/png &TRANSPARENT=TRUE&
OGC WMS: image needs to be georeferenced Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML KNMI ADAGUC tailored data KNMI ADAGUC WCS work done on server standard data OPeNDAP ODBC work done on client netcdf raw data ftp http svn SERVER database Cloud computing Web services DataBase files netcdf
OGC WMS: image needs to be georeferenced
OGC WMS: services defined GetCapabilities GetMap GetLegendGraphic GetFeatureInfo source: ADAGUC.KNMI.nl, Maarten Plieger
OGC WMS: services assembled WMS GetCapabilities WMS GetMap WMS GetLegendGraphic WMS GetFeatureInfo source: ADAGUC.KNMI.nl, Maarten Plieger
OGC WMS: Styled Layer Descriptors (SLD) style=default style=psl/bilinear style=psl/shadedcontour source: ADAGUC.KNMI.nl, Maarten Plieger
OGC WMS Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data KNMI ADAGUC WCS work done on server Google Earth beeldoverlay standard data OPeNDAP ODBC netcdf raw data ftp http svn SERVER database Cloud computing Web services DataBase files
OGC WMS: in Google Earth als beeldoverlay WMS in Google Earth -geentijdas - geen legend - geen featureinfo
OGC KML Smart phone Browser app Executable Experts CLIENT viewer graphics WMS KML tailored data OpenEarthTools WCS work done on server Google Earth standard data OPeNDAP ODBC netcdf raw data ftp http svn SERVER database Cloud computing Web services DataBase files
OGC KML: preprocess all images easy query down a quad-tree 6% 25% 100% all data of the world satellite pictures with 1 m resolution
OGC KML KML in Google Earth -weltijdas - optioneel legend - geen featureinfo
OGC KML: 3D, only WGS84 (remember Galilei)
OGC KML: HTML+ can glue geospatial stuff together KML is perfect for prototyping find out what is possible find out what we actually want cheap results perfect for citizens, fall back for professionals not recommended as main professional operational system source: Arnejan van Loenen
OGC CWS: catalogue service Smart phone Browser app Executable Experts CLIENT viewer catalogue CSW graphics WMS KML tailored data WCS work done on server standard data OPeNDAP ODBC raw data ftp http svn SERVER database Cloud computing Web services DataBase files
OGC CWS: www.nationaalgeoregister.nl EU INSPIRE directive ISO meta-data standards
Web services: standards, no silver bullet OGC CWS: perfect for indexing web services OGC WMS/WCS: perfect for 2D gridded data does not work yet for curvi-linear etc (Waqua, SWAN, Delft3D, unstruc) does not define 3D data (only layers) time dependency possible, but hardly implemented due to GIS mindset KNMI s ADAGUC can handle time, and might handle curvilinear in future OGC : perfect for vector data: both data and graphics OGC KML: perfect for citizens and professional prototypes ODBC on RDBMS: perfect for relational data distribution always works as server doesn t perform any services bad performance for very large data, e.g. 2D and 3D grids OPeNDAP on OGC netcdf: perfect for bulk data distribution always works as server doesn t perform any services no indexing, needs adjacent RDBMS for meta-data perfect to exchange data between servers: data distribution layer catalogue CSW graphics tailored data standard data raw data WMS KML WCS OPeNDAP netcdf ODBC ftp http svn
DataTube DataTube weather models 10 km resolution satellite data 1km resolution Dutch digital elevation maps 100 m resolution coastal bathymetry after De vriend 10 m resolution Proces scale: km/yr dune profiles 1m resolution scale of interest: km/yr