Introduzione a Geoserver - Sviluppi in corso per lo studio del Climate Change

Transcription

1 Introduzione a Geoserver - Sviluppi in corso per lo studio del Climate Change Ing. Simone Giannecchini, GeoSolutions Ing. Andrea Antonello, Hydrologis

2 Outline GeoSolutions Facts GeoServer 2.0 Funzionalità di GeoServer Sviluppi per supporto environmental data

3 GeoSolutions - Facts Funded mid 2006 in Italy Staff of 7 engineers (2 consultants) Expertise Image Processing, GeoSpatial Data Fusion Java, Java Enterprise, C++, Python JPEG2000, JPIP, Advanced 2D visualization Supporting/Developing FOSS4G projects GeoTools, GeoServer, GeoBatch, ImageIO-Ext, udig Focus on Consultancy (prevalentemente B2B) Training Building stack of geospatial Open Source products

4 GeoServer GeoSpatial enterprise gateway Management dati raster e vettoriali Standards compliant OGC WCS (RI) OGC WFS (RI) OGC WMS OGC WPS Google Earth/Maps support KML, GeoSearch, etc..

5 Funzionalità di GeoServer GeoServer Shapefile PostGIS DB2 Oracle MySql ArcSDE WFS Vector files DBMS Servers GeoTIFF ArcGrid GTopo30 Img+world Mosaic Raster files MrSID JPEG 2000 ECW,Pyramid WFSv* WFS 1.0 WFS 1.1 WMS Google* WCS 1.0 WCS WPS GWC Raw vector data Styled maps Raw raster data Shapefile GML2 GML3 GeoRSS GeoJSON CSV/XLS PNG, GIF JPEG TIFF, GeoTIFF SVG, PDF KML/KMZ GeoTIFF ArcGrid GTopo30 Img+World KML superoverlays Google maps tiles

6 Interfaccia grafica

7 Integrated Security Spring Security framework Specificare regole su singoli layer Configurazione semplificata con liste di regole namespace.layer.mode=role1,role2,... A name, or * to mean any r: read w: write The roles that will be authorized to access the data under this rule

8 Integrated Security: Web UI

9 Amministrazione RESTful Configurazione programmatica Workspaces DataStores/CoverageStores Layers e Stili Estensioni per classificazioni Esposizione struttura interna Ajax-JavaScript friendly Modulo stabile Sicurezza integrata

10 WMS Advanced Styling

11 WMS Advanced Styling

12 WMS KML Output TEMPORAL SERIES KML EXTRUDE KML SUPEROVERLAY

13 ImageIO-Ext GDAL Support Nuovi plug-ins: BigTiff*, netcdf-cf,grib1,matfile 5, HDF4 JPEG2000, Kakadu senza l ausilio di GDAL Ongoing work on GDAL GDAL integration via ImageIO-ext Estensione SUN ImageIO framework JPEG2000,MrSID, ECW, BigTIFF*, ERDAS Image, HDF4,etc... Mix di plugin proprietari ed open

14 Environmental data support

15 Environmental data support Ingest, catalog and disseminate multidmensional (X,Y,Z,T, TRun) data Raster, Vector (MetOc, In Situ, Remote Sensing) Exploit WCS/WMS for dissemination Exploit ebrim for cataloguing Support for metoc data Hdf4, netcdf, GriB1 ImageMosaic extensions Support for time and elevation In situ observations WPS integration of IDL and JGrass

16 ESB OpenSDI Open Spatial Data Infrastructure BI A&A&A geosdi-era OpenLayers Monitoring Data Collection Agents GeoTools GeoWebCache GeoBatch GeoServer Buddata ebrim GeoTools PostGIS Net Storage FOSS4G 2009, Sydney 23 rd September 2009

17 Ingestion/Preprocessing Real-time produced data Remote Sensing, In situ, Models, etc.. Recognizable, isolate data streams Flow Incoming series of geospatial data Defined rules for preprocessing Defined rules for ingestion and/or exploitation Automatic Ingestion and preprocessing No manual intervention Example, flow of MetOc raster data Buddata ebrim GeoWebCache Producer WRF netcdf netcdf CF Publish GeoServer

18 GeoBatch FileSystemMonitor Directory Monitoring Event Mailbox Action Action Action EventDispatcher FlowManager Event Consumer Event Consumer

19 Registry: Buddata EbRR Open Source ebxml Registry/Repository (or ebrr in short) ESA founded ERGO project lead by Intecs OGC specifications implemented e brr buddata r4: CSW-ebRIM Registry Service - Part 1: ebrim profile of CSW (1.0.1) r4: CSW-ebRIM Registry Service Part 2: Basic extension package (1.0.1) : OGC Cataloguing of ISO Metadata (CIM) using the ebrim profile of CS-W (0.1.11) r6: EO Products Extension Package for ebrim (ISO/TS ) Profile of CSW 2.0 Code on Google Code ( Wiki ERGO project (ESA HMA wiki)

20 Buddata Work Metadata published with data contextually Use of custom profiles e brr buddata Input Data GeoBatch Publish Metadata Publish Data Registry GeoServer Profiles Find Metadata Consume Data Consmer

21 Use Case: Super Ensemble Modeling Discover Buddata EbRR Toolbox WPS Ensemble GUI Harvest Invoke Publish Results MATLAB WCS::getCoverage WMS::getMap GeoServer Input Data GeoBatch Deploy

22 Use Case: Super Ensemble Modeling

23 JGrass netcdf, time and depth on grids FOSS4G 2009, Sydney 23 rd September 2009

24 JGrass netcdf, time and depth on grids FOSS4G 2009, Sydney 23 rd September 2009

25 Obiettivi Conclusions Completamento e rilascio sviluppi in GeoServer Completamento e rilascio integrazione JGrass e IDL in GeoServer Miglioramento supporto parametri WMS/WCS TIME- ELEVATION Rilascio GeoBatch ToDo Animazioni temporali su WMS Disseminazione Cubi NetCDF-CF da WCS Esposizione parametri TIME ed ELEVATION in WFS

26 The End Domande?

27 Funzionalità di GeoServer 2.0 WCS WMS WFS WFSv REST Google GWC GeoTools ImageIO 389 JAI JTS GDAL JMagick Vector Style Raster

28 Integrated Security *.*.r=* *.*.w=no_one RDONLY lock down private.*.r=trusted_role private.*.w=trusted_role topp.districts.w=legislators Per-layer override private.* topp.* topp. districts Other layers TRUSTED_ROLE r/w r r r LEGISLATORS (all other users) (no access) r r/w r (no access) r r r

29 WMS CQL GeoServer WMS CQL Examples STATE_NAME = 'Montana' MALE > FEMALE LAND_KM >

30 WFSv

31 Altri moduli Features Pre-generalizzate Pre-processing del dataset per creare una piramide di Features. Dacimated distance =... Dacimated distance = 10 Dacimated distance = 5 Il DataStore seleziona automaticamente il layer semplificato in base al livello di zoom. Full resolution

32 Complex Features Altri moduli Supporto per Community Schema e Complex Types (Features di Features) Fondamentale per supportare INSPIRE!

33 Altri moduli WPS 1.0.0: Sextante Integration (experimental) JGrass integration (tentative) IDL integration (proprietary) Obiettivi: Full OGC-WPS compliancy Raster Processing (WCPS)

34 Altri moduli JDBC Next Generation drivers Obiettivi: Ridurre il tempo di sviluppo di nuovi DataStores Evitare la duplicazione di codice Aumentare la qualità verso il backend, in termini di security, performance e testing Come: Unica JDBCDataStore class final, in modo da non poter essere subclassata Introduzione del concetto di Dialect per incapsulare le operazioni specifiche ad ogni DataBase

35 GeoWebCache GeoServer GeoWebCache Persistent raster/kml tile cache Sistema di tile cache per WMS Layer statici Fornisce KML/raster tiles GMap, Gearth OpenLayers VEarth, Bing Speed up fattore 10/100 REST interface

36 Hibernate Catalog Web REST WMS WFS WCS... Catalog Interface Hibernate Based Catalog Configuration stored in DB Hibernate Spring based Dao ServiceDAO CatalogDAO Transactions via Spring/EJB3 Caching with EhCache Hibernate 2 L cache Same catalog interface, different implementation Catalog interface needs tweaking Net Storage DB GeoServer UI still needs tweaking Transaction demarcation needs tweaking

37 Use Case: Super Ensemble Modeling Current solution Split hyper-cubes of data into a set of 2D slices recompose with mosaic Use registry for registering T and Z Input 5D Cubes GeoBatch Vertical Interpolation Geo-Rectification Resampling Mosaic Recomposition Publish Metadata Publish Data Registry GeoServer Next Step RasterVault

38 RasterVault Raster sono intrinsecamente multidimensionali (x,y,z,t) [(fielda1,fielda2),(fieldb1)]

39 RasterVault Web REST WMS WFS WCS... Catalog Interface CoverageStore Interface CoverageStore GeoServer RasterLayerDAO RangeDAO Hibernate Spatial 2 L cache RasterVault Net Storage DB

40 GeoBatch: Basics Event-based geospatial-aware batch ingestion/processing system Basic tools for automatic collection, processing and publication of data. Open Source (leverages on GeoTools, Apache FTP, Spring, Xstream, etc ) Embedded FTP Server Publish to GeoServer Publish to GeoWebCache (ongoing) Web based XML configuration

41 GeoBatch:Sample Flow - <FlowConfiguration> <workingdirectory>aisanomalies</workingdirectory> <autorun>true</autorun> - <EventConsumerConfiguration> <workingdirectory>aisanomalies</workingdirectory> <performbackup>true</performbackup> - <FileEventRule> <optional>false</optional> <originaloccurrencies>1</originaloccurrencies> <regex>.*\.shp</regex> <id>r1</id> <description>description</description> <name>test</name> </FileEventRule>. - <GeoServerActionConfiguration> <crs>epsg:4326</crs> <envelope /> <datatransfermethod>url</datatransfermethod> <geoserverpwd>geoserver</geoserverpwd> <geoserveruid>admin</geoserveruid> <geoserverurl> <wmspath>/</wmspath> <defaultstyle>polygon</defaultstyle> <styles /> </GeoServerActionConfiguration>

42 GeoBatch:Sample Flow - <GeoServerActionConfiguration> <crs>epsg:4326</crs> <envelope /> <datatransfermethod>url</datatransfermethod> <geoserverpwd>geoserver</geoserverpwd> <geoserveruid>admin</geoserveruid> <geoserverurl> <wmspath>/</wmspath> <defaultstyle>polygon</defaultstyle> <serviceid>aisanomaliesgeoservergeneratorservice</serviceid> <styles /> </GeoServerActionConfiguration> </EventConsumerConfiguration> <eventgeneratorconfiguration class="fseventgeneratorconfiguration"> <wildcard>*.*</wildcard> <watchdirectory>aisanomalies/in</watchdirectory> <keepfiles>true</keepfiles> <ostype>os_undefined</ostype> <eventtype>file_added</eventtype> </eventgeneratorconfiguration> <id>flowaisanomalies</id> <description>flowaisanomalies: testing injection of AISAnomalies shapefiles </description> <name>flowaisanomalies</name> </FlowConfiguration>

43 GeoBatch: UI

44 Index & Search Capabilities: ebrim Registry versus Repository Flexible Information Model Object Lifecycle Management Trader Authority Content Management Service Provider Event Notification Protocol Bindings Publish-Find-Subscribe(Consume) Federation Registry Publish Find Broker Consumer Provider Subscribe Consume Consumer

45 Web Service Interface Layer EbRR: Architecture overview HTTP GetRepositoryItem Interface SOAP Interfaces e brr buddata HTTP GetRepositoryItem Interface HTTP GetRepositoryItem Interface API Layer CSW SOAP Client Registry APIs CSW Backend Client Deployer Business Layer Lifecycle Manager Transaction Manager Query Manager Repository Manager Core Registry Functions Add-on Functions Translator Harvester Validator Data Layer Postgresql Database Persistence PostGIS Functions

46 Use Case: Super Ensemble Modeling Optimal MetOc models mixing Same model, different boundary conditions Different model same boundary coinditions System training (Kalman filter) historycal data Output Series of weight for optimal MetOc model mixing Result optimal MetOc model as fusion of weighted models

47 Use Case: Super Ensemble Modeling

48 Use Case: LAMMA NCEP-GFS W\RF NMM Postproc Postproc ECMWF

49 Use Case: LAMMA NCEP-GFS W\RF NMM Postproc GeoServer Publish Data GeoBatch Publish Metadata ECMWF RasterVault Registry

50 ESB Enterprise Spatial Data Infrastructure Reporting A&A&A GeoPortal Monitoring Data Collection Agents Data Management Layer Batch Processing Map Accelerator Online Processing Data Dissemination Server Data Management Layer Index & Search Spatial DBMS Net Storage

51 ESB Enterprise Spatial Data Infrastructure GeoBI A&A&A geosdi-era OpenLayers Monitoring Data Collection Agents GeoTools GeoWebCache GeoBatch GeoServer Buddata ebrim GeoTools PostGIS Net Storage