Best Practice Network for SDI Nature Conservation TECHNOLOGICAL ASPECTS Authors: Giorgio Saio, Carmelo Attardo Maria Cabello Giacomo Martirano Andrea Fiduccia, Stefano Turcato, Alina Kmiecik Monica De Martino, Riccardo Albertoni Jean Christophe Deconnet, Dorian Ginane Speaker: Piotr Krok on behalf of Marek Brylski
Presentation Overview Project background information Data harmonization process Technology and architecture Short demonstration of project Geo-portal
Project Background Project duration: 10.2008 07.2011 The INSPIRE Directive (2007/2/EC) The Natura 2000 Network (Habitat Dir. 92/43/EEC) New EU approach for nature management Necessity to link nature conservation and geoinformation Need for interoperable, accessible and harmonised datasets for nature conservation Support to environmental policies The implementation of the INSPIRE Directive
Objectives To establish a Network on Geographical Information for nature conservation To share experiences and good practices To stimulate the community of nature conservation stakeholders at improving the harmonisation, the exploitation, and the access to their datasets To evaluate and demonstrate common metadata profile and data model for the addressed data themes in supporting the INSPIRE Directive implementation at EU level
Partnership GISIG Project lider (30 partners in the project consortium) Regione Liguria
INSPIRE Themes
Links with INSPIRE Registered INSPIRE SDIC (NATURE-GIS) Participation in INSPIRE Annex I DS Testing (Protected Sites) Participation in INSPIRE Annex II/III DS Testing (BR, BH, SD) (on-going) Development of candidate DS for Annex III data themes JRC representative (Vanda Lima) in the Advisory Board NATURE-SDIplus initial phase coincided with the INSPIRE DS testing for Annex I Protected Sites (23 data providers were involved) NATURE-SDIplus representatives within the INSPIRE Thematic Working Group for Data Specification for ANNEX III nature conservation data themes (Diederik Tirry, Margaret Carlisle)
Target user groups
Work Breakdown Schema
Work organization WP3 T3.1: Mmultilingual and multicultural issue (CNR-IMATI) WP4 T4.2: Geoportal specification (GT) WP6 T6.1: Guidelines for service provision (INGR) WS T3.4:Procedures for metadata and model implementation (Tracasa) CSW T4.3: Geoportal (INGR) T5.1: Data interoperability validation (NEN) T5.2: Data accessibility and usability evaluation (Fraunhofer) WFS T 3.3 Data model (Tracasa) T3.2: Metadata profile (IRD) WMS T2.3: Data set analysis and systematisation (UNIABDN) T4.1 Harmonised datasets (Tracasa ) T5.3: Quality evaluation and datasets generalization (AGI) WP2 WP5
DATA HARMONISATION PROCESS
Considered DATASETs 17 countries involved 131 datasets related to Annex I Protected Sites 122 datasets related to Annex III themes in the scope of the project: 68 Species distribution 43 Habitats and biotopes 11 Biogeographical regions Result of 1st project phase: State of the Art of Data and User Needs
The overall DH methodology (1/3) SOURCE SIDE Selection of the sample DS Analysis and schematisation of the sample DS TARGET SIDE Selection of the target schema Analysis of the target schema Creation of the Matching table Matching analysis GUIDELINES & PROCEDURES Data transformation HARMONISED DATASET TOOLS
The overall DH methodology (2/3) Provider A Provider B Provider C Provider A Data Model GeoDataBase A.SHP.TAB... SOURCE DATA MODEL Tool A Tool B Tool C TRANSFORMATION TOOLS <GML> <GML> GeoDataBase A Download (GML, ZIP) (*) <GML> <GML> Download (GML, ZIP) OGC Services (WMS, WFS,..). GeoDataBase B OGC Services (WMS, WFS,..). <GML> <GML> GeoDataBase C Web Map Server Web Map Server Web Map Server (*) Download (GML, ZIP) (*) (*) : NATURE SDI+ DATA MODEL The best data format for creating services Depending on: - Trasnformation tool - the Web Map Server software OGC Services (WMS, WFS,..). Download (GML, ZIP) OGC Services: WMS,WFS,... Geoportal NATURE SDI+ Intranet
The overall DH methodology (3/3) The services we have created: Web Map Services (WMS) and Web Feature Services (WFS) for the Data Catalogue Web Services (CSW) for the Metadata Once processed, harmonised, transformed and made accessible through the geoportal, spatial datasets, metadata and network services (accessibility and usability) have been validated in the frame of the WP5.
Data Transformation Start Harmonisation Process NatureSDIplus Data Model Create the Create the Matching Table Matching Table Choose Transformation Tool Identify source data model Data Model? Any kind Data Model Fill Matching Table Matcheable? YES Perform Transformation Publish Harmonised Data Without Data Model NO Create a simple GeoData Structure Document Store Tranformation Tools for Reuse Step 1 Step 2 Step 4 Step 3 Step 5 Identify a source data model Create a simple geodata structure Fill the Data matching table Document the process Choose Transformation Tool Perform Transformation Store Transformation Rules Publish harmonised Data Finish Harmonisation Process
Data Transformation matching tables
Data Transformation transformation tools Transformation tools for metadata: MDweb (IRD), INSPIRE Metadata Editor, CatMDEdit, GeoNetwork, MIG Metadata Editor, disy Preludio. Transformation tools for spatial datasets: GeoConverter, GeoMedia Fusion, Humboldt Alignement Editor, Go Publisher Tools surveyed, investigated and under testing by Technical Partners, used by DPs
Metadata Transformation Identify source metadata profile Start Harmonisation Process NatureSDIplus Metadata Profile Create the Create the Matching Table Matching Table Choose Metadata Editor Metadata? Any metadata profile Fill Matching Table Matcheable? YES Create or Update Metadata Publish Harmonised Metadata No Metadata NO Document Store Tranformation Tools for Reuse Step 1 Step 2 Step 3 Step 4 Identify a source metadata profile Fill the Metadata matching table Document the process Choose Metadata Editor Create or Update Metadata Store Transformation Rules Publish harmonised Metadata Finish Harmonisation Process
Status of Data Harmonisation 250 200 150 100 215 Completed Step-5 Step-4 Step-3 50 0 6 1 5 49 301 101 BR HB PS SD Total 1 4 1 59 101 4 5 10 20
Status of Data Harmonisation Total Datasets 234 Datasets completed 215 gml datasets uploaded 149 wms/wfs url provided 75 wms 14 wms 1.1.0 10 wms 1.3 20 wms + wfs 14 wfs 2.0 1 wms + wfs source ds 16 wms/wfs url not provided 74 gml files not uploaded 65 wms/wfs url provided 6 wms 6 wms/wfs url not provided 59 Datasets completed, but delivered in shp format missing information 13 Datasets harmonisation in progress 19 46
Status of Metadata Harmonisation 250 200 150 100 221 Completed Step-4 Step-3 Step-2 Step-1 50 102 51 60 0 8 50 020 BR HB PS SD Total 21 010 2 31 7 28/06/2011 INSPIRE Conference 2011 22
Status of Metadata Harmonisation Total MD 234 MD completed 221 MD completed at step 4 (with csw publication) csw url provided 52 xml uploaded 52 MD completed at step 3 (without csw publication) xml files uploaded 156 xml files not uploaded 12 MD completed (??) 1 xml files not uploaded 1 MD harmonisation in progress 13 52 168
INFRASTRUCTURE
NatureSDIplus needs Data Providers harmonize the data according to the shared common data model Data Providers publish metadata and related services on local/national/central catalouge User searches the data by sending a request to National/NatureSDI catalogue Request: it can be in one of predefined languages Answer: provides a list of metadata describing the resources (data/services) Obtain information about discovered resources (metadata details and extent) Binding the discovered data: thin client capabilities, smart client capabilities Binding Usability rules: visibility scales, simple generalilised layers, advanced views (3D) Adding additional layers (services) coming from others service providers Sample download service (IPR constraints) 25
Architecture Common Thesaurus Framework Thesauri WS GEOPORTAL CSW WMS WFS Download Thesaurus External Thesaurus <option> Catalogue National CSW WMS WFS WMS WFS Catalogue REMODELED DATA REMODELED DATA NATIONAL GEOPORTAL DATA PROVIDER SERVICES
Architecture Common Thesaurus Framework Thesauri WS Federated catalouges GEOPORTAL CSW WMS WFS Download External Thesaurus Thesaurus <option> Catalogue NatureSDI catalouge + federated catalogues federated FR CSW upcoming SE CSW National CSW WMS WFS WFS WMS WFS Catalogue REMODELED DATA REMODELED DATA NATIONAL GEOPORTAL DATA PROVIDER SERVICES
Architecture Common Thesaurus Framework GEOPORTAL External Thesaurus Thesauri WS Thesaurus <option> Thesaurus integration Develop a pipe to exploit NatureSDIplus thesaurus for: Editing metadata Medatada editor (integrated tesaurus) Discovery service Catalogue unique thesaurus service for multi-languages serching search data starting from thesaurus vocabolary Semantic search functionality National CSW WFS Additional info into metadata WFS to recover semantics from thesaurus adding URI to each keyword adding a reference REMODELED to the DATA thesaurus service NATIONAL GEOPORTAL Catalogue CSW WMS WFS Download WMS WMS WFS REMODELED DATA DATA PROVIDER SERVICES
Common Thesaurus Framework Basic idea
Framework Requirements Modularity : new KOS may be added as a new module plugged in the set of thesauri in the NatureSDIplus solution. Openness : Each KOS should be easily extendable keeping separated the original one. Interlinking: Interlinking among the terms referring to the same concepts in more then one thesaurus in order to harmonize their usage. Exploitability encoding in a standard and flexible format in order to encourage the adoption and its enrichment from third party system
View of Common Thesaurus Framework Skos:ExactMatch Id1 skos:broder GEMET Published by EEA According to Linked Data Best Practice EARTH Id1 Id3 skos:broder DMEER/Treats Biodiversity By Biogeographical Regions Id1 Skos:RelatedMatch skos:broder Id2 skos:broder Id5 Skos:ExactMatch skos:broder Skos:ExactMatch Id3 skos:broder Id4 skos:related??? Id6 Id4 Id1 skos:broder skos:broder Id2 Id1???????? Id1 skos:broder skos:broder Id2 Id3 skos:broder Id6 skos:broder skos:broder Id3 skos:related Id2 IUCN Classification Id6 Id3 skos:related skos:broder skos:broder Id6 Id2 Eunis Species Id3 skos:related Id6 Skos:RelatedMatch Eunis Habitat Types - NATURE 2000 A I
http://linkeddata.ge.imati.cnr.it:2020/
Available tools National Geoportal (FR) FR catalouge CS-W (Mdweb) ML serching (MD-MLsearch) INTERGRAPH - GeoMedia suite - GM Pro - GM Fusion - GM WebMap Pro - GM WebPub National - GM SDI Pro Data Providers - GM SDI Portal DISY - Metadata editor MD editor (Mdweb, DisyEd) Remap EPSILON (GM Fusion / Tracasa / Humboldt) Basic WxS (GM WM, GM WP, Mdweb, GeoServer, GoPublisher) - GoPublisher Available tools Geoportal IRD - MD suite - MDweb Discovery GRAPHITECH WMS / WFS 3D Client WCTS - Advanced 3D (Graphitech) client Monitoring - GeoServer Thin Client (GM SDIsuite) TRACASA - Transformation tools HUMBOLDT - Transformation tools 33
Geoportal on-line http://www.nature-sdi.eu section Geoportal: http://naturesdi.intergarph.it/naturesdi over160 metadata and 100 datasets metadata according ot the NatureSDIplus profile data remodelled according to the NatureSDIplus thematic data model Catalouge service Overview map data Multilingual GUI + Metadata fields description Metadata Validation Service Download service
Geoportal in action 1. The available technologies to use for the SDI implementation Metadata Editing technologies Transformation tools (Intergraph, Tracasa, Humboldt) Publication technologies (Intergraph / IRD / SnowFlake / OSS) 2. Common Thesaurus Framework and related facilities (CNR IMATI / IRD). 3. Integration of CTF facilities on IRD metadata editor and central catalogue, semantic search 4. Thin/Smart clients 1. National geoportal IRD 2. NatureSDIplus geoportal (Intergraph) 3. 3D client (Graphitech) 5. Download service 6. Validation service
Intergraph Corporation Piotr Krok Project Manager Security, Government & Infrastructure Intergraph Polska Sp. z. o.o. t: +48.(22).495 88 53 Intergraph Polska Sp. z. o.o. m: +48.668 44 88 53 ul. Domaniewska 52 f: +48.(22). 495 88 01 Warszawa, Polska piotr.krok@intergraph.com