GeoNetwork, The Open Source Solution for the interoperable management of geospatial metadata

Transcription

1 GeoNetwork, The Open Source Solution for the interoperable management of geospatial metadata Ing. Emanuele Tajariol, GeoSolutions Ing. Simone Giannecchini, GeoSolutions

2 GeoSolutions GeoSolutions GeoNetwork Introduction History Software Features Standards Architecture User Interface INSPIRE RNDT

3 GeoSolutions Founded in Italy in late 2006 Expertise Image Processing, GeoSpatial Data Fusion Java, Java Enterprise, C++, Python JPEG2000, JPIP, Advanced 2D visualization Supporting/Developing FOSS4G projects GeoTools GeoServer GeoNetwork GeoBatch ImageIO-Ext Focus on Consultancy agencies, large private companies, etc

4 (GeoSpatial) Catalog Registry of Metadata Repository GeoNetwork Enterprise Search Appliance GeoPortal SDI entry point Information Broker Metadata Editor Standards Based Implemented with Java Enterprise technologies

5 Java Enterprise Technologies Apache Lucene for speed light search Support for different backends MYSQL, Oracle, Postgresql, etc.. XSL Templates for flexible presentation XML Schema Metadata Validation and Editing Support for Enterprise Security LDAP Shibboleth

6 Standards ISO TC : : : : : /Z39.50 OGC CSW (ISO Profile) INSPIRE Discovery Service Others FGDC OpenSearch Geo RSS/GeoRSS WebDAV OAI-PMH Dublin Core

7 GeoNetwork: features (1) Search capabilities to access local and distributed geospatial catalogues Up- and downloading of data, graphics, documents, pdf files and any other content type An interactive Web Map Viewer to combine Web Map Services from local and distributed servers around the world On-line editing of metadata with a powerful template system XSD schema and schematron validation of metadata Native support for international metadata standards Multilingual metadata support for the ISO19115/19119/19110

8 GeoNetwork: features (2) INSPIRE advanced search option Data and metadata export/import procedures Scheduled harvesting and synchronization of metadata between distributed catalogues (GeoNetwork, CSW, Z39.50, OGC WxS, WebDav, Thredds, OAI-PMH) Support CSW ISO Profile, OAI-PMH, Z39.50 protocols Administration of groups and users through Web interface Multi-lingual user interface Data updates dissemination via RSS news feeds and as GeoRSS

9 Standards Metadata ISO19115:2003, ISO19119:2005, ISO19110:2005, ISO19139:2007 FGDC, Dublin Core Export/Import RSS & GeoRSS newsfeeds XML + XSL Catalogue interfaces OGC CSW ISO Profile OAI-PMH Z39.50 Geo-OpenSearch GeoRSS WebDAV Web Mapping Client OGC standards for WMS, WMC Web Map Server (through GeoServer) WMS, WFS, WFS-t, WCS, KML COMMON LANGUAGES EXCHANGE FORMATS CATALOGUES/ WEB SERVICES

10 Architecture Frontend - UI Search Edit View map Lucene index Metadata registry Spatial data repository GeoServer Backend - GeoNetwork Backend - GeoServer

11 Manage, Publish and Search collections of metadata about Data, Services and related information ISO Metadata about Data ISO Metadata about Services Enterprise Unique entry point Act as a Broker (SOA) Can work in federation Multilingualism Registry

12 Repository GeoNetwork can be used as a repository for the data it describes Authorization on data are independent from authorization on related metadata Easy-to-use editor controls to upload data and set automatically the onlineresource URL

13 Registry - Federation Multiple Registries for Multiple Enterprise Clouds Different data/services Different Organizations Federation reduces complexity Available Paradigms Harvesting Synchronized Local Copy of remote Metadata Remote Search Federating node as NoCache proxy for queries GeoNetwork supports both

14 GeoNetwork OGC Portal Reference Architecture

15 Architecture Desktop and server versions running on any platform Windows, Linux, Mac OSX Java Application using XML+XSL Lucene (Apache Project for XML file indexing) Jeeves (Open Source project for XML DB interface) GeoNetwork McKoi (Desktop), MySQL, Oracle Java Application Template XSL Jetty (Desktop), Tomcat DB Indexing Lucene Jeeves (DB XML)

16 Metadata harvesting Multiple paths to same source Loops GeoNetwork Nodes Hierarchical harvesting

17 Enterprise GeoPortal User Friendly Search/View GeoPortal Customizable Presentation Search Forms Results Presentation Based on XSL templates Embedding in third party sites Integrate with A&A layers Different views for different roles Metadata Profiling

18 Enterprise GeoPortal Metadata Profiling Authentication Internal user management for smaller deploys LDAP integration Shibboleth integration (federated SSO) Authorization User groups (grants on metadata) - customizable User profiles (grants on operations) - fixed Metadata access authorization is fine grained at group level

19 User interface/home page

20 Web user interface/search Simple/local search Advanced search

21 Web user interface/search Inspire-based search options

22 Web user interface/search results

23 Web user interface/metadata Display Metadata summary Metadata details

24 Web user interface/search results

25 Web user interface/search results

26 Web user interface/search results

27 Embedded Web Map Client Map viewer opened Web user interface/web map viewer Layer tree section Map toolbar Add data layer (layers toolbar)

28 Google Earth Support View in Google Earth

29 Administration section Administration Login/Logout Add new metadata

30 Metadata editor/default View

31 Metadata editor/xml View Full ISO metadata support ISO19115:2003 / ISO19139:2007

32 Metadata editor/categories assignment

33 Metadata editor/data upload

34 Metadata editor/privileges assignment

35 Harvesting management

36 Localization Support

37 Metadata Editor Terms and Rules from ISO and Encoding in 19139, FGDC and Dublin Core Intuitive Web-Based Editor with Validation Identification Section Distribution Section Reference System Section Data Quality Section Metadata Section Highly Customizable Presentation Validation

38 Metadata Editor Additional capabilities Extensible Templates set Visual Validation Extensive online resource management (WMS, File download, etc..) Additional Metadata Linking (dataset/service, parent/child, feature catalog/dataset metadata) Role assignment for presentation profiling Multilingual Support Batch Import/Insert from XML

39 INSPIRE: about The INSPIRE directive aims to create a European Union (EU) spatial data infrastructure. This will enable the sharing of environmental spatial information among public sector organisations and better facilitate public access to spatial information across Europe. The INSPIRE directive came into force on 15 May 2007 and will be implemented in various stages, with full implementation required by Institutional site:

40 INSPIRE: about Infrastructure for Spatial Information in the European Community 2007/2/EC Directive, 14/03/2007 Fully in place by 2019 Implementing Rules and Technical Guidance to implement EU-wide Interoperable SDIs IR are legally binding TC are not legally binding Main Aspects Covered Metadata Network Services Data and Service Sharing Data Specification Monitoring and Reporting Maximum Reuse of existing standards (OGC, ISO, W3C)

41 INSPIRE: Who does What Discovery service GeoNetwork View, Download, InvokeSD, Transformation Service GeoServer

42 INSPIRE: discovery services Discovery of spatial dataset and services Provide operations on services query about service capabilities register other federated Discovery Services Provide operations on metadata search update (both push and pull modes), perform federated searches Based on Metadata specs from ISO TG requires CSW ISO AP as starting point

43 INSPIRE: discovery services in GeoNetwork GeoNetwork implements CSW ISO Profile INPIRE extended constraints in metadata should be explicitly enabled in GeoNetwork Complies with almost all main requirements in Metadata Implementation and Discovery Services Main compliancy issues in: Handling federated catalogues in Discovery Service Metadata and Link Discovery Service operations Federated metadata retrieving no CSW, only Z39.50 Publishing in pull mode matching CSW Harvest operation in GN is not stable yet

44 INSPIRE and ISO19115/19139 INSPIRE supported metadata are based on ISO19115/19139 (metadata) ISO19119 (services) There are some differences in constraints on metadata elements between ISO19115 and INSPIRE. The use of the INSPIRE guidelines to create INSPIRE metadata ensures that the metadata is not in conflict with ISO However, full conformance to ISO implies the provision of additional metadata elements which are not required by INSPIRE.

45 INSPIRE support in GeoNetwork Editing view that underlines INSPIRE required elements Easy check and insertion of INSPIRE required elements Schematron rules to check for INSPIRE conformance Search using INSPIRE codelists Extended CSW queryables fields to match INSPIRE requirements

46 RNDT: about RNDT («Repertorio Nazionale dei Dati Territoriali») is the Italian national metadata catalog - instituted in 2005 and managed by DigitPA - whose purpose is to facilitate the dissemination of the data of general interest, available in the public administration agencies at different levels. RNDT is based on ISO19115, and standards. Conformance to the RNDT metadata standard should ensure conformance to INSPIRE guidelines

47 RNDT support in GeoNetwork GeoSolutions first work with RNDT was with a GeoNetwork customization for CSI Piemonte. Issues: Some RNDT interpretations of ISO19139 differ from GeoNetwork standard implementation. Some constraints in RNDT are looser than ISO19139

48 RNDT support in GeoNetwork Search on PSR thesaurus

49 Real World Use Cases: City of FIorence OpenData Portal

50 Real World Use Cases: City of FIorence OpenData Portal

51 GeoNetwork 2.8 What s new Metadata versioning Subtemplates GeoServer publishing integration Pluggable metadata schemas Improved database connection pooling Virtual CSW endpoints

52 The End Questions?

53 Maps & metadata view in Google Earth