Minerals4EU - WP5 The EU-MKDP (Minerals Knowledge Data Platform)

Transcription

1 Minerals4EU - WP5 The EU-MKDP (Minerals Knowledge Data Platform) System architecture, objectives, services 1st MINCE Conference, Espoo, November 26-27, 2014 Daniel Cassard and the WP5 Team BRGM, CGS, GeoZS, GEUS, GTK, JRC and TNO

2 Content The objectives, the technical choices, our contribution, the future The project and the EU-MKDP objectives The technical choices: why? What do we bring to the community? Are we in competition with other Internet data providers? The EU-MKDP is a first step. Other projects currently running and the very near future Concluding remark

3 The project Minerals4EU the European Intelligence Network on the Supply of Raw Materials will provide tools and expertise to enhance resource efficiency, minerals supply security and support sustainable minerals development for Europe. Minerals4EU will thus set up: - A permanent EU Mineral Intelligence network; - The most comprehensive European Minerals Yearbook; - An INSPIRE compliant EU Minerals Knowledge Data Platform; - Foresight studies on minerals supply and demand in Europe.

4 The EU-MKDP objectives The EU-MKDP represents one of the first bricks of the future European geological data infrastructure. The proposed technical solutions assure an effective and sustainable system designed for facilitating data updates and maintenance, and for offering a full and seamless access to information related to the whole mineral resources value chain. The system is thus designed to accommodate: - Structured data from national databases and - Semi- and non-structured information: syntheses and statistics (graph charts and time-series), related to primary and secondary resources ( exploration, production, reserves and resources), exploitation technologies, end-product development and waste management practices, European market survey and raw material demand in various formats (text files, PDF files, images ).

5 General simplified architecture of the EU-MKDP Pertinent available layers from geological surveys and EU projects and other institutions (e.g., geographic, geological, geophysical, geochemical maps) Layers Based on OGC/ INSPIRE Implementing Rules for and Data EU-MKDP Portal Information Factory data filtering, advanced search, statistics computing, report generation Non-, semi- & structured / standardized information related to MR & wastes: knowledge extraction, indexation Documents & Metadata REE Info MR Info New knowledge produced by partners from other work packages A system fully INSPIRE compliant: based on INSPIRE v.3 and EarthResourceML (ERML) v.2 data models. A sustainable system always kept up to date: adoption and development of a distributed architecture. X Y XX YY Structured data provided by geological surveys Other agencies, institutes, professional associations, able to provide structured data

6 General simplified architecture of the EU-MKDP Pertinent available layers from geological surveys and EU projects and other institutions (e.g., geographic, geological, geophysical, geochemical maps) Layers Based on OGC/ INSPIRE Implementing Rules for and Data EU-MKDP Portal Information Factory data filtering, advanced search, statistics computing, report generation Non-, semi- & structured / standardized information related to MR & wastes: knowledge extraction, indexation Documents & Metadata REE Info MR Info New knowledge produced by partners from other work packages A Central Database to minimize the drawbacks of the distributed architecture: improves the performance, reduces the risk in case of server crash X Y XX YY Management of: - Non-structured data, always accompanied by their metadata - Structured data Structured data provided by geological surveys Other agencies, institutes, professional associations, able to provide structured data

7 EU-MKDP detailed architecture Based on a «production-diffusion schema» EU-MKDP Portal A professional architecture: A Central Harvesting Database synchronized with a Central Diffusion Database. The first one controls data quality and the second one is optimized for diffusion. Synchronization is made using SQL scripts. EU level Country level DB SYNCHRONIZATION Harvesting DB (+ quality control) Harvesting mechanism (ETL process) MICKA Catalog (CS/W) Deegree 3 (WMS/WFS) Diffusion DB (+ diffusion optimizations) (Stats, auto report, filtering ) INFORMATION FACTORY Indexation (Search engine) Documents & Metadata Project DB National DB National DB Standardized data models (INSPIRE MR, ERML) Mapping (ETL process and code lists) Provider DB Provider DB Provider DB Provider s own format

8 Technical choices the diffusion system The EU-MKDP Portal An Editorial: latest news of the EU-MKDP and information on the use of the web portal. A Map Viewer will present the data inside the Diffusion Database, and will allow the user to combine them with other data (geological map, consumption area...). This Map Viewer will support INSPIRE View, will propose a predefined layers list, a metadata catalogue dedicated to Minerals4EU (MICKA), a connection to other catalogues (One Geology-Europe, INSPIRE...) and external layers (OGC WMS). Some of the basic (statistics, reports...) and dedicated services will be integrated in the Map Viewer. The Search facilities will allow the user to search in the Diffusion Database, in some other databases (manually plugged into the Indexation Engine) and in documents added to the EU-MKDP using a dedicated interface. The user will be able to search (i) using full text or (ii) using a specific interface dedicated to the concept he is looking for. It will be possible to refine all these searches by adding a location (Diffusion Database, documents or both).

9 The diffusion system: overview 4 parts (front office) Editorial (1) Map Viewer (2) (2) (+ a dedicated viewer for a dynamic presentation of the e-mineral Yearbook and foresight studies) (1) Search (3) (in progress) 1 part (back office) Documents management (3) (3)

10 Technical choices the services on top of the Central Diffusion Database, accessible through the EU- MKDP Basic services: data filtering, advanced search, statistics computing, automatic report generation. Dedicated services, some answering to the most common/frequent queries (with possible storage of results in the Central Diffusion Database): e.g., LREE/HREE computation, extraction - using mineralogy - of all deposits containing REE (indicated or NOT in the commodity list) for a better definition of mining districts/provinces. On request services based on Geological Surveys know-how/expertise with a substantial added-value, not automated, tailored to meet specific demands from industry, EC, governmental agencies and other potential end users (e.g., dedicated metallogenic /potential maps, predictive maps ).

11 What do we bring? Are we in competition with other Internet data providers? Most of the Internet data providers collect, standardize and disseminate all relevant corporate, financial, market and M&A data plus news and analysis for industries like metals & mining. We are partly dealing with the same data (e.g., project/mine status, exploration, production and grades, reserves and resources ) but our goal is to provide the investor, the decision-maker or the stakeholder with the capability (i) to produce in a seamless way his own analysis combining several types of data and (ii) to search for and exploit pertinent syntheses (e.g., the e- Minerals Yearbook [WP4] and foresight studies [WP6]). We are covering the whole value chain, putting notably at the end user disposal all the geological and metallogenic knowledge necessary to evaluate ongoing mining projects (potential of the area, potential of development ) No competition, but complementarity

12 EURARE IKMS (REE) Strong synergy Addresses EIP-SIP II.C Priority Area Action area II.8: The EURMKB One of the first bricks of the EGDI Minerals4EU EU-MKDP Looking toward the near future ProSUM The EU-UMKDP: Mining wastes, WEEE, ELVs, Batteries Adding new bricks Building on Minerals4EU and extending the EU-MKDP H2020 EIP-RM COMMITMENTS Raw materials intelligence capacity: Database of models & tools (MFA, LCA, 3D-4D ), ontology-based selection tool REMIND Responsible Mining Demonstrations EUMINET European Minerals Information Network

13 Thanks a lot for your attention! Developing the EU-MKDP architecture will contribute to lay the foundations of an effective and lasting system designed to accommodate various data sets related to raw materials, make easier their visualization and their use and facilitate data updates and maintenance.