Helmholtz Impuls- und Vernetzungsfonds Marine Network for Integrated Data Access (MaNIDA) Portal Deutsche Meeresforschung W. Hiller, M. Schulz, G. Breitbach, B. Brügge, A. Lehmann Coordinating Helmholtz Centre: Alfred-Wegener-Institut für Polar- und Meeresforschung in der Helmholtz-Gemeinschaft
Status of Marine Science in Germany Challenge a deluge of marine environmental data from many different sources Extremely wide range of data sources Ship-based instruments Instruments in water column and at seafloor Air- and space-borne instruments Sensor networks Data types: individual snapshot projects vs. long-term monitoring data Data-intensive marine science needs a coherent data portal with common access strategy: aggregation, integration, free access Data stored in different data centers (PANGAEA, BSH/DOD, HZG/COSYNA) - if at all!
Data-Intensive Marine Science 19. D-GEO Arbeitstreffen 06 Okt 2011 Angela Schäfer
MaNIDA aims to establish efficient Organizational and technical solutions for building and sharing a sustainable e-infrastructure Data lifecycle management workflows and procedures from data ingestion to data publication Networking and outreach strategies for disseminating quality-controlled marine data at national and international levels and education
MaNIDA Added Value Coherent discovery, view, download and dissemination of integrated and qualitycontrolled marine data along with related content Common data-related tools Common workflows User support and data curation centers PANGAEA (AWI/MARUM): Data Publisher for Earth & Environmental Science and World data Center WDC- MARE KDMI (IFM-GEOMAR): Kiel Data Management Infrastructure COSYNA (HZG): Coastal Observing System for Northern and Arctic Seas BSH: Marine spatial data infrastructure GDI-BSH and the German National Oceanographic Data Centre DOD Strategic network and outreach activities Data mining
MaNIDA Concept (1) Evaluation work: collection and documentation of technical requirements Content aggregation harmonization integration Ingestion workflows Technical development: common sustainable e-infrastructure based on international standards Procedures for automated processes Central catalogue Common workflows
MaNIDA Concept (2) Sustainability Management plan Service-level agreements and letter of compliance Balanced scorecard (self-evaluation) Data Curation and User Support Centers Help desk Acquisition, processing, archiving, and publication of data, project data management Data compilations and visualizations Outreach and Network Graduate schools as hubs for education Coordination / participation in international networks (e.g. EMODnet/SeaDataNet) MaNIDA as national marine data provider Consolidation, and maintenance of links to data networks (World Data System etc.) and publishers (Elsevier, Copernicus, etc.)
MaNIDA Consortium Long-standing experience in data ingestion, harmonisation, management, and archival (e.g. PANGAEA, DOD, GDI- BSH) Portal Deutsche Meeresforschung Seminal work on citationenabled primary data (DOIs at PANGAEA) and linking publications directly with data (e.g. AWI s expedition portal) Compliance with international standards (OAIS, INSPIRE, OGC, etc)
MaNIDA s Outreach and Networking Research Networks EUR-OCEANS European Network of Excellence MARBEF (NoE) Marine Biodiversity & Ecosystem Functioning Large Research Infrastructures (ESFRI) ESONET/EMSO (ESFRI) European Seas Observatory JERICO (INFRA) Joint European Research Infrastructure for Coastal Observatories Euro-Argo (ESFRI) Global Ocean Observing Infrastucture 19. D-GEO Arbeitstreffen 06 Okt 2011 Angela Schäfer Research Schools POLMAR (Brhv) Helmholtz Graduate School For Polar and Marine Research ESSReS (Brhv) Earth System Science Research School GLOMAR (Bremen) Bremen International Graduate School for Marine Sciences ISOS (Kiel) Integrated School of Ocean Sciences SICSS (Hamburg) School of Integrated Climate System Sciences Standards & Technologies APARSEN (NoE) Alliance for Permanent Access to Records of Science Network INSPIRE / OGC Infrastructure for spatial information EU-Directive DOI & Publishers D-Grid Large Data-Infrastructures GEOSS Global Earth Observation System of Systems ICSU World Data System International Council for Science GBIF Global Biodiversity Information Facility (OECD) EMODNET European Marine Observation & Data Network SeaDataNet Pan-European Infrastructure for Ocean & Marine Data Management
MaNIDA Enabling Data-Intensive Marine Science Global Change Assessing, understanding, and predicting environmental changes Human environmental impact Hazards Risk analysis and support for disaster management Understanding environmental factors Resources Sustainable ecosystem management Energy from the ocean
MaNIDA konkrete Baustellen Schiffseinsatzdaten - Koordination Workflowentwicklung (Geräte, Cruise- Summaries/Reporte) Verknüpfbarkeit zu Publikationen Schiffslogistik Underwaydaten DShip mit allen Daten (Navigation, Temp., ADCP, Salzgeh., ) Entwicklung u. Etablierung eines gemeins./einheitl. Workflows auf allen beteiligten Schiffen Geologische/Geophysik-Daten u.a. Zeitscheibenproblematik, Bathymetrie Workflow-Entwicklung Auffinden von harmonisierte Bathymetriedaten von mind. vier beteiligten Instituten mit entspr. Qualityflags, Kalibrierungen und Methoden (Schiff, ROV, AUV) aggregierte Datensätze mit guter Beschreibung gut aufgestellte/passende Suchverfahren Monitoring Real-time/near Workflow und Datenfluss für Monitoringdaten (Ferrybox, feste Sensoren, Pfähle, Satelliten) vorerst auf COSYNA/MarNet beschränkt (HZG/BSH-Schnittmenge)
MaNIDA konkrete Baustellen Portalarchitektur und Koordination SW-techn. Entwicklungen Schnittstellen Harvesting, Hosting, faceted search Datenstrukturen u. Datenharmonisierung; (Vokabular, Hierarchisierung, Granularität) Harmonisierung von Metadaten Standards, Vorbereitung Klasse A-B-C- Daten Vernetzung mit Publikationen
MaNIDA - Work in progress Thank you
AWI Research infrastructure Ships: Polarstern (II), Heincke, Mya, Stations: Neumayer III, AWIPEV, Hausgarten, Airplanes: Polar 5/6 Data infrastructure Portals: expedition, epic PANGAEA DShip data acquisition/access Data ingest framework for AWI research platforms C3Grid model data repository Authentication/Authorization frameworks
MARUM (University of Bremen) PANGAEA Data Publisher for Earth & Environmental Science AMAR AWI-MARUM cooperation agreement with special focus on joint data management Cluster of Excellence "The Ocean in the Earth System". ICSU World Data Centre, WMO World Radiation Monitoring Centre (WRMC), Portals for the Integrated Ocean Drilling Program (IODP) and the ICSU World Data System (WDS), Collaborations with all major science publishers
COSYNA (HZG) : Coastal Observing System for Northern and Arctic Seas 18 in-situ platforms (5 wave rider buoys, 1 other buoy, 3 wadden sea poles, 2 fixed ferryboxes on land, 4 ferryboxes on ships of opportunity, 2 irradiation stations, 1 meteorological station) Data from R.V. Ludwig Prandtl 2 remote sensing platforms (HF radar and Meris on Envisat) Data products (gauge analysis, circulation models, reanalysis with assimilation of HF radar measurements into the circulation model) Glider, scanfish, forecast model for waves, underwater node Registered and approved monitoring services for GEOSS INSPIRE compliant metadata Web services for data access and visualization (OGC compliant)
KDMI (IFM-GEOMAR): Kiel Data Management Infrastructure Interdisciplinary, cross-project initiative implements an institutional collaboration portal for scientists focuses on a scientist's daily work(flow) yielding complete data provenance record enables sustainability of marine scientific data from raw data to publication and for subsequent re-use contributions of expertise development of software solutions, a cross-disciplinary and -project approach digital linkage of publications, data and ongoing research enabling discovery of still unknown resources contribution of raw and quality controlled data oceanographic data underway data of research vessels ALKOR and POSEIDON extensive bathymetric maps results of interdisciplinary model experiments 19. D-GEO Arbeitstreffen 06 Okt 2011 Angela Schäfer
20 different marine systems 40,000,000 data sets Browse and search (full-text and spatiotemporal searches), various data categories in various formats Visualization with MapViewer and its associated services Built upon OGC-compliant Web Map Services Embedded in GDI-DE and GeoPortal.Bund 19. D-GEO Arbeitstreffen 06 Okt 2011 Angela Schäfer BSH: Marine spatial data infrastructure GDI-BSH and the German National Oceanographic Data Centre DOD Long-term and historical data sets Data from national and international research cruises (esp. for research work in German national waters) Integrated in the European National Oceanographic data centres Operational marine real time data Regional Centre of the North-West Shelf for the Marine Core Service (GMES)
Offshore Wind Parks data aggregation for engineering and environmental impact assessment Sea Floor Faunal Samples Sea Bird Observations Deployment Mulitgrid Sampling & Monitoring Current Meter Monitoring Gauges Buoys Faunal Asemblages Temperature Benthos Mapping Hydro-Acoustics Waves, Surf and Swell Temperature Isopleths 19. D-GEO Arbeitstreffen 06 Okt 2011 Angela Schäfer