NOAA Environmental Data Management

Transcription

1 NOAA Environmental Management Report to Unidata Policy Cmtee Jeff de La Beaujardière, PhD NOAA Management Architect

2 Overview Vision for NOAA Enviro. Mgmt (EDM) EDM Framework (SAB action) EDM Dashboard EDM Virtual Workshop EDM Assessment of Systems of Record Citation pilot project Recent Presidential directives 4

3 Vision for NOAA Management All NOAA data will be: Discoverable Accessible Documented Preserved for all types of users and applications

4 NOAA Environmental Management Framework 11 Management Framework Principles Governance Resources Standards Architecture Assessment Purpose: To organize, guide and support NOAA environmental data management activities. Mandate: Science Advisory Board (SAB) recommendation to NOAA. MC/framework.php

5 15 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Principles Full and Open Access except in very limited cases Preservation for long-term usability Information Quality known quality data, complete metadata Ease of Use compatible services, formats, vocabularies

6 16 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Governance NOAA Bodies incl. EDMC NOAA Policies incl. EDMC PDs US Policies incl. OSTP PARR memo External Coordination

7 NOAA EDM Governance Bodies SAB Science Advisory Board NEC & NEP NOAA Executive Council & Panel DAARWG Access & Archiving Requirements WG NOSC NOAA Observing System Council CIO Council Chief Information Officer Council NOAA National Centers Observing Systems Committee EDMC Environmental Management Committee GIS Committee Enterprise Architecture Committee DMIT Management Integration Team

8 EDMC Procedural Directives (Environmental Management Committee) Management Planning PD Plan, in advance, how you will preserve, document and distribute your data. Archive Procedure What to archive, how to submit to archive. Documentation How to apply ISO metadata for discovery, use & understanding. Sharing by NOAA Grantees State how you will share data, and share within 2 years. Citation Assign persistent identifiers to datasets and encourage citation. Access Establish & improve on-line services for data access in prep. (2013)

9 Public Access to Research Results (PARR) Memo from White House Office of Science and Technology Policy (OSTP): "Increasing Access to the Results of Federally Funded Scientific Research" Applies to "Publications" and "Digital " Focus is more on policy than technology Draft plans from each Agency due 2013 Aug 22 Federal activity: Interagency meetings hosted by OSTP NOAA activity: PARR Cmtee established by NOAA Research Council to draft plan Co-chairs: Jeff DLB (EDMC), Neal Kaske (NOAA Library) 21

10 Executive Order (May 9, 2013) "Executive Order -- Making Open and Machine Readable the New Default for Government Information" Coupled with: Requires Open Policy -- Managing Information as an Asset Implementation Guide Machine-readable inventory of agency data assets Use of open standards and formats Life-cycle data management planning Initial efforts by November 9,

11 24 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Resources Budget Project-specific NOAA-wide Personnel Training Recognition Authority Other Resources Annual Workshop Teams Wiki

12 EDM Virtual Workshop NOAA-wide Virtual Workshop All participants connecting remotely via webinar software June 25-27, 13:00-16:30 EDT Theme: NOAA EDM: current state, target state, next steps Six 90-minute sessions: Intro & Overview Catalog & Search Access Usability Preservation & Citation Wrap-up & Final Discussion (tentative)

13 27 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Architecture Service-based approach Designing for flexibility ability to leverage Cloud & other technologies National Centers Legacy systems and agreements

14 Services Layer User Tools.gov and Other Portals Decision Support Tools Scientific Software Value- Adding Reseller data services layer Search & Discovery Services Access Services Documentation Compatible Formats and Vocabularies Sources Satellite Radar Buoy Ship Sonar Gauge ROV/UAV Surveys

15 Potential Cloud Deployment Scenario 36 Commercial Cloud Access services Discovery services Utility services One-way push Public users NOAA security boundary Master copy of NOAA Government Cloud Processing Services NOAA Internal customers

16 38 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Assessment Current state Observing System of Record EDM study Progress measurement EDMC Reporting EDM Dashboard Feedback from users & implementers

17 39 Obs. System of Record EDM Assessment Goal: For NOAA-owned Observing Systems of Record (63 N 86), determine Management plan existence/location Center used for long-term preservation Metadata location & format access services offered *CORL=Consolidated Observing Requirements List. NOSA=NOAA Observing Systems Architecture.

18 40 EDM Dashboard (internal access only)

19 45 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment

20 Planning and Production Activities Management Activities Requirements Definition Planning Development Deployment Operations Collection Processing Quality Control Documentation Cataloging Dissemination Preservation Stewardship Usage Tracking Activities Final Disposition Usage Activities Discovery Reception Understanding Analysis Value-Added Products User Feedback Citation Tagging Gap Assessment

21 Planning and Production Activities Management Activities Requirements Definition Planning Development Deployment Operations Collection Processing Quality Control Documentation Cataloging Dissemination Preservation Stewardship Usage Tracking Final Disposition Applicability of EDMC Directives DM Planning Documentation Sharing by Grantees Access Archive Procedure Usage Activities Discovery Reception Understanding Analysis Value-Added Products User Feedback Citation Tagging Gap Assessment Citation

22 Planning and Production Activities Management Activities Requirements Definition Planning Development Deployment Operations Collection Processing Quality Control Documentation Cataloging Dissemination Preservation Stewardship Usage Tracking Final Disposition Usage Activities Discovery Reception Understanding Analysis Value-Added Products User Feedback Citation Tagging Gap Assessment Focus of NOAA Citation pilot project

23 NOAA Citation Pilot Project Goals: assign persistent identifiers to archival datasets enable citation of datasets used in results encourage archival submission & complete metadata enable usage tracking Status: Have license to mint DOIs Established team of Center reps + DM Architect Working out technical details metadata reqmts, landing page creation, dataset granularity Hope to have first DOIs assigned by June

24 1 Observing Requirements 2 Management Planning Directive Documentation Directive Archive Procedure Producers 3 generate 4 transmit and Metadata preserve 6 14 NOAA Center refine feedback 13 publish 5 ID 7 Users 10 find get Access and Discovery Services publish 8 establish Tools Citation Directive Access Directive 12 measure 9 Agency Leadership 11 create Result product forecast paper decision policy response ID measure monitor Management Dashboard