NOAA Environmental Management Report to Unidata Policy Cmtee 2013-05-15 Jeff de La Beaujardière, PhD NOAA Management Architect jeff.delabeaujardiere@noaa.gov +1 301-713-7175 Jeff.deLaBeaujardiere@noaa.gov 2013-05-15 3
2013-05-15 Overview Vision for NOAA Enviro. Mgmt (EDM) EDM Framework (SAB action) EDM Dashboard EDM Virtual Workshop EDM Assessment of Systems of Record Citation pilot project Recent Presidential directives Jeff.deLaBeaujardiere@noaa.gov 4
Vision for NOAA Management All NOAA data will be: Discoverable Accessible Documented Preserved for all types of users and applications. Jeff.deLaBeaujardiere@noaa.gov 2013-05-15 5
NOAA Environmental Management Framework 11 Management Framework Principles Governance Resources Standards Architecture Assessment Purpose: To organize, guide and support NOAA environmental data management activities. Mandate: Science Advisory Board (SAB) recommendation to NOAA. https://www.nosc.noaa.gov/ed MC/framework.php
15 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Principles Full and Open Access except in very limited cases Preservation for long-term usability Information Quality known quality data, complete metadata Ease of Use compatible services, formats, vocabularies
16 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Governance NOAA Bodies incl. EDMC NOAA Policies incl. EDMC PDs US Policies incl. OSTP PARR memo External Coordination
NOAA EDM Governance Bodies SAB Science Advisory Board NEC & NEP NOAA Executive Council & Panel DAARWG Access & Archiving Requirements WG NOSC NOAA Observing System Council CIO Council Chief Information Officer Council NOAA National Centers Observing Systems Committee EDMC Environmental Management Committee GIS Committee Enterprise Architecture Committee DMIT Management Integration Team
EDMC Procedural Directives (Environmental Management Committee) Management Planning PD Plan, in advance, how you will preserve, document and distribute your data. Archive Procedure What to archive, how to submit to archive. Documentation How to apply ISO 19115 metadata for discovery, use & understanding. Sharing by NOAA Grantees State how you will share data, and share within 2 years. Citation Assign persistent identifiers to datasets and encourage citation. Access Establish & improve on-line services for data access in prep. (2013)
Public Access to Research Results (PARR) Memo from White House Office of Science and Technology Policy (OSTP): "Increasing Access to the Results of Federally Funded Scientific Research" http://www.whitehouse.gov/sites/default/files/microsites/ostp/ostp_public_access_memo_2013.pdf Applies to "Publications" and "Digital " Focus is more on policy than technology Draft plans from each Agency due 2013 Aug 22 Federal activity: Interagency meetings hosted by OSTP NOAA activity: PARR Cmtee established by NOAA Research Council to draft plan Co-chairs: Jeff DLB (EDMC), Neal Kaske (NOAA Library) 21
Executive Order (May 9, 2013) "Executive Order -- Making Open and Machine Readable the New Default for Government Information" http://www.whitehouse.gov/the-press-office/2013/05/09/executive-order-making-open-and-machine-readable-new-default-government- Coupled with: Requires Open Policy -- Managing Information as an Asset Implementation Guide Machine-readable inventory of agency data assets Use of open standards and formats Life-cycle data management planning Initial efforts by November 9, 2013 22
24 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Resources Budget Project-specific NOAA-wide Personnel Training Recognition Authority Other Resources Annual Workshop Teams Wiki
EDM Virtual Workshop NOAA-wide Virtual Workshop All participants connecting remotely via webinar software June 25-27, 13:00-16:30 EDT Theme: NOAA EDM: current state, target state, next steps Six 90-minute sessions: Intro & Overview Catalog & Search Access Usability Preservation & Citation Wrap-up & Final Discussion (tentative) Jeff.deLaBeaujardiere@noaa.gov 2013-05-15 25
27 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Architecture Service-based approach Designing for flexibility ability to leverage Cloud & other technologies National Centers Legacy systems and agreements
Services Layer User Tools.gov and Other Portals Decision Support Tools Scientific Software Value- Adding Reseller data services layer Search & Discovery Services Access Services Documentation Compatible Formats and Vocabularies Sources Satellite Radar Buoy Ship Sonar Gauge ROV/UAV Surveys
Potential Cloud Deployment Scenario 36 Commercial Cloud Access services Discovery services Utility services One-way push Public users NOAA security boundary Jeff.deLaBeaujardiere@noaa.gov Master copy of NOAA Government Cloud Processing Services NOAA Internal customers 2013-05-15
38 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment Assessment Current state Observing System of Record EDM study Progress measurement EDMC Reporting EDM Dashboard Feedback from users & implementers
39 Obs. System of Record EDM Assessment Goal: For NOAA-owned Observing Systems of Record (63 N 86), determine Management plan existence/location Center used for long-term preservation Metadata location & format access services offered *CORL=Consolidated Observing Requirements List. NOSA=NOAA Observing Systems Architecture.
40 EDM Dashboard http://sites.google.com/a/noaa.gov/edm-dashboard/ (internal access only)
45 Management Framework Management Framework Principles Governance Resources Standards Architecture Assessment
Planning and Production Activities Management Activities Requirements Definition Planning Development Deployment Operations Collection Processing Quality Control Documentation Cataloging Dissemination Preservation Stewardship Usage Tracking Activities Jeff.deLaBeaujardiere@noaa.gov Final Disposition Usage Activities Discovery Reception Understanding Analysis Value-Added Products User Feedback Citation Tagging Gap Assessment 2013-05-15 47
Planning and Production Activities Management Activities Requirements Definition Planning Development Deployment Operations Collection Processing Quality Control Documentation Cataloging Dissemination Preservation Stewardship Usage Tracking Final Disposition Applicability of EDMC Directives DM Planning Documentation Sharing by Grantees Access Archive Procedure Jeff.deLaBeaujardiere@noaa.gov Usage Activities Discovery Reception Understanding Analysis Value-Added Products User Feedback Citation Tagging Gap Assessment Citation 2013-05-15 50
Planning and Production Activities Management Activities Requirements Definition Planning Development Deployment Operations Collection Processing Quality Control Documentation Cataloging Dissemination Preservation Stewardship Usage Tracking Final Disposition Jeff.deLaBeaujardiere@noaa.gov Usage Activities Discovery Reception Understanding Analysis Value-Added Products User Feedback Citation Tagging Gap Assessment Focus of NOAA Citation pilot project 2013-05-15 53
NOAA Citation Pilot Project Goals: assign persistent identifiers to archival datasets enable citation of datasets used in results encourage archival submission & complete metadata enable usage tracking Status: Have license to mint DOIs Established team of Center reps + DM Architect Working out technical details metadata reqmts, landing page creation, dataset granularity Hope to have first DOIs assigned by June
1 Observing Requirements 2 Management Planning Directive Documentation Directive Archive Procedure Producers 3 generate 4 transmit and Metadata preserve 6 14 NOAA Center refine feedback 13 publish 5 ID 7 Users 10 find get Access and Discovery Services publish 8 establish Tools Citation Directive Access Directive 12 measure 9 Agency Leadership 11 create Result product forecast paper decision policy response ID measure monitor Management Dashboard