Esri International User Conference San Diego, California Technical Workshops July 26, 2012 Leveraging Metadata Standards in ArcGIS for Interoperability David Danko Aleta Vienneau
Leveraging Metadata Standards in ArcGIS for Interoperability Metadata standards: why, what, and when - Why metadata and metadata standards - Status of metadata standards and profiles Creating standards-compliant metadata in ArcGIS - ArcGIS notes for all standards and profiles - FGDC CSDGM metadata - ISO 19139 metadata - North American Profile (NAP) - INSPIRE Metadata Directive - ANZLIC and other ISO profiles - Customizing the metadata editor
Metadata standards: why, what, and when
Usefulness and utility of released data rating system Data is released (PDF of scanned paper) Data is structured, in machine-readable format (Excel file) Data is in an open file format (CSV file) Data uses consistent format, discoverability methods and metadata associations Data uses URLs to identify things Data is linked to other linked data
Why is geospatial metadata important? Geospatial data is an imperfect abstraction of the real world - A model, a point of view - Assumptions, limitations, approximations, simplifications Ensures we understand the geographic information - The producer is not usually the user - Supports good information management Geospatial resources are valuable - Reuse Oh yeah it helps us find the right information for the right purpose
Why use metadata standards? Provide resource producers an idea of the metadata they should collect Provide consistent terminology for global search Provide an common understanding of data around the Globe and across information communities
Regional and national standards from the mid 1990s Content Standard for Digital Geospatial Metadata (FGDC 1992) Directory Information Describing Digital Geo-referenced Data Sets, CAN/CGSB 171.3-95 Australia & New Zealand: Core metadata elements for land and geographic directories in Australia and New Zealand CEN TC287: Geographic Information - Data description Metadata (1996) All except FGDC have moved to ISO 19100 standards - FGDC now starting to transition to ISO standards
ISO Metadata standards ISO 19110:2005/Amd 1:2011 Methodology for feature cataloguing ISO 19111:2007 Spatial referencing by coordinates ISO 19112:2003 Spatial referencing by geographic identifiers ISO 19113:2002 Quality principles ISO 19114:2003 Quality evaluation procedures ISO 19115:2003/Cor 1:2006 Geospatial metadata ISO 19115-2:2009 Extensions for imagery and gridded data ISO 19119:2005 Services ISO 19130:2010 Imagery sensor models for geopositioning ISO 19138:2006 Data quality measures ISO 19139:2007 Metadata XML Schema implementation ISO 15836:2003 The Dublin Core metadata element set
ISO 19115/19139 Profiles Australia-New Zealand Profile North American Profile of ISO 19115:2003 (NAP) - CAN/CGSB-171.100-2009 - INCITS 453-2009 INSPIRE Metadata Directive ISO19115/ISO19119 Application Profile for CSW 2.0 C3Grid ISO 19115 Metadata Profile Marine Community Metadata Profile of ISO 19115 Energy Industry Profile of ISO 19115-1 USGIN ISO 19139 Profile DISDI Geospatial Metadata Profile (DGMP) National System for Geospatial Intelligence Metadata Foundation (NMF) A metadata profile for precision agriculture based on ISO 19115 standard. WMO Core Profile of the ISO 19115 Metadata Standard Transformation of HDF-EOS metadata from the ECS model to ISO 19115-based XML Draft African metadata profile of ISO19115 Samoan profile NOKIS an ISO 19115 Based Metadata System The UDK and ISO 19115 Standard Latin American Profile Núcleo Español de Metadatos (NEM) UK GEMINI Biological profile Coastal zone profile S100 Metadata profile (IHO)
Changes coming to ISO 19115 and ISO 19139 Today - ISO 19115 defines content - ISO 19139 defines encoding rules and the encoding (XML schema) Future - Encoding rules define how to create XML Schema from UML - ISO 19115-1 defines improved content - ISO 19115-3 defines encoding (XML schema) - Revise ISO 19139 to define encoding rules only
Schedule of standards work in progress ISO 19139-2 XML schema for imagery and gridded data - Technical Specification (TS) 2012-10 ISO 19115-1 (revision) - Draft International Standard (DIS) 2011-12 - Final Draft International Standard (FDIS) 2012-12 - International Standard (IS) 2013-06 ISO 19115-3 XML schema implementation of metadata fundamentals Committee Draft (CD) 2013-07 DIS 2013-11 FDIS 2014-11 IS 2015-05 ISO 19157 Data Quality - FDIS 2012-10 - IS 2013-04 ISO 19110 Methodology for feature cataloguing (revision) - CD 2013-07 - FDIS 2014-07 - IS 2015-01
What s new in ISO 19115-1 Incorporating services metadata from ISO 19119 Data Quality content managed under ISO 19157 Feature catalog (entity/attribute) included from ISO 19110 - Physically or by link Many individual elements added or improved - Metadata identifier improved - MD_Scope and MD_KeywordClass classes added - Online linkage in Citation - Reference system type code attribute added - ~75 changes in all
ISO/TS 19115-3 XML schema implementation of Metadata fundamentals First meeting in Toulouse in June Project leader is Ted Habermann, NOAA XML Schema XSLT to convert from ISO 19115/19139 format to the ISO 19115-1/19115-3 format - And back Schematron
Future planned standards work ISO 19139 revision to contain encoding rules only ISO 19157-2 XML encoding for data quality Renumber ISO 19139-2 Metadata XML encoding for imagery and gridded data: becomes ISO 19115-4
North American Profile of ISO 19115 (NAP) NAP is a profile of ISO 19115 Metadata - Remains stable as-is U.S. will focus on transition to 19115-1 using NAP as a guide - After gaining experience with 19115-1, will work with Canada to update NAP as a profile of 19115-1
Creating standardscompliant metadata in ArcGIS
ArcGIS notes for all standards and profiles Upgrade existing metadata to the ArcGIS metadata format Let ArcGIS automatically update metadata Important Help topics - The ArcGIS metadata format - Creating standard-compliant metadata Let 10.1 validation rules in the editor guide you - Validation rule updates coming with 10.1 SP1
FGDC CSDGM metadata Creating FGDC CSDGM metadata is fully supported with ArcGIS 10.0 SP4 - All FGDC metadata content upgraded to ArcGIS metadata - Continue to apply service packs as they are available Create metadata in the Description tab
FGDC CSDGM metadata Set CSDGM style, and check options in Options dialog box
FGDC CSDGM metadata View 9.3.1 FGDC CSDGM-format metadata - Popup warns you an upgrade is needed - Yes: upgrade right away - No: do it later with Upgrade button or Upgrade Metadata tool FGDC CSDGM-format content appears at the bottom of display - Click FGDC Metadata (read-only) heading - Content is read-only in the context of the Description tab
FGDC CSDGM metadata Important Help topics specific to FGDC CSDGM content - Creating and managing FGDC metadata - Illustrated guide to complete FGDC metadata - Differences between ArcGIS metadata and FGDC metadata - New topic in 10.1 online Help
FGDC CSDGM metadata Locate specific elements with the illustrated guide
FGDC CSDGM metadata Let ArcGIS automatically update metadata - Required to include spatial reference in exported metadata Some content controlled by the metadata style Don t type None added on export Process steps ordered by date on export
FGDC CSDGM metadata Export button creates a CSDGM-formatted XML file Use exported XML and USGS MP Metadata Translator tool to produce additional file formats Import button converts a CSDGM-formatted XML file to the ArcGIS metadata format Transform a CSDGM-format text file to XML format with mp using a Python script, then import XML
FGDC CSDGM metadata 10.1 editor validates ArcGIS metadata content against CSDGM rules as you type - Improvements to the rules coming with 10.1 service pack 1 Validate button creates a CSDGM-formatted XML file and validates it with the FGDC DTD Export metadata to a CSDGM XML file, then validate it with mp using USGS MP Metadata Translator tool
FGDC CSDGM metadata Can remove FGDC CSDGM-format metadata using geoprocessing model and provided XSLT - remove pre94 metadata elements.xslt
ISO 19139 metadata Set ISO 19139 style and check options in Options dialog box
ISO 19139 metadata Use ArcGIS 10.0 SP4 or later Creating ISO 19139 metadata incorporates both ISO 19115 content and ISO 19119 content
ISO 19139 metadata If you created 9.3.1 metadata using ISO wizard only, metadata is upgraded automatically when you edit it and save changes in the Description tab If you created 9.3.1 metadata using both the ISO and FGDC editors, choose if you want to upgrade FGDC or ISO Make definitive choice by running Upgrade Metadata tool
ISO 19139 metadata Export button in the Description tab creates an ISO 19139-formatted XML file Import button in the Description tab converts an ISO XML file to the ArcGIS metadata format
ISO 19139 metadata Validate ArcGIS metadata according to ISO 19139 rules as you type in the editor - The rules as defined in the ISO 19115 and ISO 19119 standard documents Validate button in the Description tab creates an ISO 19139-formatted XML file and validates with online XSDs - URL we use for online XSDs will be changing in the future
ISO 19139 metadata Can remove 9.3.1-formatted metadata using geoprocessing model and provided XSLT - remove pre94 metadata elements.xslt
North American Profile (NAP) Set NAP style and check options in Options dialog box
North American Profile (NAP) Essentially the same as creating ISO 19139 metadata Additional codelist values available in the editor NAP-specific rules in the editor Content not included in NAP is not available in the editor unless it is considered part of a complete ArcGIS metadata document
North American Profile (NAP) Export button in the Description tab creates an ISO 19139-formatted XML file If edits were saved using the NAP style, exporter ensures codelist values and content are appropriate for NAP Import button in the Description tab converts an ISO 19139 XML file to the ArcGIS metadata format - ISO importer that supports NAP-specific content will be available in a future 10.1 service pack
North American Profile (NAP) Validate ArcGIS metadata as you type according to NAP rules Validate button in the Description tab creates an ISO 19139-formatted XML file and validates with online XSDs - No NAP-specific XSDs
INSPIRE Metadata Directive Set INSPIRE style and check options in Options dialog box
INSPIRE Metadata Directive Provide the ability to create ISO metadata that conforms to the INSPIRE Metadata Directive Essentially the same as creating ISO 19139 metadata Limited codelist values in the editor as appropriate INSPIRE-specific rules in the editor
INSPIRE Metadata Directive Export button in the Description tab creates an ISO 19139-formatted XML file If edits were saved using INSPIRE style, exporter ensures codelist values and content are appropriate for INSPIRE Import button in the Description tab converts an INSPIRE-compliant ISO 19139 XML file to the ArcGIS metadata format
ANZLIC and other ISO profiles Complete ISO 19139 content is supported with the ISO 19139 metadata style As long as you know the rules for your profile, you can create metadata conforming to that profile in ArcGIS Can use the ArcGIS Metadata Toolkit to customize the ArcGIS metadata editor for your profile Can run Schematrons based on XSLT 1.0 in ArcGIS as an XSLT
Customizing the metadata editor Create a custom metadata style for a specific profile Download the ArcGIS Metadata Toolkit from support.esri.com - Documents the ArcGIS metadata format - Instructions for creating a custom metadata style - Code for all pages in the metadata editor - A WPF application with XAML forms written in C# - Sample project for adding a custom page - Instructions for customizing export transformations
Multilingual metadata ArcGIS lets you work with one language at a time Two methods are described in ISO standard documents for creating multilingual metadata Recommend creating a second XML document containing written content in a second language - Devise and stick with a naming convention Indicate in metadata that information is available for another locale Cross-reference the additional XML file in the item s metadata
Steps to evaluate UC sessions My UC Homepage > Evaluate Sessions Choose session from planner OR Search for session www.esri.com/ucsessionsurveys
Thank you for attending Have fun at UC2012 Open for Questions Please fill out the evaluation: www.esri.com/ucsessionsurveys Offering ID: 1663