EEOS 381 - Spatial Databases and GIS Applications Lecture 9 Metadata
What is Metadata? Data about data Description of a (GIS) dataset What it represents Who created it? When? How? Format Field definitions Other technical specifications The who, what, when, where, why and how of the data A summary document about the data. EEOS 381 - Spring 2015: Lecture 9 2
What is Metadata? More formal definition: Information about the content, quality, condition, and other characteristics of data. Metadata for geographic data may document its subject matter; how, when, where, and by whom the data was collected; accuracy of the data; availability and distribution information; its projection, scale, resolution, and accuracy; and its reliability with regard to some standard. Metadata consists of properties and documentation. Properties are derived from the data source (for example, the coordinate system and projection of the data), while documentation is entered by a person (for example, keywords used to describe the data). EEOS 381 - Spring 2015: Lecture 9 3
What is Metadata? (cont.) Information for user to determine if dataset satisfies requirements for a given use Should travel with the data - data and metadata should be distributed together XML Text, Word documents HTML (Web) DBF, INFO EEOS 381 - Spring 2015: Lecture 9 4
What is Metadata? (cont.) Should follow standards FGDC CSDGM * (Federal Geographic Data Committee s Content Standards for Digital Geospatial Metadata) ISO (International Standards Organization) Dublin Core * User-defined (e.g. MassGIS, NPS) * = see page 282 in textbook for details That s what s nice about standards - there s so many to choose from EEOS 381 - Spring 2015: Lecture 9 5
Metadata Considerations Takes time (and thus money) to produce Needs to be updated whenever data are updated Should be developed as data are developed, so all steps are recorded along the way Can be feature-level, layer-level, or collection-level Is important for institutional knowledge Metadata should not be an afterthought -it is an integral part of a database EEOS 381 - Spring 2015: Lecture 9 6
FGDC Standard Most widely used First published in 1993 CSDGM (FGDC-STD-001-1998) approved in June 1998 It is a content standard - describes what metadata should include, not on its format. Allows for custom use and display One way of implementing the National Spatial Data Infrastructure (NSDI) Geospatial metadata are critical to data discovery and serves as the fuel for both the Geospatial One- Stop data portal and the NSDI Clearinghouse. EEOS 381 - Spring 2015: Lecture 9 7
FGDC Standard According to the FGDC, metadata supports: Producers in locating and using their own data Consumers in locating and using data produced by others Data Management requirements preserve the data history so that it can be re-used or adapted, assess the age and character of data holdings to determine which data should be maintained, updated, or deleted, instill data accountability by requiring you to state what you know about the data and realizing what you don t, but should, know about your data limit data liability by explicitly designating the effective and administrative limits of use of the data EEOS 381 - Spring 2015: Lecture 9 8
FGDC Standard According to the FGDC, metadata supports (cont.): Project Management requirements plan and document the data types and content needed to support the project monitor data development by regular review of the process steps completed and recorded within the metadata provide all project participants a common language of attributes and process methods and a place to record and share their progress access the lineage and content of outsourced data production by requiring robust metadata as a contract deliverable EEOS 381 - Spring 2015: Lecture 9 9
FGDC Standard (cont.) Major Features: Identification Data Quality Spatial Data Organization Spatial Reference Entity and Attribute Distribution Metadata Reference Citation Time Period Contact See section 11.2 in textbook and http://www.fgdc.gov/metadata EEOS 381 - Spring 2015: Lecture 9 10
ISO Standard International Standards Organization Standard 19115-1:2014, Geographic Information Metadata Available for purchase ($265 or $212 for ANSI member) at http://webstore.ansi.org/recorddetail.aspx?sku=iso+19115-1%3a2014 Core set of elements that includes a few mandatory elements and an additional set of highly recommended ones The new standard for ArcGIS at v. 10.0 EEOS 381 - Spring 2015: Lecture 9 11
FGDC and ISO FGDC Metadata Summit in October 2011 http://www.fgdc.gov/metadata/events/metadatasummit/fgdc-metadata-summit-summary.pdf: Purpose: To cooperatively determine a course of action for moving forward with ISO metadata implementation Summary: Overall recognition that Federal agencies should be moving to ISO now Participants saw value in implementation of ISO on a larger scale Also see http://www.fgdc.gov/metadata/events/isogeospatial-metadata-implementation-forum/index_html EEOS 381 - Spring 2015: Lecture 9 12
Metadata and ArcGIS Built in to ArcGIS Click on Description tab in ArcCatalog (used to be Metadata ) to read metadata and access editor Tools Various tools to work with metadata Thumbnail Use Create Thumbnail button on Geography Toolbar to create this image See http://resources.arcgis.com/en/help/main/10.1/#/what_is_metadata/003t00000001000000/ EEOS 381 - Spring 2015: Lecture 9 13
Metadata and ArcGIS - ArcMap EEOS 381 - Spring 2015: Lecture 9 14
Metadata and ArcGIS Viewing Metadata Based on Metadata Style in ArcCatalog or ArcMap Options Customize > ArcCatalog Options Customize > ArcMap Options Metadata are stored in XML, and the style sheets take the XML and format it in a variety of ways for different types of display EEOS 381 - Spring 2015: Lecture 9 15
Metadata and ArcGIS Metadata travels with dataset with copy/paste Stored as XML in BLOB (binary large object) format in ArcSDE databases (in SDE.GDB_USERMETADATA table) Stored as XML files (ASCII text) with other data types (e.g..shp.xml) Import and export from/to other formats EEOS 381 - Spring 2015: Lecture 9 16
Metadata and ArcGIS Metadata Toolbar becomes activated when you click on the Description tab in ArcCatalog Validate metadata Automatically creates or updates metadata for the selected item Edit metadata Use the FGDC Metadata Editor Add-In to create FGDC-compliant metadata. Download from link below and add to toolbar. Export metadata Export metadata to other formats Metadata properties - Displays the metadata properties of the selected item Helpful Add-Ins: FGDC Metadata Editor add-in: http://blogs.esri.com/dev/blogs/arcgisdesktop/archive/2010/06/25/fgdc-metadata-editor-for-arcgis-10.aspx Clear Geoprocessing History add-in: http://www.arcgis.com/home/item.html?id=3646c7d507f44dbbba7a950b15315a0d EEOS 381 - Spring 2015: Lecture 9 17
Metadata and ArcGIS Standard Editor Additional categories appear if viewing the metadata with a style other than Item Description (see slide 15).Editing these categories will populate the ArcGIS Metadata and any corresponding FGDC Metadata sections. EEOS 381 - Spring 2015: Lecture 9 18
Metadata and ArcGIS (cont.) FGDC Metadata Editor Need Add-In to use this editor in ArcCatalog EEOS 381 - Spring 2015: Lecture 9 19
Other Metadata Software Listing of metadata tools http://www.fgdc.gov/metadata/geospatial-metadata-tools Metadata Parser (Verifier) http://geology.usgs.gov/tools/metadata/tools/doc/mp.html Online Metadata Validation Service: http://geo-nsdi.er.usgs.gov/validation/ EPA Metadata Editor: http://www.esri.com/news/arcuser/0807/metadata_editor.html EEOS 381 - Spring 2015: Lecture 9 20
Metadata MassGIS Example Several hundred layers needed metadata Created template XML for one layer, then applied to others Entered info into sample contacts database Used ArcCatalog FGDC Metadata Editor to enter standard info Saved as XML Selected many layers and used batch import utility Used custom tool to select one layer at a time and enter layer-specific information (title, abstract, date, entity attributes, etc.) EEOS 381 - Spring 2015: Lecture 9 21
Metadata and ArcGIS Server ArcGIS Server Geoportal Extension Organizations can manage and publish the metadata for their geospatial resources, among other features Supports FGDC, ISO, Dublin Core Includes free add-ons: Publish Client is a tool for ArcCatalog that lets you easily publish metadata from your local desktop to the geoportal. CS-W clients for ArcGIS End users can search and view metadata, and download the XML, all over the Web on your Geoportal. See: http://www.esri.com/software/arcgis/geoportal http://www.esri.com/software/arcgis/geoportal/free-addons http://www.esri.com/news/arcnews/summer09articles/arcgis-server.html EEOS 381 - Spring 2015: Lecture 9 22