DAMA. Tracking the Success of Data Quality

Transcription

1 DAMA Tracking the Success of Data Quality Peter R. Benson Project leader for ISO and ISO 8000 Copyright 2014 ECCMA All rights reserved Slide 1

2 Companies with a common interest ISO 8000 quality master data!

3

4 Information is Power Timely Relevant Accurate Data is Truth Useful Attributable Unambiguous

5 Data is truth - information is power 23mpg 26mpg Quality data but what about the information? 3 miles, I guess bigger is better.. 4.3gp100m Same data different information 3.8gp100m Half a gallon of gas every 100 miles... that s almost $2.00 a free lunch with every tank of gas! I can save $400 per year, that's one car payment a year! Copyright by ECCMA Slide 5

6 Data is truth - information is power Slide 6

7 Defining Data and Information data: fixed form into which information is transformed so that it can be stored or moved. Peter R. Benson ISO definitions (ISO/IEC :1993) Information knowledge concerning objects, such as facts, events, things, processes or ideas, including concepts, that within a certain context has a particular meaning Data Information Data Information Copyright only covers fixed form (you can only copyright data not information) Re-interpretable representation of information in a formalized manner suitable for communication, interpretation, or processing Copyright 2012 by Peter R. Benson

8 What does Quality Mean? When you order seafood from Quality Fresh Seafood, you can be confident that you are receiving the very best quality of seafood and delivery. Copyright by ECCMA Slide 8

9 ISO 9000 Definition of Quality quality degree to which a set of inherent characteristics fulfils requirements ISO 9000:2005(E) Slide 9

10 ISO 9001 Quality Management System Requirements ISO 9001:2000(E) Slide 10

11 Requirements Define Quality requirement need or expectation that is stated, generally implied or obligatory ISO 9000:2005(E) Quality is about meeting requirements Quality data is data that meets stated requirements nothing more and nothing less! (data that exceeds stated requirements does not increase the quality of the data) Slide 11

12 These are data requirements Slide 12

13 The quality of the data depends on how you ask for it Slide 13

14 Taxonomy of Data Data Dictionary Metadata and codes Transaction data Master data Identification data Descriptive data Classifications Performance characteristics Physical characteristics

15 ISO 8000 Family of Standards ISO 8000 General Principles Master Data Transaction data Part 1 Introduction Part 2 Terminology Part 100 introduction Part 110 Part 120 Provenance Part 130 Accuracy Part 140 Completeness Syntax Semantic encoding Meets requirements Slide 15

16 The Need for Semantic Encoding In South Africa a traffic light is called a robot! Robot Copyright 2011 by ECCMA Slide 16

17 ECCMA Open Technical Dictionary (eotd) Just as with music notation and engineering symbols, the eotd concept identifiers are simply used to communicate more accurately in a language independent environment. Music Engineering eotd A unique public domain identifier is assigned to a concept # #1 table # #1 chair # #1 weight # #1 length # #1 Monday # #1 kilogram Slide 17

18 Publicly Visible Terminology in a Standard Model The eotd (ECCMA Open Technical Dictionary) is an ISO compliant central registry of terminology. Each concept and terminological component in the eotd is assigned a unique and permanent public domain identifier. Users create corporate preferred subsets of the eotd and use the eotd concept identifiers to manage concept equivalence mapping with the concepts used by their trading partners. ISO ECCMA Open Technical Dictionary (eotd) Terminology Terms Abbreviations Definitions Images Public Domain Concept Identifier #xx-xxxxxx#1

19 Publicly Visible Terminology in a Standard Model Terminology Industry terminology Terminology Government terminology Terminology Terminology SDO terminology SDO terminology Public domain concept identifiers Free identifier resolution to underlying ( services terminology (web Hyperlink to source standards Multilingual Multiple terms, definitions and images linked to single concept identifier Slide 19

20 Applying Concept Equivalence to Enrich a Corporate Dictionary SABIC concept equivalence table = = Sabic Bolt = Rockwell Bolt Sabic Bolt = ASTM bolt eotd Concept ID Term Ex ref Originating Organization Definition Status # #1 BOLT IR237 SABIC A fastener that is externally threaded on one end and generally with some style of head on the other end and is normally intended to be tightened or released by torquing a nut and designed to fasten objects together. Active Equivalent concepts # #1 BOLT - Rockwell Automation, Inc A fastener consisting of a threaded pin or rod with a head at one end and designed to be inserted through holes in assembled parts and secured by a mated nut that is tightened by applying torque. Крепежная принадлежность, представляющая собой стержень с нарезанной резьбой и головкой на одной стороне, предназначенный для помещения в отверстия собираемых вместе деталей с последующей их фиксацией с помощью гайки, затягиваемой до определенного крутящего момента. Active # #1 bolt F F16 ASTM headed and externally threaded fastener designed to be assembled with a nut Active Copyright 2013 by ECCMA Slide 20

21 Building the Corporate Dictionary and Data Requirements ISO Corporate Data Requirements Registry edrr ECCMA Data Requirements Registry Spreadsheets Reports ISO/IEC Corporate Metadata Registry ISO Corporate Dictionary eotd ECCMA Open Technical Dictionary Corporate Classifications Forms New eotd concept or terminology registration Data models Slide 21

22 Managing a dictionary Slide 22

23 ISO 8000 Quality Data Data that meets stated requirements Data that is portable (defined syntax and defined semantic encoding) ISO 8000 quality data is portable data that meets stated requirements ECCMA recommends that companies own and control their own corporate dictionary, data requirements and description rules. Data coded using a licensed dictionary or validated using licensed data requirements or created using licensed description rules is subject to the terms of the license. Copyright by ECCMA Slide 23

24 Material Number Date Updated :DLIS Characteristic data Property name Value Source date Source organization CLASS VALVE,BALL DLIS THREAD CLASS 2A ALL ENDS DLIS BODY MATERIAL STEEL COMP DLIS PIPE SIZE ¼ INCH GRAINGER CONNECTION STYLE G46A PLAIN (TUBE) ALL ENDS DLIS MAX PRESSURE 2500PSI GRAINGER Identification data Property name Value Source date Source organization NATO STOCK NUMBER DLIS: DLIS SUPPLIER REFERENCE GRAINGER:1WBL GRAINGER MANUFACTURER REFERENCE (ALTERNATE) MANUFACTURER REFERENCE (PREFERRED) STANDARD REFERENCE NUMBER SWAGELOK:SS-AFSS GRAINGER PARKER:4Z-MB4LPFA-SSP PARKER ASTM:A 276 Type ASTM

25 Material Number Date Updated :DLIS Classification data Property Value Source date Source NSC : Valves, Nonpowered DLIS UNSPSC : Ball valves GS1 eclass 8.0 (basic) : Ball valve (unspecified) eclass Harmonized Tariff Schedule of the United States :hand operated steel ball valve United States International Trade Commission Material Group 25:Control System Corporate Purchasing Group 15:Pipes and Valves Purchasing Descriptions Property Description Source date Source ITEM NAME VALVE,BALL: SS, ¼, 2500PSI RG1 PURCHASE ORDER VALVE,BALL: SIZE=1/4 INCH, MAX PRESSURE=2500PSI, BODY MATERIAL=STEEL COMP 316; MANUFACTURER REFERENCE (PREFERRED)=PARKER:4Z-MB4LPFA-SSP RG2

26 Corporate Identifier Date Updated :Microsoft Characteristic data Property name Value Source date Source organization LEGAL NAME William Henry Gates III US Department of State BIRTH DATE October 28, US Department of State PLACE OF BIRTH Washington, USA US Department of State Identification data Property name Value Source date Source organization Driver license GATESWH450P Washington State Department of Licensing Passport number US Department of State Employer Issued Identifier Microsoft

27 ISO Data Warehouse used to Manage Content Multilingual Product Descriptions Copyright by ECCMA Slide 27

28 Motivation for ISO and ISO 8000 From a logistics information perspective an F-15 is just 171,000 parts flying in very close formation. Commissions on Organization of the Executive Branch of the Government [Hoover Commissions ] Studied and investigated organization and methods of operation of the Executive branch of the Federal Government, and recommended organization changes to promote economy, efficiency, and improved service Cataloging and Standardization Act, Public Law as codified by United States Code, Title 10, Chapter 145 Cataloging and Standardization Sec (a) The Secretary of Defense shall develop a single catalog system and related program of standardizing supplies for the Department of Defense. (b) In cataloging, the Secretary shall name, describe, classify, and number each item recurrently used, bought, stocked, or distributed by the Department of Defense, so that only one distinctive combination of letters or numerals, or both, identifies the same item throughout the Department of Defense. Only one identification may be used for each item for all supply functions from purchase to final disposal in the field or other area. Slide 28

29 Motivation for ISO and ISO 8000 Controlling costs requires better asset, product, component and process visibility. This is achieved through faster, better and lower cost access to authoritative characteristic data.

30 Why Standards LAWS (Mandatory) STANDARDS (Contractual requirements that can be independently verified) BEST PRACTICE (Voluntary) Copyright by ECCMA

31 ISO 8000 referenced in a NATO contract ASD Specification 2000M (S2000M) is a standard that specifies the information exchange requirements for most materiel management functions commonly performed in supporting international projects. S2000M is based on a business model agreed between military customers and industry suppliers. As of Mar 2011 ASD 2000M Chapter 1B section 3.1 includes the following statement, : The Contractor shall supply identification and characteristic data in accordance with ISO :2009 on any of the selected items covered in his contract. Following an initial codification request as specified in section 3.2, the NATO Codification Bureau (NCB) shall present a list of the required properties in accordance with the US Federal Item Identification Guides. Quality data saves money Copyright 2014 by ECCMA Slide 31

32 Automating the data supply chain using ISO A data provider may not have all the data requested so they in turn send a request through their data supply chain using the same ISO standard exchanges Request for data eotd-q-xml ISO Request for data eotd-q-xml ISO Data provider Sub Data exchange eotd-r-xml ISO Data requester Data requirement eotd-i-xml ISO Data exchange eotd-r-xml ISO

33 Motivation for ISO and ISO 8000 Controlling costs requires better asset, product, component and process visibility. This is achieved through faster, better and lower cost access to authoritative characteristic data. quality data save money Slide 33

34 ISO 8000 Referenced in a Commercial Contract The supplied data shall be ISO :2009 compliant. The data shall comply with registered ISO compliant data requirements The data shall be encoded using concept identifiers from an ISO compliant open technical dictionary that supports free resolution to concept definitions. The data shall be provided in ISO compliant Extensible Markup Language (xml). Creating ISO :2009 compliant data does not require the payment of any license fees or the use of specialized software, it is within the technical ability of all suppliers regardless of their size. quality data save money Copyright 2014 by ECCMA Slide 34

35 Motivation for ISO and ISO 8000 Quality ERP Descriptions Tire Bridgestone 435/95 R Tyre BS 435/R25 Standard Purpose E3 2 Star Radial Bridge Stone 25inch 435/95 Standardised Long Description: Tire: Pneumatic, Vehicular: Service Type for Which Designed: Loader Tire Rim Nominal Diameter: 25' Tire Width: 445mm Aspect Ratio: 0.95 Tire Ply Arrangement: Radial Ply Rating: 2* Tire & Rim Association Number: E3 Tread Material: Standard Tire Air Retention Method: Tubeless Tire Load Index and Speed Symbol: NA Tread Pattern: VHB TKPH Rating: Tyre Bridgestone Part Number Standardised Short Description: * mm 25 Loader: PneumaticTire

36 Automating the data supply chain using ISO A data provider may not have all the data requested so they in turn send a request through their data supply chain using the same ISO standard exchanges Request for data eotd-q-xml ISO Request for data eotd-q-xml ISO Data provider Sub Data exchange eotd-r-xml ISO Data requester Data requirement eotd-i-xml ISO Data exchange eotd-r-xml ISO

37 Tracking the Success of Data Quality are we there yet? SUCCESS If we define success as winning or as the monetary gain that often accompanies success, we will inevitably find ourselves disappointed and disheartened. Success only matters in terms of your progress. How hard you work for what you want and how focused you remain is the only definition of success that matters. All else is just extra weight. Paul Hudson, 2013 "data quality" about 3,080,000 results (Google) chief data officer about 1,390,000 results (Google) quality data" about 1,290,000 results (Google) ISO 8000 data quality about 16,800 results (Google) The data quality challenge is clearly visible and widely acknowledged, this is a major success. We are fundamentally changing how we manage data and we are seeing a rapid development of technologies that are capable of delivering consistent and measurable quality data. Peter Benson, 2014 Copyright 2014 by ECCMA Slide 37

38 Tracking the Success of Data Quality are we there yet? What's coming next? Automated Quality Identifier Resolution (you already use it every time you send an or browse a website). An identifier is an alias for authoritative data; it is issued by an organization and represents a collection of data held by the organization. A quality identifier is an identifier that can be resolved to all or part of the data it represents using standard data exchanges. The standardized resolution of quality identifiers allows the automation of the acquisition of authoritative data as well as data validation; it is simple, highly reliable and very low cost, Copyright 2014 by ECCMA Slide 38

39 Identifiers Dictionary of classes, properties and codes (has concept and terminology identifiers) Provides the meaning of Data Used to create Master data (has internal master data record identifiers) Identifiers used in Updates Transaction data (has transaction identifiers) Contains Characteristic data Used to validate External third party identifiers Used to create Classifications Names and descriptions

40 Questions? Peter R. Benson Executive Director Information is Power Data is Truth