Metadata Strategies: your guide through the data jungle Achim Granzen EMEA Technology Strategist

Transcription

1 Copyright 2003, SAS Institute Inc. All rights reserved. Metadata Strategies: your guide through the data jungle Achim Granzen EMEA Technology Strategist

2 This presentation! What is Metadata! The value of Metadata! Metadata concepts! The SAS Metadata framework Architecture Benefits Copyright 2003, SAS Institute Inc. All rights reserved. 2

3 Some statements sound familiar? Copyright 2003, SAS Institute Inc. All rights reserved. 3

4 Meta data is! Data about data! All physical data and knowledge-containing information about the business and technical processes, and data, used by a corporation! All physical data (contained in software and other media) and knowledge (contained in employees and various media) from inside and outside an organisation, including information about the physical data, technical and business processes, rules and constraints of the data, and structures of the data used by a corporation ("Building and managing the Meta Data Repository", David Marco) Copyright 2003, SAS Institute Inc. All rights reserved. 4

5 Meta data is Copyright 2003, SAS Institute Inc. All rights reserved. 5

6 A brief history Recognised meta data need Data dictionaries CASE tool based meta data repositories Data Warehouse meta data repositories Metadata driven enterprise system Meta data & Repository Evolution Copyright 2003, SAS Institute Inc. All rights reserved. 6

7 Types of metadata! Business and technical metadata Technical meta data supports technical users and IT staff Business meta data supports business users Needs to "Speak their language"!! Structured and unstructured meta data Structured meta data is commonly stored in tools or documents Unstructured meta data is mainly unwritten: people "just know" Both are equally important! Copyright 2003, SAS Institute Inc. All rights reserved. 7

8 Why meta data is needed! Current systems are inflexible and nonintegrated! Existing data warehouses and data marts need to grow! Business users' needs are not being fulfilled! Companies need to reduce the impact of employee turnover! Business needs to increase user confidence in data Copyright 2003, SAS Institute Inc. All rights reserved. 8

9 Usernames The Business Analyst jdoe JDOE joe4_aix JOE_WNT JOE_DOE Jdoe_pass annadarling 56CZu28B JAPW42 Passwords "additional info" KDNDB_TS STRGALTENTF03 "all Sales in local currency" SPRDCZ means: Product Sales Czech Republic 0203DE_FRCST file names wntdept47 unxprod_emea hrz34905 Server names Copyright 2003, SAS Institute Inc. All rights reserved. 9

10 The Business Analyst Usernames KDNDB_TS 0203DE_FRCST jdoe joe4_aix JOE_DOE STRGALTENTF03 JDOE JOE_WNT annadarling JAPW42 Jdoe_pass 56CZu28B Passwords HELP! "additional info" SPRDCZ means: Product Sales Czech Republic "all Sales in local currency" file names wntdept47 unxprod_emea hrz34905 Server names Copyright 2003, SAS Institute Inc. All rights reserved. 10

11 IT department, 5 minutes later MARKETING calling Copyright 2003, SAS Institute Inc. All rights reserved. 11

12 Questions how are the Sales figures in Austria in first Quarter 2003 how can I get a year-to-date comparison for each of our product ranges what's the sales forecast for our german branch Copyright 2003, SAS Institute Inc. All rights reserved. 12

13 and Answers? Remember! Sales Sales figures figures for for Germany, can can be be found found in in SLSxxyyDE (where (where xx xx denotes the the To month month and and yy yythe year) year) on To access access forecasts, forecasts, please please on the the wnt_de_123 server. enter server. enter the the region, region, product product class class and and timeframe timeframe in in the the Query Query Window Window of of Cosinus CosinusObjects, and and then then copy copy the the values values over over to to Sales Sales figures figures for for Austria Austria are are in in db2_dept3_03 on on UNXPRODAT (you (you need need your your UNIX UNIX password). Steve from IT extension 101 Copyright 2003, SAS Institute Inc. All rights reserved. 13

14 IT department, 2 minutes later SALES calling Copyright 2003, SAS Institute Inc. All rights reserved. 14

15 Metadata is! Technical metadata where is the data stored when was it created who updated it who is authorised to access it! Business metadata Provides a semantic link between the information technology systems and business users translation into terms a business user understands using the terminology they know with applied business rules Copyright 2003, SAS Institute Inc. All rights reserved. 15

16 What makes a good architecture " A sound meta data architecture incorporates five general characteristics: 1. Integrated 2. Scalable 3. Robust 4. Customizable 5. Open " ("Building and managing the Meta Data Repository", David Marco) Copyright 2003, SAS Institute Inc. All rights reserved. 16

17 linking up front end and back end systems Copyright 2003, SAS Institute Inc. All rights reserved. 17

18 The SAS Vision Copyright 2003, SAS Institute Inc. All rights reserved. 18

19 The SAS Vision Let's check last year's sales figures for Czech Republic Aggregate Product Sales for Czech Republic 2002 = SPRDCZ02_AGG SPRDCZ02_AGG Copyright 2003, SAS Institute Inc. All rights reserved. 19

20 The SAS Vision Aggregate Product Sales for Aggregate Czech Republic Product 2002 Sales for Aggregate Czech = Republic Product 2002 Sales SPRDCZ02_AGG for Aggregate Czech = Republic Product 2002 Sales SPRDCZ02_AGG for Austria = 2002 SPRDCZ02_AGG = Busperfaut02_prod SPRDCZ02_AGG Let's do an pan-emea sales report for 2002 Busperfaut02_prod Copyright 2003, SAS Institute Inc. All rights reserved. 20

21 A single version of the truth? System A System B Copyright 2003, SAS Institute Inc. All rights reserved. 21

22 Metadata Architecture I non-integrated Tools, metadata islands ETL ETL Analytics Data Data Models Data Data Quality Storage BI BI Metadata repository Interface Data flow Copyright 2003, SAS Institute Inc. All rights reserved. 22

23 A real-life example ("Building and managing the Meta Data Repository", David Marco) Copyright 2003, SAS Institute Inc. All rights reserved. 23

24 Metadata Architecture II non-integrated Tools, common metadata ETL ETL Analytics Data Data Models Data Data Quality Storage BI BI Metadata repository Interface Data flow Copyright 2003, SAS Institute Inc. All rights reserved. 24

25 Metadata Architecture III integrated tools, common metadata Models ETL Storage BI Analytics Metadata repository Interface Data flow Copyright 2003, SAS Institute Inc. All rights reserved. 25

26 Metadata Architecture III integrated tools, common metadata Models ETL Storage BI Analytics Common Metadata Single point of control Copyright 2003, SAS Institute Inc. All rights reserved. 26

27 SAS Open Metadata Framework! Central Metadata server! Single point of administration! technical metadata and business metadata! Common meta data interface! Adherence to meta data standards SAS Open Metadata Architecture Copyright 2003, SAS Institute Inc. All rights reserved. 27

28 Open - Interoperability! Object Management Group's Common Warehouse Metamodel/ XML Metadata Interchange (CWM/XMI)! Meta Integration Model Bridge (MIMB)! APIs for JAVA, VisualBasic, Visual C++! Based on XML Copyright 2003, SAS Institute Inc. All rights reserved. 28

29 Import via MIMB! Live Metadata Database Schemas via JDBC/ODBC W3C XML DTDs and Schemas! Data Modeling tools CA ALLFusion ERwin Data Modeler CA Advantage Gen (COOL:Gen) CA COOL:BusinessTeam (GroundWorks) CA COOL:DBA (Terrain) CA COOL:Enterprise (ADW) Oracle Designer Popkin System Architect IBM Rational Rose Data Modeler Select SE Silverrun RDM Sybase PowerDesigner Visible IE:Advantage And many more: EAI, ETL, DW, BI/OLAP & Repositories IBM DB2 Warehouse Manager Informatica PowerMart IBM DB2 Cube Views SAS ETL Studio Oracle Warehouse Builder Business Objects Data Integrator Microsoft MDS Repository (OIM) Business Objects Designer NCR Teradata MDS Repository Cognos Adaptive Repository Hyperion Analytic Development! Object Modeling tools IBM Rational Rose & XDE Sybase PowerDesigner OOM IBM WebSphere Studio TogetherSoft Telelogic Tau ArgoUML CA ALLFusion Component Modeler (ParadigmPlus) Copyright 2003, SAS Institute Inc. All rights reserved. 29

30 Summary - The Challenge!Ineffective Data Access - Decision makers want simple answers for simple questions, but the path to get answers may be difficult. Underlying data structures are too complex Technical skills required to access the data Need to rely on others with resources/skills to get reports Users forced to make decisions without information due to delays in getting the data or lack of access to the data. Copyright 2003, SAS Institute Inc. All rights reserved. 30

31 The Solution integrated Metadata framework! provide business view to physical data for enterprise-wide users HR Data HR Information Map Copyright 2003, SAS Institute Inc. All rights reserved. 31

32 SAS Metadata Framework! delivers the power to integrate share leverage Metadata across the entire intelligence creation process! results in fewer errors less complexity reduced maintenance increased interoperability = a single version of Enterprise truth Copyright 2003, SAS Institute Inc. All rights reserved. 32

33 External Validation! "SAS 9.1 metadata-management facilities and the suite's unmatched analytic capabilities differentiate SAS's products from the competition and position SAS to advance in vertical applications and emerging market spaces including business performance management." (Seth Grimes, Intelligent Enterprise magazine, 17 th June) Copyright 2003, SAS Institute Inc. All rights reserved. 33

34 Do you Understand how to Select Intelligence Software? The Intelligence Value Chain + SAS Solutions Strategy: An integrated suite of applications with common metadata and a single point of administration Copyright 2003, SAS Institute Inc. All rights reserved. 34

35 Copyright 2003, SAS Institute Inc. All rights reserved. 35