Embarcadero DataU Conference. Data Governance. Francis McWilliams. Solutions Architect. Master Your Data

Transcription

1 Data Governance Francis McWilliams Solutions Architect Master Your Data

2 A Level Set Data Governance Some definitions... Business and IT leaders making strategic decisions regarding an enterprise s data assets and the information environment to ensure it meets the needs of the enterprise. Data Stewardship Exercise of responsibility, accountability, and authority by a data steward for a data subject area across the enterprise, overseeing it s definition, quality, security, and effective use.

3 Principles for Data Governance Accountable Data Stewards define and apply context specific definitions and rules to assure data quality, relevance, privacy, and security.

4 What do we need to get there? Business Lexicon Common Enterprise Vocabulary Enterprise Conceptual Data Model Definition of and relationships among entities (e.g., person, encounter, case) of importance to the business Enterprise Logical Data Model Definitions and relationships among data entities Designation of Authoritative Data Sources Business Rules for Standard Data Calculations, Derivations, and Transformation Rules Data Standards Enterprise Data Standards (e.g., valid port of entry codes, CUSTOMER, ACCOUNT, CASE, date, address, etc.) Information Privacy and Security Requirements, Rules, and Controls Data Exchange Requirements, Rules, Agreements, Descriptions Data Integrity Thresholds Identification, Prioritization, and Resolution of Data Issues

5 Data Governance A Scenario An Insurance company thought it had major problems with their business processes (e.g., seemingly redundant work efforts, long time to close accounting books) They started a Business Process Optimization effort And found out that the problem was with their data and their information environment!!

6 Data Governance A Scenario The current state was crazy used 10,000 spreadsheets They formed an organization to govern their data and information environment Didn t know they were doing Data Governance

7 Data Governance A Scenario The governance organization had STRONG support from the very top! CEO CFO Chief Actuary Exec s have to feel the pain need to identify WIFT What s in it for them Paid for business and IT representatives from across the country to meet every other month! Without executive sponsorship data governance is very difficult to do well

8 Data Governance A Scenario Pain Points - WIFT

9 Executive & Business Participation is Key Business unit involvement is CRUCIAL IT should be aparticipant but not the driving force (psst data is a business asset ) Without executive sponsorship and business involvement.. High likelihood of being seen as a roadblock to be avoided and navigated around (app developers ) Information silos continue to proliferate.. Decisions have no teeth Nothing really improves

10 Data Governance Outcomes Embarcadero DataU Conference A climate of trust, collaboration, and transparent communications exists among data stakeholders. Enterprise data is effectively and efficiently governed to ensure accuracy, security, privacy, and accessibility All legitimate data stakeholders are acknowledged and have ready access to enterprise data. Clear and concise expectations, roles and responsibilities, and accountability for information and data are in place and consistently practiced. Policies for managing and sharing data and regulating information flow and congruity are clearly defined, well communicated, and consistently applied. Data risks and issues are identified and resolved quickly. Data decision making is consistent, efficient, and incorporated into all project planning and implementation processes.

11 Introducing ER/Studio Team Server ER/Studio Team Server is a metadata governance and database tools platform that makes your tools smarter and your users experts, by giving your data on-the-fly business context and collaboration.

12 Building for Data Governance Evolving Database Ecosystems IT Challenges Volume, Velocity, Variety Agile Development Cycles Meta Data Data Quality Data Architectur e Enabling Governance Embarcadero DataU Conference Data Developme nt Data Operations Compliance Organizational Transparency Maximizing IT Infrastructure Document & Content Data Warehousin g & Business Intelligence Reference & Master Data Data Security Source: DAMA Design Develop Deliver ER/Studio Innovative data, process and UML modeling tools RAD Studio The developer force multiplier for Windows 8, Mac, Web and mobile. DB PowerStudio Simplified DB development, admin, and tuning across all major DBMS platforms Meta Data Data Architecture Data Development Data Operations

13 Surge in Granularity & Diversity Embarcadero DataU Conference

14 Alignment Add Insight to Information Management Workflows Embarcadero DataU Conference

15 Data Governance Strategy Opens New Opportunity Aligns with senior executive priorities & budgets Creates cross-sell and up-sell opportunities Creates Competitive Advantage Differentiates individual products vs. competition Cannot be credibly replicated by competitors Makes the whole more than the sum of the parts Compelling & Timely Builds on Embarcadero strengths and brand Reasons to act now

16 How does ER/Studio Team Server do this? Metadata governance for on-the-fly business context and collaboration Smart Tools for Better Work Speed comprehension and reduce risk of data policy violations Users Into Experts Locate and completely utilize existing enterprise data Collaborate Over Data Define and publish more valuable business and data definitions

17 ER/Studio Team Server Makes Your Tools Smarter Stay compliant with sensitive data alerts Be informed using business definitions

18 ER/Studio Team Server Makes Users into Experts Find information assets using business terms Increase productivity with data relationships

19 ER/Studio Team Server Enables Collaboration Over Data Embarcadero DataU Conference Capture Tribal Knowledge Classify and Relate Customize to Comprehend

20 Metadata Governance & Syndication Business Architecture Collaboration Definition Structure Deployment Syndication Analyst Executive IT Developer Authors Integration Readers

21 WHO IS ER/STUDIO TEAM SERVER FOR? 21

22 For Data Consumers, Technologists and Executives Technical Users Benefit from data speed and accuracy Business Users Benefit from improved data quality and regulatory compliance Ops S A B I D AuditorB A B A D A Finance D ev D G MD M Analyst Admin Technical Architects Drive the programs that ER/Studio Team Server enhances

23 Data Consumers Embarcadero DataU Conference Auditors Data Analysts Business Analysts Data Governance roles Insufficient time to spend accurately interpreting ever-increasing volumes of enterprise data Compromised business decisions based on incomplete or misunderstood data Benefits: Context for data comprehension in daily workflows Faster analysis Consistency of Reporting

24 Technical Users Data Architects Data Modelers DBAs Data & Application Developers Develop or re-engineer existing data strategies to support demands to accurately understand data Not complying with ever more complex regulations Benefits: Faster application development with business terms Smarter database tools with information maps Adhere to industry regulations and business standards

25 Business Executives VPs responsible for major data driven company initiatives Strategic decisions made on incomplete or misunderstood data Significant professional and personal risk exposure from costly compliance challenges Benefits: Manage risk from data quality and data mismanagement Support corporate compliance initiatives

26 WHY ER/STUDIO TEAM SERVER? 26

27 Experts and Users with Collaboration Capture and use tribal knowledge and siloed expertise to enable better characterization and comprehension of information assets Only platform bringing collaboration capabilities to correct data quality and comprehension issues

28 Data Users to Data Insights Integrate data comprehension into daily workflows to deliver context and meaning Only tool to extend comprehension of data elements and business terms to the widest range of destinations

29 Business Definitions to Information Assets Develop insight faster by using business terms to easily locate information assets Only tool that allows users to quickly map business terms to information assets using existing metadata

30 Communicate Technical Design Embarcadero DataU Conference

31 Communicate with Executives Embarcadero DataU Conference

32 Discovery of Undocumented Data Gain understanding of data sources through reverse engineering and visualization access understanding benefit Reverse Engineering & Infer domains sales and customer databases Finance & Accounting Data Architect Marketing E-commerce

33 ER/Studio Team Server - Think outside the box What makes your data model complete? Well-formed Definitions! Business names in the logical Reference values Domains assigned to each attribute/column Verb phrases (at least in the logical)

34 ER/Studio Team Server - Think outside the box What new types of metadata will help your audiences? Data security PCI Compliance metadata Stewardship Governance Workflow Source/target mappings etc

35 Common Challenges with Reporting Modeling Teams Business Analysts Executives ER/Repo App and DB Developers Data Stewards DBAs Manual and laborious Difficult to keep up to date with the latest changes Out-dated reports lose trust among end users

36 Automated Reports Self-service and self-maintaining reports will make your life a lot easier Modeling Teams Repository App and DB Developers Data Stewards DBAs Web Portal Business Analysts Executives

37 Find, Know and Protect BENEFIT: Create an authoritative guide relating technical architecture to business value Match and Deploy Quickly Auto-Match Business Terms to critical data elements Map your landscape Create an integrated enterprise information map by relating models and data sources Centralize sources Single searchable registry of all available data sources

38 Find, Know and Protect BENEFIT: Collaborate to establish definitions, taxonomy and usage policies Collaborate across functions Capture and share tribal knowledge previously siloed in business & technical teams Classify and Relate Classify and structure business terms and data elements based on subject area Customize to Comprehend Enhance comprehension of business terms and data elements with custom attributes

39 Find, Know and Protect BENEFIT: Delivery of metadata into data workflows and data analysis tasks Gain context instantly Easily comprehend business terms listed in any webpage Be Alerted Get alerted when viewing or changing data elements containing sensitive data Share Universally Leverage the central repository by integrating other applications

40 ER/Studio Enterprise (Data Modeling) BENEFIT: Quickly access and model a range of data sources from Big Data to Mobile Data Centralized Data source Registry* Provides the ability for Data Architect users to work from a common, centralized data source repository Big Data Support Reverse Engineer and Compare No SQL databases such as Hadoop Hive Mobile Data Support Support for Interbase XE and XE3 including mobile platforms Support for Triggers and Generators * Requires ER/Studio Team Server

41 ER/Studio Enterprise (Data Modeling) BENEFIT: Faster and more accurate models from more sources Oracle Updates Oracle NOT NULL Constraints More accurate data models and data dictionary by identifying columns that mandate a value SQL Server Updates Support for SQL Server Sequences Better support for complex data models with faster compare and forward & reverse engineering capabilities Expanded ETL Support Expanded support for ETL sources and targets with support for Talend Data Integrator

42 DB PowerStudio (DB Management) Inline Metadata* (DBArtisan/Rapid SQL) Gives users real-time metadata visibility in the SQL IDE. Examples of metadata attributes are: compliance, data governance policy information. Benefits Improve SQL productivity Instantly gain valuable context to SQL query development Sensitive data awareness Become aware of sensitive data stemming from PII, regulatory, data governance policies and their policy owners * Requires DBArtisan Team Server

43 Why did we create Team Server? Situation Increasing volume, velocity of change and variety of systems and technologies creates complexity in enterprise data landscapes Challenge Complexity creates obscurity, the inability to find your data Obscurity hampers agility, decision-making & compliance Solution The key to ending information obscurity is metadata Metadata is foundational to effective information management and governance To make enterprise data more valuable.

44 Team Server Makes Enterprise Data More Valuable Find Know Protect

45 Q&A Thank You for Attending!! Francis McWilliams 45