Data Virtualization for Agile Business Intelligence Systems and Virtual MDM To View This Presentation as a Video Click Here
Agenda Data Virtualization New Capabilities New Challenges in Data Integration & Management A New Vision Unified Virtual Data Layer Data Virtualization New Capabilities and Differentiation High Value Uses for Data Virtualization Data Virtualization and Agile DW / BI Systems Data Warehouse Extension Virtual DW and Data Marts Demo Data Virtualization and MDM 4 Steps to Pragmatic MDM Demo Resources to Learn More
Enterprise Data Challenges Getting Bigger Exponential Data Growth Data Silos CRM (MySQL) IT Complexity, Rigidity Inherent Latency Move to Cloud Inventory System (MS SQL Server) Product Catalog (Web Service -SOAP) Billing System (Web Service - Rest) Customer Voice (Internet, Unstruc) Unstruct. & Web High Costs Product Data (CSV) Big Data, Cloud (Hadoop, NOSQL,Web) Log files (.txt/.log files) Big Data, Cloud, Real-Time, Unstructured, Agile Trends Driving Need for a New Data Approach to Complement Existing Ones
What is Agile BI? New paradigm: fast, flexible, low-cost, results-oriented iterative BI development Self-service BI & data services tools Plan Processes Specifications Liaisons, business analysts Traditional BI Reacting to change Interactions Prototypes Face-to-face business participation Agile BI Metadata-generated BI & data services applications Rapid prototyping BI & data services development tools Social technologies for BI and data services developer/user collaboration Integrated BI and data services component management Virtualized, flexible, on-demand data services optimized for heterogeneous sources SOA, REST, and other abstraction layers Complex data models, schemas, and formats 4
Denodo Vision: Unified Virtual Data Layer Enables Agile BI and Agile Business Process Agile High Performance Universal Data Publishing Unified Data Governance Unified Virtual Data Layer Universal Data Access
What is Data Virtualization? Data Virtualization combines disparate data sources into a single virtual data layer that provides unified access and integrated data services to consuming applications in real-time (right-time) DERIVED VIEW Connect & Virtualize Combine & Integrate Publish as a Data Service BASE VIEW BASE VIEW BASE VIEW
Data Virtualization: Delivering New Capabilities Logical abstraction, unified data governance Agile methodologies Data Virtualization On-demand, real-time access to disparate data Data services provisioning (secure, reuse, many formats) Semantic integration of structured, Web, unstructured
Denodo Platform Architecture
Data Virtualization - Use Cases Agile Business Intelligence Real-time Reporting Performance Dashboards Customer 360 View - Call Center, Portals Customer Analytics Agile BPM/ Customer Focus Virtual Data Marts / EDW EDW Prototyping Competitive and Social BI Social Media, Feedback Operational Decision Data Data Services for BPM Web Data Extraction Web, Cloud, SaaS Integration Web Automation (2-way) Cloud /SaaS with no API Data Aggregation Regulatory & External Watch Agile Data Services (IaaS) Virtual Data Layer Virtual MDM Logical Data Abstraction for Migration / Modernization Mashups and Info Feeds Data Services
Agenda Data Virtualization New Capabilities New Challenges in Data Integration & Management A New Vision Unified Virtual Data Layer Data Virtualization New Capabilities and Differentiation High Value Uses for Data Virtualization Data Virtualization and Agile DW / BI Systems Data Warehouse Extension Virtual DW and Data Marts Demo Data Virtualization and MDM 4 Steps to Pragmatic MDM Demo Resources to Learn More
Data Virtualization: Unified Virtual Data Layer Complements Existing Integration Tools
Existing Data Warehousing & BI Systems BI /Analytics tools Needless data replication Many data sources not included Mart Mart ETL ETL Data Warehouse ETL ODS ETL Operational Systems Unstructured, Web, Cloud, etc
Data Warehouse extension through Virtualization Dashboards BI/ Analytics tools Portals Data Virtualization Minimize / replace redundant data marts with virtual views Integrate data from Web, unstructured, NoSQL sources DV Views DV Views DV Views Data Warehouse Data Services ODS Reusable logical and business data services shared by multiple applications Various BI & Reporting tools Dashboards Extended Data Warehouse Portals, Mobile apps ETL ETL Operational systems Unstructured data Web, Cloud etc
Virtual EDW Across Multiple Business Units Dashboards Virtual EDW BI/ Analytics tools Data Services Portals Create a Virtual Enterprise DW Faster time to market, less risk Optimized performance across traditional DW and newer analytic databases, BigData and Web sources DV Views DV Views DV Views Traditional DB and DW systems DW Div A ODS DW Div B ODS ETL ETL ETL ETL Operational systems Operational systems Big Data, NOSQL, Web, Unstructured etc
Agile Business: Operational BI Data Services for Dashboards, Performance Management
Agile BI and Data Warehouse Extension Daily Sales Reporting Financial Reports
Agile Reporting Key Benefits Biogen Idec Example - Overview Executive report Global Drug Sales (units) across all products Business Problem Manual process Data freshness and quality concerns Fragile and complex to change Business Benefits Automated Validated and trusted data Self service enabled for changes Available on-demand IT Challenges Diverse data sources Structured and semi-structured data Data structure complexity Constantly changing sources and data IT Benefits Implementation - 4 weeks Changes 2,4 days Low maintenance and support costs Biogen Idec executives now have access to new partner and public data sources that they could not leverage before : 60% faster with change requests met in just a few days with IT using 40% less analyst time to support.
Agenda Data Virtualization New Capabilities New Challenges in Data Integration & Management A New Vision Unified Virtual Data Layer Data Virtualization New Capabilities and Differentiation High Value Uses for Data Virtualization Data Virtualization and Agile DW / BI Systems Data Warehouse Extension Virtual DW and Data Marts Demo Data Virtualization and MDM 4 Steps to Pragmatic MDM Demo Resources to Learn More
Data Virtualization - Use for Pragmatic MDM Prototype your MDM using Virtual MDM DV is a perfect complement to Registry MDM Extend Federated MDM Enrich MDM with Unstructured, External and Web Data
1. Denodo Virtual MDM
2. Denodo Registry MDM
3. Denodo Federated MDM
4. Denodo Enriched MDM
MDM Data Normalization and Validation Data Normalization Combined_address is a field created in real time as a combination of Street, City, Zip, State and used as input for Google Geocoder Task Orchestration The Denodo Scheduler allows to automate tasks including dependencies, triggers and filters Data Cleansing Use of rules like the CASE operator with the formatted address allows to: Create a field that validates if the address is correct Add the correct value for zip in case is null Address Table Google Geocoder Validator returns the Formatted Address Valid records Invalid records Valid data is inserted into the Address table Email Invalid Records Report
MDM Creating a Golden Record Golden Record Utilization Custom Data from CRM and ERP is now obtained by using the Golden Record Golden Records Management Denodo keeps the records current Multiple Cleansing Functions Such as keep the longest name or lastname CRM ERP Built in Functions and Semantics Textual similarity matching operator between different sources CRM ERP
Single View of Investigator Pharma Use Case Investigator with Clinical Trial Experience and Equipment Used Investigator_ID Name Age Group Specialization Current Trial Status Validation Show All Equipment Used Intelligent Source Constraints Query Delegation Diverse Modeling Functions Real Time Data Normalization / Cleansing Trials NESTED JOIN Advanced Query Optimization Nested and Parallel execution Built in Functions and Semantics Textual similarity matching operator ClinicalTrials.gov EXTERNAL TRIALS Cloud/Web accessible as structured sources of info Address Specialty Investigator INVESTIGATOR PROFILE DATA INVESTIGATOR EXPERIENCE DATA XML Package_type LAB EQUIPMENT INFO Extended Relational Model Hierarchical views joinable with flat or relational views
Customer Smart Services Unified View: Combine Master + Transactions; Internal + External; Persisted + Real-time CNC ACCESS INTEGRATION REAL-TIME Transactions C3BL EDW Enterprise Federation Local Federation Match & Consolidate Data Deterministic matches Data Access Services Data Access APIs Others PERSISTENT STORAGE Enterprise Data Customer Master Item Master Batch Access Match & Consolidate Data Nondeterministic matches Based on name & other parameters Data Access Services Persistent Store Enrich & writeback Analytic Applications Reports and Dashboards Data Sources Data Services Data Consumers
Data Virtualization: Best Practice Insights Learn to leverage all data that has value Initial adoption for read-only use case read-write uses growing fast Primary drivers are unified access, business agility and quicker ROI Hybrid models prevail best-of-breed data virtualization integrates well Virtualization enables cloud integration with on-premise data Abstraction layer useful for application modernization and migration Performance and data governance set best-of-breed DV platforms apart Evolve from project use to agile enterprise data services capability. Increasing need for integrating semi and unstructured data
Agenda Data Virtualization New Capabilities New Challenges in Data Integration & Management A New Vision Unified Virtual Data Layer Data Virtualization New Capabilities and Differentiation High Value Uses for Data Virtualization Data Virtualization and Agile DW / BI Systems Data Warehouse Extension Virtual DW and Data Marts Demo Data Virtualization and MDM 4 Steps to Pragmatic MDM View Demo <insert video url> Resources to Learn More
World Series on Data Virtualization 12 expert talks with comprehensive coverage Select episodes: Data Virtualization, the time is now! - Dr. Barry Devlin, Analyst & Principal, 9Sight Consulting Agile Telecom Information Strategies - Manuel Doval Seijas, CIO, R Turning Data Into Information (Financial Services) - Oppenheimer Funds Data Virtualization for Agile Business Intelligence Systems - Rick van der Lans, Analyst, R20/Consultancy Value-Added Customer Technical Services Cisco Systems MDM 3.0 - Virtual MDM and Distributed Data Governance Global Pharma Company Data Virtualization for Unified data Services - Randy Heffner, VP & Principal Analyst, Forrester Research Click here to register
World Series on Data Virtualization World Premiere of White Papers: High Value Uses of Data Virtualization - Part 1 & Part 2 Analytical Uses Operational Uses Data Management Uses http://go.denodo.com/datavirtualization_use_cases
Q&A Suresh Chandrasekaran Denodo Technologies suresh@denodo.com