<Insert Picture Here> Real-Time Data Integration for BI and Data Warehousing

Transcription

1 <Insert Picture Here> Real-Time Data Integration for BI and Data Warehousing

2 Agenda Why Real-Time Data for BI? Architectures for Real-Time BI Oracle GoldenGate for Real-Time Data Integration Customer Examples Summary <Insert Picture Here> 2

3 Evolution of Business Intelligence A Paradigm Shift Strategic BI Operational BI Business focus Long-term organizational goals Manage and optimize daily business operations Primary users Executives, analysts LOB managers, front-line employees, operational systems Timeframe Months to years Intra-day Use model Rely on query/response Event-driven, Event processing Data Historical metrics Real-time, low-latency & historical data Source: Intelligence Solutions Inc. 3

4 Why Real-Time Data for BI? 4

5 Real-Time, Operational BI in Action Fraud detection Online promotion optimization Contact optimization Customer churn Location-based offers Supply chain improvements Source: Intelligence Solutions Inc. Webinar: Operational BI Its Everywhere. 5 5

6 Real Time vs. Right Time 6

7 Agenda Why Real-Time Data for BI? Architectures for Real-Time BI Oracle GoldenGate for Real-Time Data Integration Case Studies Summary <Insert Picture Here> 7

8 Architectures for Real-Time BI Single source, operational reporting Restricted to a single application Easily combines BI into transaction processing OLTP Reporting instance Multiple source integration for reporting BI apps run on ODS using operational data Multiple source with operational and historical data BI apps run on both ODS and the DW to combine historical analyses with transactional data OLTP ODS ODS OLTP EDW 8 8

9 Common Methods for Data Loading to ODS/DW And Their Shortcomings 9 9

10 Agenda Why Real-Time Data for BI? Architectures for Real-Time BI Oracle GoldenGate for Real-Time Data Integration Customer Examples Summary <Insert Picture Here> 10

11 What is Oracle GoldenGate? Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in real time Key Differentiators: Performance Non-intrusive, low-impact, sub-second latency Flexible and Extensible Open, modular architecture - Supports heterogeneous sources and targets Reliable Maintains transactional integrity - Resilient against interruptions and failures 11

12 Oracle GoldenGate Use Cases Enterprise-wide Solution for Real Time Data Needs Zero Downtime Migration and Upgrades New DB/ OS/HW/App Log Based, Real- Time Change Data Capture Oracle GoldenGate Active-Active High Availability Query Offloading ETL Fully Active Distributed Database Reporting Database Reduce Costs Lower Risks Achieve Operational Excellence Heterogeneous Source Systems ODS ETL Real-time BI EDW EDW Data Distribution Global Data Centers SOA/EDA 12

13 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Capture LAN/WAN Internet Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 13

14 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Capture Trail LAN/WAN Internet Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 14

15 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Capture Trail Pump LAN/WAN Internet Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 15

16 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Capture Trail Pump LAN/WAN Internet TCP/IP Trail Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 16

17 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required. Capture Trail Trail Pump Delivery LAN/WAN Internet TCP/IP Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 17

18 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required. Capture Trail Trail Pump Delivery LAN/WAN Internet TCP/IP Source Oracle & Non-Oracle Database(s) Bi-directional Target Oracle & Non-Oracle Database(s) 18

19 Oracle GoldenGate 11g Supported Databases and OS Databases Oracle GoldenGate Capture: Oracle DB2 Microsoft SQL Server Sybase ASE Teradata Enscribe SQL/MP SQL/MX JMS message queues Oracle GoldenGate Delivery: All listed above, plus: MySQL, TimesTen, Netezza, Greenplum, HP Neoview and any ODBC compatible databases ETL products O/S and Platforms Windows 2000, 2003, XP Linux Sun Solaris HP NonStop HP-UX HP TRU64 HP OpenVMS IBM AIX IBM z/os z/linux 19 19

20 Oracle GoldenGate Topologies Unidirectional Query Offloading Zero-Downtime Migration Bi-Directional Hot Standby or Active-Active for HA Peer-to-Peer Load Balancing, Multi-Master Broadcast Data Distribution Integration/Consolidation Data Warehouse Data Distribution via Messaging BPM 20

21 Real-Time Data Integration for BI with ODS Low-impact, change data capture, transformation, and delivery Oracle GoldenGate Real-time streaming of transactions BI Application trans5 trans4 trans3 trans2 trans 1 Production OLTP Databases LAN / WAN / Internet Capture Source Trail Target Trail Delivery ODS Sub-second latency No impact on source systems Read-consistent changed data with referential integrity Transformations at capture, delivery or within the database Certified for Oracle Applications to offload operational reporting 21

22 Real-Time Data Integration for BI with DW Fastest Real-Time Data Integration, Fastest Bulk Data Transformation Oracle GoldenGate Real-time streaming of transactions tx6 tx5 tx4 tx3 tx2 tx1 BI Application OBI EE ODI EE & DQ Production OLTP Databases LAN / WAN / Internet Capture Source Trail Target Trail Delivery DW Low-latency data for end users No source impact and reduced batch windows on target Thin middle-tier for high-performance, in-database transformations Complete data recoverability with persisted queuing 22

23 ODI EE & GoldenGate: Complete & Integrated Non-invasive Capture + E-LT Processing Application Real Time BI (using OLTP Schema) Analytic BI (Facts & Dims) Consistency Window E-LT (Mini-Batch + Transforms) Low-impact change data capture 23

24 Oracle Real-Time BI/DW Complete, Flexible, Integrated OBI EE Suite Plus Real-time Analytics Historic Analytics Batch Feed Log-based, Real-time Data Feeds Oracle Data Integrator DIM DIM EMP DEPT trans3 trans2 trans1 FACT Source OLTP System Oracle GoldenGate 24 EMP DEPT ODS Schema DIM DW Schema DIM Oracle Exadata 24

25 Agenda Why Real-Time Data for BI? Architectures for Real-Time BI Oracle GoldenGate for Real-Time Data Integration Customer Examples Summary <Insert Picture Here> 25

26 Reduced Churn and Optimized Field Operations DIRECTV Business Challenges Focus on differentiating with customer service and reducing churn in a competitive market Centralize customer information to achieve single view to support sales, marketing, support & field service Executive direction to limit data latency to 15 minutes Solution Real-time data integration from Siebel CRM on Oracle Database to central Enterprise Warehouse 1,500 service agents log 600,000 customer calls per day Oracle GoldenGate moves million records per day with 1.5 second latency. Return on Investment Reduced customer churn by 25% Increased responsiveness of field technicians by optimizing call routes More targeted/personalized offers by call center agents Ranked top in its industry in the American Customer Satisfaction Index 26

27 Improved Customer Service and Reduced Costs Overstock.com Business Challenges Better understand customer purchasing behavior Provide timely information to support marketing, merchandising & operational decisions Improve shopping database reliability & uptime Solution Enabled active data warehouse roll-out in 90 days with real-time data feeds from shopping and auction systems Complements Oracle GoldenGate with Oracle Data Integrator for data transforms within the EDW Zero-downtime system migration and upgrade for shopping systems Return on Investment Customer analysis now done in minutes, rather than days Reduced marketing spend with smart campaign decisions Reduced inventory costs Eliminated batch windows Ranked #2 in customer service by National Retail Federation 27

28 Enhance Customer Experience with Unified View MGM Business Challenges Launched a Players Club for frequent, loyal customers, which requires complete view of members Built an Enterprise Data Warehouse, to track demographic and hotel folio data as well as casino activity, for marketing and financial analysis Solution Feed real-time data from Cage & Marker management, Property Management and the Players Club loyalty applications to EDW Disaster Protection for Cage & Marker Management application Zero downtime database and hardware upgrades for Players Club application Return on Investment Achieved complete view of customers and gain better insight on customers experience Provides timely data to marketing teams for high quality service and targeted offers for loyal customers Maintains system uptime during planned and unplanned outages 28

29 Agenda Why Real-Time Data for BI? Architectures for Real-Time BI Oracle GoldenGate for Real-Time Data Integration Customer Examples Summary <Insert Picture Here> 29

30 Technical Benefits of Real-Time BI/DW with Oracle 30

31 Business Benefits of Real-time BI/DW with Oracle 31

32 Quote Attribution Title, Company Get Started Visit the Oracle Fusion Middleware 11g web site at oracle.com/goto/fmw11g/index.html Oracle Data Integration on oracle.com oracle.com/goto/odi Oracle GoldenGate on oracle.com oracle.com/goto/goldengate Oracle BI/EPM on oracle.com oracle.com/solutions/business_intelligenc e/index.html Resources Oracle GoldenGate Resource Kit: oracle.com/goto/goldengate Blog: Technical information available at: oracle.com/technology/products/oracledata-integrator/goldengate/index.html Data Integration Events 32

33 33