Oracle GoldenGate 11g Overview Mike Denman October 17, 2012

Transcription

1 Oracle GoldenGate 11g Overview Mike Denman October 17, Copyright 2011, Oracle and/or its affiliates. All rights

2 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 2 Copyright 2011, Oracle and/or its affiliates. All rights

3 Program Agenda Introduction to Oracle GoldenGate Technology Overview Continuous Availability Next Generation Data Warehousing Summary Q&A 3 Copyright 2011, Oracle and/or its affiliates. All rights

4 GoldenGate is Oracle s Strategic Replication Solution Best-in-class leader in real-time data integration solutions Complements existing Oracle products Continuous Availability for heterogeneous systems Real-time data access for Reporting & BI/EPM Zero-downtime migrations / upgrades to Oracle Database, Hardware, and Applications Over 1200 customers including Fortune 500 companies, representing Financial Services, Communications, Healthcare, Public Sector, Retail, Utilities industries 4 of top 5 largest commercial banks 3 of top 3 busiest ATM networks 5 of top 5 financial data services companies 5 of top 5 telecommunications providers 3 of top 5 largest food & drug stores 4 Copyright 2011, Oracle and/or its affiliates. All rights

5 Oracle GoldenGate Differentiators Performance Flexible & Extendable Reliable Sub-second latency for data movement Low-impact capture, routing, transformation, and delivery of transactional data Open, modular architecture Supports heterogeneous sources and targets Agile and adaptable to modern data integration architectures Maintains transactional integrity Resilient against interruptions and failures Fast Recovery after process interruptions. 5 Copyright 2011, Oracle and/or its affiliates. All rights

6 Oracle GoldenGate 11g Low-Impact Real-Time Data Integration & Transactional Replication New DB/HW/OS/APP Zero Downtime Upgrade & Migration Legacy Fully Active Distributed DB Highly Available / Disaster Recovery Log-based, changed data Reporting Database Query Offloading, Disaster Recovery Real-time BI, Operational Reporting, MDM Database ODS Data Integrator Data Warehouse Data Synchronization across the Enterprise Message Bus Global Data Centers Message Bus Event Driven Architecture, SOA 6 Copyright 2011, Oracle and/or its affiliates. All rights

7 Program Agenda Introduction to Oracle GoldenGate Technology Overview Continuous Availability Next Generation Data Warehousing Summary Q&A 7 Copyright 2011, Oracle and/or its affiliates. All rights

8 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 8 Copyright 2011, Oracle and/or its affiliates. All rights

9 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 9 Copyright 2011, Oracle and/or its affiliates. All rights

10 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 10 Copyright 2011, Oracle and/or its affiliates. All rights

11 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 11 Copyright 2011, Oracle and/or its affiliates. All rights

12 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required. Source Oracle & Non-Oracle Database(s) Target Oracle & Non-Oracle Database(s) 12 Copyright 2011, Oracle and/or its affiliates. All rights

13 How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required. Source Oracle & Non-Oracle Database(s) Bi-directional Target Oracle & Non-Oracle Database(s) 13 Copyright 2011, Oracle and/or its affiliates. All rights

14 Oracle GoldenGate Differentiator: Flexibility Unidirectional Query Offloading Zero-Downtime Migration Bi-Directional Hot Standby or Active-Active for HA Peer-to-Peer Load Balancing Multi-Master Broadcast Data Distribution Integration/Consolidation Data Warehouse Data Distribution via Messaging BPM BAM CEP 14 Copyright 2011, Oracle and/or its affiliates. All rights

15 Differentiator: Performance and Scalability GoldenGate Capture Log-based change data capture High volume Low overhead Decoupled architecture Multiple capture processes may be used to scale, but generally not required Possible to split hot tables into a separate capture process Filtering and compression Unnecessary change data is discarded immediately Updates and deletes are compressed by default Before images are discarded by default 15 Copyright 2011, Oracle and/or its affiliates. All rights

16 Differentiator: Performance and Scalability GoldenGate Delivery Decoupled architecture Multiple delivery processes may be used to scale Possible to split hot tables into a separate delivery process Possible for multiple delivery processes to split the work for a single table Transaction grouping Small transactions are grouped by default to reduce commit overhead Record batching Records are batched by table and operation within a single SQL execution Automatic reordering of batches 16 Copyright 2011, Oracle and/or its affiliates. All rights

17 Differentiator: Transaction Integrity Transaction boundaries Recorded in GoldenGate trail file Transactions ordered in commit sequence Boundaries adjusted automatically due to record filtering or trail splits Transaction integrity Checkpointing and recovery are based on transaction boundaries Original commit sequence is maintained by the delivery process 17 Copyright 2011, Oracle and/or its affiliates. All rights

18 Differentiator: Reliability Decoupled architecture Individual processes can be restarted automatically Tolerance to network outages (configurable) Recovery Recovery ensures that no operations are skipped or duplicated after failure of any kind Recovery of the Capture process is more involved than recovery the Delivery process Although GoldenGate processes are completely decoupled, the Delivery process must be aware of a recovery performed by the Capture process or pump 18 Copyright 2011, Oracle and/or its affiliates. All rights

19 GoldenGate Checkpointing Capture, Pump, and Delivery save positions to a checkpoint file so they can recover in case of failure Source Database 19 Copyright 2011, Oracle and/or its affiliates. All rights

20 GoldenGate Checkpointing Capture, Pump, and Delivery save positions to a checkpoint file so they can recover in case of failure Source Database 20 Copyright 2011, Oracle and/or its affiliates. All rights

21 GoldenGate Checkpointing Capture, Pump, and Delivery save positions to a checkpoint file so they can recover in case of failure Source Database Target Database 21 Copyright 2011, Oracle and/or its affiliates. All rights

22 Oracle GoldenGate 11g Overview EXPANDED HETEROGENEITY Log-based capture for MSFT SQL Server 2008, IBM DB2 9.7, MySQL Subscription to JMS messaging systems/service bus Delivery to IBM DB2 for I TIGHTER INTEGRATION WITH ORACLE Database Direct data loads and expanded data type support Certification for Oracle Exadata Applications Real-time reporting solution for Oracle applications and zero downtime application upgrade for JD Edwards Integration with Oracle Data Integrator Enterprise Edition ENHANCED PERFORMANCE Faster recovery after process interruptions for long running transactions Improved tracing to identify bottlenecks and tune for higher performance 22 Copyright 2011, Oracle and/or its affiliates. All rights

23 Oracle GoldenGate 11g Supported Platforms Databases Oracle GoldenGate Capture: Oracle DB2 for v 9.7 DB2 for v 10 on z/os Microsoft SQL Server for 2008 R1, R2 Sybase ASE, 15.5 Teradata Enscribe SQL/MP SQL/MX MySQL JMS message queues Oracle GoldenGate Delivery: All listed above, plus: TimesTen, IBM System I, Netezza & Greenplum ETL product O/S and Platforms Linux Sun Solaris Windows 2000, 2003, XP, 2008 HP NonStop HP-UX IBM AIX IBM z Series zlinux 23 Copyright 2011, Oracle and/or its affiliates. All rights 23

24 Oracle Management Pack for OGG Complete Visibility (1 / 2): Director 1. Oracle GoldenGate Director: Has basic configuration, management, monitoring, and alerting. Based on legacy pull infrastructure. Works on legacy GoldenGate instances. 24 Copyright 2011, Oracle and/or its affiliates. All rights

25 Oracle Management Pack for OGG Complete Visibility (2 / 2): Monitor 2. Oracle GoldenGate Monitor: Has advanced monitoring, alerting (SNMP support), lag graphs, and historical repository. Based on new agent infrastructure, which will be the foundation for all future integration projects. Supports OGG Copyright 2011, Oracle and/or its affiliates. All rights

26 Program Agenda Introduction to Oracle GoldenGate Technology Overview Continuous Availability Next Generation Data Warehousing Summary Q&A 26 Copyright 2011, Oracle and/or its affiliates. All rights

27 Eliminate All Downtime for Continuous Availability Available no issues Planned outage Upgrade Migration Maintenance Semi-available Performance issues R, R/W Unplanned outage System failure Data failure 27 Copyright 2011, Oracle and/or its affiliates. All rights

28 ASM, RMAN, OSB Storage failure Data recovery Backups Five Steps to Maximize Availability Oracle RAC Instance failure Server failure RAC rolling maintenance Performance scale-out Consolidation Flashback Continuous point-in-time recovery Granular repair of logical corruptions Transaction Table Database Active Data Guard Database failure System failure Site failure Zero data loss Automatic database failover Lost-write protection Database rolling upgrade Offload read-only workload and backups Some migrations Oracle GoldenGate Online platform and application upgrades Bi-directional and multi-master replication Distribute read-only & read-write workload An alternative to physical replication for site protection Flexible planned maintenance and heterogeneous migrations Zero downtime upgrades and migrations 28 Copyright 2011, Oracle and/or its affiliates. All rights

29 Oracle GoldenGate for Continuous Availability Zero Downtime Upgrades, Migrations and Maintenance Migration from non-oracle databases to Oracle 11gR2 & Exadata Upgrade Oracle Database 8i, 9i, 10g to 11gR2 Upgrade/Migrate Database Server/OS Perform Database Maintenance Application Upgrade (Siebel CRM and JD Edwards) Disaster Recovery for Non-Oracle Databases and Cross- Oracle Database versions Continuous Availability via Active-Active Databases Offloading Queries from Legacy Systems to Oracle Databases for Maximized Performance 29 Copyright 2011, Oracle and/or its affiliates. All rights

30 Minimized User Impact During a Major Siebel Upgrade Home Shopping Network (HSN) Business Challenges Always on, always available production Siebel CRM call center application. No tolerance for downtime operates 24x7x365 Need to minimize impact to users during Siebel application & Oracle database upgrade Solution Real-time, bi-directional replication using Oracle GoldenGate between Siebel and Siebel 8.0 to enable a zero downtime phased migration over a three month period agents migrated per day users in total. Oracle GoldenGate configured with application upgrade & downgrade logic to enable both systems to run in parallel. Return on Investment Reduced downtime during the massive migration effort. Simplified data conversions without interruption to regular business processes. Mitigated risk to the business by having both environment remain online together in sync for 3 months before switching off old environment. 30 Copyright 2011, Oracle and/or its affiliates. All rights

31 Eliminate Downtime During Upgrades to Oracle 11g R2 Zero database downtime for upgrades from 8i, 9i, 10g to 11g Application Switchover Leverage new features of Oracle Database 11g without impacting business operations Minimize risks with failback option Oracle Database 8i/9i/10g Failback Data Flow Compare & Verify With Oracle GoldenGate Veridata Oracle Database 11g Release 2 31 Copyright 2011, Oracle and/or its affiliates. All rights

32 Ensuring Business Continuity During Migration e-dialog Business Challenges 24x7x365 provider of advanced and multichannel marketing solutions to business worldwide helping marketers transform conversations into conversions. Ensure absolute business continuity when migrating data to a new data infrastructure capable of supporting extreme processing and data growth Solution Oracle Exadata Database Machine as the foundation for new data infrastructure that ensures continuous high-performance marketing services and campaign analysis. Used GoldenGate for a phased migration with more than 12 terabytes of data from heterogeneous legacy environments Return on Investment Completed the phased migration in six months. Gained the ability to complete the migration in phases, enabling e-dialog to test the new environment over time. Reduced downtime during the massive migration effort. Improved throughput by 50% and cut report generation time in half. 32 Copyright 2011, Oracle and/or its affiliates. All rights

33 Improve Production System Performance and Lower Costs Off-load queries from production systems in Active-Active or Heterogeneous configurations Transaction Processing Real-time changed data Read-Only Activity E.g. different OS, database version, database E.g. legacy system query off-load Legacy Production OLTP Oracle Database 33 Copyright 2011, Oracle and/or its affiliates. All rights

34 Operational Reporting for Oracle E-Business Suite Herbalife Business Challenges Needed to offload resources consumed by E-Business Suite reports to a separate system. Solution must be flexible to support easily created new reports and changes to existing reporting requirements and must be real-time/up-to-date data. Solution Needed solution to offload resources consumed by E-Business Suite reports to a separate dedicated system. Solution must be flexible to support easily created new reports and changes to existing reporting requirements. Real-time, up-to-date data required for reporting. Return on Investment Improved overall performance of Oracle E- Business Suite by removing overhead incurred by ad-hoc reporting. Improved execution times for ad-hoc reporting. Continued use of existing production systems until fully depreciated, saving Herbalife millions of dollars. 34 Copyright 2011, Oracle and/or its affiliates. All rights

35 Increase ROI on Existing Servers & Synchronize Data Across Globe Utilize secondary systems for transactions Enable continuous availability during unplanned and planned outages Synchronize data across data centers around the globe Application Source & Target Region A Application Source & Target Region B 35 Copyright 2011, Oracle and/or its affiliates. All rights

36 Meet Stringent SLAs for Critical Manufacturing System Research in Motion (RIM): Data Synchronization and Continuous Availability Business Challenges Experiencing exponential growth and stringent carrier SLA s to meet growing demand for Blackberry devices All plants must see same local data Maintain continuous availably of critical data across 4 global hubs Solution Oracle GoldenGate synchronizes data in 4-way active-active deployment on Oracle Sub-second latency with high data volumes across distances Active-active configuration also enables planned maintenance and migrations with zero downtime Data Guard for DR with fast failover in key hubs RAC used for server availability Offloads reporting to Exadata with GoldenGate Return on Investment Avoid negative publicity and from outages or missed SLAs Global replication of critical data to support manufacturing 24*7*365 Fast, cost-effective, non-intrusive, reliable method for adding new data center hubs with up-to-date data Achieve reporting with real-time without impacting operational system 36 Copyright 2011, Oracle and/or its affiliates. All rights

37 Program Agenda Introduction to Oracle GoldenGate Technology Overview Continuous Availability Next Generation Data Warehousing Summary Q&A 37 Copyright 2011, Oracle and/or its affiliates. All rights

38 Why Real-Time Data for BI? Real-Time= Relevant and actionable information Improved insights for operational decision making Better customer service and cost savings via operational efficiencies Increased profitability, customer retention, and competitive advantage 38 Copyright 2011, Oracle and/or its affiliates. All rights

39 Oracle GoldenGate Next Generation Data Warehousing: Enabling Real Time BI High Performance E-LT, Real-Time Data Warehousing EMP ODS Schema Oracle Data Integrator DEPT DIM DIM FACT DW Schema DIM DIM Solution Using OGG for log-based capture of database transactions from source to minimize overhead Load to target with sub-second latency Transformation performed on the database using E-LT in mini-batches Fast ETL/E-LT handled by database processing Benefits No resource / performance impact to OLTP Live data available for better decision making Get double-duty from database investment by using it for transformations Maximizes availability of source systems and DW due to smaller batch windows. 39 Copyright 2011, Oracle and/or its affiliates. All rights

40 Next Generation Data Warehousing: Enabling Real Time BI High Performance E-LT, Real-Time Data Warehousing Synchronize Exadata with OGG New Exadata platform optimized for OLTP and Data Warehousing suits Real Time DW Extreme Exadata performance can handle huge data volumes that come with Real Time DW Oracle Data Integrator Oracle GoldenGate DIM FACT DIM EMP DEPT DIM DIM ODS Schema DW Schema 40 Copyright 2011, Oracle and/or its affiliates. All rights

41 Complementary and Used Together Oracle GoldenGate and Oracle Data Integrator Oracle GoldenGate Fastest real-time solution Sub-second latency for real-time feeds Guaranteed delivery eliminates data loss Eliminates down-time for migration and upgrades Least intrusive to source systems Oracle Data Integrator Fastest E-LT Solution Optimized SET-based transformation for high volume transformations Data lineage for improved manageability Integrates to Data Quality 41 Copyright 2011, Oracle and/or its affiliates. All rights

42 Program Agenda Introduction to Oracle GoldenGate Technology Overview Continuous Availability Next Generation Data Warehousing Summary Q&A 42 Copyright 2011, Oracle and/or its affiliates. All rights

43 Advantages of Oracle GoldenGate 11g Reduced Overhead and TCO Captures once, delivers to many targets for different uses Non-invasive, log-based capture Moves only committed data, reduces bandwidth needs High Performance with Reliability Subsecond latency even with high data volumes Preserves transaction integrity Ensures data recoverability Flexibility and Ease of Use Provides decoupled, modular architecture Supports heterogeneous sources and targets, and different latency needs Coexists and integrates with ELT/ETL and messaging solutions 43 Copyright 2011, Oracle and/or its affiliates. All rights

44 Benefits of Oracle GoldenGate 11g Cut Costs, Reduce Risk, and Achieve Operational Excellence Cut Costs and Shorten Time to Value Lower TCO and reduce hardware Shorten implementation, and lower dev costs Reduce Risk Improve your IT infrastructure without interrupting business operations Enable data recoverability and reliable data delivery Achieve Operational Excellence Make better decisions based on accurate, timely information Provide better service to customers with continuous operations 44 Copyright 2011, Oracle and/or its affiliates. All rights

45 45 Copyright 2011, Oracle and/or its affiliates. All rights Q&A

46 46 Copyright 2011, Oracle and/or its affiliates. All rights

47 47 Copyright 2011, Oracle and/or its affiliates. All rights