BI Applications Integration with ODI and GoldenGate

Transcription

1 BI Applications Integration with ODI and GoldenGate Narasimha Rao Madhuvarsu L V Sr. Principal Architect Apps Associates LLC Julian Troake Marketing Director Apps Associates LLC July 22, 2014 Copyright Apps Associates LLC. 1

2 Confidentiality Statement The content of this document is proprietary, confidential information pertaining to Apps Associates products, services, solutions and methods. Information herein is intended for use by the client or prospective client only and must not be shared with any third party without consent from Apps Associates. For any questions with this proposal, please contact Julian Troake Phone: (978) Copyright Apps Associates LLC. 2

3 Agenda Introduction Customer Benefits Infrastructural TCO Productivity Additional Content Data Lineage BI Apps 7.9.x vs. 11g ODI BI Apps Architecture Oracle Data Integrator Licensing and Supported Platforms Migration Options from 7.9.x Versions Real-Time Data Refresh Using GoldenGate Demo Configuration Manager Functional Setup Manager Web-Based ODI Console Copyright Apps Associates LLC. 3

4 Introduction Most significant BI Applications release Completely re-architected solution Expansion of content and new products Released on the latest version of OBIEE Copyright Apps Associates LLC. 4

5 Customer Benefits Leverages the database tier power for ELT No need of separate ETL tier significant cost reduction Number of new out-of-the-box tools to increase productivity and drive down TCO Configuration Manager Functional Setup Manager Additional modules and content expansion Reduced functional configuration time Complete data lineage from source to analysis Copyright Apps Associates LLC. 5

6 Customer Benefits Integrated FMW security across components Easy near real time incremental refresh of data warehouse Copyright Apps Associates LLC. 6

7 BI Applications 11g Features Over 7.9.x Significant release with multiple enhancements Additional content and new products New architecture leveraging the power of ODI Content built on latest version of OBIEE Tools to increase productivity and drive down TCO Near real time option for customers that have significant ETL time pressures Copyright Apps Associates LLC. 7

8 New Features Copyright Apps Associates LLC. 8

9 New Content in BI Apps 11g Over 7.9.x Financials HR Commitment Control & Public Sector Financial / Budget Analysis (EBS & PSFT) Fixed Assets (EBS & PSFT) Time & Labor (EBS & PSFT) Global Payroll (PSFT) Transfers (EBS & PSFT) Projects Resource Management (EBS & PSFT) Cross Charge (EBS & PSFT) Forecasting Enhancements & Commitments (PSFT) GL Reconciliation (EBS & PSFT) Copyright Apps Associates LLC. 9

10 CRM New Content in BI Apps 11g Over 7.9.x Service Analytics Enhancements (EBS) Price Analytics (EBS) Procurement & Spend Sourcing Analytics Enhancements to Change Orders and Agreements Supply chain & Order Management Costing Inventory Cycle Count and Other Enhancements Student Information Analytics Admissions, Recruiting, Records, partial Financials (PSFT) Indirect Spend Planning Copyright Apps Associates LLC. 10

11 Extended Connectivity Over 7.9.x Application Adapters for SAP ERP and SAP BW Application Adapters for Endeca, Hadoop Oracle OLAP Hyperion Planning, Financial Management and Essbase Real-Time CDC with GoldenGate Oracle DB multi-table insert Optimizations for IBM DB2, Microsoft SQL Server, Teradata, Netezza Copyright Apps Associates LLC. 11

12 Bulk Data Processing & Data Transformation BI Apps supports more source systems over Copyright Apps Associates LLC. 12

13 ODI BI Apps Architecture Copyright Apps Associates LLC. 13

14 ETL BI Apps with Informatica BI Applications with Oracle Data Integrator and GoldenGate Copyright Apps Associates LLC. 14

15 Data Loading The Key to Improved Performance and Reduced Costs E-LT provides flexible architecture for optimized performance Benefits Leverage set-based transformations Improved performance for loading, no network hop Takes advantage of existing hardware Copyright Apps Associates LLC. 15

16 ETL Architecture Informatica Is an ETL tool (Extract, Transform, Load) Has dedicated ETL engine Transformation is the core part of ETL Integration service handles the transformation part, resulting in better performance File based transformation operations Copyright Apps Associates LLC. 16

17 ETL Architecture ODI Is an ELT tool (Extract, Load, Transform) Does not have dedicated ETL engine Relies on database capabilities of the source / target database i.e. first loads the data in some staging tables in the target database and later inserts / updates the data into the final target tables based on the data transformation has to perform Performance is primarily based on Source and Target Tables and Database Copyright Apps Associates LLC. 17

18 ETL Architecture In-database E-L-T Transformation vs. E-T-L. Best in class performance, scalability, availability Lightweight deployment for lower TCO Faster time-to-value through declarative design Heterogeneous, open and standards-based Set based transformation Copyright Apps Associates LLC. 18

19 Components Informatica Copyright Apps Associates LLC. 19

20 Components ODI Copyright Apps Associates LLC. 20

21 GUI Connecting to the ETL Repository We need to have client tool installed in the machine to access repository ETL Repositories It has only one repository, so we have one set of connection entries Cost ODI is cost effective compared to Informatica Connecting to the ETL Repository No separate Client tools is involved. We can connect to repositories using ODI console or by web based URL ETL Repositories We have two Repositories. Master and Work Repositories. So we need two Independent connection entries Copyright Apps Associates LLC. 21

22 GUI Hardware Informatica tool utilize its own engine to implement the ETL process. So investment in additional hardware to implement the tool s ETL engine. Hardware Utilizes existing hardware. ODI can run on the same hardware as the database engine underpinning the data warehouse, using the existing hardware deployed. Copyright Apps Associates LLC. 22

23 Implementation Domain Files We need to configure manually Time It takes more time for configurations ETL Customization In order to load data to custom column we need to edit the Mapping ETL Troubleshooting Features like backtracking, dependencies and debugger Domain Files No need to configure Domain files. It is automatically configured by using Configuration Manager. Time It takes less time for configurations ETL Customization In order to load data to custom column we need to edit the interface ETL Troubleshooting Features like Simulation to debug Copyright Apps Associates LLC. 23

24 Declarative Design Improved Developer Productivity and Lower Maintenance Costs Informatica ETL Design Developer must define every step of Complex ETL Flow Logic And significant development and maintenance efforts ODI Declarative Design Simplifies the number of steps Automatically generates the Data Flow whatever the sources and target DB Benefits Reduces the learning curve Shorter implementation times Streamline access to non-it pros Copyright Apps Associates LLC. 24

25 Benchmarking Copyright Apps Associates LLC. 25

26 Tools for Accelerating Deployment BI Applications DAC Another tool to install BI Applications Configuration Manager Administrative UI to manage system configuration for BI Applications Functional Setup Manager Administrative UI to track and manage implementation projects and functional setup steps Copyright Apps Associates LLC. 26

27 BI Applications Configuration Manager A centralized (thin client/web application) console to Simplify configuration process Minimize manual setups and configurations Generate list of necessary configurations based on BI Application being configured and user selections Provide check lists and validations of all necessary tasks Reduce dependency on documentation Configuration migration capabilities Copyright Apps Associates LLC. 27

28 Edit Dialog Copyright Apps Associates LLC. 28

29 Functional Setup Manager Domains ETL execution to extract configuration data from source Ability to track configuration progress for project management Enable / disable a functional area from a module Ability to create load plans with extract only Define, generate, execute and monitor load plan Scheduling for load plan for data refresh Copyright Apps Associates LLC. 29

30 BI Applications OLTP Coverage Copyright Apps Associates LLC. 30

31 Migration Path No formal migration path from 7.9.x to 11g Ideal for implementations with minimal customizations Upon implementation of BI Apps 11g, manually migrate the customizations on a case by case basis as needed Copyright Apps Associates LLC. 31

32 Enhanced ETL Architecture Using GoldenGate Optional Feature for 11g Challenge: Customers with geographically distributed source systems are increasingly being challenged by rapidly expanding data sizes and shorter ETL windows Solution: Optimize ETL load and reduce impact on OLTP system leveraging the strengths of GoldenGate Completely prepackaged solution Creation of Source Dependent Data Store (SDS) Ability to complete all extraction tasks while in source system availability window Copyright Apps Associates LLC. 32

33 Real-Time Data Refresh Using GoldenGate Built in integration with GoldenGate No need for batch load windows ODS/SDS near real time refresh from distributed source databases Ability to add/change indexes and views on SDS Source for real time reporting needs Recommended for customers with pressing ETL times Suitable for 24 x 7 deployments Copyright Apps Associates LLC. 33

34 Demo Configuration Manager Functional Setup Manager ODI Console Copyright Apps Associates LLC. 34

35 Why ODI BI Apps? Faster Simpler Fastest E-LT Bulk/Batch Performance Faster Real Time integration (sub-second) with CDC, Replication, and SOA Faster Project Setup, Design and Delivery Simpler Setup, Configuration, Management, and Monitoring Simpler way to do Mapping using Declarative SQL Interfaces Simpler Deployment with Fewer Hardware Devices Simpler extensibility with Knowledge Module code templates Copyright Apps Associates LLC. 35

36 Why ODI BI Apps? Saves Money (Lower TCO, Higher ROI) Less Hardware & Energy Costs with E-L-T Architecture Less Time spent on Unnecessary ETL Mappings, Scripting, and Training Less Integration Overhead Integrating with Applications, SOA, and Management Copyright Apps Associates LLC. 36

37 Connect with Us Web: YouTube: LinkedIn: Facebook: Google+: Copyright Apps Associates LLC. 38

38 Thank You!