Universal Data Access via SAP BW Java Integration Functionality

Universal Data Access via SAP BW Java Integration Functionality Arnd Graf, Dev. Architect BI Analysis Platform Rainer Uhle, Product Management BI SAP AG Learning Objectives As a result of this lecture, you will be able to: Explain the benefits that SAP Business Information Warehouse (BW) derives from the J2EE components that are integrated into SAP Web Application Server 6.40 Understand the architecture of SAP BW s integration with the SAP Web Application Server Java Environment Describe which protocols and standards are supported by the BI Java Connectors Describe the concept of data migration and integration in heterogeneous system landscapes using the Universal Data Connect Explain how the BI Java SDK complements and extends SAP BW s existing open analysis interfaces SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 2

Agenda Overview Migration and Integration of diverse data sources Enabling J2EE applications to access BW data SAP NetWeaver & BI Java Connectors SAP BW 3.5 Universal Data Connect (UDC) UDC Details BI Java SDK for Custom Applications SDK Details Outlook Summary SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 3 Agenda Overview Migration and Integration of diverse data sources Enabling J2EE applications to access BW data SAP NetWeaver & BI Java Connectors SAP BW 3.5 Universal Data Connect (UDC) UDC Details BI Java SDK for Custom Applications SDK Details Outlook Summary SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 4

Overview Diverse Data Sources Quantitatively Data sources now Data sources in 18 months Mainframe/ legacy, 65% Packaged applications, 39% Replication or CDC, 15% Other, 30% External, 14% XML, 29% Flat files, 81% Web, 15% Packaged applications, XML, 15% 18% EAI/Messaging, 12% Mainframe, 12% EAI, 5% Excel, 12% Source: The Data Warehousing Institute (TDWI); based on 756 respondents. Relational databases, 89% Flat files, 23% Source: TDWI-Giga Information Group Quarterly Technology Survey, 2/2003, 150 respondents. Relational, 34% SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 5 SAP NetWeaver - A Broader View of Data Acquisition SAP BW BAPI DB Connect File UDC http/ SOAP A B C D SAP XI E F G Universal Data Connect Integrates data for analysis and enables a complete business view Persistent and transient data handling possible Java based connectors for different drivers, providers, and protocols available JDBC OLE DB for OLAP XML for Analysis SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 6

SAP TechEd 03 Las Vegas Overview Enabling Applications to Access BW BI Java SDK OLAP BAPIs OLE DB for OLAP XML for Analysis based on COM as protocol Business Application Programming interface based on XML as exchange format driver installation on clients based on RFC as protocol based on HTTP/SOAP as protocol Windows platform only access library available on any SAP platform any platform MDX as query language available since BW 1.2B MDX as query language available since BW 3.0A MDX as query language available since BW 2.0A SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 7 Overview Java Connectivity in SAP NetWeaver Industry standard Connection Architecture (JCA) SAP NetWeaver PEOPLE INTEGRATION Portal INFORMATION INTEGRATION Bus. Intelligence Knowledge Mgmt Master Data Management PROCESS INTEGRATION Integration Broker Business Process Management APPLICATION PLATFORM J2EE Pluggability for 3rd party connectors Uniform connection management, monitoring and foundation for all connectors Portability and Synergies with other J2EE standards Collaboration Life Cycle Management Composite Application Framework Multi channel access BI Java Connectors fully leverage the SAP J2EE connection framework and provide integration with diverse data sources Visualization of SAP BW and nonsap BW data via the SAP BW Business Explorer BI Suite and SAP Enterprise Portal ABAP DB and OS Abstraction SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 8 2003 SAP AG, Germany BW204, Eric Schemer/Rainer Uhle 4

Overview - BI Java Connectors Connectors for diverse data sources Used together with the Universal Data Connector or the BI Java SDK to extract and consume BW or non-bw data. Relational BI JDBC Connector JDBC is the standard Java API for RDBMS Connectivity to over 170 JDBC drivers, supporting data sources such as: Teradata, Oracle, MS SQL Server, MS Access, DB2, Excel, text files (CSV) BI SAP Query Connector Connectivity to SAP operational applications (4.x) R/3, Ad-Hoc, Operational Reporting OLAP BI ODBO Connector Established industry-standard OLAP API for the Windows platform Connectivity to MS Analysis Services, SAS, MS PTS BI XMLA Connector Web services-based, platform independent access to OLAP providers Connectivity to MS Analysis Services, Hyperion, MicroStrategy, MIS, BW 3.x SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 9 Overview Java Industry Momentum 177 JDBC Drivers available ADABAS, Clipper, DB2, dbase, FoxPro, IBM AS/400, Informix, Ingres, InterBase, LDAP, MS Access, News Server, OS/390, Paradox, Redbrick, SAS, Sybase, Teradata, Text (CSV, Tab separated etc.), TinySQL, VSAM, XML. SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 10

Agenda Overview Migration and Integration of diverse data sources Enabling J2EE applications to access BW data SAP NetWeaver & BI Java Connectors SAP BW 3.5 Universal Data Connect (UDC) UDC Details BI Java SDK for Custom Applications SDK Details Outlook Summary SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 11 UDC - Architecture DB WAS 6.40 BW 3.5 J2EE Server 6.40 JDBC Connector JDBC Driver RDBMS InfoSource Generic DataSource with FM Rules BI Java Integration... Universal Data Connect XMLA Connector ODBO Connector http-url, port ODBO Prov. MS AS, SAS, Hyperion SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 12

UDC - Integration Scenario with JDBC DB WAS 6.40 BW 3.5 Web Application Query RemoteCube InfoSource Generic DataSource with Rules FM J2EE Server 6.40 BI Java Integration... Universal Data Connect JDBC Connector JDBC Driver Supporting JDBC Enterprise Portal 6.0 File Syst. Transient data. No data physically stored in SAP BW. DB access via JDBC driver (from DB provider) Mapping via Transfer Rules in BW, Inversion of Transfer Rules RemoteCube SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 13 UDC - Extraction Scenario with JDBC DB WAS 6.40 BW 3.5 Data Mart Layer EDW Layer InfoPackage InfoSource Generic DataSource with Rules FM J2EE Server 6.40 BI Java Integration... Universal Data Connector JDBC Connector JDBC Driver Supporting JDBC File Syst. Persistent data DB access via JDBC driver (from DB provider) Mapping via Transfer Rules in BW, no Inversion of Transfer Rules required Data load via InfoPackage SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 14

UDC Details Connector Deployment and Connection Configuration JNDI: Java Naming Directory Interface SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 15 UDC Details - InfoSource Maintenance Create BW DataSource with UDConnect Order No. Patner No. RC Date Commission Da Shipping Date Lineitem No. SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 16

UDC Details DataSource Wizard BW InfoSource Connect Info Man. Mapping Fields of table ITEM in ext. DB Generate DS SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 17 Autom. Mapping UDC Feature Summary Scenarios Connection of diverse data source systems to SAP BW E.g. Extraction/Remote Access from a relational database via open interface JDBC E.g. Extraction/Remote Access from OLAP source using OLE DB for OLAP and extraction from an OLAP source using XML for Analysis Features Leveraging SAP WebAS J2EE Connectivity for SAP BW Enhancing SAP BW Openness: Connectivity to virtually all data sources UDConnect: Universal Data Connect Extraction to SAP BW and Remote Cube Access via UDConnect Uses the BI Java Connectors JDBC (170+ drivers available for: Adabas, Clipper, DB2, FoxPro, Informix, Ingres, MS Access, Sybase, SAS, Teradata, XML, CSV text files, ) - see http://java.sun.com for more information OLE DB for OLAP XML for Analysis SAP Query The set of connectors will be extended in future SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 18

Agenda Overview Migration and Integration of diverse data sources Enabling J2EE applications to access BW data SAP NetWeaver & BI Java Connectors SAP BW 3.5 Universal Data Connect (UDC) UDC Details BI Java SDK for Custom Applications SDK Details Outlook Summary SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 19 BI Java SDK - Architecture BI BI Java Java SDK SDK OLAP APIs OLAP Metadata API OLAP Query API Relational APIs Relational Metadata API Relational Query API ResultSet API Connection Management Logging and Tracing Documentation (including Javadocs, Developer s Guide); Examples BI XMLA Connector BI XMLA Connector BI JDBC Connector BI JDBC Connector BI ODBO Connector BI ODBO Connector BI SAPQ Connector BI SAPQ Connector OLAP Relational OLAP Relational SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 20

BI Java SDK Scenarios Managed Application Scenario Unmanaged Application Scenario WAS 6.40 EP 6.0 J2EE Server 6.40 Java Components BI XMLA Connector http-url, port Enterprise Portal Web Application Any OS J2SE J2SE Application BI XMLA Connector http-url, port BW XMLA Service BW XMLA Service DB BW DB BW SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 21 BI Java SDK Supported Open Standards JCA (J2EE Connector Architecture) Standard architecture for integration of J2EE servers with EISs. The architecture defines a set of contracts that a resource adapter has to support to plug in to an application server. CWM (Common Warehouse Metamodel) Describes the exchange of shared, global metadata. Capable of modeling a wide spectrum of OLAP and relational providers. JMI (Java Metadata Interface) Provides a common Java programming model for accessing metadata. XMI (XML Metadata Interchange) Standard for exchanging metadata between UML-based modeling tools and MOF-based metadata repositories. Why s this important? Connection Management JCA provides an API for connecting to heterogeneous data sources in a consistent way. Supports pluggability of connectors into multiple J2EE engines. The SDK s connectors are JCA-compliant. Metadata Integration Common Metamodel (CWM) You need a common understanding of metadata to be able to exchange it between different, heterogeneous systems. The SDK uses CWM to represent metadata. Common Access API (JMI) Provides a common access API. The SDK uses JMI mapping to render its metadata models into Java APIs. Common Exchange Format (XMI) The SDK supports XMI to exchange and persist metadata objects in a platform-independent manner. MOF (Meta Object Facility) Standard for the specification of interoperable metamodels, integrated in XMI. MOF can also refer to any metadata service which abides by the MOF specifications. SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 22

BI Java SDK - Developer s Documentation Set Features: Features: Complete Complete set set of of Javadocs Javadocs Developer s Developer s Guide Guide Code Code Examples Examples Integrated Integrated CWM CWM Documentation Documentation Navigable Navigable UML UML Diagrams Diagrams SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 23 BI Java SDK Feature Summary Scenarios Java developers will use the SDK to create custom BI applications and deploy them on the SAP NetWeaver s J2EE server For accessing SAP (BW) or non-sap data Access to diverse sources (SAP or non-sap) supported by the BI Java Connectors (JDBC, XMLA, OLE DB for OLAP, SAP Query) Features Easy to use and learn Simplified command interfaces hide the complexity of underlying low-level data access protocols (MDX, SQL, HTTP, JNI ) Leverages resources, skills, and infrastructure customers already have Provides complete documentation on an API level (Javadocs), tutorials, and examples Based on open and accepted standards for interoperability Common access APIs (JMI) Common meta models (CWM) Common interchange format (XMI) Connection management (JCA) SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 24

Agenda Overview Migration and Integration of diverse data sources Enabling J2EE applications to access BW data SAP NetWeaver & BI Java Connectors SAP BW 3.5 Universal Data Connect (UDC) UDC Details BI Java SDK for Custom Applications SDK Details Outlook Summary SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 25 Outlook BEx and Portal Integration BEx Integration (BW 4.0) BEx as an XMLA, ODBO, JDBC consumer Ad-hoc reporting on non-sap OLAP and relational data sources Data ready for reporting without modeling Portal Integration (Availability tbd) Visual tool (GUI Machine) to enable code-free development of portal content Designed for content experts and content managers BI Extension for creation of BI content SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 26

Summary SAP NetWeaver supports an industry standard pluggable connector architecture SAP BW leverages and integrates with this architecture via BI Java Connectors SAP BI Java Connectors enable integration of diverse data sources based on JDBC, XMLA and OLE DB for OLAP SAP BI Java SDK, based on BI Java Connectors, enables rapid development of custom Java applications with access to BW SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 27 Further Information Internet: J2EE Connector Architecture (JCA): http://www.jcp.org/en/jsr/detail?id=16 Java Database Connectivity (JDBC): http://java.sun.com/products/jdbc/ XML for Analysis (XMLA): http://www.xmla.org/ Java Metadata Interface (JMI): http://java.sun.com/products/jmi/ OLE DB for OLAP (ODBO): http://msdn.microsoft.com/library/default.asp?url=/library/enus/oledb/htm/olprpart3.asp Related Workshops/Lectures at SAP TechEd 2003 BW 253: XML for Analysis; 2-hour hands-on: Sept. 30, 2003, 4:00 PM - 6:00 PM, H11 SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 28

Questions? Q&A SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 29 Feedback Please complete your session evaluation and drop it in the box on your way out. Thank You! The SAP TechEd 03 Basel Team SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 30

Copyright 2003 SAP AG. All Rights Reserved No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, WINDOWS, NT, EXCEL, Word, PowerPoint and SQL Server are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iseries, pseries, xseries, zseries, z/os, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix and Informix Dynamic Server TM are trademarks of IBM Corporation in USA and/or other countries. ORACLE is a registered trademark of ORACLE Corporation. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, the Citrix logo, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, MultiWin and other Citrix product names referenced herein are trademarks of Citrix Systems, Inc. HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C, World Wide Web Consortium, Massachusetts Institute of Technology. JAVA is a registered trademark of Sun Microsystems, Inc. JAVASCRIPT is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. MarketSet and Enterprise Buyer are jointly owned trademarks of SAP AG and Commerce One. SAP, R/3, mysap, mysap.com, xapps, xapp and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned are the trademarks of their respective companies. SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 31 SAP TechEd `03 EMEA Online WATCH THE REPLAYS, DOWNLOAD THE SLIDES, AND READ THE TRANSCRIPTS. www.sap.com/community SAP AG 2003, TechED Basel 2003, BW204_EMEA; Arnd Graf/Rainer Uhle, 32