SAP BusinessObjects & Hadoop. Brian Wrona June 1, 2012

Transcription

1 SAP BusinessObjects & Hadoop Brian Wrona June 1, 2012

2 What is Hadoop? Hadoop is open source software that enables reliable, scalable, distributed computing on clusters of inexpensive servers Reliable Software is fault tolerant, it expects and handles hardware and software failures Scalable Designed for massive scale of processors, memory, and local attached storage Distributed Handles replication. Offers massively parallel programming model, MapReduce Hadoop framework handles: partitioning, scheduling, dispatch, execution, communication, failure handling, monitoring, reporting and more 2011 SAP AG. All rights reserved. Confidential 2

3 Hadoop Technology Family Logical View* Non-Relational DB Fine-grained data handling Scripting Machine Learning Hive HBase Pig Mahout Data warehouse that provides SQL interface. Data structure is projected ad hoc onto unstructured underlying data Column oriented, schema-less, distributed database modeled after Google s BigTable. Random realtime read/write Platform for manipulating and analyzing large data sets. Scripting language for analysts Machine learning libraries for recommendations, clustering, classfication and itemsets MapReduce Parallel programming Large block data handling (e.g. 64MB) HDFS Distributes & replicates data across machines Hadoop Common MapReduce Distributes & monitors tasks, restarts failed work * For simplicity, mapping to servers is omitted SAP AG. All rights reserved. Confidential 3

4 BI4 FP3: A solution leveraging the existing BI 4.0 architecture Empower business users with the autonomy they need to access, analyze, enrich, and share information freely and securely using familiar business terms Empower all people, enable all workflows Common user experience for all front-ends Web Intelligence Crystal Reports Dashboards Explorer High performance, feature rich and secured access Best access method for each specific data source Universe Access Direct Access The new information design tool is your point of entry to business intelligence solutions HADOOP HIVE All data sources SAP BW Sybase SAP HANA Any Relational Database Files Web Service 2012 SAP AG. All rights reserved. 4

6 Providing Richer Insight SAP BusinessObjects Explorer Provide all users with a simple and intuitive experience for immediate, interactive access to information to answer common business questions on the fly Key New Capabilities Casual users create their own compositions of multiple Explorer visualizations Exploration views support ios Geographic awareness new semantic type for geographic dimensions Time aware new semantic type for time dimensions Natural visualization and navigation for time and geo dimensions Improved search auto-correction and did you mean feature 2012 SAP AG. All rights reserved. 6

8 Information Design Tool on Apache Hadoop Hive We connect to Hive using a relational connection and a JDBC driver The connectivity for Amazon EMR is planned for the 4.1 release SAP AG. All rights reserved. 8

9 Semantic Layer Hadoop support New Universe format (UNX) via a JDBC relational connection to Hive Access via tables in Data Foundation Can support Hive Partitioned tables. The connectivity for Amazon EMR is planned for the 4.1 release SAP AG. All rights reserved. 9

10 Information Design Tool on Hadoop Hive A Data Foundation against a Hive schema One can draw joins between the Hive tables We support Hive tables, aliases, derived tables, Hive views and Hive partitioned tables Support for multi-source is planned for SAP AG. All rights reserved. 10

11 Querying Hive data The business user can get his data out of Hadoop in a non-technical manner using the query panel. Under the covers we generate a HiveQL statement that is then translated into map reduce tasks by Hadoop Hive. Sub-query and Ranking features are not supported. Sampling is supported SAP AG. All rights reserved. 11

13 Text Analysis Finding recurrent words Words extraction and counting is done by Hadoop Hive WebI only presents the aggregated counts data in a chart The most occuring words found in the speech SAP AG. All rights reserved. 13

16 Statistical Analysis Histogram on salary data Bins definition and counting are done by Hadoop Hive WebI only presents the aggregated counts data in a chart The salary data distribution SAP AG. All rights reserved. 16

17 Statistical Analysis Summarizing a data set All the computations required for the descriptive statistics are pushed to Hadoop WebI is used as the presentation layer 2012 SAP AG. All rights reserved. 17

19 Hana + Hadoop + Data Services + BusinessObjects + SAR POC Objective Provide insight into how a real-life retail problem is solved by SAP HANA-Hadoop Analyze 10 years of Transactional data = 13 Billion records Showcase how we can leverage Hot Data(2 years) in SAP HANA with Warm/Cold Data(10 Years) in Hadoop Demonstrate at SAPPHIRE an efficient SAP HANA-Hadoop Cloud solution leveraging SI for data migration and integration services Solutions: SAP HANA Apache Hadoop SAP BusinessObjects Data Services 4.1 SAP BusinessObjects 4.0 fp3 RDS-Sales Analysis for Retail on Hana Benefits: Affordable solution for Data Storage Reduce capital expenditures with cloud management of data storage and SAP Analytics Web Intelligence Hadoop Universe JDBC BusinessObjects 4.0 fp3 Explorer SAR Universe Virtual Private Servers on the Cloud Hive (via SQL) Linux Data Services 4.1 Hana COLD/WARM HOT 2012 SAP AG. All rights reserved. 19

20 SAP Database Strategy SAP s current innovative data assets SAP Sybase ASE SAP Sybase IQ SAP Sybase SQL Anywhere Sybase ESP, Replication Server, PowerDesigner, + SAP EIM #1 Transactional Database with Best TCO #1 Analytics Database with Best TCO #1 Mobile and Embedded Database #1 Unified EIM platform for Real-Time SAP HANA SAP Real-time Data Platform Open for Partners 2012 SAP AG. All rights reserved. 20

21 Next generation SAP Real-time Data Platform 3rd Party BI Client SAP Business Suite SAP Business Warehouse SAP Big Data Applications SAP Analytics SAP Mobile Custom Apps SAP NetWeaver (On Premise / Cloud) SAP Real-time Data Platform Common Modeling Sybase PowerDesigner MPP Scale-Out SAP Sybase ASE SAP Sybase Replication Server Open Developer APIs and Protocols SAP Sybase SQLA SAP HANA Platform SAP Sybase ESP SAP Data Services SAP Smart Data Services Platform SAP Sybase IQ SAP MDG, MDM HADOOP 3 rd Party DB Common Landscape Management SAP innovation without customer disruption 2012 SAP AG. All rights reserved. 21

22 Thi s im SAP HANA Vision/roadmap Integrate Optimize Synthesize Higher performance through in-memory database Customer Value State of the art In-memory database platform Crafted for BW, ERP, B1, ByDesign and all other SAP applications Accelerate business by removing most common processing bottlenecks between layers Best application and database experience through in-memory optimization Customer Value Deep optimization: SAP applications, SAP HANA, Sybase SAP HANA becomes the single application platform for OLAP and OLTP for all applications Higher business value at reduced cost of operation Next-generation PaaS offering based on inmemory architecture Customer Value Leverage the power of SAP HANA OnDemand Seamless structure for OnPremise and OnDemand integration Innovative co-development across the community SAP innovation without customer disruption 2012 SAP AG. All rights reserved. 22

23 2012 SAP AG. All rights reserved No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iseries, pseries, xseries, zseries, eserver, z/vm, z/os, i5/os, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation. Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. Oracle is a registered trademark of Oracle Corporation. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C, World Wide Web Consortium, Massachusetts Institute of Technology. Java is a registered trademark of Sun Microsystems, Inc. JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an SAP company. Sybase and Adaptive Server, ianywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary. The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall not apply in cases of intent or gross negligence. The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages SAP AG. All rights reserved. 23