Finding the signals in the noise Niklas Packendorff @packendorff Solution Expert Analytics & Data Platform
Legal disclaimer The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP. This presentation is not subject to your license agreement or any other service or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation and SAP's strategy and possible future developments, products and or platforms directions and functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this document is not a commitment, promise or legal obligation to deliver any material, code or functionality. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. This document is for informational purposes and may not be incorporated into a contract. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP s willful misconduct or gross negligence. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions. 2015 SAP SE or an SAP affiliate company. All rights reserved. 2
https://www.youtube.com/watch?v=hs-0zadt6so 2013 SAP AG. All rights reserved. 3 2015 SAP SE. All rights reserved.
SAP Big Data Portfolio Do you have good answers to these questions? Architecture that is logical and mapped to needs Do our business users always get timely, up-to-date and accurate information? Do the users have access to upto-date KPIs/reports that they can change quickly, as needed? Do we have processes that need massive re-work due to data latency? Which transactions/batch processes run multiple times a day or are simply too long? Can we respond flexibly to changing business situations? Can we perform scenario simulations or predictive scenarios? Can we manage the cost and complexity to combine Big Data with ERP/CRM data? 2015 SAP SE. All rights reserved. 4
SAP Data Platform Portfolio Use whatever tool or UI to view your data (SAP has a few ready for you) BusinessObjects, Lumira, Custom Application, Predictive Analysis Use data from any system, SAP or non-sap, business or sensor, POS... Data Services/SLT Listen to millions of records per second and only keep what is interesting Event Stream Processor Connect to many terabytes and petabytes of backend data Hadoop integration/data staging Query billions of records combined from many sources ad-hoc in seconds Query Engine, Rules Engine Make use of built-in sophisticated statistical algorithms Predictive Analytics Library Treat text as just another query aspect. Search and relate. Text analysis engine Enjoy fast programs (using many queries) XS Engine, SQL, SQLScript, JavaScript Explore statistics... or let the system make a best proposal KXEN InfiniteInsight Treat geographic location as just another query aspect Geospatial data types Reuse your exising tools/ models with high-speed execution SAS integration Reuse your R models (your local statistician will know) with high-speed integration R integration 2015 SAP SE. All rights reserved. 5
The modern, fast & agile data platform Please find more details here: https://blogs.saphana.com/2015/06/16/new-sap-hana-sps10/ 2015 SAP SE. All rights reserved. 6
Rethinking the Information Supply Chain 2015 SAP SE. All rights reserved. 7
Comprehensive Data Provisioning for SAP HANA Conceptual view of real-time high volume data movement from any source Any Source SAP and other Transactional systems Databases and data marts Cloud Deployments SAP HANA Data Provisioning SAP HANA Real-time replication SAP HANA Smart Data Integration SAP HANA Smart Data Quality SAP HANA Cloud Integration Transform and Persist Data HANA Tables SAP HANA Virtual Tables Streaming Event Sources SAP HANA Smart Data Streaming Other Data Sources (HANA, IQ, ASE, Hadoop, Teradata, Oracle, MSSQL) SAP HANA Smart Data Access Each of these product provides unique data movement capability for SAP HANA, so that customers can integrate any data sources into SAP HANA in real time. 2015 SAP SE. All rights reserved. 8
HANA Agile data modeling Store data once, re-use in multiple models, avoid duplicate data and aggregates Calculation Views Analytical Views Attribute Views Tables 2015 SAP SE. All rights reserved. 9
SAP HANA Smart Data Access Data virtualization for on-premise and hybrid cloud environments Benefits Enables access to remote data access just like local table Smart query processing including query decomposition with predicate push-down, functional compensation Supports data location agnostic development No special syntax to access heterogeneous data sources 2015 SAP SE. All rights reserved. 10
A platform for Predictive Analytics & Machine Learning Accelerate predictive analysis and scoring with in-database algorithms delivered out-of-thebox. Adapt the models frequently Execute R commands as part of overall query plan by transferring intermediate DB tables directly to R as vector-oriented data structures Predictive analytics across multiple data types and sources. (e.g.: Unstructured Text, Geospatial, Hadoop) 2015 SAP SE. All rights reserved. 11
Data visualization Analyzing all data and sharing insights to make it actionable 2015 SAP SE. All rights reserved. 12
2015 2014 SAP SAP SE. All SE rights or an reserved. SAP affiliate company. All rights reserved. 13
ebay Early Signal Detection System Powered by Predictive Analytics on SAP HANA Company ebay Headquarters San Jose, California Industry Professional Service (Internet) Services Online Marketplace Employees 31,500 (2012) Revenue or Budget US$ 14.1 billion (2012) Web Site ebay.com Business Challenges Increase ability to separate signal from noise to identify key changes to the health of ebay s marketplace Improve predictability and forecast confidence of ebay s virtual economy Increase insights into deviations and their causes Technical Challenges Detect critical signals from 100 PBs of data in ebay EDW Highly manual process because one model does not fit all the metrics hence requires analyst intervention Key benefits Automated signal detection system powered by predictive analytics on SAP HANA selects best model for metrics automatically; increases accuracy of forecasts Reliable and scalable system provides real-time insights allowing data analysts to focus on strategic tasks Decision tree logic and flexibility to adjust scenarios allows ebay to adapt best model for their data Determine with 100% Accuracy that a signal is positive at 97% confidence Automated Early Signal Detection system powered by SAP HANA 2015 SAP SE. All rights reserved. HANA is valuable in the sense that it accelerates that speed to insight. HANA, with in-memory capability, with multicore, fast, lots of data, all of that coming together is how I think analytics is going to work broadly in the future. David Schwarzbach, VP&CFO ebay North America at ebay Inc. 14
ebay Early Signal Detection System Powered by Predictive Analytics on SAP HANA Key SAP Solutions/ Features SAP HANA Enterprise + R SAP Business Objects dashboards Architecture Diagram Technical KPIs 500 metrics analyzed to identify outliers Determines 100% accuracy at 97% confidence if signal is true positive Automated Early Signal Selection System Implementation Project Duration: 6 weeks (4 POC, 2 Productize) Data Go-Live: 05/09/2013 Next Step Implementation Phase II, exploration of Signal Causation R Server Network SAP HANA Storage EDW [100 Petabytes] 2015 SAP SE. All rights reserved. 15
Niklas Packendorff @packendorff Solution Expert Analytics & Data Platform Tack!!
2015 SAP SE or an SAP affiliate company. All rights reserved. No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company. SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices. Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors. National product specifications may vary. These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty. In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE s or its affiliated companies strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forwardlooking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions. 2015 SAP SE or an SAP affiliate company. All rights reserved. 17