Predictive Analytics Powered by SAP HANA. Cary Bourgeois Principal Solution Advisor Platform and Analytics

Transcription

1 Predictive Analytics Powered by SAP HANA Cary Bourgeois Principal Solution Advisor Platform and Analytics

2 Agenda Introduction to Predictive Analytics Key capabilities of SAP HANA for in-memory predictive analytics SAP HANA predictive analysis library (PAL) SAP HANA Application Function Modeler R Integration for SAP HANA Q & A 2013 SAP AG or an SAP affiliate company. All rights reserved. 2

3 Competitive Advantage Extend Analytics Capabilities Where You Want to Be Sense & Respond Predict & Act Optimization Raw Data Cleaned Data Standard Reports Ad Hoc Reports & OLAP Generic Predictive Analytics Predictive Modeling Why did it happen? What will happen? What is the best that could happen? What happened? Analytics Maturity The key is unlocking data to move decision making from sense & respond to predict & act 2013 SAP AG or an SAP affiliate company. All rights reserved. 3

4 Why Predictive Now? Increased Business Interest Now that BI users know what happened, they are asking why and what s likely to happen next Explosive demand from sales, marketing, and call center analyses fraud, and government intelligence/ security agencies Increased Data Value (Big Data) Exploding data volume Expanding data varieties Increasing Technology Performance Parallel processing, faster CPUs, and in-memory technologies reduce time and cost of data processing Changing landscapes and new opportunities 2013 SAP AG or an SAP affiliate company. All rights reserved. 4

5 More than Just a Database SAP HANA Platform Converges Database, Data Processing and Application Platform Capabilities & Provides Libraries for Predictive, Planning, Text Processing, Spatial, or Business Analytics Introduction for some key components: SAP HANA XS Application Server build in-memory and transactional web apps directly in the SAP HANA appliance, which searches text indexes on big data, does high-volume analytics and transactions. SAP HANA Predictive Analytics Library builtin library in SAP HANA to run predictive analytics, such as regression or correlation analysis. SAP HANA Text Processing built-in capabilities to identify the language, apply appropriate linguistic rules for the particular language, and then interpret or search the data semantically SAP AG or an SAP affiliate company. All rights reserved. 5

6 SAP HANA In-Memory Predictive Analytics Combine the depth and power of in-memory analytics within SAP HANA with the breadth of R to support a variety of advanced analytic and predictive scenarios Predictive Analysis Library (PAL) Native predictive algorithms In-database processing for powerful and fast results Quicker implementations Support for clustering, classification, association, time series, etc. R Integration for SAP HANA Enables the use of the R open source environment (> 3,500 packages) in the context of the HANA in-memory database R integration enabled via high-performing, parallelized connection R script is embedded within SAP HANA SQL Script 2013 SAP AG or an SAP affiliate company. All rights reserved. 6

7 SAP HANA Predictive Ecosystem SAP Predictive Analysis SAP and Custom Applications Business Intelligence Clients SAP HANA Platform SAP HANA Studio Predictive Analysis Library (PAL) R Integration for SAP HANA Data Pre-Processing and Loading SAP Data Services, Information Composer, SLT, DXC, Hadoop 2013 SAP AG or an SAP affiliate company. All rights reserved. 7

8 SAP HANA Application Function Library (AFL) AFL Technology includes Application Functions Written in C++ and delivered as AFL content by SAP Predictive Analysis and Business Function Library have been released in SPS05 as AFL content AFL Framework On demand library loading framework for registered and supported libraries AFL are consumed for use from SQL Script via socalled wrapper-procedures Consumption can be controlled via permissions Beyond the initial script-based approach, the Application Function Modeler provides a graphical editor to facilitate the design-time process of creating the wrapperprocedures and can easily be re-used as part of development workflow SAP HANA Parameter Table Application Functions (C++) Predictive Analysis Library SAP HANA Clients SQLScript AFL Framework Business Function Library 2013 SAP AG or an SAP affiliate company. All rights reserved. 8

9 SAP HANA In-Memory Predictive Analytics Predictive Analysis Library (PAL) Algorithms Supported Association Analysis Apriori & Apriori Lite Cluster Analysis K-Means Kohonen Self-Organized Maps DBSCAN * ABC Classification Classification Analysis C4.5 Decision Tree Analysis CHAID Decision Tree Analysis K-Nearest Neighbor Multiple Linear Regression Polynomial Regression Exponential Regression Bi-Variate Geometric Regression Bi-Variate Logarithmic Regression Logistic Regression Naïve Bayes * Time Series Analysis Single, Double, & Triple Exponential Smoothing Outlier Detection Inter-Quartile Range Test (Tukey s Test) Variance Test Anomaly Detection Data Preparation Sampling, Binning, & Scaling Convert Categorical to Binary Link Prediction * Common Neighbours; Jaccard s Coefficient; Adamic/Adar; Katz β Other Weighted Scores Table * New in SPS SAP AG or an SAP affiliate company. All rights reserved. 9

10 SAP HANA Predictive Analysis Library (PAL) Reference SAP AG or an SAP affiliate company. All rights reserved. 10

11 SAP HANA Application Function Modeler New for SAP HANA SP6 Graphical editor to facilitate a faster and easier design-time process of creating the wrapper-procedures AFL models stored as repository objects and easily re-used as part of development workflow Model Editor Drag n drop of functions Template for table types Data source selection and automatic mappings to table types Function List and Search Sample SQL for procedure consumption Library Selection Parameters and specifications for table types 2013 SAP AG or an SAP affiliate company. All rights reserved. 11

12 R Integration for SAP HANA What Is R? R is a software environment for statistical computing and graphics Open Source statistical programming language Over 3,500 add-on packages; ability to write your own functions Widely used for a variety of statistical methods More algorithms and packages than SAS + SPSS + Statistica Who s using it? Growing number of data analysts in industry, government, consulting, and academia Cross-industry use: high-tech, retail, manufacturing, CPG, financial services, banking, telecom, etc. Why do they use it? Free, comprehensive, and many learn it at college/university Offers rich library of statistical and graphical packages 2013 SAP AG or an SAP affiliate company. All rights reserved. 12

13 R Integration for SAP HANA Functionality Overview Embedding R scripts within the SAP HANA database execution Enhancements are made to the SAP HANA database to allow R code (RLANG) to be processed as part of the overall query execution plan This scenario is suitable when the modeling and consumption environment sits on SAP HANA and the R environment is used for specific analytic functions Sample Code in SAP HANA SQLScript DROP TABLE "spamclassified"; CREATE COLUMN TABLE "spamclassified" LIKE "spameval" WITH NO DATA; ALTER TABLE "spamclassified" ADD ("classified" VARCHAR(5000)); DROP PROCEDURE USE_SVM; CREATE PROCEDURE USE_SVM( IN train "spamtraining", IN eval "spameval", OUT result "spamclassified") Send data and R script 1 3 Get back the result from R to SAP HANA 2 Run the R scripts LANGUAGE RLANG AS BEGIN library(kernlab) model <- ksvm(type~., data=train, kernel=rbfdot(sigma=0.1)) classified <- predict(model, eval [,- (which(names(eval) %in% "type"))]) result <- as.data.frame(cbind(eval, classified)) END; CALL USE_SVM("spamTraining", "spameval", "spamclassified") WITH OVERVIEW; 2013 SAP AG or an SAP affiliate company. All rights reserved. 13

14 R Integration for SAP HANA System Landscape and Requirements Software Requirements: SAP HANA 1.0 SPS4 or later R version 2.13 or later ( R Integration Requirements: SAP does not ship, maintain, or provide training and/or support for the R environment R is an open source project under the GPL license and needs to be downloaded, installed, and configured by the customer The R Integration is currently only supported on SLES 11 SP1 operating system R (and the Rserve 0.6-5) must be installed on a different host machine from the SAP HANA software Recommended to have a 10 GB dedicated link between the R server and HANA server 2013 SAP AG or an SAP affiliate company. All rights reserved. 14

15 SAP HANA R Integration Guide SAP AG or an SAP affiliate company. All rights reserved. 15

16 SAP AG or an SAP affiliate company. All rights reserved. 16

17 SAP Predictive Analytics Desktop Tool / Demo Desktop Tool For Analysis, Data Modeling, and Collaboration Drag and Drop interface to intuitively design and visualize complex predictive models. Native predictive algorithms. Works with multiple data sources on and offline. Offline analysis capabilities. Integrates with HANA for deep analysis on large and complex data sets. Leverages existing and custom built PAL libraries, R integrations, and procedures. Push results data to HANA or other RDBMS s. Publish models for re-use and in portable PMML format for use with other tools. Integrates with R on the desktop. Share Analysis with others / integrated with Lumira SAP AG or an SAP affiliate company. All rights reserved. 17