SAP BW: The Real-time Data Application Platform How SAP BW uses the SAP database options Roland Kramer - Product and Strategy - PM EDW/In-Memory July 2014
Disclaimer This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent. 2013 SAP AG or an SAP affiliate company. All rights reserved. 2
Multi Temperature Data Management for BW on HANA 2013 SAP AG or an SAP affiliate company. All rights reserved. 3
Process Orchestration Process Orchestration SAP BW on HANA - Smarter, simpler, more efficient How Does BW running on RDBMS differ from BW running on HANA? Customer value of SAP BW powered by SAP HANA SAP NetWeaver BW Data Modeling Planning OLAP Data Management SAP BW on HANA Data Modeling Planning OLAP Data Management Excellent query performance for improved decision making Performance boost for Data Load processes for decreased data latency Accelerated In-Memory planning capabilities for faster planning scenarios Flexible combine EDW with HANA-native data for real-time insights and decision making Data persistency layers are cut off and reduced administration efforts Simplified data modeling and remodeling RDBMS Data Schema & Data Push Down Data intensive functions are pushed down from BW to HANA HANA as the Primary Database for BW and Foundation for new Applications Traditional Stack HANA Stack 2013 SAP AG or an SAP affiliate company. All rights reserved. 4
SAP BW - Overview Available with SAP BW 7.4, SP5 (Q4/2013) on HANA HANA tables, views HANA Schema BW Queries, ODATA, MDX, SQL BW Virtualization Layer Open Operational DataStore Layer External Sources Transformations Architected Datamart Layer Transformations EDW Core Layer DataStore Objects BW Schema Agile Datamarts BW Workspaces Enhanced Data Modeling Common Eclipse based Modeling Tools BW/HANA Smart Data Access providing the logical EDW Easy integration of external data models with Open ODS Layer Further reduce data layers in BW via Operational Data Provisioning Push down further processing logic to HANA BW Analytic Manager HANA Analysis Processes BW Transformations PAK Pushing down more planning semantics 2013 SAP AG or an SAP affiliate company. All rights reserved. 5
Database Application Server SAP HANA optimized Transformations Available with SAP BW 7.4, SP5 (Q4/2013) on HANA BW 7.3x on anydb BW 7.3x on HANA BW 7.4 on HANA Next level of performance in data staging for BW on HANA DSO Activation Transformation DSO Transformation DSO Standard Transformations are gradually optimized to be processed directly in SAP HANA by generating according DB procedure First set of Transformations optimized i.e.: Mappings Conversions (time, currency, units) Activation Activation Formulas Read Master Data, Read from DSO Data Data Transformation Data Expert routine for HANA SQL script... Sources: PSA, DSOs, InfoCubes, SPOs, CompositeProvider, MultiProvider Targets: DSO 2013 SAP AG or an SAP affiliate company. All rights reserved. 6
SAP BW Planning (aka BPC) Available with SAP BW 7.4, SP8 (Q3/2014) on HANA BW-IP EDW-integration Built-in functions Combine the best of three worlds to a unique planning solution (HANA, BPC, BW-IP) BPC NW user experience collaboration data flexibility HANA Unprecedented speed Combines the successful EPM Excel add-in flexible BPC admin-ui powerful BW-IP / PAK planning manager super-fast HANA planning engine BPC NW unified (10.1) Selected features Full PAK-model compatibility Business process flows (BPF) Work-status Data auditing Easy upload scenario LOB authorizations 2013 SAP AG or an SAP affiliate company. All rights reserved. 7
CompositeProvider Available with SAP BW 7.4, SP6 (Q1/2014) on HANA Other SAP HANA Schema CompositeProvider Combine the data of various applications Model Table Operational or Real-time Datamart SAP and non SAP Applications SQL MDX BICS ODATA View Classical Datawarehouse Schema SAP BW Schema BW Workspace Prototyping involving Business User Easier data modeling and reduction of InfoProvider types by enhancing the CompositeProvider Supports Consolidation of existing CompositeProvider, MultiProvider, TransientProvider on HANA Models, VirtualProvider on HANA Models and InfoSet into CompositeProvider Use CompositeProvider as single BW metadata object to combine data from other HANA based applications on the same instance of HANA (consumption of native HANA models or tables) with data in BW Faster Implementations More flexibility Unions and Joins Easier consumption of data HANA optimized query runtimes Modern Eclipse based UI Option to include Inventory key figures Possibility to include in planning scenarios External Database Hadoop ERP BW 2013 SAP AG or an SAP affiliate company. All rights reserved. 8
Automatic generation of HANA models Available with SAP BW 7.4, SP5 (Q4/2013) on HANA Enhanced Metadata interoperability between BW and HANA HANA Model generation Triggered from BW InfoProvider / CompositeProvider push Complements BW model import from HANA Modeler Analysis Authorization: Automatic sync between HANA and BW Object changes include HANA model impact analysis Enhanced HANA View Direct consumption of BW data via generated HANA views SAP Lumira, BO Explorer, SQL CompositeProvider generates HANA View HANA View Scenario Major footprint of scenario in BW Info Provider Master Data HANA View Usage of generated view in HANA Studio to build own data models using BW data and HANA native algorithms BW Schema HANA Schema 2013 SAP AG or an SAP affiliate company. All rights reserved. 9
SAP HANA Smart Data Access data virtualization for on-premise and hybrid cloud environments, SAP BW 7.4, SP5 (Q4/2013) on HANA Query Enhanced Business Flexibility by providing the logical EDW BW Virtualization Layer Composite Provider, Open ODS View HANA Tables Virtual Tables HANA Smart Data Access Layer Oracle Hadoop MSSQL SAP HANA IQ/ASE Data Federation in diverse EDW landscapes Smart data access read access to relational and non-relational sources via ODBC Enables access to remote data access just like local table Supports data location agnostic development No special syntax to access heterogeneous data sources BW based Analytic Services on external data Scenario Make other DWHs transparent to HANA Non-disruptive evolution from virtual table to persistent structure by establishing ETL without major effort Consolidating / rationalizing the DWH landscape Consumption of HANA datamart scenarios from second HANA database 2013 SAP AG or an SAP affiliate company. All rights reserved. 10
Extended storage in SAP BW on HANA (with SAP IQ) Available with SAP BW 7.4, SP8 (Q3/2014) on HANA BW Staging Area DataSource DataSource Corporate Memory wo-dso wo-dso DataSources and writeoptimized DSOs can have the property Extended Table HANA Write and read operations are re-directed to IQ IQ PSA Table IQ Table Corporate Memory Table IQ Table RTDP All BW standard operations are supported no changes Only minor temporary RAM required in HANA to support extended tables 2013 SAP AG or an SAP affiliate company. All rights reserved. 11
Synergy PBS CBW Add-On and SAP-NLS Implementation Available with SAP BW 7.4, SP5 (Q4/2013) and SP08 *(Q3/2014) on HANA SAP-NLS Release capabilities Detailed e2e Monitoring Detailed Query Analysis Fast Copy/Snapshot option Utilities for Planning NLS Projects Add. Enhancement PSA DAP PBS CBW NLS Add-On Inventory Cubes Smart Data Access, ET* SAP-NLS Reporting Layer (MultiProvider) SAP-NLS for InfoCubes, DSOs and non Reporting Layer (Corp. Memory) 7.40 7.3x 7.0x Nearline Adapter (ABAP and Unicode based) DBSL for Sybase ASE/IQ Kernel based; Open SQL + Native IQ SQL via ADBC) ODBC Driver from IQ BW Porting General Porting DB Client from 7.0x onwards Kernel 7.2x 2013 SAP AG or an SAP affiliate company. All rights reserved. 12
HANA Smart Data Access for BW NLS with SAP IQ Available with SAP BW 7.4, SP8 (Q3/2014) on HANA BW Analytic Query Query Access to NLS part of InfoProvider can leverage SDA (if NLS uses SAP Sybase IQ for NLS) HANA API NLS-Split SQL Optimized Query execution plan (Semi-JOIN), Filter push-down, Significantly better Query performance for many NLS queries Facts (online) Master data VIRTUAL_TABLE especially Queries using Hierarchies or Nav. Attributes can run 100 times faster SAP IQ Articles Categories Facts (nearline) Example from Retail: Aggregation of articles in categories as Nav. Attributes 2013 SAP AG or an SAP affiliate company. All rights reserved. 13
HANA Smart Data Access for BW NLS with SAP IQ Available with SAP BW 7.4, SP8 (Q3/2014) on HANA BW Analytic Query NLS-Split VirtualTable can be used in HANA CalcView Initial version w/ HANA SP07 Full plan optimizations w/ HANA SP08 HANA API API CalcScenario BW Query execution can push OLAP calculations to HANA (Restricted KeyFigures, Hierarchies, ) Facts (online) Master data VIRTUAL_TABLE Further improvement of NLS Query performance due to optimized access Facts (nearline) SAP IQ 2013 SAP AG or an SAP affiliate company. All rights reserved. 14
BW NLS data for External HANA Views Available with SAP BW 7.4, SP8 (Q3/2014) on HANA HANA Facts (online) BI Client (native SQL) Generated HANA View for BW InfoProvider optional Master data CalcScenario VIRTUAL_TABLE Generated HANA Views for InfoProvider (new with BW7.4 SP05) HANA Views can (optionally) include NLS part as UNION between online and nearline facts NLS part is available for external consumption, e.g. 3 rd Party Frontend s NLS part is always accessed SAP IQ Facts (nearline) 2013 SAP AG or an SAP affiliate company. All rights reserved. 15
SAP IQ is the preferred solution for warm and cold data archiving capabilities for SAP BW, Business Suite, and HANA NLS (Near Line Store) for SAP BW Optimized NLS data transfer throughput using IQ Loader functionality SAP HANA and IQ share the same columnar paradigm, and similar data compression rates Ready for large data volumes Suitable for ad-hoc queries with long history Minimum administration effort ILM for SAP Business Suite Fast archive index read w/o additional secondary DB indexes Increased search capabilities Faster archive I/O fewer layers (software, network, storage hardware) ERP archive files as well as archive indexes stored in SAP IQ Warm archive for HANA using smart data access (SDA) Using SDA, HANA customers can access IQ as a federated store Store warm data in IQ, and real time data in HANA Push query processing down to IQ 2013 SAP AG or an SAP affiliate company. All rights reserved. 16
Common Modeling Sybase Power Designer MPP Scale-Out HADOOP NoSQL Common Landscape Management SAP Real-time Data Platform optimized for all big data applications 3 rd Party BI Clients SAP Business Suite SAP BW SAP Big Data Applications SAP Analytics SAP Mobile Custom Apps SAP NetWeaver (On Premise/Cloud) SAP Real-time Data Platform Open Developer API s and Protocols SAP Sybase ASE SAP Sybase SQLA SAP HANA Platform SAP Sybase IQ SAP Sybase ESP SAP Sybase Replication Server SAP Data Services SAP MDG, MDM, DQ Enterprise Information Management 2013 SAP AG or an SAP affiliate company. All rights reserved. 17
How to get there Post Copy Automation for BW (BW-PCA) Upgrade/Migration Procedure database migration option (DMO) as part of software update manager (SUM)
Three things to know - Migration BW on HANA Blog: Three things to know when migrating NetWeaver BW on HANA BW 7.31 7.40* * DMO 1.0 SP10 and BW 7.40 SP06 available since Q1/2014 DMO HANA DB upgrade/migration/unicode* in one technical step BW Housekeeping tasks smaller ROW store footprint in HANA BW 7.0x any DB Sybase IQ Near-Line Storage (NLS) smaller COLUMN store footprint in HANA 2013 SAP AG or an SAP affiliate company. All rights reserved. 19
SAP BW powered by HANA and Sybase IQ Near-Line Storage (NLS) Architecture - Overview MultiProvider SAP HANA BI Clients SAP Netweaver BW 7.3x Transient Provider Partner OEM InfoCube/DSO Near-Line SDK Sybase IQ BW NLS4IQ SAP Native SAP owned alternative to existing NLS-Partner Solutions An SAP - owned BW NLS implementation for Sybase IQ offers a fully integrated solution from one provider Main aspects: Deliver an ABAP-based implementation of the BW NLS interfaces Deliver a Sybase IQ DBSL light that covers all the needs of the abovementioned NLS implementation Sybase IQ to deliver reliable, highperformance execution of the DBSL driven loads and queries Availability since Q2/2013 2013 SAP AG or an SAP affiliate company. All rights reserved. 20
Time Database migration option (DMO) in the SUM Framework one-step upgrade and migration with DMO - phases during the procedure Traditional DB SAP System 1 Upgrade Prepare 2 Execute Upgrade (until downtime phase) Switch 3 database connection Setup SAP HANA specifics (client, schema ) Uptime Note Traditional database continues to run 4 Migrate application data (incl. UC data conversion) 5 Finalize upgrade 6 Start SAP HANA-based system Downtime 2013 SAP AG or an SAP affiliate company. All rights reserved. 21
Conclusion: SAP BW? - three things to know... 1 Three Things to now when migration BW on HANA Blog: Three Things to Know when Migrating SAP NetWeaver BW on SAP HANA 2 The Upgrade from 7.0x to 7.4 is possible directly/one step including SEM Blog: Good News - Easier Modeling of the SEM Add-On in Solution Manager 3 The NetWeaver BW 7.40 Released (on HANA) Our Customers know the (Business) Value - https://scn.sap.com/docs/doc-48044 2013 SAP AG or an SAP affiliate company. All rights reserved. 22
Thank you Absolvent 1997 - Fachrichtung WI Roland Kramer Product and Strategy - PM EDW/In-Memory SAP SE Dietmar-Hopp-Allee 16 DE-69190 Walldorf Germany t +49 62277 64403 m +49 151 4260 3219 @ roland.kramer@sap.com BW ALM Page: http://scn.sap.com/docs/doc-7856 I BW on HANA first guidance Join me online: Xing I Linkedln I SAP Connect I ondemand Twitter 2013 SAP AG or an SAP affiliate company. All rights reserved.