CBW NLS High Speed Query Access to Database and Nearline Storage

Transcription

1 CBW NLS High Speed Query Access to Database and Nearline Storage Speed up Your SAP BW Queries with Column-based Technology Dr. Klaus Zimmer, PBS Software GmbH

2 Agenda Motivation Nearline Storage in SAP BW Architecture Column-based Databases and CBW NLS Retrieval Success Seamless Access to NLS, Archive and Database Feedback from Customers Summary and Outlook 2 PBS CBW NLS Nearline Storage Solution for SAP BW

3 Challenges in Today s SAP BW Large and rapidly growing BW database Database, SAP HANA Poor retrieval performance Growing maintenance/admin overhead Increasing TCO 3 PBS CBW NLS Nearline Storage Solution for SAP BW

4 Nearline Storage Goals Reduce & control DB size and growth Speed up query response time Simplify backup, DR, maintenance Seamless query access and data flow 4 PBS CBW NLS Nearline Storage Solution for SAP BW

5 SAP BW Data Aging Strategies Data Category Online Database Near-Line Storage (read only) Classic Archive (read only) Frequently read/ changed data (current/ hot ) Infrequently read data (mature/ warm ) Very rarely read data (aged/ cold ) Quelle: SAP AG 5 PBS CBW NLS Nearline Storage Solution for SAP BW

6 CBW NLS Nearline Storage Solution for BW End user query Nearline Repository - IQ, Vectorwise - SAP NLS Nearline Storage Interface PBS CBW Nearline Services BW Database SAP HANA Classical ADK Storage SAP Archive Files PBS Indexes/Aggregates 6 PBS CBW NLS Nearline Storage Solution for SAP BW

7 Column-based Architecture Row-based Database => ideal for OLTP needs Column-based Database => ideal for OLAP needs A1 A2 A3 A4 A5 A... B1 B2 B3 B4 B5 B... B2 B5 C1 C2 C3 C4 C5 C... B3 B B1 B4 Data is stored horizontally in rows Reporting is very I/O-intensive No effective analyses / reporting Data is stored vertically in columns Intrinsic indexing Effective data access with few I/O 7 PBS CBW NLS Nearline Storage Solution for SAP BW

8 Features of CBW NLS Nearline Repositories Effective NLS data transfer very fast load process Column-based DB technology no aggregates or indexes Excellent for large data volumes Huge data compression (up to 90% and more) Very fast especially with huge data load Suitable for very large InfoCubes and systems with many queries Suitable for ad-hoc queries with nearline access Very low administration effort 8 PBS CBW NLS Nearline Storage Solution for SAP BW

9 CBW NLS System Landscape SAP BW Server PBS CBW NLS Server Nearline Repository SAP Gateway CBW NLS PBS CBW NLS Server Instance Sybase IQ Actian Vectorwise Database Instance Minimum Test Hardware 4 Core CPU 16 GB RAM* 130 GB+ HDD CBW NLS supports: Linux, Unix, others on request Sybase IQ 15.x Actian Vectorwise Minimum PROD Hardware 8 Core CPU 32 GB RAM* 130 GB+ HDD 9 PBS CBW NLS Nearline Storage Solution for SAP BW

10 Nearline Storage - Admin Efforts Standard nearline operation Monitoring and customizing directly from the SAP frontend Backup of nearline storage (Sybase IQ, Actian Vectorwise): Full, incremental, incremental since full; virtual, offline OS level Backup of CBW NLS interface (OS level backup) No index and aggregate modeling Tuning options for the nearline repository Hardware: Add CPU and main memory as needed Software: dedicated indexes for improved database operation 10 PBS CBW NLS Nearline Storage Solution for SAP BW

11 Data Transfer to Nearline Storage SAP Nearline Storage Interface: Data Archiving Process "DAP" Data transfer via SAP NLS and PBS CBW into the nearline storage Compression 90% Very fast and effective data transfer Transparent process for reload and updates Cubes DSO PSA Database HANA DAP IQ, Vectorwise Nearline Storage PBS enhancement for NLS: PSA archiving 11 PBS CBW NLS Nearline Storage Solution for SAP BW

12 SAP DAP (i) Data Archiving Process - set up and customized via the Workbench: T-RSA1 12 PBS CBW NLS Nearline Storage Solution for SAP BW

13 SAP DAP (ii) Create and maintain a data archiving request 13 PBS CBW NLS Nearline Storage Solution for SAP BW

14 Query Access Example: Query which compares data of the current year with the previous. Current year s data in the SAP BW database, data of previous year in the nearline storage, accessible via the SAP nearline interface and PBS CBW NLS: Current year (BW DB) Previous year CBW NLS 14 PBS CBW NLS Nearline Storage Solution for SAP BW

15 CBW Architecture Query access NLS and DB MultiProvider VP SAP BW 7.0: MultiProvider integration via VirtualProvider InfoCube DataStore Object SAP Nearline Provider PBS Nearline Services BW Database SAP HANA NLS Repository 15 PBS CBW NLS Nearline Storage Solution for SAP BW

16 CBW Administration Cockpit Administrator s frontend to set up and maintain the CBW infrastructure Select the InfoProvider Generate InfoProvider for MultiProvider integration. Data Browser and NLS Monitor for flexible maintenance and test options 16 PBS CBW NLS Nearline Storage Solution for SAP BW

17 Create a VirtualProvider for MP Integration The VirtualProvider is generated via a straight process directly from the CBW Administration Cockpit 17 PBS CBW NLS Nearline Storage Solution for SAP BW

18 CBW Master Data Snapshots BW Query DSP Data Snapshot Process Characteristics Key Figures DAP BW Database SAP HANA MD Attributes Hierarchies DSP NLS Repository InfoProvider <JOIN> Master Data Hierarchies 18 PBS CBW NLS Nearline Storage Solution for SAP BW

19 CBW Master Data Snapshots The setup and maintenance for PBS snapshots for master data and hierarchies is controlled via the CBW Administration Cockpit Integrate updates /synchronization for snapshots into process chains: 19 PBS CBW NLS Nearline Storage Solution for SAP BW

20 NEW: InfoCube/DSO Snapshots Replicate BW data with PBS DSP, e.g. to compare query performance Original Query Copied Query MultiProvider MultiProvider VP VP VP BW Database SAP HANA Data Snapshot Process NLS Repository 20 PBS CBW NLS Nearline Storage Solution for SAP BW

21 Customer Experience One of the first PBS CBW NLS customers reported excellent results: DAP performance storing data in the nearline repository (Sybase IQ): Transfer rate depends on data structures: 6 million records/h up to 15 million records/h Data compression in the nearline repository (IQ): Typical range: 88 % - 95 % Query response time: Few seconds (NLS with Sybase IQ) instead of minutes (online DB) 21 PBS CBW NLS Nearline Storage Solution for SAP BW

22 Customer Success Query Performance InfoCube with 17 million records Online DB with-w/o aggregates Runtime improvement for NLS retrieval using IQ x 26 DB no aggregates DB with aggregates CBW NLS IQ x s 71 s 16 s 22 PBS CBW NLS Nearline Storage Solution for SAP BW

23 Summary Flexible query access to nearline/archive data for InfoCubes and DSO Effective storage due to large data compression High data transfer rate into NLS repository Excellent retrieval speed from NLS repository Setup of nearline data and access with minimal administration efforts Very low IQ management efforts and costs Additional features: PSA archiving and data extraction (Audits) 23 PBS CBW NLS Nearline Storage Solution for SAP BW

24 Thank you for your attention! PBS Software GmbH Schwanheimer Strasse 144a Bensheim Phone: Fax: info@pbs-software.com Internet: PBS CBW NLS Nearline Storage Solution for SAP BW

25 Copyright Copyright 2013 PBS Software GmbH. All rights reserved. No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH. The information of this presentation might change without prior notice. Microsoft, Windows are registered trademarks of Microsoft Corporation. IBM, IBM DR550, IBM TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered trademark of Linus Torvalds in the USA and other countries. UNIX is a registered trademark in the USA and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera, EMC Celerra are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP, Hitachi HCP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. Sybase IQ is a registered trademark of Sybase an SAP Company. Actian Vectorwise is a registered trademark of Actian Corporation. PBS archive add ons is a registered trademark of PBS Software GmbH. SAP, R/3, SAP NetWeaver, SAP NetWeaver Business Warehouse, SAP Industry Solutions and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. PBS Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty. 25 PBS CBW NLS Nearline Storage Solution for SAP BW