CBW NLS IQ High Speed Query Access to Database and Nearline Storage

Transcription

1 CBW NLS IQ High Speed Query Access to Database and Nearline Storage Speed up Your SAP BW Queries with Column-based Technology Dr. Klaus Zimmer, PBS Software GmbH, 2012

2 Agenda Motivation Nearline Storage in SAP BW Architecture Column-based IQ and CBW NLS Retrieval Success Seamless Access to NLS, Archive and Database Feedback from Customers Summary and Outlook 2 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

3 Challenges in Today s SAP BW SAP BW Rapidly growing BW database Poor retrieval performance Growing maintenance/admin overhead Database, SAP HANA Increasing TCO 3 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

4 Nearline Storage Goals Reduce & control DB size and growth Speed up query response time Simplify backup, DR, maintenance Seamless query access and data flow 4 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

5 CBW NLS Nearline Storage Solution for BW End user query Nearline Repository - IQ - SAP NLS Nearline Storage Interface PBS CBW Nearline Services BW Database SAP HANA Classical ADK Storage SAP Archive Files PBS Indexes/Aggregates 5 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

6 Column-based Architecture Classical row-based Database Column-based Database A1 A2 A3 A4 A5 A... B1 B2 B3 B4 B5 B... B2 B5 C1 C2 C3 C4 C5 C... B3 B B1 B4 Data is stored horizontally in rows Reporting is very I/O-intensive No effective analyses / reporting Data is stored vertically in columns Intrinsic indexing Effective data access with few I/O 6 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

7 Features of the CBW Nearline Repository IQ Effective NLS data transfer very fast load process into IQ Column-based DB technology no aggregates or indexes Excellent for large data volumes Huge data compression (up to 90% and more) Very fast especially with huge data load Suitable for very large InfoCubes and systems with many queries Suitable for ad-hoc queries with nearline access Very low administration effort 7 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

8 CBW NLS IQ System Landscape SAP BW Server PBS CBW NLS Server Nearline Repository SAP Gateway CBW NLS IQ PBS CBW NLS IQ Server Instance Sybase IQ Database Instance CBW is perfectly integrated into the SAP nearline storage interface NLS in the SAP BW system CBW interface components control the communication between the SAP system and the CBW NLS nearline repository Sybase IQ. 8 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

9 Platforms and Hardware Requirements Supported platforms and operating systems Supported Sybase IQ version from 15.x IBM-AIX, HP-UX, Linux, Sun Solaris, Microsoft Windows Server Minimum Test Hardware 4 Core CPU 16 GB RAM* 130 GB+ HDD Minimum Prod. Hardware 8 Core CPU 32 GB RAM* 130 GB+ HDD * exclusively reserved for Sybase IQ usage 9 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

10 IQ Admin Efforts Standard nearline operation Monitoring and customizing directly from the SAP frontend Backup of nearline storage (Sybase IQ): Full, incremental, incremental since full; virtual, offline OS level Backup of CBW IQ interface (OS level backup) No index and aggregate modeling Tuning options for the nearline repository Hardware: Add CPU and main memory as needed Software: dedicated indexes for improved IQ operation 10 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

11 Data Transfer to Nearline Storage SAP Nearline Storage Interface: Data Archiving Process "DAP" Cubes DSO PSA BW Database DAP IQ Nearline Storage NLS using IQ Compression 90% Fast data transfer Dedicated PBS PSA Archiving 11 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

12 SAP DAP (i) Data Archiving Process - set up and customized via the Workbench: T-RSA1 12 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

13 SAP DAP (ii) Create and maintain a data archiving request 13 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

14 Query Access Example: Query which compares data of the current year with the previous. Current year s data in the SAP BW database, data of previous year in nearline storage (IQ), accessible via the SAP nearline interface and PBS CBW NLS: Current year (BW DB) Previous year CBW NLS IQ Set NLS flag to enable query access to archive/nearline data 14 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

15 CBW Architecture Query access NLS and DB MultiProvider VP MultiProvider integration via VirtualProvider InfoCube DataStore Object SAP Nearline Provider PBS Nearline Services BW Database SAP HANA NLS Repository IQ 15 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

16 CBW Administration Cockpit Administrator s frontend to set up and maintain the CBW infrastructure Select the InfoProvider Generate InfoProvider for MultiProvider integration. Data Browser and NLS Monitor for flexible maintenance and test options 16 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

17 Create a VirtualProvider for MP Integration The VirtualProvider is generated via a straight process directly from the CBW Administration Cockpit 17 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

18 CBW Master Data Snapshots BW Query DSP Data Snapshot Process Characteristics Key Figures DAP BW Database SAP HANA MD Attributes Hierarchies DSP NLS Repository IQ InfoProvider <JOIN> Master Data Hierarchies 18 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

19 CBW Master Data Snapshots The setup and maintenance for PBS snapshots for master data and hierarchies is controlled via the CBW Administration Cockpit Integrate updates /synchronization for snapshots into process chains: 19 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

20 NEW: InfoCube/DSO Snapshots Replicate BW data with PBS DSP, e.g. to compare query performance Original Query Copied Query MultiProvider MultiProvider VP VP VP BW Database SAP HANA Data Snapshot Process NLS Repository IQ 20 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

21 Customer Experience One of the first PBS CBW NLS IQ customers reported excellent results: DAP performance storing data in the nearline repository (IQ): Transfer rate depends on data structures: 6 million records/h up to 15 million records/h Data compression in the nearline repository (IQ): Typical range: 88 % - 95 % Query response time: Few seconds (NLS IQ) instead of minutes (online DB) 21 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

22 Customer Success Query Performance InfoCube with 17 million records Online DB with-w/o aggregates Runtime improvement for NLS retrieval using IQ x 26 DB no aggregates DB with aggregates CBW NLS IQ x s 71 s 16 s 22 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

23 Summary Flexible query access to nearline/archive data for InfoCubes and DSO Effective storage due to large data compression Setup of nearline data and access with minimal administration efforts Integration of IQ technology into SAP BW Very low IQ management efforts and costs Additional features: PSA archiving and data extraction (Audits) 23 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

24 Thank you for your attention! PBS Software GmbH Schwanheimer Strasse 144a Bensheim Phone: Fax: info@pbs-software.com Internet: PBS CBW NLS IQ Nearline Storage Solution for SAP BW

25 Copyright Copyright 2012 PBS Software GmbH. All rights reserved. No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH. The information of this presentation might change without prior notice. Microsoft, Windows are registered trademarks of Microsoft Corporation. IBM, IBM DR550, IBM TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered trademark of Linus Torvalds in the USA and other countries. UNIX is a registered trademark in the USA and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera, EMC Celerra are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP, Hitachi HCP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. Sybase IQ is a registered trademark of Sybase an SAP Company PBS archive add ons is a registered trademark of PBS Software GmbH. SAP, R/3, SAP NetWeaver, SAP NetWeaver Business Warehouse, SAP Industry Solutions and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. PBS Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty. 25 PBS CBW NLS IQ Nearline Storage Solution for SAP BW