Near-line Storage with CBW NLS

Transcription

1 Near-line Storage with CBW NLS High Speed Query Access for Nearline Data Ideal Enhancement Supporting SAP BW on HANA Dr. Klaus Zimmer, PBS Software GmbH

2 Agenda Motivation Why would you need Nearline Storage in SAP BW Architecture CBW NLS and its Integration into SAP BW Retrieval Success Online Demo: Seamless Query Access with NLS Feedback from Customers Summary and Discussion 2 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

3 Challenges in Today s SAP BW Large and rapidly growing BW database Poor retrieval performance Database, SAP HANA Growing maintenance/admin overhead Preparing a classical SAP BW for HANA Increasing TCO 3 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

4 Nearline Storage Goals Reduce & control DB size and growth Speed up query response time Simplify backup, DR, maintenance Seamless query access and data flow Improve migration to SAP BW on HANA 4 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

5 SAP BW Data Aging Strategies Data Category Online Database Near-Line Storage (read only) Classic Archive (read only) Frequently read/ changed data (current/ hot ) Infrequently read data (mature/ warm ) Very rarely read data (aged/ cold ) Quelle: SAP AG 5 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

6 CBW NLS Nearline Storage Solution for BW End user query Nearline Repository - IQ/Vectorwise - SAP NLS Nearline Storage Interface PBS CBW Nearline Services BW Database SAP HANA Classical ADK Storage SAP Archive Files PBS Indexes/Aggregates 6 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

7 Column-based Architecture Row-oriented Database => ideal for OLTP needs Column-oriented Database => ideal for OLAP needs A1 A2 A3 A4 A5 A... B1 B2 B3 B4 B5 B... B2 B5 C1 C2 C3 C4 C5 C... B3 B B1 B4 Data is stored horizontally in rows Reporting is very I/O-intensive No effective analyses / reporting Data is stored vertically in columns Intrinsic indexing Effective data access with few I/O 7 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

8 Features of CBW NLS Nearline Repositories Effective NLS data transfer very fast load process Column-based DB technology no aggregates or indexes Excellent for large data volumes Huge data compression (up to 90% and more) Very fast especially with huge data load Suitable for very large InfoCubes and systems with many queries Suitable for ad-hoc queries with nearline access Very low administration effort 8 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

9 CBW NLS System Landscape SAP BW Server PBS CBW NLS Server Nearline Repository SAP Gateway CBW NLS PBS CBW NLS Server Instance Sybase IQ Actian Vectorwise Database Instance Minimum Test Hardware 4 Core CPU 16 GB RAM* 130 GB+ HDD CBW NLS supports: Linux, Unix, others on request Sybase IQ 15.x Actian Vectorwise Minimum PROD Hardware 8 Core CPU 32 GB RAM* 130 GB+ HDD 9 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

10 Nearline Storage - Admin Efforts Standard nearline operation Monitoring and customizing directly from the SAP frontend Backup of nearline storage (Sybase IQ, Actian Vectorwise): Full, incremental, incremental since full; virtual, offline OS level Backup of CBW NLS interface (OS level backup) No index and aggregate modeling Tuning options for the nearline repository Hardware: Add CPU and main memory as needed Software: dedicated indexes for improved database operation 10 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

11 Data Transfer to Nearline Storage SAP Nearline Storage Interface: Data Archiving Process "DAP" Data transfer via SAP NLS and PBS CBW into the nearline storage Compression 90% Very fast and effective data transfer Transparent process for reload and updates Cubes DSO PSA Database HANA DAP IQ, Vectorwise Nearline Storage PBS enhancement for NLS: PSA archiving 11 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

12 CBW NLS IQ - Overview Online Demo 12 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

13 CBW Query Access with HANA and NLS NLS data HANA data HANA NLS via PBS CBW 13 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

14 CBW Architecture BW Query NLS and DB InfoProvider Cube - DSO SAP Nearline Provider PBS Nearline Services NLS Repository BW Database SAP HANA NLS enabled BW query with seamless access to SAP database and NLS repository 14 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

15 CBW Master Data Snapshots BW Query DSP Data Snapshot Process Characteristics Key Figures DAP BW Database SAP HANA MD Attributes Hierarchies DSP NLS Repository InfoProvider <JOIN> Master Data Hierarchies 15 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

16 Customer Experience One of the first PBS CBW NLS IQ customers reported excellent results: DAP performance storing data in the nearline repository (Sybase IQ): Transfer rate depends on data structures: 6 million records/h up to 30 million records/h Data compression in the nearline repository (Sybase IQ): Typical range: 88 % - 95 % Query response time: Few seconds (NLS repository) 16 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

17 Summary CBW NLS Flexible query access to nearline/archive data for InfoCubes and DSO Effective storage due to large data compression High data transfer rate into NLS repsitory Excellent retrieval performance from NLS repository Setup of nearline data and access with minimal administration efforts Very low NLS management efforts and costs Ideal enhancement for SAP BW on HANA Additional features: PSA archiving and data extraction (Audits) 17 PBS CBW NLS IQ Nearline Storage Solution for SAP BW

18 Thank you for your attention! PBS Software GmbH Schwanheimer Strasse 144a Bensheim Phone: Fax: [email protected] Internet: PBS CBW NLS IQ Nearline Storage Solution for SAP BW

19 Copyright Copyright 2013 PBS Software GmbH. All rights reserved. No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH. The information of this presentation might change without prior notice. Microsoft, Windows are registered trademarks of Microsoft Corporation. IBM, IBM DR550, IBM TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered trademark of Linus Torvalds in the USA and other countries. UNIX is a registered trademark in the USA and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera, EMC Celerra are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP, Hitachi HCP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. Sybase IQ is a registered trademark of Sybase an SAP Company. Actian Vectorwise is a registered trademark of Actian Corporation. PBS archive add ons is a registered trademark of PBS Software GmbH. SAP, R/3, SAP NetWeaver, SAP NetWeaver Business Warehouse, SAP Industry Solutions and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. PBS Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty. 19 PBS CBW NLS IQ Nearline Storage Solution for SAP BW