CBW NLS ADK-based Nearline Storage Solution

Transcription

1 CBW NLS ADK-based Nearline Storage Solution Keep Seamless BW Query Access to Database and Archived Data Dr. Klaus Zimmer, PBS Software GmbH

2 Agenda Motivation Nearline Storage in SAP BW Architecture ADK-based Nearline Storage with CBW Retrieval Success Seamless Access to Archive and Database Feedback from Customers Summary 2 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

3 Challenges in Today s SAP BW SAP BW Large and rapidly growing BW database Poor retrieval performance Growing maintenance/admin overhead Database Increasing TCO 3 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

4 Nearline Storage Goals Reduce & control DB size and growth Speed up BW performance Simplify backup, DR, maintenance Seamless query access and data flow 4 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

5 CBW NLS Nearline Storage Solution for BW End user query SAP NLS Nearline Storage Interface PBS CBW Nearline Services SAP BW Database Classical ADK Storage SAP Archive Files PBS Indexes/Aggregates 5 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

6 Data Transfer to Nearline Storage (Archive) SAP Nearline Storage Interface: Data Archiving Process "DAP" Cubes DSO PSA DAP ADK ADK ADK SAP Archive Files NLS ADK (PBS enhanced) Data transfer to flat files (SAP ADK format) Compression 80% BW Database NLS high level statistics NLS Admin Data PSA Archiving by CBW Transfer to flat files (ADK) Compression 90% Easy reload/staging 6 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

7 SAP DAP (i) Data Archiving Process - set up and customized via the Workbench: T-RSA1 7 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

8 SAP DAP (ii) Create and maintain a data archiving request 8 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

9 CBW Architecture Query access NLS and DB MultiProvider VP SAP BW 7.0: MultiProvider integration via VirtualProvider InfoCube DataStore Object SAP Nearline Provider PBS Nearline Services SAP BW Database ADK PBS Aggregate PBS Index SAP Archive 9 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

10 Query Access Example: Query which compares data of the current year with the previous. Current year s data in the SAP BW database, data of previous year in archive files (ADK), accessible via CBW NLS. Current year (BW DB) Previous year CBW NLS Set NLS flag to enable query access to archive/nearline data 10 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

11 CBW Administration Cockpit Administrator s frontend to set up and maintain the CBW infrastructure Select InfoProvider Manage aggregates and indexes InfoProvider for MP integration Generate and manage index data Additional tools 11 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

12 Criteria for Effective Aggregates and Indexes Goal: Achieving high performance query access to archive/nearline data Aggregates for archive data Achieve short query response time Important for large archive data stock Suitable for query access with high aggreation Small footprint (Flat files with up to 10 % of the archive stock) Indexes Single access to archive data (drill-down from aggregate query) Footprint depends on total index volume/structures 12 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

13 CBW Aggregate Modeling Subsets of archived InfoCubes or DataStore objects (DSO) Flat table structure (similar to index and archive) Modeling from SAP template or query analysis Compressed storage in flat files (ADK format) ADK ADK Archive Characteristics Key Figures Controlling Area Cost Center Vendor Amount Quantity Major Characteristic Add. Characteristic Key Figures Aggregates Controlling Area Cost Center Amount Quantity Cost Center Controlling Area Amount Quantity A1.1 A1.2 Vendor Amount Quantity A2 13 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

14 Archive Access with Aggregates Archive Aggregate A1.1 Controlling area Cost center Amount North Warehouse North Production North Production South Warehouse Query selection via aggregate: few I/O fast retrieval response no OLAP calculation Archive data w/o aggregates Controlling area Cost center Vendor Amount North Warehouse Bak Retail North Warehouse Schmiel North Warehouse Wilms AG North Production Phoenix North Production Fremont North Production Colinas North Production Destec GmbH North Production esupplier South Warehouse Bak Retail South Warehouse Wilms AG Query Result Controlling area Cost center Amount North Warehouse Query selection w/o aggregate: OLAP calculation more I/O slow retrieval response North Production PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

15 CBW Aggregate Modeling CBW modeling frontend similar to SAP screen Propose archive aggregates from query analysis 15 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

16 Archive Aggregate Performance Careful query analysis is decisive for effective aggregates Aggregation 10 compared to archive data Reconciliation to the most frequently used queries Suitable for many queries regular usage Achieve favourable retrieval response times Example: InfoCube with 100 million entries Target: Response time less than one minute Required: Aggregation 100 (smaller than 1 mill. entries) For queries with few selection restrictions 16 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

17 CBW Index Modeling Generic indexing for InfoCubes and DataStore objects (DSO) Any characteristic can be indexed Additional attributes (characteristics, key figures) Suitable for drilldown from aggregate queries ADK ADK Archive Characteristics Key Figures Controlling Area Cost Center Vendor Amount Quantity Index Key Index Attributes Cost Center Vendor Amount... Archive Pointer CBW Index Vendor Vendor Amount... Archive Pointer G/L Account Vendor Amount... Archive Pointer 17 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

18 CBW Index Modeling Propose indices from query analysis CBW index modeling Add characteristics and key figures as attributes to index structure 18 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

19 VirtualProvider for MP Integration The VirtualProvider is generated directly from the CBW Administration Cockpit 19 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

20 Dedicated Archiving for PSA Tables PSA data is usually deleted after staging into higher layers/infoproviders Archiving needs may occur for dedicated reasons PBS CBW provides dedicated PSA archiving features with ADK-based storage Time slice and request-based archiving Flexible integration of data sources Easy archive administration and reload options Reload archived PSA into SAP DB or stage PSA with dedicated VirtualProvider 20 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

21 Customer Experience PBS CBW NLS implementation to control BW database size and growth rate, improve the system performance, reduce backup window. Data compression for archived data (ADK flat files) : InfoCube data: 83 % PSA archiving (CBW): 96 % Additional results: Seemless query access to NLS Faster retrieval response from archive (NLS) TCO reduction via 66% smaller BW database InfoCube archiving results 514 GB 90 GB 83 % Compression 21 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

22 Additional Components PBS Conversion Tool Archive access for custom reports CBW Data Export Interface Data extracts for audit needs PBS BW Database Analyzer Database analysis for archiving support PBS ContentLink Compliant storage for BW archive files 22 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

23 Summary Generic add-on solution to archive/nearline BW application data Integrated in the SAP nearline storage interface NLS Flexible query access for InfoCubes and DSO Based on well-approved ADK archiving technique (SAP ERP) High data compression, typically 80% Efficient archive aggregates and optional indexing Economic software solution no additional HW necessary Additional features: PSA archiving and data extraction (Audits) 23 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

24 Thank you for your attention! PBS Software GmbH Schwanheimer Strasse 144a Bensheim Phone: Fax: info@pbs-software.com Internet: PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW

25 Copyright Copyright 2013 PBS Software GmbH. All rights reserved. No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH. The information of this presentation might change without prior notice. Microsoft, Windows are registered trademarks of Microsoft Corporation. IBM, IBM DR550, IBM TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered trademark of Linus Torvalds in the USA and other countries. UNIX is a registered trademark in the USA and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera, EMC Celerra are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP, Hitachi HCP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. Sybase IQ is a registered trademark of Sybase an SAP Company. Actian Vectorwise is a registered trademark of Actian Corporation. PBS archive add ons is a registered trademark of PBS Software GmbH. SAP, R/3, SAP NetWeaver, SAP NetWeaver Business Warehouse, SAP Industry Solutions and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. PBS Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty. 25 PBS CBW NLS ADK-based Nearline Storage Solution for SAP BW