PBS archive add on CBW ADK-based Nearline Storage Solution for SAP BW 3.x PBS Software GmbH, Dr. Klaus Zimmer, 2010 1
Agenda Introduction: Data Archiving and Nearline Storage in SAP NW BW PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) Solution Overview: PBS archive add on CBW Archiving Solution for PSA Tables Additional Tools: DB Analysis, Data Extraction, Data Storage Summary 2
Initial Situation SAP ERP SAP BW POS SAP IS Database Legacy Challenge: - Heavily growing SAP BW database - Reduced retrieval performance - Growing maintenance and administration efforts Increased TCO Solution: Remove data from the BW database 3
Motivation for BW Data Archiving Potential savings: Significant reduction of the BW database size/growth Reduction of hardware and administration costs Better performance shorter query response times Less effort for backup and desaster recovery Compliant data management to cover legal requirements Reduced effort for release upgrades Challenges for SAP BW data archiving: Flexible and complete online access via BW end user queries Short response times for archive data retrieval No restrictions concerning BW data flow 4
Motivation for BW Data Archiving 4000 Size in GB 3000 Data Archiving Potential $ savings Growth rate reduction by 25% 2000 Size reduction by 25% 1000 Source: SAP AG Postponement of hardware investment Year 2009 2010 2011 2012 2013 5
SAP Data Archiving for SAP BW 3.x T-Code RSA1 Create a new archiving object 6
SAP Data Archiving for SAP BW 3.x T-Code RSA1 Maintain an existing archiving object Transaction SARA 7
PBS NLS Concepts Introduction: Data Archiving and Nearline Storage in SAP NW BW PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) Solution Overview: PBS archive add on CBW Archiving Solution for PSA Tables Additional Tools: DB Analysis, Data Extraction, Data Storage Summary 8
Available PBS CBW Solutions for SAP BW Archiving and Access Options SAP BW Release PBS Solution ADK(classic) PBS IQ NLS ADK NLS IQ 3.x PBS add-on CBW X 3.5 PBS add-on CBW for IQ X X 7.x PBS CBW NLS X X 7.x PBS CBW NLS IQ X X X 9
Integrated PBS Nearline Concept Query, Ad hoc Analysis DB + Archive/IQ Nearline Database (Sybase IQ) PBS NLS Services for ADK and Sybase IQ SAP NetWeaver BW Nearline Interface SAP NetWeaver BW Database Storage System SAP archive files PBS indexes/aggregates 10
PBS CBW Nearline Storage Concept SAP BW 3.x: PBS archive add on CBW Nearline Storage Solution PBS CBW NLS PSA Archiving ADK and Sybase IQ Write and delete Read and reload Update ADK SYBASE PSA archive InfoCubes and DSO Access via NLS Interface (N) Access via V, M Provider CBW NLS (ADK version) Aggregates and indexes CBW NLS for Sybase IQ Load to Sybase IQ, read PBS aggregates PBS indexes NLS DB Sybase IQ NLS query access Data Extracts (GDPdU) CBW Data Export Interface Extracts: archive/nls + DB InfoCubes, DSO Master data and texts Transparent tables SAP ArchiveLink-enabled SAP/AIS Data extracts in SAP AIS format 11
PBS ILM Concept for SAP NetWeaver BW DB BW Nearline Storage Sybase IQ Nearline Storage ADK InfoCubes DataStore PSA (PBS) Data extracts (PBS) ETL: BW extractors for SAP ERP PBS archive add ons for SAP ERP PBS ILM Concept for SAP BW Capacity analysis and distribution for InfoProvider PBS BW Database Analyzer Query access for InfoCubes and DataStore Objects PBS CBW NLS PSA: archive, read, reload, update PBS CBW NLS Data extracts (Z3): InfoCubes, DataStore, Master Data PBS CBW NLS Compliant storage of BW nearline archive data PBS ContentLink 12
CBW Solution Overview Introduction: Data Archiving and Nearline Storage in SAP NW BW PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) Solution Overview: PBS archive add on CBW Archiving Solution for PSA Tables Additional Tools: DB Analysis, Data Extraction, Data Storage Summary 13
PBS archive add on CBW (SAP BW 3.x) SAP BW Query DB only Archive only DB + Archive InfoCube DataStore Object Multi Provider Virtual Provider PBS ADK Interface SAP NetWeaver BW Database PBS Aggregates PBS Index SAP Archive ADK files: Compression 1: 10 14
Generate the CBW Infrastructure Select InfoProvider Define CBW Infrastructure Generate Infrastructure Setup and Maintain CBW Index Data Additional Tools 15
Aggregate Modeling for CBW NLS ADK Subsets of archived InfoCubes or DataStore Objects Flat table structures (in analogy to index and archive files) Subsets of InfoProvider characteristics and key figures (with standard aggregation) in the aggregate structure Modeling of aggregates from SAP templates, queries or via analysis Compressed storage in sequential files (ADK format) Archive Data Characteristics Key figures Controlling Area Cost Center Vendor Amount Quantity Major characteristic Remaining char. Key figures Archive Aggregate Controlling Area Cost Center Amount Quantity Cost Center Controlling Area Amount Quantity A1.1 A1.2 Vendor Amount Quantity A2 16
Aggregate Modeling for CBW NLS ADK PBS archive aggregates are maintained via familiar frontend Aggregate definition either from SAP BW database, used queries or according to analysis 17
Archive Access via CBW Aggregates Controlling area Cost center Vendor Amount North Warehouse Bak Retail 10.500 North Warehouse Schmiel 12.300 North Warehouse Wilms AG 8.900 North Assembly Phoenix 15.100 North Assembly Fremont 21.500 North Production Colinas 33.700 North Production Destec GmbH 57.100 North Production esupplier 42.800 South Warehouse Bak Retail 9.700 South Warehouse Wilms AG 14.200 Archive data Selection w/o aggregates Selection with aggregates Controlling area Cost center Amount North Warehouse 31.700 North Assembly 36.600 North Production 133.600 South Warehouse 23.900 A1.1 Cost center Controlling area Amount Warehouse North 31.700 Warehouse South 23.900 Assembly North 36.600 Production North 133.600 A1.2 Archive aggregate A1 with two instances Controlling area Cost center Amount North Warehouse 31.700 North Assembly 36.600 Query result 18
Index Modeling for CBW NLS ADK Flexible and generic indexing for InfoCubes and DSO Each characteristic (dimension) can be indexed Additional attributes (characteristics or key figures) Indexes are stored as compressed flat files (ADK) outside database Archive Data Characteristics Key Figures Cost Center Vendor G/L Account Amount Quantity Index Key Index Attributes Cost Center Vendor Amount... Archive Pointer Archive Indexes Vendor Vendor Amount... Archive Pointer G/L Account Vendor Amount... Archive Pointer 19
Index Modeling for CBW NLS ADK Flexible index and index attribute selection Default values to simplify selection Indexes can be added or changed at any time Additional support and diagnostics features Index-Auswahl 20
CBW Integration into Storage Infrastructure BW Database SAP NetWeaver BW - online - BW Query DB + Archive Archive Data - File System - SAP File System - nearline - Archive Data -StorageSystem - Storage System Archive Data SAP ArchiveLink Archive Data ContentLink SAP NetWeaver BW Database PBS Index PBS Aggregates PBS Index PBS Aggregates 21
Data Retrieval with CBW 3.x Access to InfoCube and DSO data from archive files and database via archive access-enabled BW queries DB + Archive Archive Database 22
Query Access to Database Data Query with online access to the BW database (Basic Cube) Data of current year in the SAP BW database, data of previous year in ADK archive files 23
Query Access to Archived Data Query with online access to the ADK archive files via virtual InfoProvider - PBS archive add on CBW Data of current year in the SAP BW database, data of previous year in ADK archive files 24
Query Access to Archive + Database Query with online access to the database and ADK archive files via MultiProvider - PBS archive add on CBW Data of current year in the SAP BW database, data of previous year in ADK archive files 25
PSA Archiving Introduction: Data Archiving and Nearline Storage in SAP NW BW PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) Solution Overview: PBS archive add on CBW Archiving Solution for PSA Tables Additional Tools: DB Analysis, Data Extraction, Data Storage Summary 26
PBS Archiving Solution for PSA Tables SAP BW: Delete PSA tables after staging into InfoProviders Archiving requirements, e.g. to repeat staging into InfoProvider PBS PSA Archiving (ADK-based and with Sybase IQ): User-friendly definition of AOBJ/DAP Flexible integration of DataSources Enhanced archive administration Comfortable read and reload access 1 Archive 2 Delete 3 Read/Reload PSA ADK ADK PBS PSA Archiving: - ADK archive files Archiving program Delete program Read program (seq). 27
PBS Archiving Solution for PSA Tables PSA archiving with PBS archive add on CBW T-SARA 28
PBS Archiving Solution for PSA Tables PSA archiving with PBS archive add on CBW 29
PBS Archiving Solution for PSA Tables PSA archiving with PBS archive add on CBW 30
Additional Tools Introduction: Data Archiving and Nearline Storage in SAP NW BW PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) Solution Overview: PBS archive add on CBW Archiving Solution for PSA Tables Additional Tools: DB Analysis, Data Extraction, Data Storage Summary 31
PBS BW Database Analyzer - Features DB Capacity Analysis Data analysis in background (batch) Dialog evaluation Individual analysis Dialog evaluation Comparison analysis Data transfer to InfoCube DB Distribution Analysis Distribution by time characteristics Data analysis in background (batch) Dialog evaluation Individual analysis 32
SmartX Import PBS CBW Data Export Interface Create data carrier for audits (e.g. tax audit, GDPdU-Z3) Extract arbitrary InfoCubes, DataStore objects and master data Select database and archive data Arbitrary field selection via ALV Data extraction in SAP AIS format Supports XML description standard Full support for Audicon IDEA and TaxAudit SAP/AIS 33
PBS Conversion Tool PBS API to enhance customer-specific programs with PBS access Custom ABAP ZZEXAMPLE SAP BW Database PBS Conversion Tool Enhance SQL statements with PBS archive access Enhance customer programs with PBS function module "Select-into-table" Archive-enabled ZZEXAMPLE_PBS SAP BW Database PBS Index ADK 34
PBS ContentLink Overview PBS ContentLink is a Web server-based INTERFACE solution to link SAP systems and external storage solutions via SAP ArchiveLink. PBS ContentLink enables write and read access for all SAP ArchiveLink enabled data (ADK files, PBS index files, PBS aggregates...). ContentLink is a lean, fast and scalable software solution which is optimized for SAP data archiving goals in SAP NetWeaver BW and SAP ERP. SAP Server Intel Server (Windows) Storage System Apache2 Server (Unix) 35
PCL Integration with PBS CBW NLS PBS CBW NLS PBS ContentLink Storage Repository 36
PBS CBW NLS Summary Generic NLS solution with online query access to archived and online (database) InfoCube, DSO and PSA data. Short query response time via flexible indexing and aggregation technique. Additional features: PSA archiving and data extracts (audits). ABAP API for data access via custom ABAP programs. PBS CBW ADK indexes stored outside the database in compressed ADK format (comp. 80% and higher). PBS long-term archiving concept to enable date-controlled archive access for enlarged time periods (compliant to audit requirements). SAP ArchiveLink enabled => integration into ILM concepts using external storage systems (optical, EMC Centera, Celerra NetApp FAS, IBM DR550, Hitachi HCP). 37
PBS Software Solution Portfolio PBS Analysis Tools PBS Database Analyzer PLUS, BW Database Analyzer PBS archive add ons for SAP ERP (and SAP R/3) Effective Indexing and Transparent Retrieval of SAP Appl. Data PBS Solutions for SAP NetWeaver Business Warehouse PBS CBW Nearline Storage Solutions for SAP NetWeaver BW PBS Solutions for Data Extraction CFI DEI, Database Export Interface, CDART, ECS PBS Solutions for Customer-Specific Applications PBS archive add on CUSTOM (SAP ERP, SAP BW, etc.) PBS Solutions for SAP Industry Solutions (SAP IS) IS Retail, IS Utilities, IS Telecommunication (IS Oil, IS Mill) PBS Solutions for Compliant Storage PBS ContentLink (Centera, Celerra, Filer, DR550, HCAP, NAS) 38
Thank you very much for your attention! We would appreciate to provide you further information. Please click our website. PBS Software GmbH Schwanheimer Strasse 144a 64625 Bensheim Germany T: 06251 174 0 F: 06251 174 174 E: info@pbs-software.com I: www.pbs-software.com 39
Copyright Copyright 2010 PBS Software GmbH. All rights reserved. No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH. The information of this presentation might change without prior notice. Microsoft, Windows are registered trademarks of Microsoft Corporation. IBM, IBM DR550, IBM TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered trademark of Linus Torvalds in the USA and other countries. UNIX is a registered trademark in the USA and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera, EMC Celerra are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP, Hitachi HCP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. PBS archive add ons is a registered trademark of PBS Software GmbH. SAP, R/3, SAP NetWeaver, SAP NetWeaver Business Warehouse, SAP Industry Solutions and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. PBS Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty. 40