PBS CBW NLS - Overview

PBS CBW NLS - Overview PBS Nearline Storage Solutions for SAP NetWeaver BW PBS Software GmbH, Dr. Klaus Zimmer, February 2009 1

Agenda Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution for PSA Data, Additional Tools Summary and Outlook 2

PBS Software GmbH 18 years' experience with supplementary solutions for data archiving and Information Lifecycle Management with SAP Founded in 1991 by Günther Reichling Worldwidemorethan1000 customers More than 2500 PBS archive add ons installed 3

PBS Software GmbH SAP Software Partner since 1999 Intensive cooperation with SAP since 1998 (data archiving, ILM) Cooperation with partner companies for the Americas since 1998 Cooperation with partner companies for Europe since 2000 Cooperation with partners for the APAC region since 2001 All major PBS solutions certified by SAP AG (ICC) 4

PBS Partner Network Technology Partners: 5

PBS Solution Portfolio PBS Analysis Tools PBS Database Analyzer PLUS, BW Database Analyzer PBS archive add ons for SAP ERP (and SAP R/3) Effective Indexing and Transparent Retrieval of SAP Appl. Data PBS Solutions for SAP NetWeaver Business Warehouse PBS CBW Nearline Storage Solutions for SAP NetWeaver BW PBS Solutions for Data Extraction CFI DEI, Database Export Interface, CDART, ECS PBS Solutions for Customer-Specific Applications PBS archive add on CUSTOM (SAP ERP, SAP BW, etc.) PBS Solutions for SAP Industry Solutions (SAP IS) IS Retail, IS Utilities, IS Telecommunication (IS Oil, IS Mill) PBS Solutions for Compliant Storage PBS ContentLink (EMC Centera, NetApp Filer, IBM DR550,...) 6

Data Archiving and Nearline Storage Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution for PSA Data, Additional Tools Summary and Outlook 7

Initial Situation SAP ERP SAP BW POS SAP IS Database Legacy Challenge: - Heavily growing SAP BW database - Reduced retrieval performance - Growing maintenance and administration efforts Increased TCO Solution: Remove data from the BW database 8

Motivation for BW Data Archiving Potential savings: Significant reduction of the BW database size/growth Reduction of hardware and administration costs Better performance shorter query response times Less effort for backup and desaster recovery Compliant data management to cover legal requirements Reduced effort for release upgrades Challenges for SAP BW data archiving: Flexible and complete online access via BW end user queries Short response times for archive data retrieval No restrictions concerning BW data flow 9

Motivation for BW Data Archiving 2000 Size in GB 1750 1500 1250 Data Archiving Potential $ savings Growth rate reduction by 25% 1000 750 Size reduction by 25% 500 250 Source: SAP AG Postponement of hardware investment Year 2007 2008 2009 2010 2011 10

Information Lifecycle Management Aspects Data access rate Source: SAP AG 11

SAP BW Nearline Storage Concept SAP NetWeaver BW 7.0 Nearline Storage Interface and Data Archiving Pure ADK Archiving Transfer to seq. files Reload from ADK Update from ADK Sequential access (slow) Nearline Storage Solution Transfer into external nearline storage solution No SAP archive files Reload via NLS Update via NLS Combine ADK + Nearline Transfer into external nearline storage solution Transfer into ADK files Reload from ADK Update via NLS SAP ADK archive file Query (sequential) Nearline storage (ext. solution) Query SAP ADK Nearline storage (ext. solution) Query 12

SAP Data Archiving for SAP BW 3.x T-Code RSA1 Create a new archiving object 13

SAP Data Archiving for SAP BW 3.x T-Code RSA1 Maintain an existing archiving object Transaction SARA 14

SAP DAP (Data Archiving Process, from BW 7.0) Create/change data archiving processes T-Code RSDAP T-Code RSA1 15

SAP DAP (Data Archiving Process, from BW 7.0) T-Code RSA1 Maintain archiving requests via Data Warehousing Workbench 16

SAP DAP (Data Archiving Process, from BW 7.0) Create/maintain archiving requests Selection conditions for DAP: chronological archiving (time slices) 17

PBS BW Database Analyzer Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution for PSA Data, Additional Tools Summary and Outlook 18

PBS BW Database Analyzer - Features DB Capacity Analysis Data analysis in background (batch) Dialog evaluation Individual analysis Dialog evaluation Comparison analysis Data transfer to InfoCube DB Distribution Analysis Distribution by time characteristics Data analysis in background (batch) Dialog evaluation Individual analysis 19

BW Database Analyzer Capacity Analysis (I) Configure the analysis and start: Evaluate all BW data types, Limitation to details is possible: InfoCubes DataStore Objects PSA Tables Analysis options for InfoCubes/PSA: Fact and dimension tables Current or all versions Periodic database analysis: Monitoring of data growth Detect fast growing InfoProviders 20

BW Database Analyzer Capacity Analysis (II) Analysis of the BW database with the PBS BW Database Analyzer 21

BW DB Analyzer Distribution Analysis (I) Configure the analysis and start in the background (batch) Evaluate InfoProviders with reference to capacity analysis Limit and select InfoProviders which are to be analyzed Prioritize time characteristics User-defined characteristics 22

BW DB Analyzer Distribution Analysis (II) Evaluate analysis online variable time characteristics selection 23

PBS Concepts for Nearline Storage and ILM Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution for PSA Data, Additional Tools Summary and Outlook 24

Available PBS CBW Solutions for SAP BW Archiving and Access Options SAP BW Release PBS Solution ADK(classic) PBS IQ NLS ADK NLS IQ 3.x PBS add-on CBW X 3.5 PBS add-on CBW for IQ X X 7.x PBS CBW NLS X X 7.x PBS CBW NLS IQ X X X 25

Integrated PBS Nearline Concept Query, Ad hoc Analysis DB + Archive/IQ Nearline Database (Sybase IQ) SAP NetWeaver BW Nearline Interface PBS NLS Services for ADK and Sybase IQ SAP NetWeaver BW Database Storage System SAP archive files PBS indexes/aggregates 26

PBS CBW Nearline Storage Concept SAP BW 3.x: PBS archive add on CBW Nearline Storage Solution PBS CBW NLS PSA Archiving ADK and Sybase IQ Write and delete Read and reload Update ADK SYBASE PSA archive InfoCubes and DSO Access via NLS Interface (N) Access via V, M Provider CBW NLS (ADK version) Aggregates and indexes CBW NLS for Sybase IQ Load to Sybase IQ, read PBS aggregates PBS indexes NLS DB Sybase IQ NLS query access Data Extracts (GDPdU) CBW Data Export Interface Extracts: archive/nls + DB InfoCubes, DSO Master data and texts Transparent tables SAP ArchiveLink-enabled SAP/AIS Data extracts in SAP AIS format 27

PBS ILM Concept for SAP NetWeaver BW DB BW Nearline Storage Sybase IQ Nearline Storage ADK InfoCubes DataStore PSA (PBS) Data extracts (PBS) ETL: BW Extractors for SAP ERP PBS archive add ons for SAP ERP PBS ILM Concept for SAP BW Capacity analysis and distribution for InfoProvider PBS BW Database Analyzer Query access for InfoCubes and DataStore Objects PBS CBW NLS PSA: archive, read, reload, update PBS CBW NLS Data Extracts (Z3): InfoCubes, DataStore, Master Data PBS CBW NLS Compliant Storage of BW Nearline archive data PBS ContentLink 28

PBS CBW NLS - Data Access, Architecture Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution for PSA Data, Additional Tools Summary and Outlook 29

BW End User Query Access to InfoCube and DSO data from Nearline storage and database via archive access-enabled SAP BW queries DB + NLS Archive 30

BW End User Query Query with only online access to the SAP BW database Data of current year in the SAP BW database, data of previous year in Sybase IQ 31

BW End User Query Query monitor: Enable SAP BW Query for nearline access Retrieve data from SAP BW database + nearline storage (here Sybase IQ) 32

BW End User Query Query with online access to database + nearline storage via CBW Data of current year in the SAP BW database, data of previous year in Sybase IQ 33

CBW Architecture NLS and Sybase IQ Read DB and Nearline (activate in query attributes) SAP BW Query InfoCube DataStore Object SAP Nearline Provider PBS Nearline Services for Sybase IQ SAP BW Database Sybase IQ Column-based Data Warehouse DB, Compression max. 1:10 34

Architecture PBS CBW NLS for Sybase IQ CBW IQ Interface for the SYBASE IQ Analytics Server SAP BW Sybase IQ Data Archiving Process (DAP) Access: Queries, Reload... PBS CBW NLS IQ Interface Server Administration/ Monitoring Load Data Read Data CBW NLS IQ infrastructure w/o ADK components 35

Architecture PBS CBW NLS for Sybase IQ CBW NLS IQ Components overview, technical view SAP BW Sybase IQ Java VM JCo JDBC dom4j log4j SAP Gateway PBS CBW NLS IQ Interface Runtime Environment PBS CBW NLS IQ Interface Instance Sybase IQ DB Instance Sybase IQ DB Engine RFC JDBC Relationships between instances (SAP BW, CBW, Sybase IQ): n:m 36

Administration Cockpit and NLS Monitor Select the InfoProviders Generate Infrastructure Components Additional Utilities Monitor: - CBW NLS - Sybase IQ - Connector 37

Benefits of the CBW IQ Version Effective NLS data transfer very fast load process into IQ (e.g. 10 million records within approx. 10 minutes) Column-based data storage (Vector DB) no need for aggregation and index generation Suitable for ad-hoc queries with archive/nearline access Very low administration effort Well suited for large data volumes Very fast also with high system and data load Suitable for very large InfoCubes and systems with many queries 38

CBW Architecture with NLS ADK Read DB and Nearline (activate in query attributes) SAP BW Query InfoCube DataStore Object SAP Nearline Provider PBS Nearline Service for ADK PBS aggregate SAP BW Database PBS index SAP archive ADK ADK files: Compression 1: 10 39

MultiProvider Integration in SAP BW 7.0 (PBS) Read DB BW Query Read Archive DB + Archive InfoCube DataStore Object Multi Provider Virtual Provider PBS NLS Interface SAP BW Database PBS aggregate PBS index SAP archive Sybase IQ 40

CBW Administration Cockpit (SAP BW 7.x) Select the InfoProvider Modeling of CBW infrastructure (Archive aggregates and indexes) Generate the CBW infrastructure Create and administrate the aggregate and index data Additional utilities 41

Aggregate Modeling for CBW NLS ADK Subsets of archived InfoCubes or DataStore Objects Flat table structures (in analogy to index and archive files) Subsets of InfoProvider characteristics and key figures (with standard aggregation) in the aggregate structure Modeling of aggregates from SAP templates, queries or via analysis Compressed storage in sequential files (ADK format) Archive Data Characteristics Key figures Controlling Area Cost Center Vendor Amount Quantity Major characteristic Remaining char. Key figures Archive Aggregate Controlling Area Cost Center Amount Quantity Cost Center Controlling Area Amount Quantity A1.1 A1.2 Vendor Amount Quantity A2 42

Index Modeling for CBW NLS ADK Flexible and generic indexing for InfoCubes and DSO Each characteristic (dimension) can be indexed Additional attributes (characteristics or key figures) Indexes are stored as compressed flat files (ADK) outside database Archive Data Characteristics Key Figures Cost Center Vendor G/L Account Amount Quantity Index Key Index Attributes Cost Center Vendor Amount... Archive Pointer Archive Indexes Vendor Vendor Amount... Archive Pointer G/L Account Vendor Amount... Archive Pointer 43

CBW Integration into Storage Infrastructure BW Database SAP NetWeaver BW - online - BW Query DB + Archive Archive Data - File System - SAP File System - nearline - Archive Daten -StorageSystem - Storage System - nearline - Archive Data SAP ArchiveLink Archive Data ContentLink SAP NetWeaver BW Database PBS Index PBS Aggregates PBS Index PBS Aggregates 44

Benefits of the CBW ADK Version ADK well-approved archiving method (SAP R/3, ERP) High data compression, typically 1:10 Pure software solution no additional HW required Optional aggregation and indexing Suitable for large DSO with few queries Compliant data storage via SAP ArchiveLink Economical solution 45

Archiving of PSA Data, Additional Tools Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution for PSA Data, Additional Tools Summary and Outlook 46

Archiving of PSA Data SAP BW: Delete PSA tables after staging into InfoProviders Archiving requirements, e.g. to repeat staging into InfoProvider PBS PSA Archiving (ADK-based and with Sybase IQ): User-friendly definition of AOBJ/DAP Flexible integration of DataSources Enhanced archive administration Comfortable read and reload access 1 Archive 2 Delete 3 Read/Reload PSA ADK ADK PBS PSA Archiving: - ADK archive files - Store in Sybase IQ Archiving program Delete program Read program (seq). Sybase IQ 47

Archiving of PSA Data PSA archiving with PBS archive add on CBW or PBS CBW NLS T-SARA 48

Archiving of PSA Data PSA archiving with PBS archive add on CBW or PBS CBW NLS 49

Archiving of PSA Data PSA archiving with PBS archive add on CBW or PBS CBW NLS 50

SmartX Import PBS CBW Data Export Interface Create data carrier for audits (e.g. tax audit, GDPdU-Z3) Extract arbitrary InfoCubes, DataStore objects and master data Select database and archive data Arbitrary field selection via ALV Data extraction in SAP AIS format Supports XML description standard Full support for Audicon IDEA and TaxAudit SAP/AIS 51

PBS Conversion Tool PBS API to enhance customer-specific programs with PBS access Custom ABAP ZZEXAMPLE SAP BW Database PBS Conversion Tool Enhance SQL statements with PBS archive access Enhance customer programs with PBS function module "Select-into-table" Archive-enabled ZZEXAMPLE_PBS SAP BW Database PBS Index Sybase IQ ADK 52

PBS ContentLink Overview PBS ContentLink is a Web server-based INTERFACE solution to link SAP systems and external storage solutions via SAP ArchiveLink. PBS ContentLink enables write and read access for all SAP ArchiveLink-enabled data (ADK files, PBS index files, PBS aggregates...). ContentLink is a lean, fast and scalable software solution which is optimized for SAP data archiving goals in SAP NetWeaver BW and SAP ERP. SAP Server Intel Server (Windows) Storage System Apache2 Server (Unix) 53

PCL Integration with PBS CBW NLS PBS CBW NLS PBS ContentLink Storage Repository 54

Summary and Outlook Introduction - PBS Software GmbH, Solution Portfolio Data Archiving and Nearline Storage in SAP NW BW PBS BW Database Analyzer Effective DAP Preparation PBS Concepts for Nearline Storage and ILM (Information Lifecycle Management) PBS CBW NLS Data Access and Architecture PBS Archiving Solution of PSA Data, Additional Tools Summary and Outlook 55

PBS CBW Summary Generic add-on solution for online query access to database and archive data (InfoCubes, DataStore objects) ADK version: real archive aggregates and effective indexing IQ version: minimal administration efforts + short response time IQ + ADK: huge compression rates when storing the data Compliant storage of nearline /archive data Data extraction for audit needs (e.g. GDPdU) PSA: archive, read and reload: ADK + IQ version Available and SAP certified for all SAP BW release levels 56

Thank you very much for your attention! We would appreciate to provide you further information. Please click our website. PBS Software GmbH Schwanheimer Strasse 144a 64625 Bensheim Germany T: 06251 174 0 F: 06251 174 174 E: info@pbs-software.com I: www.pbs-software.com 57

Copyright Copyright 2005-2009 PBS Software GmbH. All rights reserved. No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH, Bensheim, Germany. PBS archive add ons is a registered trademark of PBS Software GmbH. SAP, the SAP Logo, R/3, SAP ArchiveLink, SAP ERP, SAP BW, SAP NetWeaver, SAP NW BW and others are registered trademarks of SAP AG in Germany and many other countries. EMC and Centera are registered trademarks of EMC, Hopkinton, USA. NetApp is a registered trademark of Network Appliance, Sunnyvale, CA, USA IBM and DR550 are registered trademarks of IBM, Armonk, NY, USA Sybase, Sybase IQ are registered trademarks of Sybase Inc, Dublin, CA, USA 58