PBS CBW NLS IQ Enterprise Content Store

Transcription

1 CBW NLS IQ Enterprise Content Store Solution for NetWeaver BW and on HANA

2 Information Lifecycle Management in BW Content Information Lifecycle Management in BW...3 Strategic Partnership...4 Information Lifecycle Management with CBW NLS IQ...4 Transfer Data into the Storage...5 Access to Information in Storage...6 Architecture and Administration...8 Reduction of the Investment and Operating Costs...9 Benefits...10 Solutions, Supported Platforms, Licensing...11 The many demands made on a Data Warehouse lead to more and more increasing efforts and costs for system operation, as the number of users and the volume of data steadily increase. With traditional databases the evaluation of large data stocks within a matter of seconds is only possible with additional effort using aggregates. Therefore, the question arises for many companies that have an NetWeaver Business Warehouse ( BW), whether they should use an Business Warehouse Accelerator ( BWA) in addition to an BW system, or whether they should invest in the in-memory database, HANA. These measures should considerably increase user satisfaction and productivity. The systems mentioned Access Frequency are already being used or their use is currently being evaluated in the framework of pilot projects in more and more companies. The use of in-memory technology offers new perspectives as far as data analyses are concerned, but also involves, however, corresponding investment costs. The increasingly complex requirements for fast and flexible evaluations and analyses of ever-increasing volumes of data can only be realized on a longterm basis and in a cost-efficient way with the help of a strategic Information Lifecycle Management (ILM) concept. Within the scope of an Information Lifecycle Management concept, information should be differentiated according to whether it is retrieved very often, less often, or never. Database / HANA Current Status of Data Figure 1: Data Access depending on its current Status Abbildung 1: Datenzugriff in Abhängigkeit von der Aktualität The ILM solution for BW is based on the nearline storage architecture and allows the storage to nearline combined with integrated query searches of information from BW systems. It also supports the processing of classical BW data archives. Both enable the implementation of a strategic ILM concept. The nearline solution is certified by. 2 3

3 Strategic Partnership In this way the following is enabled: Information Software GmbH has become a leading provider of add-on solutions in the ILM environment thanks to its intensive partnership with over many years in the area of Information Access Frequency Lifecycle Management for a wide variety of applications and with more than 1,400 productive customers worldwide. The many years experience of handling extensive enterprise information have Database / been incorporated HANA in the design of the Current Status of Data Lifecycle Management with CBW NLS IQ Abbildung 1: Datenzugriff in Abhängigkeit von der Aktualität nearline solution. By integrating modern column-based database technology, significant improvements have been achieved during the processing of large data volumes. The solution can ideally be used in combination with traditional databases and the new HANA. This enables the database size and the hardware and software costs associated with it to be better controlled. performance is increased and at the same time the costs for data storage are reduced in BW systems with traditional DB technology, the size of the working memory being used is reduced considerably enabling huge cost savings for licenses and hardware costs for BW on HANA. Transfer Data into the Storage To transfer data of an InfoProvider into the nearline storage, you create a data archiving process in the Administrator Workbench and specify the respective nearline connection in the general settings (see figure 4). Afterwards, you can transfer the data into the nearline storage and monitor the transfer (see figure 5). The starting point for ILM in BW systems is shaped by the various requirements regarding data storage and data access during the complete Database/ HANA Current Data Figure 2: Data Storage in BW in different Data Storages Storage Less current Data DB / HANA Zugriff auf Informationen des -Speichers 7 DB / HANA Less or no Accesses Figure 2: Data Storage in BW in different Data Storages CBW NLS IQ Database lifecycle of the information. Current information that is accessed frequently is stored in the BW database. If HANA technology is used for this the data can be processed at an extremely high speed. With increasing age, the access rate to the data decreases. This is why it is recommended to move the information (archiving) into nearline storage (see figure 2). Afterwards, extremely old data that is accessed seldom, or even not at all, should then be transferred to the data archive. CBW NLS IQ uses the columnbased database Sybase IQ as the nearline storage for BW or for BW on HANA respectively. The high degree of compression of the column-based database results in a considerable reduction in the data volume (see figure 3). The column-based database technology of Sybase IQ enables extremely fast access to the nearline data. Figure 4: Data Archiving Process to transfer Data into Storage (Administrator Workbench, Transaction RSA1) 4 In einer Query lassen sich Daten des aktuellen Geschäftsjahres mit Vorjahresdaten Figure gemeinsam 3: Data Reduction auswerten. of an Während NetWeaver die aktuellen BW System Daten in using der BW-Datenbank CBW NLS IQ bzw. BW on HANA gespeichert sind, befinden sich die Daten des Vorjahres im -Speicher. Der Zugriff auf die Vorjahresdaten erfolgt über die -Schnittstelle und über -Services. In der Query werden die aktuellen und die -Daten gemeinsam angezeigt (siehe Abbildung 6). Dazu brauchen Sie nur in den Eigenschaften einer Query Figure 3: Data Reduction of an System using CBW NLS IQ Figure 5: Monitoring and Management of Data Transfer into Storage 5

4 Access to Information in Storage CBW NLS IQ As an example for integrated nearline formed via the nearline interface 7 DB / HANA access, the analysis of data from the and via nearline services. The current and the Database current and from the previous year DB / HANA nearline data is displayed should be considered. The current together in the query (see figure 6). To Zugriff auf Informationen des -Speichers data is located in the BW database do this, you only need to define in the In (traditional einer Query or lassen HANA). sich Daten The data des aktuellen properties Geschäftsjahres of a query mit Vorjahresdaten that an evaluati- gemeinsam from the previous auswerten. year Während is located die aktuellen in Daten on in of der the nearline BW-Datenbank storage bzw. should also BW the on nearline HANA gespeichert database. sind, Access befinden to sich the die Daten take des place. Vorjahres im -Speicher. Der data Zugriff from auf the die previous Vorjahresdaten year erfolgt is per- über die -Schnittstelle und über Figure 3: Data Reduction of an System using CBW NLS IQ -Services. In der Query werden die aktuellen und die -Daten gemeinsam angezeigt (siehe Abbildung 6). Dazu brauchen Sie nur in den Eigenschaften einer Query festlegen, dass auch eine Auswertung des -Speichers erfolgen soll. Abbildung 5: Anmeldung an ECS Figure 7: Creation of a virtual InfoProvider in the Administration Cockpit InfoCube Data Store Object BW Query NLS and DB Provider MultiProvider VP Services Integration via virtual InfoProviders With CBW NLS you can accelerate query accesses in comparison to a BW system with traditional DB technology. For example, acceleration by a factor of 26 (without aggregates) or by factor 4 (with aggregates) respectively can be achieved by a fast, column-based evaluation in the nearline database. In this actual customer example, the runtime of a query (without aggregates) is reduced from 416 seconds or 71 seconds (with aggregates) respectively to 16 seconds (see figure 8). BW Database / HANA Storage InfoCube with 17 millions of Data Records Online DB with or without Aggregates Improved Query Access with CBW NLS IQ Abbildung 6: Gleichzeitige Auswertung von Daten aus BW-Datenbank und -Speicher Figure 6: Simultaneous Evaluation of Data from in einer BW Database Query and Storage in a Query Figure 6: Simultaneous Evaluation of Data from BW Database and Storage in a Query Ein gleichzeitiger Zugriff auf aktuelle Daten und Daten aus dem -Speicher über einen MulitProvider ist allerdings über den Standard nicht möglich. Hier bietet CBW NLS IQ zusätzliche Funktionen an. Hierbei erfolgt der Zugriff auf -Daten über x 26 DB without Aggregates DB with Aggregates CBW NLS IQ einen virtuellen InfoProvider. Die Einrichtung des virtuellen Providers erfolgt mit einem Administration Cockpit (siehe Abbildung 7). In addition to the integrated MultiProvider accesses, the solution provides additional data access possibilities via virtual InfoProviders, for example, to accelerate combined query accesses to master and transaction data. These VirtualProviders can be generated in a user-friendly manner in the Administration Cockpit (see figure 7). 0 Figure 8: Reduction of Runtimes for a Query by using CBW NLS IQ in a traditional BW Database Environment x s 71 s 16 s 6 Figure 8: Reduction of Runtimes for a Query by using CBW NLS IQ in a traditional BW Database Environment 7

5 x s 71 s 16 s Architecture and Administration Figure 8: Reduction of Runtimes for a Query by using CBW NLS IQ in a traditional BW Database Environment Reduction of the Investment and Operating Costs ADK Services Tools Java Connector Server Sybase IQ CBW NLS IQ Figure 9: Structure of Solution CBW NLS IQ Figure 9: Structure of Solution CBW NLS IQ The nearline solution also enables the direct indexing and evaluation of ADK archives. This allows archive data to also be evaluated directly with BW queries. Figure 10: Administration of CBW NLS IQ with Monitor On the one hand, NLS IQ consists of software components that are installed in the BW system. These are responsible for transferring the data and enable query searches. In addition they provide an administration tool. On the other hand, NLS IQ consists of the nearline server implemented in Java that ensures the communication between BW and Sybase IQ (see figure 9). For this, the nearline server communicates with the system via the Java Connector. A monitor that enables you to check the complete nearline system via the BW administration interface is available in the BW system. This supports easy administration of the nearline server and of Sybase IQ (see figure 10). You can significantly reduce both the operating costs of an BW system BW as well as the investment costs for the implementation of an BW on HANA with the nearline solution. Consider an BW system with a data volume of 2.5 TB. With the Data help volume: of CBW NLS IQ it is generally pos- 2.5 TB sible to move two thirds of the data BW from the BW system into the nearline storage (see figure 11). BW 2.5 TB BW 0.83 TB 1.08 TB 0.25 TB Figure 11: Reduction of Data Data Volume volume: from 2.5 to 1.08 Figure 11: Reduction of Data Volume from 2.5 to 1.08 TB using CBW NLS IQ TB using Figure 11: CBW Reduction NLS IQ of Data 0.83 Volume TB from 2.5 to TB using TB CBW NLS IQ 0.83 TB BW BW A third of the data (0.83 TB) remains in TB (this is two thirds of the originally 2.5 TB 1.08 TB BW. By compressing the data in available data) to Data 0.25 volume TB [TB] so that Annual the Annual Data volume [TB] Annual Operating Costs [Euro] Annual Operating Costs [%] the nearline database by 85 per cent, Figure 11: Reduction total of data Data Volume volume from comprises 2.5 to Operating 1.08 TB using 1.08 Costs TB CBW [Euro] NLS IQ Operating Costs [%] you can reduce a data volume of 1.67 (see table 1) , ,500 27, Consequently, with a 2.5 TB system you , , Data volume [TB] Annual Annual Operating Costs [Euro] Operating Costs [%] can achieve yearly cost savings of ,500 Table 1: Reduction of annual operating costs by more than 50% 57 per cent through needing less (Assumption: GB memory 62,500 space costs 25 /year) , memory space. The yearly savings Table 1: add Reduction of annual operating costs by more than 50% , up when a mirror system is being (Assumption: used. 1 GB memory space costs 25 /year) After removing two thirds of the data, the following initial situation applies for the conversion of an BW system to BW on HANA (table 2): Data volume RAM for HANA Table 1: Reduction of annual operating costs by more than BW [TB] [GB] 50% Table 1: Reduction (Assumption: of annual operating 1 GB memory costs by space more costs than 50% 25 /year) (Assumption: 1 GB memory space costs 25 /year) Data volume RAM for HANA BW [TB] [GB] Data volume RAM for HANA BW [TB] [GB] Table 2: Reduction 2.5 of investment costs for 512 an BW on HANA by reducing the 0.88 in-memory 0.88 memory space 256 requirement Table by 2: reducing Reduction the in-memory of investment memory space costs requirement for an BW on HANA As a result of drastically by reducing the in-memory doubled memory when space using requirement a mirror system. data volume in your BW system By continuously transferring data into you only need to calculate with an the nearline storage, the growth of the in-memory space requirement of main memory when operating 256 GB instead of with an in-memory BW or HANA respectively can be space requirement of 512 GB when kept better under control resulting in performing planning for an BW on further cost benefits. HANA. The savings made are 1.08 TB Database Table 2: Reduction of investment costs for an BW on HANA Table 2: Reduction of investment by reducing costs the for in-memory an BW memory on HANA space requirement Database Database 0.25 TB 8 9

6 Benefits Licensing With the nearline solution you can implement your ILM strategy for BW or for BW on HANA respectively. Information that is required urgently is always available to users quickly and in full. Online and nearline data is completely integrated without the user having to change the way they work in the system. Considerable cost savings are achieved when saving data since the volume of data is drastically reduced due to the extremely high degree of compression. Very fast access to data is even guaranteed in the case of high data volumes thanks to the use of column-based data storage. Easy administration and fast load processes reduce the effort for the system administrator. Compared to the standard, additional functions enable the archiving of PSA tables as well as the generation of snapshots for master data, hierarchies, and InfoCubes/DSOs. Long-term use is ensured based on its extremely good suitability in the case of large data volumes (Big Data). User satisfaction increases due to the improved system performance. Controls the growth of the main memory when using BWA or HANA. The nearline storage solution with the Sybase IQ analytics server ( CBW NLS IQ) supports all BW releases from 3.x up to HANA. You can find more detailed information on suitable operating systems/platforms in the respective product specification that you can find in the Media Center section on our website. The license model depends on the total amount of named BW users. We offer a hotline support to customers with a maintenance contract. focuses on the software development. We cooperate with many partner companies for implementation and consulting services. Most partner companies also provide software licenses and first level support. You can find a complete partner list on our website at www. pbs-software.com 10 11

7 Software GmbH Software GmbH Software is a leading provider of add-on software for Software is a leading provider of add-on software for solutions for areas like data archiving, extraction and storage, as well as system closings. The company has been known to be an expert on complex, integrated data access to both archived and nearline data in applications for many years. In addition to classical data archiving, the extensive solutions also support the BW-specific nearline storage concept that enables completely new ILM application scenarios together with the column-based analytics server Sybase IQ. solutions for areas like data archiving, extraction and storage, as well as system closings. The company has been known to be an expert on complex, integrated data access develops pragmatic ILM tools in close collaboration with and supports the new ILM solution as an SOFTWARE SOLUTION PARTNER. For further information: to both archived and nearline data in applications for many years. In addition to classical data archiving, the extensive solutions also support the BW-specific nearline storage concept that enables completely new ILM application scenarios together with the column-based analytics server Sybase IQ. Software GmbH Schwanheimer Strasse 144 A Bensheim, Germany phone: +49 (0) / fax: +49 (0) / info@pbs-software.com Software GmbH Schwanheimer Strasse 144 A phone: +49 (0) / info@pbs-software.com Bensheim, develops Germany pragmatic fax: ILM +49 tools (0) 62 in 51 / close collaboration with and supports the ILM solution as an SOFTWARE SOLUTION PARTNER. For further information: Copyright 2010 Software GmbH. All rights reserved. None of the elements of this brochure may be reproduced or forwarded to other parties in any form or for any purpose without the written permission of Software GmbH. The information contained herein may be changed without prior notice. Microsoft, Windows are registered trademarks of Microsoft Corporation. IBM, IBM DR550, IBM TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered trademark of Linus Torvalds in the U.S.A. and other countries. UNIX is a registered trademark in the U.S.A. and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. Sybase IQ is a registered trademark of Sybase Inc. archive Copyright add ons is a 2012 registered trademark Software of GmbH. Software All rights GmbH. reserved., R/3, None NetWeaver, of the elements NetWeaver of this Business brochure Warehouse, may Industry be reproduced Solutions and or other forwarded products to other and services parties mentioned in any form herein, or for as well any as purpose their respective without logos, the are written trademarks or permission registered trademarks of Software AG GmbH. in Germany The information and other countries. contained All other herein product may and be service changed names without mentioned prior are the trademarks notice. Microsoft, of their respective Windows companies. are registered The information trademarks contained of Microsoft in this document Corporation. is solely for IBM, informational IBM DR550, purposes. IBM Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and TSM and SSAM are trademarks or registered trademarks of IBM Corporation. Linux is a registered services are those that are set forth in the express warranty statements accompanying such products and services. Nothing herein trademark should be of construed Linus Torvalds as constituting in the U.S.A. an additional and other warranty. countries. UNIX is a registered trademark in the U.S.A. and other countries, licensed exclusively through X/Open Company Limited. HP, HP-UX11 Apache are trademarks or registered trademarks of Hewlett-Packard Company. EMC, EMC Centera are trademarks or registered trademarks of EMC Corporation. Hitachi, Hitachi HCAP are trademarks or registered trademarks of Hitachi Ltd. NetApp, NetApp Filer are trademarks or registered trademarks of NetApp Corporation. Sybase IQ is a registered trademark of Sybase an Company. archive add ons is a registered trademark of Software GmbH., R/3, NetWeaver, NetWeaver Business Warehouse, Industry Solutions and other products and services mentioned herein, as well as their respective logos, are trademarks or registered trademarks of AG in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies. The information contained in this document is solely for informational purposes. Software GmbH shall not be liable for errors or omissions with respect to the materials. The only warranties for products and services are those that are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty.