Delphix Modernization Engine REDUCING THE BURDEN OF REGULATION, LEGAL HOLD, AND DISCOVERY USING DELPHIX LIVE ARCHIVE WHITE PAPER

Transcription

1 Delphix Modernization Engine REDUCING THE BURDEN OF REGULATION, LEGAL HOLD, AND DISCOVERY USING DELPHIX LIVE ARCHIVE

2 TABLE OF CONTENTS Introduction...3 Common Terms to Which We Refer....4 What is Live Archive?...4 Translating the Archiving Needs of the Business Into Technology....5 Syncing and Re-Syncing Delphix Data Sources...6 Archival: TimeFlow Preservation & Data Source Bookmarking... 7 Restoring Application Environments or Composite Applications...7 Customer Implementation: Live Archive at a Public Manufacturer... 9 Summary

3 INTRODUCTION Your company is subject to legal obligations to preserve and produce detailed point-in-time records of your business in response to regulations (such as HIPAA, Sox, FINRA) or hold or discovery orders from courts. Companies often meet these burdens with data archiving. Typically, an archiving strategy must deliver key capabilities such as preserving data, protecting preserved data from change, providing reasonable and rapid access to archived data, migrating data to be archived off of live Business Systems, and archiving Business Systems that are or are targeted to be retired but whose data must continue to be available to comply with those regulations or court orders. To complicate matters, a poor data archiving strategy can take its toll in terms of increased risk and exposure to the company and its executives, damage to the corporate brand, decreased revenue due to data bloat in Business Systems, and longer timelines for the delivery of the infrastructure that underpins the Business Systems. The implications of not being able to comply with regulations, orders, and laws which require data delivery can be huge. Consider the following actual customer scenarios: Failure to meet these burdens, or meet them in a timely fashion, has subjected CFOs, general counsel, auditors, and even CEOs, to both corporate and personal risk, loss of credibility, loss of employment, and even risk of imprisonment. Poor archiving strategies have throttled Line of Business systems, reducing their ability to accommodate new markets, new product lines, and more customers, putting increased pressure on LOB owners. Business system costs have rapidly grown and application rationalization timelines have rapidly expanded due to the ever-increasing age of live data, and the enormous scale of the backups of that data. The Delphix Modernization Engine is an integral part of ensuring your archiving strategy is actually enabling your business. It provides an easier and more cost-effective way to preserve and protect the data and file systems that underpin your Business Systems, and also provides very rapid access to that data even for retired systems. This whitepaper provides an overview of the Live Archive feature of the Delphix Modernization Engine, and focuses on two business cases: Retiring a Business System that may need to be resurrected if there s a compliance issue. Reproducing data as of specific points in time in response to injunctions to hold data, or discovery collections to release data. 3

4 COMMON TERMS TO WHICH WE REFER Because terms can be confusing, for the remainder and more technical portion of this document, we ll define a Data Source as one of the following: a database (such as Oracle, SQL Server, or Postgres), an application tier (such as the application tier for a packaged Oracle E*Business Suite environment), or a set of one or more directories within a file system (any collection of unstructured data short of a full copy of a host). We ll define an Application Environment as a collection of two of more Data Sources that work together as a single application whether packaged or custom. Finally, we ll define a Composite Application as a collection of two or more Data Sources or Application Environments that are distinct and provisioned independently, but that have interdependencies requiring them to be able to act in concert. Application users, line of business owners, and CXOs or Executives will commonly refer to the live version of an Application Environment or of a Composite Application as a Business System. WHAT IS LIVE ARCHIVE? Delphix is an Agile Data Delivery Platform for Application Projects. Recently, we released a new product called the Delphix Modernization Engine, which brings agile data to your Data Center Migration/ Consolidation and Application Consolidation, Rationalization, and Archiving needs. As part of this new product, Delphix introduced Live Archive, a collection of features that will allow you to maintain many point in time copies of 1 or more Data Sources or Application Environments in a highly efficient and readily reproducible manner. In particular, Live Archive uses the Delphix SnapSync, LogSync, Bookmarking and AppData features and the Group Provisioning capability together to help you retain, protect and reproduce any point-in-time from your Data Source(s) and Application Environment(s) on demand. We ll discuss each of these Delphix features/capabilities as it relates to commonly-needed archiving capabilities, show you how the Delphix Modernization Engine provides them, discuss some key insights, and provide a few customer examples. 4

5 TRANSLATING THE ARCHIVING NEEDS OF THE BUSINESS INTO TECHNOLOGY Archiving commonly exists to answer questions such as: Are you in compliance? What did the company know?, When did the company know it?, and How do I know the data is accurate?. Answering these seemingly simple questions often involves tangled and torturous processes because data may no longer present in Business Systems, may not be readily available for restore, or may not be possible to restore in a time consistent manner. Moreover, the very nature of the legal process means that the exact points in time that are relevant for discovery may not be known in advance, resulting in huge storage bills and impacts to Business Systems as this massive amount of data is journaled. These business needs require the following technical capabilities: An ability to preserve data from one or many Data Sources within an Application Environment or Composite Application in the most space-efficient manner possible, mitigating the enormous backup and journaling burden while also preserving self-service data access to meet the need to produce the archived data. An ability to continuously (or in a change event driven fashion) bookmark all of those Data Source(s) individually or severally so that organizations can identify and synchronize the timelines for any single Data Source or any group of Data Source(s) to a point in time generally unknown in advance, providing rapid pointin-time access to data and radically simplifying the ability to relocate the data to new geographies. An ability to retrieve or reproduce whole and time-synchronized Application Environments or Composite Applications on demand so that a true and accurate point-in-time picture of the data across a large set of Data Sources can be reproduced with high fidelity. Figure 1: Live Archive Workflow 5

6 SYNCING AND RE-SYNCING DELPHIX DATA SOURCES Delphix utilizes its SnapSync, LogSync and AppData features to non-disruptively connect to a Data Source, build a one-time, highly condensed and faithful copy of that Data Source, and then continuously or at regular intervals sync with that Data Source through automated, on-demand, or event-driven collection. For Oracle databases, the SnapSync and LogSync features utilize standard Oracle RMAN APIs. For Oracle databases, the first (and only the first) SnapSync synchronization is akin to an RMAN Level 0 Backup. All subsequent SnapSync synchronizations are like RMAN Level 1 Backups. The LogSync feature is akin to an Archive or Online Redo shipment (depending on how you configure it). For SQL Server databases, the SnapSync and LogSync features are a function of the collection of T-logs from your backup server. For PostgreSQL databases, the SnapSync and LogSync features leverage the standard PostgreSQL tools. The initial copy of the PostgreSQL database is completed with pg_ basebackup. Going forward, the PostgreSQL synchronization activities are completed from WAL files via pg_ receivelog. For the Oracle E*Business Suite, the database tier is treated as described above and the application tier leverages the AppData feature to connect and synchronize with the file system. Delphix specifically supports Oracle E*Business Suite s application tier by creating a Data Source to represent the variety of directories used to deploy E*Business Suite. Essentially, for E*Business Suite, each directory is ingested into Delphix akin to a file system snapshot, but with advanced controls and configurations to maintain its ease of deployment. Delphix leverages standard EBS and file system tools to perform these operations. For the initial copy, and subsequent SnapSync operations, Delphix initiates rsync with incremental flags (one-time full copy, then incremental forever). If you have additional scripts or commands that you require to complete the cloning operation, Delphix allows you to add these through the Delphix Hooks feature as part of the automatic clone configuration process. Finally, for E*Business Suite, the Oracle database binaries themselves become a Data Source in the same sense as the application tier. Together, these three Data Sources form an Oracle E*Business Suite Application Environment. For non-e*business Suite packaged applications, and unstructured data, each directory (or collection of directories) is ingested as a Data Source. Proper division into multiple Data Sources requires some planning to avoid problems such as dependencies with common configuration files and directories, differing O/S owners, permissions issues, and application-specific cloning and deployment concerns. Some application architectures simply cannot unhook their dependencies with a directory-level approach, and must instead have their data archived along with their application installation media and configuration files. 6

7 ARCHIVAL: TIMEFLOW PRESERVATION & DATA SOURCE BOOKMARKING The timeline of these synchronization events with Data Sources can be tuned to a very fine-grained level; collectively, all of these reproducible points in time form a Delphix TimeFlow. Delphix can faithfully reproduce a Data Source at any point in time on its TimeFlow. The time-stamps common to all synchronization events on the TimeFlow provide simple bookmarking, and a common scheme for provisioning multiple Data Sources simultaneously. In addition, customers can use specify their own bookmarks for convenience or easy labeling. Live Archive allows you to store a set of every provision-able point on an entire Data Source s TimeFlow (or set of Data Sources TimeFlows) in a highly compressed manner and in a method where each of those provision-able points can be reproduced on demand. Live Archive also utilizes the retention period and discrete retention features of the Delphix Modernization Engine to allow you to selectively release the contents of an Archive once a judicial hold order or a regulatory data preservation period expires. In particular, retention periods allow you to hold an arbitrarily long window of data for as long as necessary, and then with a few clicks of a mouse release all of the archived data from before a specific date. Further, discrete retention allows you to keep particular points in time separately from that window on a different schedule. For example, you may wish to keep your end-of-year archive for seven years, but only keep your interest rate swaps for 6 months to meet the Dodd-Frank rules. RESTORING APPLICATION ENVIRONMENTS OR COMPOSITE APPLICATIONS Application Environments composed of many Data Sources, or Composite Applications composed of many Data Sources and/or Application Environments cannot be faithfully reproduced if each of the Data Sources does not have a marker that orders and distinguishes among different points in time within the life of a Data Source, as well as shared points in time between two or more Data Sources. The Delphix Modernization Engine relies on its bookmark feature to attach labels for various points in time and to distinguish and order those points in time. This bookmarking is often sufficient for provisioning groups of Data Sources that have unique identifiers of change since the Delphix Modernization Engine already records each of those changes. Often, even when archives exist, it s extremely expensive or difficult to restore even the data to a point where it is usable and searchable in response to a regulatory or judicial need. However, with Live Archive customers can faithfully reproduce Data Sources, Application Environments, and even Composite Applications, either virtually or physically, and in very short order. 7

8 Since the Delphix Modernization Engine is built around the Delphix Data Virtualization capacity, Delphix can easily spin up virtual Files, Binaries and Databases collectively to bring an application up in minutes. Moreover, by utilizing our Virtual to Physical feature, customers can fully restore these same systems outside of their Live Archive as well while the virtual is up and running. Live Archive offers the best of both worlds very rapid access to virtual copies of archived systems that are available for transactions and that don t compromise the original archive, and copy-time access to physical copies of archived systems available for any other purpose. Suppose, for example, that you had migrated off of your R11 Oracle E*Business Suite to SAP about a year ago and decommissioned the system. Suppose further that you were audited and had to reproduce the reports that were in that R11 EBS system as they would have been on August 11th before your merger and August 12th after your merger. With standard tape archives, it could be a two-month exercise to find the appropriate tapes, carve out storage to rebuild this new environment, load the tapes up, synchronize the data, code, and configuration, reconfigure the environment, get the environment up and running, and finally execute the reports. With Live Archive, you can point to a server, select August 11, and spin up the database files, database, and application in a few minutes, and run the report. And you can repeat it for August 12th immediately after that. You can turn your two-month report reconstruction project into a few mouse clicks and be done that afternoon. 8

9 CUSTOMER IMPLEMENTATION: LIVE ARCHIVE AT A PUBLIC MANUFACTURER BUSINESS PROBLEM Before Delphix, a major public manufacturer would have faced significant infrastructure challenges for their Oracle E-Business Suite Upgrade from R11 to R12. Costs for maintaining this legacy environment were significant, and data delivery was impeded by the lack of data management controls and rapid access to data. In addition, there was significant concern of being out of compliance with Sarbanes-Oxley (SOX) regulations. This manufacturer needed to upgrade to R12 quickly, reduce costs, and make sure there was no data loss or compliance risk for SOX. TECHNICAL DETAILS The manufacturer was deployed in a fairly standard R11 Architecture with an EBS Application Tier supporting a 1 TB Oracle Database. Copies of this R11 environment were created for R12 Data Mapping, and each occurrence of that copy as development of testing continued took hours to days across multiple teams. In this upgrade case, the manufacturer needed full copies of the data for development and testing to prepare and execute a production cutover to R12. Compliance Risk Mitigation Start Migration Complete Migration Compliance Audit Missing Data! EBS R11 2x Faster EBS R Deployed Delphix R11 Live Archive Reactivate R11 Environment RESULTS Delphix successfully supported the R12 conversion, reducing the migration timeline by 50% and mitigating major project risks. And, when a SOX compliance audit caused a concern that data had been lost, Delphix Live Archive was able to reactivate their R11 environment so that they could pull the data needed to satisfy the SOX audit and, as the customer said, save my bacon. The manufacturer realized a 92% reduction (up to 7 Tb) in storage for their nonproduction Oracle E-Business Suite databases, reduced provisioning time from 5 hours to 5 minutes, enabled rapid provisioning of test environments, spun up additional environments to support their R12 effort, and shifted resources to R12 efforts to accelerate project timelines. 9

10 SUMMARY With Live Archive, users can take continuously preserved data and restore it in a fraction of the time it would take to restore from a tape backup. With Live Archive, users can restore the databases and the applications to complete working order in very short time frames. Live Archive short circuits the time between the request for archived data and the time that data is ready for search, report, and use. Delphix Live Archive mitigates the risk and exposure to your company and your brand by providing you secure access to your archived data without the enormous data bloat caused by many extant solutions. Using the Delphix Modernization Engine, customers can deliver key archiving capabilities to preserve and protect their data while still providing rapid and faithful access to it in very short order; can enable migration or consolidation of legacy data centers/applications/databases while preserving the ability to reproduce those legacy systems on demand to comply with specific regulation; and can provide cost and time efficient storage and discovery of data to comply with regulations or court orders. 10

11 Reducing the Burden of Regulation, Legal Hold, and Discovery Using Delphix Live Archive February 2015 You can find the most up- to- date technical documentation at: The Delphix Website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: Delphix Corp. 275 Middlefield Road, Suite 210 Menlo Park, CA Delphix Corp. All rights reserved. The Delphix logo and design are registered trademarks of Delphix Corp. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.