SanDisk/Kaminario Processing Rate of 7.2M Messages per day Indexed 100 Million s and Attachments Solves SanDisk ediscovery Challenges

Transcription

1 WHITE PAPER SanDisk/Kaminario Processing Rate of 7.2M Messages per day Indexed 100 Million s and Attachments Solves SanDisk ediscovery Challenges June SanDisk Drive, Milpitas, CA SanDIsk Corporation. All rights reserved

2 Table of Contents 1. Overview SanDisk ediscovery Challenges The Solution Underlying Hardware About SanDisk

3 1. Overview SanDisk Corp., a top-tier provider of flash storage technology, with multinational businesses across retail consumer goods, OEM relationships with phone and computing device manufacturers, and a provider of enterprise data center and cloud solutions, faced mounting ediscovery challenges that, if not managed properly, would put the company at risk with time-consuming litigation matters, non-compliance of Records and Information Management (RIM) Governance, and ediscovery-related cost overruns. SanDisk Corporation Company Profile: Revenue: US$ 6.3 billion (Q1-2014) Publically traded and member of the S&P 500 5,900+ employees, business in more than 100 countries Products are sold at more than 300,000+ storefronts worldwide OEM relationships with phone and computing devices Holds more than 4,900 patents worldwide Silicon Valley headquarters, manufacturing facilities in China and Japan To alleviate and address these ediscovery challenges, SanDisk chose to deploy an end-to-end solution comprised of ediscovery and global archiving software running on enterprise-class flash storage. SanDisk/Kaminario: indexed 100 million s and attachments at a processing rate of 7.2M messages per day The SanDisk ediscovery solution has improved the time and cost spent by the legal department in managing ediscovery issues and enhanced the legal department s ability to mitigate litigation risks. As part of the solution, a centralized global archive was also deployed to help employees retain, manage and access SanDisk ediscovery Challenges With over 5,900 employees supporting SanDisk business in over 100 countries for consumer products, OEM relationships, and enterprise & cloud solutions, SanDisk ediscovery challenges are complex and diversified. SanDisk, founded in 1988, and with over 25 years of operations, accumulated ediscovery challenges where indexing, searching, sorting, and archiving processes have become time-consuming and operationally expensive. SanDisk employees send and receive more than 500,000 to 1 million s per day. SanDisk IT maintains a corporate archive that stores over 21 Terabytes (TB) of data. The elimination of local Microsoft Outlook Exchange PST File archiving also required the need to transition to a centralized approach for compliant data retention. SanDisk , at 25,000 pages per gigabyte (GB), is more than 0.5 billion pages of documents, which reside in the SanDisk archive. Costs of searching and reviewing an archive of this particular size needed to improve due to traditional approaches would not be able to perform at the current volume. 3

4 Cost reduction was necessary, considering an attorney generally takes 167 hours to read one GB of (about 20,000 s). The SanDisk ediscovery solution needed to implement the following: Ability to set digital data retention rules Provide legal capabilities for legal hold Enable early case assessment Collaboration and external case management Analytics Establishment of end-user retention rules Special handling of electronic data for active litigation holds 3. The Solution Initially, SanDisk IT Department planned on the deployment of traditional spinning hard disk storage for the SanDisk ediscovery infrastructure. After performance testing and ediscovery trials in preparation for the complex data migration, the traditional HDDs proved to not meet the performance requirements of SanDisk and would increase the migration risk and considerably lengthen the project implementation timeline. Based on trial runs, SanDisk IT estimated that to load, index and archive these quarter of a billion s (plus the attachments) onto traditional HDD storage, an unacceptable lead time of 50 days (processing rate of 2 million s per day) would be required. HDD storage was deemed unusable, as its use would jeopardize the release of the ediscovery capabilities to the SanDisk legal team, and eventually, the company-wide deployment of the powerful search and archive functionality. To accelerate the ediscovery timetable, SanDisk CIO, Ravi Naik, assigned a team of engineers to evaluate the performance of several all-flash storage arrays that would serve as an alternative to HDDs for this particular ultra-high performance application. The hypothesis that drove this decision was that low latency (<0.5 millisecond) flash storage would virtually eliminate the immense indexing challenge. SanDisk IT and SanDisk attorneys deployed HP Autonomy ediscovery solution so they could migrate data from Microsoft Exchange and the legacy EVault archiving platforms into HP Autonomy. In total, more than 250 million messages were processed and then eventually reduced to 100 million unique indexed messages (generating 11TB of data) on the Autonomy platform. 4. Underlying Hardware 4

5 Kaminario all-flash storage array was selected which comprises thirty two 800GB capacity SanDisk Optimus Extreme Solid State Drive (SSD) from SanDisk. The combination of this enterprise-class SSD with the Kaminario all-flash array offers predictable, sustained performance, superior reliability and high endurance. The Kaminario architecture is scalable and features proprietary technology, including N + 1 redundancy to ensure the high resilience and uptime of SSDs. With the SanDisk/Kaminario all-flash solution, the data dilemma was solved. Against a production workload, HP Autonomy indexed 100 million s and attachments in just 12 days, averaging 7.2M messages per day a result that surpassed even the most optimistic estimates. That processing time was a fraction of the 50 days (two million s a day) that it took conventional HDDs to complete the same migration task. The all-flash array storage solution achieved ultra-high performance, high IOPS (input/output operations per second) rates, low latency and high resilience. The architecture was optimized for data protection and it proved to have high reliability and high availability. # Messages Indexed (Millions) Kaminario Produc on Autonomy Indexing Dura on (Hours) Figure 1: SanDisk IT Test Lab Performance 5

6 days 7.2M s/day Days M s/day 12 Days 5 0 HDDs SSDs Figure 2: SanDisk IT Production Performance 5. About SanDisk The world of digital content grows exponentially every day. From mobile devices to data centers, SanDisk delivers the peace of mind that data is readily available and reliable, even in the most challenging environments. It s all part of delivering on our mission to enrich people s lives through digital storage anytime, anywhere. Since 1988, companies and consumers around the world have counted on our storage solutions in many areas, including: Data Center - In the data center or in the cloud, our leading-edge flash technology enables fast, reliable access to mission-critical data. Computing - Our solid state drives offer energy-efficient, compact, and durable alternatives to traditional hard-disk drives for desktops, laptops, and ultra-thin PCs. Mobile - High performance flash storage is essential in smartphones, tablets, and other mobile devices. We deliver embedded memory solutions to every major mobile device manufacturer. Consumer Electronics - From cameras to USB drives to MP3 players, the quality and performance of SanDisk technology is in many of your favorite devices. 6

7 Products, samples and prototypes are subject to update and change for technological and manufacturing purposes. SanDisk Corporation general policy does not recommend the use of its products in life support applications wherein a failure or malfunction of the product may directly threaten life or injury. Without limitation to the foregoing, SanDisk shall not be liable for any loss, injury or damage caused by use of its products in any of the following applications: Special applications such as military related equipment, nuclear reactor control, and aerospace Control devices for automotive vehicles, train, ship and traffic equipment Safety system for disaster prevention and crime prevention Medical-related equipment including medical measurement device Accordingly, in any use of SanDisk products in life support systems or other applications where failure could cause damage, injury or loss of life, the products should only be incorporated in systems designed with appropriate redundancy, fault tolerant or back-up features. Per SanDisk Terms and Conditions of Sale, the user of SanDisk products in life support or other such applications assumes all risk of such use and agrees to indemnify, defend and hold harmless SanDisk Corporation and its affiliates against all damages. Security safeguards, by their nature, are capable of circumvention. SanDisk cannot, and does not, guarantee that data will not be accessed by unauthorized persons, and SanDisk disclaims any warranties to that effect to the fullest extent permitted by law. This document and related material is for information use only and is subject to change without prior notice. SanDisk Corporation assumes no responsibility for any errors that may appear in this document or related material, nor for any damages or claims resulting from the furnishing, performance or use of this document or related material. SanDisk Corporation explicitly disclaims any express and implied warranties and indemnities of any kind that may or could be associated with this document and related material, and any user of this document or related material agrees to such disclaimer as a precondition to receipt and usage hereof. EACH USER OF THIS DOCUMENT EXPRESSLY WAIVES ALL GUARANTIES AND WARRANTIES OF ANY KIND ASSOCIATED WITH THIS DOCUMENT AND/OR RELATED MATERIALS, WHETHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION, ANY IMPLIED WARRANTY OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE OR INFRINGEMENT, TOGETHER WITH ANY LIABILITY OF SANDISK CORPORATION AND ITS AFFILIATES UNDER ANY CONTRACT, NEGLIGENCE, STRICT LIABILITY OR OTHER LEGAL OR EQUITABLE THEORY FOR LOSS OF USE, REVENUE, OR PROFIT OR OTHER INCIDENTAL, PUNITIVE, INDIRECT, SPECIAL OR CONSEQUENTIAL DAMAGES, INCLUDING WITHOUT LIMITATION PHYSICAL INJURY OR DEATH, PROPERTY DAMAGE, LOST DATA, OR COSTS OF PROCUREMENT OF SUBSTITUTE GOODS, TECHNOLOGY OR SERVICES. No part of this document may be reproduced, transmitted, transcribed, stored in a retrievable manner or translated into any language or computer language, in any form or by any means, electronic, mechanical, magnetic, optical, chemical, manual or otherwise, without the prior written consent of an officer of SanDisk Corporation. All parts of the SanDisk documentation are protected by copyright law and all rights are reserved SanDisk Corporation. All rights reserved. SanDisk is a trademark of SanDisk Corporation, registered in the United States and other countries. Optimus is a trademarks of SanDisk Enterprise IP LLC, registered in the United States and other countries. Optimus Extreme is a trademark of SanDisk Enterprise IP LLC. Other brand names mentioned herein are for identification purposes only and may be the trademarks of their holder(s). Kaminario_eDiscovery_short