ARCHIVING FOR DATA PROTECTION IN THE MODERN DATA CENTER. Tony Walker, Dell, Inc. Molly Rector, Spectra Logic

Transcription

1 ARCHIVING FOR DATA PROTECTION IN THE MODERN DATA CENTER Tony Walker, Dell, Inc. Molly Rector, Spectra Logic

2 SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member companies and individual members may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. 2

3 Agenda What archive is What archive is not Differences between archive and backup Challenges Why archive Recommendations Benefits Active Archives definition and benefits Case studies of Active Archives Evolution of tape-based storage and role in archiving 3

4 Abstract Archive We ll establish a standard definition of data archiving, forces driving it s adoption in enterprise environments and the benefits to be achieved with an optimized approach. We ll also review data lifecycle divisions and subcategories to understand where data should be stored (including storage tiers) and why (how to value data). By examining guidelines and policies for an effective archiving system we ll review how companies can optimize their storage network and reduce the bandwidth requirements needed for replication and disaster recovery necessary elements to satisfy data integrity and regulatory compliance requirements. In addition, we ll review how today s active archive solutions enable affordable, online, long-term data retention through case studies from the healthcare, broadcast, finance, education and oil/gas industries. Learning about the software applications available to manage data archives will help companies facilitate user online search and access 4

5 What archive is SNIA A collection of data objects, perhaps with associated metadata, in a storage system whose primary purpose is the long-term preservation and retention of that data. Archives are long term repositories for the storage of records. Electronic archives preserve the content, prevent or track alterations and control access to electronic records. (Source: Sedona Principles) Specialized repository (including the supporting processes, policies, hardware, and software) used to preserve information and data for the long term. (Source: Building a Terminology Bridge for Digital Information Retention and Preservation Practices) 5

6 What archive is not NOT backup NOT data protection NOT user selected, but policy driven NOT keep everything forever deletion policies are critical NOT storage tiering Moving older data to lower cost tiers for storage reclamation Storage that is physically partitioned into multiple distinct classes based on price, performance or other attributes. Data may be dynamically moved among classes in a tiered storage implementation based on access activity or other considerations. Source: SNIA 6

7 Archive vs. Backup Archive Primary record of data Retention and access Long-term Data maintained for analysis, value generation, history, or compliance Online or nearline Not data protection Backup Secondary copy of data Recovery Short-term Data typically overwritten periodically Not archive 7

8 Archive vs. Tiered Storage Archive Retention for future reference or compliance Policies determined by regulations Dynamic Tiered Storage Primary storage reclamation Policies driven by access patterns 8

9 Challenges Tiered Storage Primary storage overflowing with aged data 95% of data growth is unstructured data which is rarely accessed after creation* Issues with existing data management policies sometimes compound the data growth problem Backups taking too long; backing up static data Reluctance to address the issue due to lack of understanding the value of the data Lack of visibility into access patterns * IDC Multimedia White Paper, "As the Economy Contracts, the Digital Universe Expands," Sponsored by EMC, May

10 Challenges Archiving Regulatory requirements: Retention Disposal Change history Important information at risk of being lost Reference Perceived as difficult to implement No one cares sometimes even inside IT 10

11 Why archive? Determine retention requirements on creation. If archive, then why archive? Because you want to Because you have to 11

12 Retention Requirements Source: 100 Year Archive Requirements Survey 12

13 Archive Because you want to Data has some value to the business Requires policies and software to enable migration from the production environment into the archive environment 13

14 Archive because you have to Data retention is required for legal reasons Legal Compliance Regulatory Archive policies typically require legal approval 14

15 Some Legal Requirements FRCP Federal Rules of Civil Procedure Rule 16 Pretrial Conferences Rule 26 General Provisions Rule 33 Interrogatories Rule 34 Production of information Rule 37 Failure make disclosure or cooperate SEC 17 specifies retention, authenticity discovery, security, DR with penalties for noncompliance HIPAA requires security, privacy, authenticity, retention with penalties for noncompliance SOX penalties for knowingly altering, concealing, or destroying informaiton relative to an investigation Gramm-Leach-Bliley Act protect PII confidentiality and authenticity with penalties for noncompliance CFR requires preservation, authenticity, retention, protection, availability 15

16 Archive Performance Cost Tier 1 Tier 2 Archive Environment DR Copy Tier 3 Data is moved from the production environment into the archive environment. This movement removes data from the production environment. Archive occurs across all storage tiers The Archive environment provides long term data retention and disposition The Archive environment is not just another storage tier 16

17 Recommendations Archiving is not an isolated / stand-alone solution. Archiving should be part of a broader data management view. Do not implement an archive solution and simply move your data management problem from one place to another (ex. archive everything forever ) Establish retention periods and disposition polices for all business important information at creation Classify information upon creation and save a copy of all required records in a proper preservation-class archive upon creation 17

18 Archive Benefits Meet compliance requirements Preserves business important information Simplified data management Simplified backup/recovery operations Simplified disaster recovery operations 18

19 Active Archive: Online Access to ALL Your Data

20 Storage Pyramid

21 Active Archive Approach Extended File System

22 Active Archive Result:

23 Definitions Active archive A set of unstructured data such as office files and documents, video/audio files, PST files and CAD/CAM files, that contains production data, no matter how old or infrequently accessed, that can accessed online. Fueled initially by introduction of high density, lower power disk drives Momentum continued to build with release of power efficient disk arrays and high density, lower power disk drives. Next generation archives can leverage the latest in automated tape technologies offering high density, low power, cost effective archive storage 23

24 The Evolution of Active Archive SCSI/FC /SSD Host Data Creation SATA ACTIVE ARCHIVE APPLICATION DATA PROTECTION APPLICATION ARCHIVE Backup Onsite/Offsite Disaster Recovery Offsite Active Archive of Primary Data Set Copy of Data 24

25 Ineffective Storage Management Up to 70% of capacity of every disk drive installed today is misused 40% of data inert 15% allocated but unused 10% orphan data 5% contraband data Disk storage accounts for between 33 and 70 cents of every dollar spent on IT hardware: trend accelerating Source: Making IT Matter (Chalfant/Toigo, 2009)

26 Requirements for Active Storage 26

27 Tape technologies are reliable Reliability has increased 700% over the technology available a decade earlier Advances in the coating of tape film Read-after-write data verification Error correction codes Drive technology features simplified tape paths and servo tracking systems Beech, Debbie. Best Practices for backup and long-term data retention Sylvatica Whitepaper. The evolving role of disk and tape in the data center. June

28 and even more reliable in intelligent libraries Some libraries today have the intelligence to proactively alert if a media, drive or hardware issues are developing Gone are the days of not knowing if A tape has been used beyond any manufacturer thresholds There has been environmental damage to media Failures are drive or media related Data is on the tape media 28

29 Tape storage offers high energy efficiency Tape Library Disk System Clipper Group Study, Tape and Disk Costs - Starting with 125 TB of data - Assuming 14.5 cents per kw/hr increasing by 10% per year 29

30 Tape libraries offer the greatest storage density Low density disk array Reclaim space: % Same capacity, smaller footprint 30

31 Tape Libraries are Fast really fast! Write to tape: 121 TB/hr* Access from tape: seconds avg ** * Based on benchmarked data; assumes 2:1 data compression * Based on 120 LTO-5 Drives * *Times vary based on library and tape drive in use 31

32 Q&A / Feedback Please send any questions or comments on this presentation to SNIA: trackdatamgmt@snia.org Many thanks to the following individuals for their contributions to this tutorial. - SNIA Education Committee Tony Walker Molly Rector Name of contributor here Name of contributor here Name of contributor here Name of contributor here Name of contributor here Name of contributor here Name of contributor here Name of contributor here Name of contributor here Name of contributor here 32