Understanding How Tape Storage Addresses Key IT Objec:ves

Transcription

1 Understanding How Tape Storage Addresses Key IT Objec:ves Introducing LTO Ultrium 5 Technology and Linear Tape File System Bruce Master Sr. Program Manager IBM Data Protection & Retention bmaster@us.ibm.com Linear Tape-Open, LTO, LTO Logo, Ultrium and Ultrium Logo are registered trademarks of HP, IBM and Quantum in the US and other countries. Linear Tape File System is a trademark of IBM Corp. Other symbols may be trademarks of other companies. 1

2 Agenda State of the Storage Universe Storage Issues Addressing performance, data protec:on and reten:on objec:ves Introducing LTO- 5 Technology and Linear Tape File System 2

3 State of the Storage Universe Data stores are rapidly growing and files are huge (HD, 3D) Budgets are :ght Storage acquisi:on, maintenance, management and energy cost constraints Must manage SLAs Must protect and preserve data assets 3

4 Storage Issues Data is growing faster than I can manage Not all data is alike Costs are out of control Data is vulnerable to corrup:on threats My backup repository is growing My backups are my archive 4

5 Informa(on is beaming in from everywhere! 2.5 billion RFID tags sold in million GPS devices sold annually by million smart electric meters in M by 2014 Text messages generate 400TB of data daily in the U.S. MRIs will generate a petabyte of data globally this year 5

6 An Informa:on Explosion Meets Budget Reality Zettabytes Storage requirements growing 20-40% per year Exabytes Backup and Archive requirements growing 40-50% per year Storage budgets up 1%-5% in 2010 Petabytes The information explosion meets budget reality Terabytes Gigabytes

7 Storage Hierarchy Balanced Diet DRAM Cache Solid-State Drives (SSD) Phase Change Memory FC and SAS disks SAN SATA disks Virtual Tape NAS/iSCSI Build out automated :ered storage architecture to op:mize performance, protect data and reduce costs Tape 7

8 Not All Data Should Be Treated the Same Way Recovery Time Objective (guidelines only) Seconds - Minutes" Minutes - Hours." Hours - Days" Value of Data Determines RTO Mission Critical Dynamic Data Disk and DB Mirroring Electronic Vaulting / Replication Active Online Data Nearline Data Tape Storage Value of Data / Financial Investment 8

9 Data has a lifespan... It can be hot, warm or cold Most data, as it ages, becomes: Less frequently accessed Frequency of Access Less likely to be needed for business continuity More likely to be archived Some Data remains warm Some Data stays cold Most Data starts out cold Data Created Data Actively Used Data Archived Time 9

10 Most Network Data Sits Untouched Access Patterns of Data Stored on Disk. Three month study of a businesses 22TB disk data access Conducted by University of California, Santa Cruz 90% of the data was COLD - never accessed after being stored on disk Another 6.5% of the data was COOL - accessed only once U of C recommendation: move data to less expensive and less energy consuming storage units.. Use Tape! Source: Government Computer News, July 1, Most network data sits untouched by Joab Jackson 10

11 Costs Comparison Studies ESG Backup/DR TCO Study: Dedupe VTL vs. LTO-5 Library System 1 5 Year TCO Backup/DR Study; VTL with 15:1 Deduplication reduction ratio vs. LTO-5 Library Costs included hardware, maintenance, floor space, software, people and energy Clipper Group Archive TCO Study: SATA Disk System vs. LTO-5 Tape Library System 2 12 Year TCO Archiving Study Back-end storage costs covering hardware, maintenance, floor space and energy Disk storage was 15x Tape TCO Scenarios included various DR methods (i.e. replication, PTAM) The cost of energy alone for the average disk-based solution exceeded the entire TCO for the average tape-based solution Dedupe VTL was from about 2-4 times more costly than tape system LTO-5 Cartridge is about 5 cents per GB uncompressed! 3 1 A Comparative TCO Study: VTLs and Physical Tape, By Mark Peters, ESG, Feb Cartridge price as of internet search March Clipper Notes report In Search of the Long-Term Archiving Solution - Tape Delivers Significant TCO Advantage over Disk, The Clipper Group, Dec.23, This was a general TCO study and did not 11 specifically focus on LTFS or video storage.

12 Numerous Threats Can Corrupt and Destroy Data More than a quarter of the companies in a Forrester Research study declared a disaster in the past five years 1 76% of companies have experienced a disaster or major business disruptions 1 Risks of downtime " Lost revenue and market share " Lost productivity " Non-compliance " Loss of reputation and customer trust " Loss of the business ACCIDENTAL Natural Disaster System Error Operation Error INTENTIONAL Virus Theft Hacker Sabotage Disgruntled employee 1 Building the Business Case for Disaster Recovery Spending, Forrester Research, April

13 Hard Lessons Learned Feb 2008: Bank lost unencrypted backup tapes with sensitive data about 12 million customers Jan 2010: University computer infected with a virus may have exposed the personal information of 3,500 Mar 2009: Large pharmacy chain pays $2.25M in fines for improper disposal of patient data 2011: Software error corrupts many records on primary and replicated storage. Offline tape storage recovers records. 2011: Software error corrupts many records on primary and replicated disk. Offline tape storage recovers records. Feb 2009: Hackers broke into government admin computers accessing 48K names and social security numbers May 2009: Hackers 'destroy' both production servers and there was no offline backup May 2009: Hackers 'destroy' both production servers and there was no offline backup 13

14 Tape Saves the Day Ben Treynor, VP Engineering and Site Reliability Czar for Google Gmail, used the official Gmail blog to explain the situa:on and provided a powerful endorsement for off- line removable tape storage. I know what some of you are thinking: how could this happen if we have mul:ple copies of your data, in mul:ple data centers...well, in some rare instances soeware bugs can affect several copies of the data. That s what happened here. Some copies of mail were deleted...to protect your informa:on from these unusual bugs, we also back it up to tape. Since the tapes are offline, they re protected from such soeware bugs. 14

15 Flood Brisbane, Australia - January 2011 March 2011: Japan is Devastated 15

16 You may not have had a car accident in years But you still want a car with: Seatbelts, Airbags, ABS, Alarm System, Etc Data Protec:on / Data Backup => Life insurance for your company => Mul:ple levels of protec:on

17 Best Prac:ces in Data Protec:on Have mul:ple copies or layers of protec:on: depending upon value of data, keep at least 3 copies, keep in different loca:ons; one out of region Use disk and tape Isolate one copy: at least one copy offline for logical system isola:on to avoid inten:onal or uninten:onal corrup:on that can occur with online storage - Use tape; Keep offline Have technology diversifica:on: copies on different forms of media to avoid a media or system process disaster - Use disk and tape Protect access to data: at rest and in transit Use encryp:on; Use WORM Manage backup differently than archive: Backup mul:ple, point in :me consistent copies for opera:onal and DR recovery consistent with applica:on specific RTO/RPO - Use disk and tape Archive single instanced data for long term reten:on: combina:on of disk & tape *Best Practices Source: Debbie Beech, Sylvatica Consulting / David Hill, Mesabi Group 17

18 Large Truck Express Line Survives Hurricane Flood Implements Best Prac(ce Data Protec(on and Reten(on Systems Business Challenge: Hurricane Gastone flooded Data Center with 5 e. of water Total loss of hardware, networks, phone systems, generator, and u:lity power Good news: a tape backup of 100% of the data was made the night before stored off site! "You are out of your mind if you think you can live without tape" Dick Crosby Systems Manager, Estes Solu:on: Protect assets and business resilience with comprehensive best prac:ce strategy Create nightly disk flash copy for fast retrieval and window- less backup to tape Backup 100% produc:on data to LTO tape library nightly: tapes moved offsite Global Mirror DR site and backup to LTO tape library Lights out! Creates 5 copies of data (2 offline on tape in different remote loca:ons) Benefits: Able to control TCO, access data and protect data with :ered storage strategy No produc:on system interrup:on No save window- Set it & forget it No produc:on cycles, no operators, lights out opera:ons Logical data protec:on and out of region protec:on 18

19 Facts about archived data: Long term preservation of: Company Intellectual Property Federal, State, Industry, or Company Regulations ediscovery and Legal Implications Data older than 1 year is very unlikely to be recalled Operational Expense of maintaining data whether archived or backed up is dependant on the hardware and software used, not the purpose. The size of an archive is only going to grow, regardless of retention length. Removing static data from backups to the archive can reduce backup storage requirements, reduce costs and improve backup performance 19

20 Archive Capability Tape Disk Source: Tape The Digital Curator of the Information Age. By Fred Moore, President, Horison, Inc. 20

21 The reports of tapes demise are grossly exaggerated, (borrowing a phrase from Mark Twain) Tape is cheap, safe and reliable and there is no substitute.the archive data backstop. It is the data centre's lifebelt and lifeboat. Without it, when the data loss/data corruption storm strikes, you are sunk. It's that simple. Chris Mellor Tales from the Storage Frontier May

22 WW Tape Storage Media Capacity Shipments Trends Record setting 4.7PBs of Tape Shipped in 1Q11 Up 7% over previous quarter Up 34% over previous year Double digit growth for LTO Tape Media 22

23 Why Tape? Top 10 Reasons 1. Tape has the lowest TCO and lowest consump:on of energy 2. Tape is portable off- site and off- line logical data protec:on from asacks that can corrupt on- line data 3. Tape is reliable: advanced servo systems, state of the are heads and media formula:ons, read aeer write verifica:on and more! 4. Tape is infinitely scalable just add more cartridges! 5. Tape streams very fast.up to 280MB/sec with LTO- 5 Drives* 6. Tape is secure & innova:ve: WORM, encryp:on, and new LTFS 7. Tape is easy to manage with automated tape libraries 8. Tape has a long shelf life: up to 30 years 9. Tape s future is bright: LTO Roadmap, 35TB & 50TB demos 10. Tape is a strategic :er: A blend of disk and tape can help address the varied needs for performance, compliance, security, archive, data protec:on, TCO and energy efficiency *assumes 2:1 compression 23

24 Tape and Disk are Complementary for Op:mal Performance, Archive, Data Protec:on and TCO Blended Tiered Storage Example With Layers of Protection There is no other medium that offers what tape does for archiving. LTO tape technology continues to evolve with LTO-5, Curtis Preston, techtarget.com Feb 18, 2010 Application Servers Backup Server DR Library Tape Library VTL Virtual Tape Library Replication Storage Manager Survey Results* 61% of current disk-only users plan to start using tape *Source: Fleishman-Hillard Research Dec

25 LTO- 5 Tape Can Handle and Preserve Large Backups and Archives LTO- 5 Tape is Huge and Reliable 1.5 TB / cartridge na:ve: 3 TB / cartridge (2:1 compressed) That s about 30 DVD movies per cartridge Automa:on offerings from 20-1,000s of cartridge slots Highly Reliable: Servo Tracking, Read a^er Write Verifica:on, 250K MTBF Hours, up to 30 year shelf life LTO- 5 Drives are Fast Up to 140 MB / sec. na:ve Up to 280 MB / sec. (2:1 compressed) That s > 1TB of saved per drive / hr (2:1) LTO TAPE About 4M LTO Tape Drive Shipments About 200M LTO Cartridge Shipments 25

26 LTO Data Security WORM (Write Once Read Many) LTO 3, 4 and 5 drives and WORM cartridges Unalterable tape data storage Can append data to cartridge Tape Drive Encryp:on LTO 4 and 5 Tape Drive Hardware Encryp:on AES 256 bit encryp:on data key provided to tape drive Data is compressed then wrisen to tape cartridge in encrypted form to maximize capacity and protect sensi:ve informa:on Virtually no impact to drive performance Helps eliminate need for encryp:on SW or appliance Get encryp:on key management soeware from tape vendors Straight forward implementa:on process 26

27 Providence Health & Services Encrypts with LTO- 4 Tape Drives Six data centers in five states all encryp:ng off- site media Daily backups are between 1 8 TB per site Centralized, automated data protec:on system eliminated manual management of backups Effec:vely established a disk to disk to tape strategy Assured data is protected LTO- 4 addresses security and compliance requirements it took only 1 to 2 days to implement encryption. Mack Kigada, Data Storage Manager, Providence Health and Services *See white paper: Securing Sensitive Information -- with LTO-4 tape drive encryption. by Silverton Consulting at 27

28 Linear Tape File System (LTFS) What is it - How does it work? Tape drive freeware that is downloaded on to Linux, MAC, Windows U:lizes the new LTO- 5 dual- par::oning capability Index par::on and content par::on: Mount a tape as if it was a hard drive Creates a self describing tape; view contents in the OS browser; drag and drop! No addi:onal backup applica:ons needed; can share tapes across plavorms You can think of it as a giant 1.5TB uncompressed memory s:ck BOT Partition 0 Guard Wraps Partition 0 Guard Wraps F123DesrLoc1344 EOT Partition 1 1 F123 Potential Applications: Video workflow, individual scene access and video asset archive Digital video surveillance (squad car, parks, garages, etc.) Design and drawing content for manufacturing, architecture, construction Medical / Health imaging; Legal documents-evidence; Cloud apps and more! 28

29 LTFS in Ac:on with File Browser Files can be accessed on tape directly from any application Tape browsing on Linux Device Directory Tape Contents "We think that LTFS could be one of the most significant developments in the tape drive space since the introduction of LTO itself. George Crump, Analyst, Storage Switzerland, May 2010 See LTFS in Action in a 1 Minute Movie Clip at: 29

30 Client Reac:ons at NAB Show A^er Viewing LT0-5 Drive and Linear Tape File System in Ac:on "I am shocked! This is exactly what we need!" "You have made my dreams come true!" "You can't see it, but I am dancing inside!" "LTO-5 technology gives tape-less work-flow...with tape!" "We are going to get this (LTO-5 tape and LTFS)." "Now I can offer an LTO-5 archiving service to my movie clients." "We have LTO-3 and are now going to go to 5 with the file system" 30

31 LTFS Gets Rave Reviews LTO5 with its own File System: An Enabling Technology for Archive, Backup, Simple DR - even the Cloud By Eric Slack, Senior Analyst, Monday, October 18, 2010, Storage Switzerland LTO- 5 and LTFS: Shaking the Pillars of Heaven By Mark Ferelli, Aug 17, 2010, Computer Technology Review LTFS: Crazy like a fox "The more I thought about this idea the more I liked it... (LTFS is) also excellent for long term storage (i.e. archiving)." By W. Cur:s Preston, Aug 12, 2010, BackupCentral.com "The file system allows users to drag and drop files to and from tape the way they do with disk." By Andrew Burton, Site Editor, Aug 2, 2010, SearchDataBackup.com What is LTFS? could be one of the most significant developments in the tape drive space since the introduc:on of LTO itself. By George Crump, Storage Switzerland LTO- 5 with LTFS Gives Tape a New Lease on Life By Jerome M. Wendt on June 4,

32 Some LTFS Developments 1Beyond: high performance video produc:on and post produc:on, tapeless workflow and storage systems Arkivum: assured archiving, 100% guaranteed safe data storage service Cache- A: archive appliances serving the digital video industry Crossroads: online, file- based archive, combining disk storage with LTFS tape storage for a fast, cost effec:ve, long- term data archive FOR- A: innova:ve products and advanced video and audio technology Panasonic: this product can easily archive P2 content and preview P2 content from LTO tape directly like video tape SGL: content archive and storage management solu:ons to the media and entertainment Storage DNA: Intelligent LTO- 5/LTFS archiving for file- based workflows, applica:on archiving (Avid, Final Cut etc.) and con:nuous backup Thought Equity: large scale archive management and smart content metadata tools TOLIS Group Inc: Bru Backup Soeware- Producers Edi:on version provides na:ve LTFS support for OS X users 32

33 Protect Your Data Now and Down the Road LTO Ultrium technology can provide: Cost effective backup Reliable archive Disaster recovery Low energy consumption Ultimate data protection LEARN more at TRUSTLTO.com 33