Digital Data Preservation. PPDM Brisbane 2014

Transcription

1 Digital Data Preservation PPDM Brisbane 2014

2 Presentation Outline Some key thoughts and concepts A Brief History of Tape Why Preserve Data? Some Industry Examples of Data Loss The Future of Data Storage Tips on Basic Preservation Requirements

3 Key Thoughts Magnetic tape is still the choice for long term data retention for oil and gas exploration data. The amount of tape based data trapped on old storage media increases at the same rate as the release of new drive technology. Unlike disk drives, tape drives suffer from a unique problem. Disk drives store data, tape drives don t the tapes do. This parent child relationship is now ending in divorce at an increasing and alarming rate. Legacy data is no longer 20 year old data, it is data that is only a few years old. Alternatives now exist to stop the ongoing cycle.

4 Brief History of Tape The IBM 726 tape reader/recorder (launched in 1952) came complete with almost 4Mb of storage media.

5 Brief History of Tape Past and Present

6 50 YEARS AGO - A CITY OF LEGACY DRIVES Over 160,000 drives and tapes

7 TODAY 1 LTO tape drive now holds the same as over 160,000 IBM 726 tapes

8 Active Preservation Why? Three Main Reasons for Active Preservation - Oil and Gas Data is revisited on a routine basis Data needs to be transferred to other parties The data sets are expensive Three Main Commercial Reasons for Active Preservation Legal Commercial and competitive advantage (Big Data, Analytics, etc.) Avoiding data loss

9 Active Preservation Why? Three Main Drivers Behind the Need for Active Preservation Hardware technology changes Software technology changes Deterioration and damage

10 Benefits of Active Preservation Competitive advantages (focus of resources) Joint venture maintenance, data trades, Govt Submissions Ongoing Accessibility 24/7 and forever Meeting Stakeholder/Investor expectations Increased flexibility to move into future technologies Costs of not migrating - Storage and management or possible downtime for not being ready Makes Disaster Recovery Possible

11 The Main Reasons for Data Loss Hardware and software changes Mother boards, slots, plugs Poor handling or storage Lost tapes Poor Database of what you have Deterioration Damage General IT Industry Momentum (Need for Speed etc.)

12 Industry Momentum

13 Changing Technology

14 Poor Storage An Example From India Area: Panval 60,000 oil and gas tapes and support documents - LOST

15 Read/Write Head Deterioration No Deterioration Good Brand Aligned, Solid color, No shadows Tape Travel Direction

16 Deterioration Deterioration Cheap Media (Poor Brand Choice) Variable Tape Movement Through Path Tape Travel Direction

17 Tape Cartridge Consumption 120 Units (millions) Over 1 Billion Tapes Consumed

18 Tape Capacity vs. Cloud vs. Vault Storage Costs 7000 $ Tape Capacity (Gb) 5000 Capacity of Tape Gb Unviable Media Viable Media The Nexus $1.00/Tape $0

19 What a Virtual Vault Gives Salvage data previously trapped Stopping the rot Massive Compute Power - scalable Disposal of legacy equipment, support contracts etc. Easy to budget for (reallocate) Reduction in overall cost Immediate Accessibility Access to Big Data, Analytics, new tools No More Tapes Better control on retention

20 What a Virtual Vault Looks like

21 Some Tips for Future ` Proofing Future Proof Yourself Some Tips For Tapes 1. Purchase a good media brand to prevent degradation 2. Keep a register of not only what type of data you have on tape, but also what tape type you have data on 3. Include in your register the software you used to backup the data including versions, and the format of the data 4. Perform regular technology and media audits (work with IT) 5. Visit your tape storage vendors facility (Stay away from storage vendors that offer river views from their facility!) 6. Look towards cloud implementation go media independent 7. Act Now