The Expanding Digital Universe: Can we Contain it?

Transcription

1 The Expanding Digital Universe: Can we Contain it? Dave Reinsel Vice President, Storage and Semiconductor Research July 16, 2007 Copyright 2007 IDC. Reproduction is forbidden unless authorized. All rights reserved.

2 Agenda The Expanding Digital Universe The Study The Results The Implications Sep-07 2

3 Research Objective Measure the total amount of digital information created in the world Forecast the the digital universe by region NA, WE, AP, ROW to 2010 Analyze the character of the information in the digital universe based on information source and type Measure and forecast the available storage capacity through 2010 Derive implications for society, enterprises, and governments Draw conclusions for enterprise IT organizations and vendors Sep-07 3

4 Key Findings The digital universe will grow six-fold, from 161 exabytes in 2006 to 988 exabytes in 2010 ^ Digital Sep-07 4

5 Key Findings The digital universe will grow six-fold, from 161 exabytes in 2006 to 988 exabytes in 2010 Roughly 3.6 TB/s About 25 GB/person in the world If we put all of this information in typical books, we could have 12 separate stacks that each could reach the sun In 2010? 31 TB/s A stack of books that could extend from the sun to pluto.and back When do we surpass a Yottabyte? ^ Digital Sep-07 5

6 Behind The Explosion: The Internet 1,800 1,600 1,400 1,200 Total Users (M) Users with Broadband (M) 1, Sep-07 6

7 Behind The Explosion: Trillions WW per Year Person-to-Person s Spam and Alerts Sep-07 7

8 Behind The Explosion: Images Images Captured by Digital Cameras and Camera Phones WW 600 B 500 B Digital Still Cameras Camera Phones 400 B 300 B 200 B 100 B 0 B Sep-07 8

9 Behind the Explosion: DTV And it s not just digital TV it s also HIGH DEF High Definition: Increases storage requirements 1 hour of HD video is roughly 10GBs of storage (depends on encoding rates) Requires more bandwidth and special equipment But is it worth it.? Sep-07 9

10 Behind the Explosion: DTV HIGH DEF Std. DEF 350 M 300 M 250 M 200 M 150 M 100 M 50 M 0 M Installed base of LCDs Sep-07 10

11 Key Findings The digital universe will grow six-fold, from 161 exabytes in 2006 to 988 exabytes in 2010 > 90% of the information in the digital universe is unstructured ^ Digital Sep-07 11

12 The Danger of Data Irrelevance A Caveat to Metcalfe s Law? In general, the value of a network increases as the number of active nodes increase IDC research consistently reveals that datacenter storage requirements are increasing 50 60% per year for the next several years Google has leveraged this network quite successfully! Can too much of a good thing turn sour? Telephone and telemarketers (caller ID) and spam (filters and blockers) Data growth and data irrelevance Goal: Find the RIGHT data in the Quickest amount of time IDC 12 Sep-07 12

13 Key Findings ^ Digital The digital universe will grow six-fold, from 161 exabytes in 2006 to 988 exabytes in 2010 > 90% of the information in the digital universe is unstructured By 2010 ~ 70% of the digital universe will be created by individuals Sep-07 13

14 The Content Disruption 2.0 The success of these online companies are dependent on sources of revenue Reliable content access and protection are mission critical fast, reliable, always Manage large, fast growing pools of content storage! available, secure Content and the advertising surrounding it are the major if not only 1PB to >40PB and growing at >100% a year 2007 IDC 14 Sep-07 14

15 What Will We Keep Online? Content Depots Change the Rules 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Consumption of External Disk Capacity by Type Content depots Replicated data Fixed content Traditional business data CAGR 145% 47% 62% 37% Content depots change the rules for data 25.5x as much as in 2006 Environmental extremism Resets rules for provisioning and decommissioning Petabyte scale storage What kind of contract with data owners? Impact on storage industry Grids and multicore servers New levels of system density New data management and organization models Power concerns increasing Sep-07 15

16 Key Findings ^ Digital The digital universe will grow six-fold, from 161 exabytes in 2006 to 988 exabytes in 2010 > 90% of the information in the digital universe is unstructured By 2010 ~ 70% of the digital universe will be created by individuals At the same time organizations will have responsibility or liability for 85% of the information Sep-07 16

17 User Creation; Enterprise Worries User* Generated Content Organizational Touch** Content * Consumers and Workers Creating, Capturing, or Replicating Personal Information 692 Exabytes WW Exabytes 859 Exabytes WW ** Transported, Hosted, Managed, or Secured Sep-07 17

18 What Will We Keep Online/Offline Archives Are The Missing Piece (EB) Consumption of External Disk Capacity by Type (incl. Tape/optical) Archive (tape, optical) Content Depots Fixed content Replicated data Traditional business data Archived data dwarfs active data in most organizations Significant duplication Limited organization Impact on Companies Reducing media consumption becomes high priority (VTL) Data de-duplication becomes important feature Data management and organization become critical Sep-07 18

19 Content Creation VS Duplication We are Pacmen and Pacwomen might need it some day mentality Digital enables multiple copies Transient data exists Unused digital streams Un-kept phone calls? Can t possibly store everything, can we? 75% of the digital universe is a copy a replicate a duplicate a backup a mirror image is redundant 25% of digital universe is created or generated Sep-07 19

20 Key Findings ^ Digital Can we Containerize it.all? The digital universe will grow six-fold, from 161 exabytes in 2006 to 988 exabytes in 2010 > 90% of the information in the digital universe is unstructured By 2010 ~ 70% of the digital universe will be created by individuals At the same time organizations will have responsibility or liability for 85% of the information Information created and replicated (the DU) will exceed the available storage capacity this year Sep-07 20

21 Information And Storage Petabytes 1,000, , , , , , ,000 Information Available Storage Transient information, unused streams, temporary data 300, , , Sep-07 21

22 Available Storage Worldwide Exabytes 600 Flash/Memory Bottom Line, we will store what we want to store (probably more) but we won t save every BIT Information Creation Optical Hard Disk Drives Tape Sep-07 22

23 Key Takeaways for the Digital Universe The Digital Universe is Growing Around 55% Annually We will save as much as we want to save, but won t save everything Vast majority is unstructured and duplicate information Majority of content creation driven by consumers Results in Creators and Custodians The Creators will be increasingly enabled and mobile The Custodians will be increasingly challenged What to keep and How to keep it (media life, efficiency, power) How to keep data relevant (metadata, response times, availability, the right data) How to keep data safe from datajacking (security, encryption) Hardware is the foundation, but software is the personality Sep-07 23

24 Thank You Please me at Sep-07 24