Digital Storage Innovations and Trends for the Professional Media and Entertainment Industry

Transcription

1 Digital Storage Innovations and Trends for the Professional Media and Entertainment Industry Thomas Coughlin Coughlin Associates 1

2 Outline More Real = More Digital Storage (and performance) Content Acquisition Trends and Drivers Post Production and Delivery Archiving and Preservation Conclusions Host Interface Storage Manager Hard Disk Drive Flash Memory 2

3 Richer content = more storage Frame rates for movie content are increasing from the historical 24 frames per second (fsp) to 48 fps (e.g. in The Hobbit by Peter Jackson) and 60 fps and may eventually be as high as 300 fps. Cameras are now available that can support 120 fps 4K production is commonplace but 6K and even 8K movie production is starting to appear in professional video projects. Video resolutions of 16K and even higher are contemplated in the future. 3

4 Japanese drive 8K content BBC Image of HNK Super Hi-Vision Camera NHK from Japan has been making steady progress on their Super Hi-Vision TV that could display 33 megapixel video with 22:1 multichannel sound. Sharp demonstrated an 8K X 4K LCD Display in 2011 and at the 2012 CES The BBC plans some 8K Summer Olympic Content Sharp 8K X 4K LCD Display 4

5 Professional video production is moving to multiple petabyte requirements! As video resolution and frame rate increase and stereoscopic projects multiply, the storage capacity and bandwidth performance of these devices and systems becomes staggering. A calculation shows that 16,000 X 8,000 pixel resolution, 64 color bits/pixel, 300 fps raw video content could require 307 GB/s data rates and 1.1 PB/hour. If this was full stereoscopic capture then these requirements would double. Truly the bandwidth and capacity requirements to work with future rich media formats are staggering! 5

6 1000 Media Content Size Trends Virtual Reality, 3D Movie 100 Ultra HD Movie HD Movie Data Rate (Mbps) 10 1 CD Quality Stereo Audio DVD Movie (MPEG-2) 0.1 One page ASCII text KB 10KB 100KB 1MB 10MB 100MB 1GB 10GB 100GB 1TB Multimedia Object Size 6

7 Content Capture 7

8 Acquisition, post-production, and distribution workflow. Film Print Film Camera NLE Compositing Digital Cinema Broadcast Digital Camera Telecine DI Cable/Satellite Internet/Phone Shared Storage Transcode Network and Other Digital Sources Render Farm Color Correction Grain and Noise Conform and Assembly Archive or Backup 8

9 Profession video camera media Flash memory 28% Film 8% Magnetic tape 25% Optical discs 17% Hard disk drives 22% ARRI Alexa Camera 2011 Digital Storage in Media and Entertainment Report, Coughlin Associates, Sony CineAlt F65 8K Camera RED 5K Camera 9

10 Content shot for an hour of completed work hours 20% Other 14% 1 hour 4% 1-3 hours 27% 7-9 hours 8% 4-6 hours 27% 2011 Digital Storage in Media and Entertainment Report, Coughlin Associates, 55 % of 2010 SMPTE Storage Survey Participants said that they captured 4 hours or more of content for an hour of completed work The low costs of digital capture encourage capturing more content than was economical with film as costs decline the average number of content captured will likely increase further 10

11 Post Production and Delivery 11

12 Professional non-linear editing model system Cloud DRAM Local Storage NAS SAN Video Editing Station GE Card Or HBA GE Card Or HBA In addition to traditional local storage and network storage, content in cloud storage is starting to play a role in modern workflows In late 2010 M&E professionals involved in post production showed the following statistics: 83.8% had DAS Over 69% of these had more than 1 TB of DAS 81.2% had NAS or SAN use of network storage is increasing Over 58% had more than 16 TB of NAS or SAN Coughlin Associates Professional M&E Survey, 2009 &

13 Post production annual storage capacity demand (TB) 2011 Digital Storage in Media and Entertainment Report, Coughlin Associates, 13

14 The cloud for M&E content In many regards cloud offerings are an out-sourcing approach But there are new M&E capabilities enabled by the rise of remote services Growth in cloud storage use by professional video enables collaborative workflow Internet enabled content distribution with technologies such as those of Aspera or BitSpeed new cost effective services through the cloud enable greater sophistication for smaller shops Some vendors offering cloud archiving services Cloud storage drives growth in tiered storage including flash memory, tape, HDDs 14

15 Internet content distribution system (CDN) Internet User Internet User Internet User Internet User Content Central Server Edge Server Internet User Internet User Source Content (NAS or SAN) Edge Server Internet User Internet User Internet User Solid state storage devices being used for edge content delivery because they are more reliable in non-data center locations Solid state storage increasingly being used for caching and even some central content delivery applications 15

16 Archiving and Preservation 16

17 Hard disk drives 24% Digital Camera Tape 18% Blu-ray discs 7% DLT 8% Other 19% Other 7% DVD discs 10% AIT 1% Digital tape 36% CD discs 4% LTO 66% 2011 Digital Storage in Media and Entertainment Report, Coughlin Associates, Digital archive media Tape (esp. LTO) and HDDs predominate in long term archival media and are projected to show greatest growth in the future New optical disc technologies etching the surface of a ceramic layer may show long archival life Likewise some holographic technologies show media stability indicating a long storage life. About 39% of survey participants never update their digital archives 17

18 Annual Estimated Cost for 1 PB Comparison of estimated annual cost to save 1 PB for 20 years $1,000,000 $100,000 HDD Tape $10,000 $1,000 $ Digital Storage in Media and Entertainment Report, Coughlin Associates, 18

19 Growth in near-line and off-line digital storage for content archiving 70,000 60,000 Near-Line Off-Line 50,000 Archive Storage (Petabytes) 40,000 30,000 20,000 10, Near-Line 393 1,081 2,289 4,153 7,203 12,025 19,762 27,033 36,419 Off-Line 1,908 3,244 4,647 6,775 9,706 14,003 19,294 22,118 24, Digital Storage in Media and Entertainment Report, Coughlin Associates, 19

20 Conclusions 20

21 Archiving and Preservation 57% Media and entertainment storage market trends (2011) Post Production 13% Content Acquisition 4% Market share of storage media by storage capacity shipped Content Distribution 26% HDD 39.1% Media and entertainment market storage revenue share by segment 2011 Storage Capacity Market Share Flash 0.2% Tape 43.6% 2011 Digital Storage in Media and Entertainment Report, Coughlin Associates, Optical 17.1% 21

22 Total New Capacity (PB) Total new storage capacity for media and entertainment 2011 Digital Storage for Media and Entertainment Report, Coughlin Associates (over 62 Exabytes of New Storage by 2016) 100,000 10,000 1, Digital Conversion & Preservation New Content Archiving Film Scanning Episodic Acquisition Movie Acquisition Digital Cinema VOD Streaming VOD Ingest Internet Distribution Headends Master Network Headends Local Broadcaster Headends Satellite Headends Cable Headends Compositing and Special Effects Post Production Total revenue for media and entertainment storage will increase about 1.7X from 2011 through 2016 ($3.8 B to $6.4 B) 22

23 Summary and Conclusions Demand for higher resolution and higher frame rate content for media and entertainment applications is driving multiple-pb storage needs these needs will only increase in the future Storage devices and interfaces used in media and entertainment applications will evolve to meet changing needs and unique performance requirements for video workflows Cloud-based services are playing an increasing role by enabling collaborative workflows Lower costs for analog to digital conversion and long term storage of new digital assets are further driving archive storage demand Increased storage demand will drive storage media and system sales 23

24 Thanks 24

25 Sources CES, Creative Storage and Storage Visions Conferences ( Creative Storage Conferences ( Digital Storage for Media and Entertainment Report, Coughlin Associates (2012 issue is in preparation) 2009 and 2010 Survey on Storage for Media and Entertainment, Coughlin Associates Go to (tech papers page) SNIA SSSI: 25