4K End-to-End. Hugo GAGGIONI. Yasuhiko MIKAMI. Senior Manager Product Planning B2B Solution Business Group

Transcription

1 4K End-to-End HPA Technology Retreat 2010 Yasuhiko MIKAMI Hugo GAGGIONI Senior Manager Product Planning B2B Solution Business Group Sony Corporation CTO Broadcast & Professional Division Sony Electronics Inc. Sony Corporation

2 HDTV & Beyond 4 K Cinema RESOLUTION UDTV 3.8K / 7.6K FRAME RATE D-RANGE 4 K O.D.S HDTV Main Stream Production Tool Set HDR Imaging VIEW POINT 3 D Stereo COLOR SPACE

3 Recent studies / developments New Imager sampling structure CMOS sensor characteristics High speed storage technology Scalable Production CODEC High performance UP-Conversion

4 Various Sensor Patterns 4K Full RGB HD 16:9 = 6.2M pixels 4K x 2K = 26.5M pixels Single Sensor Stripe Structure 3 Sensor With Prism 2K 4K 2K 2K 2K 4K 4K 2K 4K 2K 2K 4K 2K RGB 100% Bayer Pattern 4K x 2K = 8.8M pixels 4K 2K 2K 4K 2K 4K 2K 4K 33% Q67 4K x 2K = 17.7M pixels 2K 4K 2K 4K 2K 4K Q67= Novel Color Filter Array for 4K sensor 4K 2K 67%

5 Simulation: Original vs. Bayer Original Bayer (No Optical LPF) Lack of GREEN resolving power Imbalance between R/G/B samples Loss of diagonal resolution

6 Simulation: Q67 vs. Bayer Q67 (No Optical LPF) Bayer (No Optical LPF) Lack of GREEN resolving power Better diagonal resolution Imbalance between R/G/B samples

7 Simulation: Q67 with Signal Processing Q67 Q67 with Digital Processing

8 Simulation: Bayer vs. Q67 Bayer Camera: Sinar/P2 4x5 Film: Kodak E100S Scanner: ICG/330i Q67

9 More pixels, smaller pixels, but % Pixel Size 6.2Mpixel -30% 8.8Mpixel (140%) 17.7Mpixel (285%) -65% 26.4Mpixel (427%) Pixel Count -75% Improving sensitivity, dynamic range, and noise level while reducing pixel size is an engineering challenge Advancement in both semiconductor design / manufacturing technology & camera signal processing technology are required 2K Full RGB 4K Bayer 4K Q67 4K Full RGB

10 CMOS Image Sensor Artifacts 1) CCD Global Shutter CMOS Rolling Shutter Commuter Train CCD global shutter shifts all pixel data to transmission register at the same time. CMOS reads pixel with line by line. Time delay in reading lines create distortion

11 CMOS Image Sensor Artifacts 2) Pixel Noise Vertical Stripe Random Horizontal Stripe Luminance, Color Shading Every sensor has a unique noise footprint Difficult to Fix-it-in-post Requires In-Camera correction Color Reproduction

12 Few thoughts for future camera SYSTEM design Full & Equal RGB imaging & processing is the final target Q67 structure provides better resolution than Bayer CMOS yet to reach CCD imaging QUALITY Requires a lot of cleaning processing behind the curtains Quantity defines quality, CMOS processing keeps improving Close communication between sensor designers & camera designers is mandatory

13 More-K, More-P, More-T, More-DATA HD x 4.3 HD x 2.8 HD x 1.4

14 SR Memory Compact, Removable memory cartridge Guaranteed Transfer rate 5Gbps Storage capacity up to 1TB HD~3D~4K Mastering quality recording Multi-Channel HD, High frame rate recording Data security & integrity

15 Evolution of the SRW-9000 SR Memory SR Tape 35mm PL

16 CODEC development for HD, 2K, 4K Production Operations

17 MPEG-4 Simple Studio Profile (SStP)

18 MPEG4 Simple Studio Profile: ISO/IEC Level Typical Image Format Max. Data rate Level 1 Level 2 Level 3 Level 4 Level 5 Level 6 SDTV 4:2:2 / 4:4:4 10bit 1920x1080 4:2:2 8 /10bit 30P/60i 1920x1080 4:4:4 10 / 12 bit 30P/60i 1920x1080 4:4:4 10 / 12 bit 60P 2K x 2K 4:4:4 10 / 12 bit 30P 4K x 2K 4:4:4 10 / 12 bit 24P~30P 4K x 2K 4:4:4 10 / 12 bit 50P/60P 180 Mbps 600 Mbps 900 Mbps 1.35 Gbps 1.8 Gbps 3.6 Gbps

19 New SR Codec Chipset Technology 2 nd Generation MPEG4-SStP Codec ASIC Small and low power consumption Powerful new functionalities Beyond HD Resolution HD, 2K and 4K; 10/12 bit SStP Stream Output New Operating Points SR - Lite (220Mbps), Mathematically Lossless Mode

20 A Bit-rate for Every Application 880 Mbps HQ 440 Mbps SQ 220 Mbps Lite

21 MPEG4 SStP FILE Operation Why? Strong requests from broadcasters for SR native file operation Cost effective file-based workflow Viewing / Editing on standard IT platforms Editing on native camera original codec Avoid multi-generation loss Future Storage products to support SStP FILE interface Standardisation? HDCAM-SR based MPEG-4 Simple Studio Profile (MPEG4 SStP) standard MXF wrapping for MPEG4 SStP essence is standardised: SMPTE-381M How? SRW-5800/2 will be the 1st product to output SR native file (= MXF SStP FILE) Hardware Codec & Software decoder under development

22 MPEG-4 SStP SR-Lite 500 Mbps Repurposing SStP 200 Mbps SR-Lite Grading System TX Server SStP Archive SStP 100 Mbps 50 Mbps MPEG2 MPEG2 Mezzanine Compression for HDTV on-air & file archiving Cost efficient 1080/60P (50P) HDTV operation

23 Introducing SRW-5800/2 New feature set includes: MXF file import From HDCAM-SR and HDCAM Multiple Bit Rates 880Mbps/440Mbps/220Mbps Double speed 4:4:4 Recording and Playback Easy migration from SRW KHz / 48KHz audio

24 ELLCAMI Project Anything In 4K IN Transcode & Manage Anything Anything Out Tape OUT DNxHD Editorial HD IN Film IN DPX MPEG2/AVC J2K Lossless SStP DNxHD J2K Lossy MPEG2/AVC Dailies D-Cinema Distribution & Archive BD/IPTV/EST/Mobile DPX Film OUT

25 High Precision UP-Conversion Technology

26 Key Points Requirements for high quality UP-conversion Content distribution Re-purposing SD archive Create 4K DCP from 1080/24P RGB Master Content Production Merge 2K VFX elements with 4K live action elements Unique intelligent picture analysis (element breakdown) achieves: Blur-free textures Jaggy-free edges Noise-free flat area

27 SUMMARY 4K Projection is here, but limited number of 4K quality content Increasing use of High quality HD Digital Cinematography tools for episodic TV & Feature movie production Pursuit of higher resolution requires orchestrated development in Optics, Sensor, Storage, Compression, and Processing technology STANDARDIAZTION is key. Work with AMPAS, ASC, SMPTE, and other manufacturers