HDR proposal. TV Pl at f or m Di v., Sony Vi sual Pr oduct s Toshi Ogur a J ul y/ 16/ ' 14

Transcription

1 proposal TV Pl at f or m Di v., Sony Vi sual Pr oduct s Toshi Ogur a J ul y/ 16/ ' 14

2 now

3 UHD and mor e Spatial resolution 8K Depth resolution FY11 4K 2K Temporal resolution 12bit 10bit 8bit 6bit SD QVGA 30p 60i 60p 240p 120p Color Dy-Range srgb DCI BT.2020 LCD LCD w/ LD OLED Beyond UHD Lumi Dy-Range

4 Re al wor l d br i ght ne s s ( Dol by mat e r i al ) Real world brightness range is quite large

5 Vi s i on Dynami c Range Real World Human Vision Current LCD Future TV [cd/m2] Luminance Levels Sun Direct Sun light Indoor light Moon light Star light Night Vision Day Vision ~1014 Typical Range w/o adjustment ~105 ~

6 Cur r e nt s t andar d vi de o t r ans mi s s i on Production Transmission Displying 5 digits Camera Production (16bit, linear) signal level Lossy compression 信信信信信信信信信 limitation: 8bits, 100cd/m2max 3 digits signal (8bit) display brightness 3 digits Real world LCD LCD (LD), OLED Resemblance expansion 5 digits 信信信信信信信信 Current standard production 信 5 digits transmission 信 3 digits displaying LCD 信 3 digits OLED, LCD(LD): 5 digits real world transmission is a bottleneck and information lost

7 vi de o t r ans mi s s i on production transmission displaying 5 digits Camera Production (16bit, linear) signal level data compression real world created image transmitted as it is 5 digits signal (10~12 bit, nonlinear) 信信信信信信信信 X000 display brightness display mapping 5 digits disp. real world X000 standard production 信 5 digits transmission 信 5 digits more displaying disp. 信 5 digits by, created image can be reproduced as it is

8 ととととととと Wha t i s 信 I t ' s a dva nt a ge (current), High Brightness Display, High Brightness Display Source example ( ととととととと ) Panel Signal luminancelevel Panel Signal luminancelevel 3000 cd/ 信信信信信信信信信信信信信信信信信信信信 Panel Signal luminance level 3000 cd/ 信 Bit 信 (n) 信信信信信信信信 Banding 信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信信 Tone Curve 500 cd/ 信 8 bit 100 信信信信信信信信信信信信信信信信信信信信 Original Source cd/ 信 8 bit 100 Original Source cd/ 信 n- bit 100 Original Source cd/ 信信信信信信信 Display 信信信信信信信信信 Combination of video and high brightness disp. 信信信信信信信信信信信信信信信信信信信信信信信

9 Col or Vol ume c ompar i z on <BT v. s. BT. 709> BT.2020(10,000cd/m2) & BT.709(100cd/m2); Yxy BT.2020 Wider gamut and higher brightness brings much more number of the colors と Reproducing the glitter of light and color BT.709 from Dolby material (light blue area can not be expressed by BT.709)

10 wor kf l ow

11 wor kf l ow Creation Distribution Consumption HD R HD R

12 s ol ut i on c andi dat e Native Contents Raw Data Film scan Still image Capturing/Post-production Transmission Displaying Capturing/Editing video mastering Transmitting Decoding Displaying Broadcast Game IP delivery GFX Physical media (BD, DVD, memory) Edit CG Comp master OETF OETF gamma Enc Dec EOTF EOTF gamma Linear Linear Panel correction Panel correction Shooting Technology, editing environment Optical Electrical Transfer Function Transmission Technology Display Mapping Technology High Contrast Display Technology

13 s ol ut i on c andi dat e Capturing/Editing video mastering Transmitting Decoding Displaying Broadcast IP delivery Physical media (BD, DVD, memory) Native Game Contents GFX Raw Data Shooting Edit Film Technology, scan editing CG Still environment Comp image Capturing/Post-production Transmission Displaying master Optical OETF Electrical Transfer OETF Function gamma Transmission Enc Technology Dec EOTF Display Mapping Technology EOTF gamma Linear Linear Panel correction High Contrast Display Panel Technology correction It is important to keep the environment for individual technology evolution for each stage among the workflow individual selection of the video format:, WCG, Quantization number, spatial resolution

14 s ol ut i on c andi dat e <Dol by Vi s i on> Native Contents Raw Data Film scan Still image Capturing/Post-production Transmission Displaying Capturing/Editing video mastering Transmitting Decoding Displaying Broadcast Game IP delivery GFX Physical media (BD, DVD, memory) Edit CG Comp master OETF OETF gamma Enc Dec EOTF EOTF gamma Linear Linear Panel correction Panel correction Capturing camera Editing Dolby plug-in tool monitor OETF Barten model Dolby PQ curve Philips EOTF Gamma base BBC curve BT.2020/BT.709 Transmission Separate stream / Scalable codec Dolby Layered MPEG SHVC Compatible stream BBC Philips Technicolor Signal Processing Linear space convert Dolby PQ EOTF Display mapping, WCG panel High brightness High power LED XDR Local dimming # of division LD algorithm XDR Dolby Monitor

15 s ol ut i on c andi dat e <c ol l abor at i ve s ugge s t i on> Native Contents Raw Data Film scan Still image Capturing/Post-production Transmission Displaying Capturing/Editing video mastering Transmitting Decoding Displaying Broadcast Game IP delivery GFX Physical media (BD, DVD, memory) Edit CG Comp master OETF OETF gamma Enc Dec EOTF EOTF gamma Linear Linear Panel correction Panel correction Capturing camera (Sony) Editing plug-in tool (Technicolor) monitor (SIM2, XDR) OETF Barten model Dolby PQ curve Philips EOTF Gamma base BBC curve BT.2020/BT.709 Transmission Separate stream (MPEG regular) / Scalable codec Dolby Layered MPEG SHVC Compatible stream BBC Philips Technicolor Signal Processing panel Linear space convert High brightness EOTF (according to OETF) High power LED Display mapping (Toshiba), WCG (disp. manufac.) XDR (Sony) Local dimming # of division LD algorithm (Toshiba) XDR (Sony)

16 Sony s ugge s t i on f or

17 Col l abor at i ve Sugge s t i on f or Sony s ugge s t i on: ope n s t andar d s ys t e m EOTF と Bar t e n mode l ( Dol by PQ, Phi l i ps EOTF unde r di s c us s i on) or BBC EOTF ( unde r di s c us s i TU) c r e a t or ' s c hoi c e me t a : ma s. br i ght ne s s, r e f e r e nc e whi t e, ( unde r di s c us s i on) Tr ans mi s s i on と Si ngl e l aye r ( r e gul ar s t r e am) と or SHVC f or c ur r e nt de c ode r : s i ngl e l a ye r ( s e pa r a t e s t r e a m f or, ) SHVC<Sc a l a bl e HEVC> ( J ul / ' 14 s t a nda r di z e Re c e i ve r と 1 Mul t i EOTF r e ady 2SHVC r e ady ( i f ne c e s s a r y) EOTF ( ga mma ), EOTF ( Ba r t e n, BBC, e t c. ) SHVC: whe n t r a ns mi s s i on s i de wi l l r e qui r e ( f or f ut ur e )

18 Sony s ugge s t i on vs Dol by Vi s i on tech nolo gy Band width EOTF Sony suggestion multi EOTF (Barten family & Gamma family) Dolby Vision PQ curve (Barten family) max L variable (operational rule) 10,000cd/m^2 codec Disp. mapping Single layer: AVC, HEVC Multi layer: SHVC(future) meta data base & signal analysis base Dolby Layered coding (proprietary) meta data base meta data 3 levels: Mandatory/Standard/Expert proprietary only same as regular stream +10~20% & double or +XX%(SHVC/RExt) +10~20% additional hardware decoder: no EOTF: <multi> programmable nonlinear-linear: yes (no w/ simple solution) decoder: additional composer, meta extractor EOTF: <Dual> PQ, gamma(for ) nonlinear-linear: yes

19 me t a dat a Sony s ugge s t i on f or me t a Eac h c ompany has t he i r own opi ni on about movi e s t udi o: r i c h me t a ( but not one opi ni on) BBC- R&D: f e a r i ng mi s s i ng me t a s ome whe r e t r a ns mi s s i on s t a ge f or ma t pr opos e r s : me t a br i ngs a dva nt a ge of t he i r s ugge s t i on SMPTE, MPEG 信 me t a s houl d be s t a nda r di z e d Sys t e m t o i nc l ude al l of t hos e r e que s t s I nt r oduc i ng ' Le ve l ' of me t a Le ve l - 1: ma nda t or y ( mi ni mum i nf or ma t i on t o ha ndl e s i gna l ) Le ve l - 2: s t a nda r d ( s t a t i c i nf or ma t i on of c ont e nt i t s e l f ) Le ve l - 3: e xpe r t ( dyna mi c i nf o. of c ont e nt, va l ua bl e i nf o. f or di s pl a y ma ppi ng, e t c. ) Above i nf or ma t i on s houl d r e pr e s e nt c ol or vol ume, whi c h i nc l ude s l umi na nc e a nd c ol or i nf or ma t i on. Hi ghe r l e ve l i nc l ude s mor e opt i ona l i t e ms t o a ppl y ma ny i de a by pr opos e r s.

20 me t a dat a Le ve l de f i ni t i on LEVEL 信信 Mandat or y s t at i c me t a f or c ol or gamut and EOTF ( ut i l i z i ng c ur r e nt s t a nda r d f or ma t ) VUI : c ol or pr i ma r i e s, ma t r i x_c oe f f s, t r a ns f e r _c ha r a c t e r i c s c ol or pr i ma r i e s : BT2020 i s a va i l a bl e a t bot h AVC a nd HEVC EOTF: PQ i s a va i l a bl e a t HEVC onl y LEVEL 信信 St andar d St at i c me t a at mas t e r i ng ( ne w a ppl i c a t i on) VUI, Mas t e r i ng di s pl ay c ol or vol ume SEI : Col or s pa c e, mi n/ ma x l umi na nc e SEI i s a va i l a bl e a t HEVC onl y LEVEL 信信 Expe r t Dynami c me t a f or e ac h uni t, s c e ne or f r ame ( ne w a ppl i c a t i on) VUI, Kne e f unc t i on i nf or mat i on SEI と Lumi na nc e f or e a c h Sc e ne / f r a me ( Pe a k l umi na nc e ),...

21 Col l abor at i on

22 wor kf l ow Creation Distribution Consumption HD R HD R

23 Col l abor at i on Sc ope Te c hnol ogy, St a nda r di z a t i on, Ope r a t i ona l s pe c, I nt e r ope r a bi l i t y Pur pos e Bui l di ng e nt i r e wor kf l ow f or Gua r a nt e e qua l i t y of ' ' Coope r a t i ng pr omot i on Common l ogo Subj e c t s Cr e a t i on, Tr a ns mi s s i on, Di s pl a yi ng Equi pme nt, Cont e nt, Se r vi c e,...

24 s pe c i f i c at i on ( 1) ( dr a f t ) s hoot i ng Cont r as t pe r f or manc e ne e d e nough c ont r a s t f or huma n vi s i on s ys t e m ( s ugge s t i on) i ma ge c a n de s c r i be mor e t ha n 400% wi t h e nough ba ndi ng pe r f or ma nc e ne e d t he ba c kgr ound of 400%, how t o e va l ua t e ba ndi ng pe r f or ma nc e Tr ans mi s s i on pe r f or manc e ne e d t o t r a ns mi t e nough s i z e c ol or vol ume wi t h ne c e s s a r y i nf or ma t i on ( s ugge s t i on) mor e t ha n 10bi t, wi de r c ol or ga mut t ha n BT. 709, c ol or vol u me me t a i nf or ma t i on

25 s pe c i f i c at i on ( 2) ( dr a f t ) t r ans mi s s i on s i gnal f or mat r e qui r e me nt ne e d t o ha ve e nough c a pa c i t y a nd me t a da t a c a pa bi l i t y t o t r a ns mi t vi de o ( s ugge s t i on) mor e t ha n 10bi t, mor e t ha n 400% l umi na nc e i nf or ma t i on, l a r ge r c ol or ga mut t h a n BT. 709, me t a me t a r e qui r e me nt ne e d t o r e pr oduc e / WCG c ol or vol ume c or r e c t l y 3 l e ve l me t a ma nda t or y me t a s t a nda r d me t a e xpe r t me t a me t a mi ght be ut i l i z e d not onl y ne w di s pl a y, e ve n c ur r e nt di s pl a y t oo ne e d t o ke e p me t a da t a dur i ng t r a ns mi s s i on

26 s pe c i f i c at i on ( 3) ( dr a f t ) di s pl ay Br i ght ne s s pe r f or manc e ne e d t o ma ke pe opl e f e e l da z z l e d ( s ugge s t i on) 700c d/ m2 mor e w/ a r ul e f or a r e a ne e d da t a of c ur r e nt s t a t us Cont r as t pe r f or manc e 信信信信 dyna mi c r a nge 信信信信信信信信信信信信信信 ( s ugge s t i on) 105 mor e ( e. g ~1000c d/ m2) w/ c l a r i f i e d me a s ur e me nt me t hod ne e d da t a of c ur r e nt s t a t us Bandi ng pe r f or manc e ne e d t o a voi d pe opl e s e e i ng ba ndi ng e a s i l y ( s ugge s t i on) Col or di f f e r e nc e l e s s t ha n 4dE00 de t a i l e d i nve s t i ga t i on i s ne c e s s a r y how t o ha ndl e di t he r i ng f unc t i on, wha t ' s ki nd of e va l ua t i on e nvi r onme nt?

27 SONY is a registered trademark of Sony Corporation. Names of Sony products and services are the registered trademarks and/or trademarks of Sony Corporation or its Group companies. Other company names and product names are registered trademarks and/or trademarks of the respective companies.