Panasonic. AVC-Ultra - the universal Codec family. Professional Camera Solutions. Stefan Hofmann Business Development Manager

Transcription

1 Panasonic Professional Camera Solutions AVC-Ultra - the universal Codec family Stefan Hofmann Business Development Manager

2 Agenda AVC-Ultra the Codec family AVC-Ultra file and data structure microp2 a new recording device

3 Agenda AVC-Ultra the Codec family AVC-Ultra file and data structure microp2 a new recording device

4 Baseline concept AVC-Ultra is a codec family based on - H.264/AVC MPEG-4 Part 10 - has the same mathematics like AVC-I Inheriting the advantages of AVC-Intra Extending for wider variety of applications - creative productions - network based workflows - cost effective solutions

5 Higher picture quality for creative work of production 4Kx2K & 1080p50/60 Class4:4:4, Class200 Class100, 50 LongG50 LongG25 Lower data rate with high picture quality for cost effective workflow LongG12, LongG6 Extremely low data rate for network based workflow

6 Compression Format Approximate data rate (bps) Codec Class Color sample Bit depth Full resolution Intra/ Long CBR/ VBR File format 24p p 30p 60i 50i 24p 25p 30p 60p 50p 60p 50p 444 4:4:4 12bit Yes Intra CBR MXF 178M 222M 444M 200 4:2:2 10bit Yes Intra CBR MXF 178M 222M 222M 222M 444M 100 4:2:2 10bit Yes Intra CBR MXF 89M 111M 111M 44M 56M 111M 222M 50 4:2:0 10bit No Intra CBR MXF 54M 54M CBR: Constant Bit Rate, VBR: Variable Bit Rate

7 Compression Format Approximate data rate (bps) Codec Class Color sample Bit depth Full resolution Intra/ Long CBR/ VBR File format 24p p 30p 60i 50i 24p 25p 30p 60p 50p 60p 50p 444 4:4:4 12bit Yes Intra CBR OP-Atom MXF 178M 222M 444M 200 4:2:2 10bit Yes Intra CBR OP-Atom MXF 178M 222M 222M 222M 444M 100 4:2:2 10bit Yes Intra CBR OP-Atom MXF 89M 111M 111M 44M 56M 111M 222M 50 4:2:0 10bit No Intra CBR OP-Atom MXF 54M 54M G50 4:2:2 10bit Yes Long VBR OP-1b MXF 50M 50M 50M 50M G25 4:2:2 10bit Yes Long VBR OP-1b MXF 25M 25M 25M 25M 50M G12 4:2:0 8bit Yes Long VBR MXF/mov OP-1b/mov 12M 12M 24M G6 4:2:0 8bit Yes Long VBR MXF/mov OP-1b/mov 6M 6M 12M CBR: Constant Bit Rate, VBR: Variable Bit Rate

8 Compression Format Approximate data rate (bps) Codec Class Color sample Bit depth Full resolution Intra/ Long CBR/ VBR File format 24p p 30p 60i 50i 24p 25p 30p 60p 50p 60p 50p 444 4:4:4 12bit Yes Intra CBR OP-Atom MXF 178M 222M 444M 200 4:2:2 10bit Yes Intra CBR OP-Atom MXF 178M 222M 222M 222M 444M 100 4:2:2 10bit Yes Intra CBR OP-Atom MXF 89M 111M 111M 44M 56M 111M 222M 50 4:2:0 10bit No Intra CBR OP-Atom MXF 54M 54M G50 4:2:2 10bit Yes Long VBR OP-1b MXF 50M 50M 50M 50M G25 4:2:2 10bit Yes Long VBR OP-1b MXF 25M 25M 25M 25M 50M G12 4:2:0 8bit Yes Long VBR MXF/mov OP-1b/mov 12M 12M 24M G6 4:2:0 8bit Yes Long VBR MXF/mov OP-1b/mov 6M 6M 12M G3.5 4:2:0 8bit No Long VBR mov 3.5M G1.5 4:2:0 8bit No Long VBR mov 1.5M G0.8 4:2:0 8bit No Long VBR mov 800k CBR: Constant Bit Rate, VBR: Variable Bit Rate

9 MPEG-4 Part 10 H.264/AVC Codec H.264 MPEG-4/AVC Part 10 control data Base Band Signal 720p 1080i 1080p - + Encoder control Integer Transformation / Scaling / Quantization Decoder Scaling / Inverse Transformation coefficients Entropie Coding Output Bitstream + Intra frame prediction Motion Compensation Deblocking Filter Output Motion Estimation motion vector simplified

10 MPEG-4 Part 10 H.264/AVC Codec Field/ Frame Control Encoder control control data Input 720p 1080i 1080p Blocking + - Decoder Integer DCT / Scaling / Quantization Inverse Scaling / Quantization / IDCT coefficients Entropie Coding Output Bitstream Intra frame prediction simplified

11 MPEG-4 Part 10 H.264/AVC Codec Base Band Signal Encoder control control data 720p 1080i 1020p Sampling Conversion for AVC-I => => Integer DCT Scaling / Quantization Inverse Scaling / Inverse Quantization coefficients CABAC CAVLC Output Bitstream Bit rate saving: 20~30% Intra frame prediction inverse IDCT Bit rate saving: 30~40% lossless Memory + simplified

12 MPEG-4 Part 10 H.264/AVC Codec H.264 MPEG-4/AVC Part 10 control data Base Band Signal 720p 1080i 1080p - + Encoder control Integer Transformation / Scaling / Quantization Decoder Scaling / Inverse Transformation coefficients Entropie Coding Output Bitstream + Intra frame prediction Motion Compensation Deblocking Filter Output Motion Estimation motion vector simplified

13 Base Band Signal 720p 1080i 1080p - + Pre-encoder and Picture Analyzer Integer Transformation / Scaling / Quantization Decoder Adaptive Bit-allocation optimizer Scaling / Inverse Transformation coefficients control data Entropie Coding Output Bitstream + Intra frame prediction Motion Compensation Deblocking Filter Output Motion Estimation motion vector simplified

14 AVC-LongG Codec Features Specify constraints on picture prediction and GOP structure like MPEG-2 style to ensure decoder compatibility Parameter sets (SPS/PPS) are present in the start of each GOP to dynamically optimize picture quality and help random access and editing, e.g. Cut detection and I-frame insert Common structure of SEI message for real-time metadata between AVC-Intra and AVC-LongG to give compatibility Support HRD (Hypothetical Reference Decoder) conformance to ensure decoder buffer control

15 H.264/AVC Profile Conformance H.264/AVC profiles High Main Profile Profile 4:2:0, 8bit High 10 Profile High 4:2:2 Profile High 4:4:4 Profile 4:2:0, 10bit 4:2:2, 10bit 4:4:4, 14bit H.264/AVC High profiles Limited to Intra-only H.264/AVC Intra profiles High 10 Intra profile High 4:2:2 Intra profile High 4:4:4 Intra Profile

16 MXF Mapping Standard for AVC-LongG Panasonic is driving the development of SMPTE MXF AVC mapping standard to encapsulate AVC-LongGOP Compression MPEG-2/4 Proposed SMPTE AVC mapping Under revision to support LongG MXF Mapping SMPTE RP 2008 AVC mapping SMPTE ST MPEG ES mapping SMPTE ST MXF specification

17 AVC-ULTRA CODEC Chip Code Name: DYNA H.264/AVC MPEG-4 Level 5.2 compliant dual stream capability 30M Gates LSI with two low power memories stacked in one package 18mm² package with 753 pins

18 Partner Status

19 Agenda AVC-Ultra the Codec family AVC-Ultra File and data structure microp2 A new recording device

20 File Structure AVC-Intra with Proxy CONTENTS CLIP VIDEO AUDIO 0001AB.XML ICON PROXY 0001AB.BMP 0001AB.MXF 0001AB00.MXF 0001AB01.MXF 0001AB.MOV AVC-LongG with Proxy CONTENTS AVCLIP CLIP ICON VIDEO AUDIO PROXY 001AB2CD.MXF 001AB2CD.XML 001AB2CD.BMP 001AB2CD.MOV AVC-LongG +AVC-Intra with Proxy CONTENTS AVCLIP CLIP 001AB2CD.MXF 0001AB.XML 001AB2CD.XML ICON 0001AB.BMP 001AB2CD.BMP VIDEO 0001AB.MXF AUDIO 0001AB00.MXF 0001AB01.MXF PROXY 0001AB.MOV 001AB2CD.MOV

21 Agenda AVC-Ultra the Codec family AVC-Ultra File and data structure AVC-I: OP-Atom microp2 A new recording device

22 P2/microP2 Content data structure ISO/IEC SMPTE RP2027 SMPTE RP2008 SMPTE 381M SMPTE 377M SMPTE 379M SMPTE 390M H.264/AVC AVC Intra-frame coding Mapping AVC-I Streams into Generic Container Mapping MPEG streams into Generic Container MXF File format specification MXF Generic Container OP-Atom File header File body File footer MXF file Header Header Metadata Table K L Essence Container/ Generic Container Footer Table Audio MXF file Header Header Metadata Table K L Essence Container/ AES3 Footer Table Plus additional optional files, e.g., metadata, bitmaps, proxy, voice memo

23 P2/microP2 Content data structure/op-atom File header File body File footer MXF file Header Header Metadata Table K L Essence Container/ Generic Container Footer Table Audio MXF file Ch 1 Header Header Metadata Table K L Essence Container/ AES3 Footer Table Audio MXF file Ch 2 Header Header Metadata Table K L Essence Container/ AES3 Footer Table Audio MXF file Ch 16 Header Header Metadata Table K L Essence Container/ AES3 Footer Table

24 AVC-I and DV-based data structure/op-atom AVC Intra (H.264), DV based frame compression file structure and MXF mapping (OP-Atom) DV/DVCPRO MXF file CONTENTS Content Essence Header Header Metadata Table DV,DVCPRO/50/HD compressed stream Footer Table VIDEO AUDIO MXF file Audio MXF file DV-DIF mapping AVC-Intra MXF file CLIP XML metadata file Header Header Metadata Table AVC-Intra compressed stream Footer Table ICON Thumbnail file (Bitmap) MPEG mapping VOICE Voice memo file(wave) Audio MXF file (common) PROXY Proxy AV file(mp4) Metadata Header Header Metadata Table PCM Audio data Footer Table

25 P2/microP2 Content data structure Relationship OP-Atom/OP-1a OP-Atom OP-1a File header File body File footer A/V MXF file Header Header Metadata Table K L Essence Container/ Generic Container Footer Table File body Audio MXF file Ch 1 Header Header Metadata Table K L AES/EBU Essence Container/ Ch 1 AES/EBU CH 1 Footer Table Audio MXF file Ch 2 Header Header Metadata Table K L AES/EBU Essence Container/ Ch 2 AES/EBU Ch 2 Footer Table

26 Agenda AVC-Ultra the Codec family AVC-Ultra File and data structure AVC-LongG: OP-1b microp2 A new recording device

27 AVC-Ultra LongG data structure/op-1b 128kB - Header Length 128kB - is divided every 2sec Header Header P.P. Metadata XML BMP Audio : Constant frames wrapping VIDEO: Frame Wrapping ANC: Frame Wrapping Audio: Custom Wrapping P.P. KL Data Frame Data KL Data Frame ---- Data P.P. Table P.P. KL ANC KL ANC Data Data Data Data ---- P.P. Table P.P. Audio KL Data Data Ch 1 P.P. Table P.P. Audio KL Data Data P.P. Table ---- Ch 2 P.P. KL Data Frame Data KL Data Frame Data ---- P.P. Table P.P. KL ANC KL ANC Data ---- Data Data Data P.P. Table P.P. Audio KL Data Data P.P. Ch 1 Table P.P. Audio KL Footer Data Data P.P. Table ---- P.P. RIP Ch 2 2sec 2sec 2sec 125kB / frame (average at 25Mbps) 192kB / 2 sec Random

28 Thank Implementation you targets of OP-1b - Typical video server wishes to playback within 5 seconds after capturing video 2 second partition has been choosen to meet such demand with enough margin - Live application needs to playback while ingesting OP-1b is defined every index table is located after essence If system finds index table, corresponding essence is already arrived - To access any frame immediately, OP-1b has been fixed to 2 seconds partition Structural HPP Metadata Descriptive Metadata BPP ( XML&Thumbnail ) Audio BPP Table BPP ANC BPP Table BPP BPP Table --- BPP --- FPP RIP Seg. Seg. - ch1 Seg. K L #1 K L --- K L #m K L ANC #1 K L --- K L ANC #m K L Audio ch1 data 2 seconds (m frames) 2 seconds (m frames) 2 seconds

29 Differences of OP-1a and OP-1b MXF OP-1a - required Frame Wrapping which causes very small piece of audio data between every video frame - difficult to playback audio in FF/REW mode at mobile devices - needs extra time to rewrap to other container such as OP-Atom or Quicktime - no external file support MXF OP-1a #1 #2 #3 #4 #5. (104kB / Frame) Audio ch1 (3.2kB / Frame ) MXF OP-1b - allows any duration of audio/video interleave - gives better performance to playback and re-wrapping processes MXF OP-1b #1 #2.. #60 Audio ch1 Audio ch2 #61 #62.. #120 Audio ch1 Audio ch2. (6.2MB / 60Frame) Audio ch1 ( 192kB / 60Frame )

30 SMPTE RDD-9 Long GOP implementation of OP-1a File header File body File footer Header Header Metadata MPEG-2/AES stream MPEG-2/AES Table stream Table MPEG-2/AES stream Footer Table Random Size: 1 GOP up to 10sec Random Random Length SID Key Byte Offset SID Byte Offset SID Byte Offset SID Byte Offset SID Byte Offset Length In this specification, the Random is strongly recommended. Because of the variable length Edit Unit, it could be much difficult to find each element without the Random.

31 Agenda AVC-Ultra the Codec family AVC-Ultra File and data structure AVC-I: OP-Atom microp2 A new recording device

32 microp2 card Same high reliability like P2 card - integrated RAID system High speed data transfer - 2Gbps Same form factor like SD card - SD compatible Low price media - 32GB: 200,- RRP - 64GB: 300,- RRP AJ-P2M032A (32GB) QR code for wireless applications AJ-P2M064A (64GB) Content Protection System (CPS)

33 Security: Content Protection System (CPS) (1) Set password to PC (2) Export password to SD card P2 Viewer Plus Set Password ******** Password password (3) Copy password to P2 device (4) Format microp2 card Then microp2 is formatted as CPS ON (locked by password) media (5) microp2 (CPS) can be used among your devices *You don t have to enter password each time Password Protected Password

34 microp2 card adapter AJ-P2AD1 165,- RRP Compatible with - many legacy P2 products - SDHC/SDXC cards (max 50Mbps write)

35 Emergency use of SDHC/SDXC cards Maximum writing speed of 50Mbps based on SDHC/SDXC technology Support of SDHC/SDXC (4GB-128GB) Class10 or faster Recordable Codecs up to 50Mbps: - DV/DVCPRO/DVCPRO50 - AVC-Ultra If SDHC/SDXC cards are used, recording is not guaranteed