AVC-ULTRA TECHNOLOGY BALANCING: FILE SIZE, PROCESSOR LOAD AND PERFORMANCE FOR NEW WORKFLOWS AND APPLICATIONS- LEARN MORE HTTP://WWW.PANASONIC.COM/BUSINESS-SOLUTIONS/AVC-ULTRA.ASP
AVC-ULTRA
Compression is just the CODEC LTO, HDD, BluRay Disc P2 Card, SD Card Media Format P2, AVCHD HDCAM, Mini DV, SR Wrapper MXF OP Atom MXF OP1B, Quicktime, DVI CODEC AVC-Intra Class 100 DNXHD, ProRes AVC LongG
Compression Overview The goal of compression lossless compression When is lossy compression necessary?* Goal for Improving Compression* Compression improvement costs* *Video compression quality is content and application dependent
Compression Overview Intra-frame = I frame only Inter-frame compression = Long GOP long GOP can achieve higher compression ratios long GOP compression performance is highly content and application dependent
Video CODECs balanced for applications Will my hardware encode/decode the content fast enough? How good will the content look? Will it hold up to further processing:? Image Qality File Size Complexity How much storage will I require? Will it fit in the pipe?
The Pie Gets Bigger As processor speed improves As storage gets cheaper As high data rate physical links come into use As GPU begin to be utilized With Moore s law
But Everyone Gets Hungrier As resolution increases As temporal resolution increases As more downstream processing is expected As production teams wish to be mobile Utilizing WAN and wireless networks Budgets are shaved Many different people expect that THEY will get the extra piece from Mr.. Moore
What is AVC? AVC stands for Advanced Video Coding ITU-T was standardized it as H.264, and ISO standardized as ISO/IEC 14496-10 MPEG-4 part10 AVC AVC is a core technology for all types of encoding applications AVCHD - High profile AVC implementation supported by Panasonic and Sony AVC-Intra - applications of AVC high profiles using Intra frame coding AVC-Ultra are expanded AVC-Intra applications and other high profile applications The goal of the JVT was to double the compression efficiency of then existing techniques
What does AVC give us Over MPEG 2? Support for the new formats 60p, 444, 2K, 4K Efficient compression of 10bit or 12bit quantization Opportunities to trade complexity For performance For file size
High Intra Profiles Subset of High Profile that uses only I picture AVC Production Format CODEC design High 444 Intra - AVC 444 (12 Bit 4:4:4 1080p, 2K, 4K) High 4:2:2 Intra Profile (Hi422IP) e.g., AVC-Intra class 100 - Including 60p High 10 Intra Profile (Hi10IP) e.g., AVC-Intra class 50 High Profiles - Including 60p & AVC Intra Class 200 High 4:2:2 profile is AVC-LongG (10 Bit 4:2:2) High Profile is supported by Blu-ray Disc and AVCHD Extended Profiles basic tools + high efficiency tool (excluding CABAC) + streaming tool Main Profiles basic tools + high efficiency tool (including CABAC) Baseline Profile
What s New in the AVC toolbox? Intra-Frame prediction Variable block sizes, 2x2, 4x4 and 8x8 Integer Transform & Quantization Improved Inter-frame prediction (long GOP) & motion estimation Finer motion prediction accuracy Powerful CAVLC and CABAC entropy encoding Flexible image slicing optimizes multi-node processing De-blocking Filters to hide errors
How About H.265?? More prediction tools More block configurations More entropy coding More motion prediction Heavier processor load More later
Intra frame Prediction Pixel Block Error Image Some possible prediction modes Best approximation, repeat right adjacent pixels Errors
Variable Size Blocks Varying block sizes are chosen to provide best fit to image data structure and thus generate optimal coefficient data sets. This creates more efficient coding.
Motion Vectors
Improved INTER frame Compression More complex (weighted) referencing More accurate motion vectors ¼ pixel & 1/8 pixel motion vector accuracy & a variety of block sizes Motion PREDICTION
What Is Entropy Coding? More common data strings represented by fewer bits Morse Code is Entropy Coding Entropy coding requires knowledge of the statistical behavior of the data
Advanced Entropy Coding Context Adaptive Variable Length Coding (CAVLC) changes the code table to suit the localized image content ~ 25%* improvement over non-adaptive coding (e.g., huffman coding) Context Adaptive Binary Arithmatic Coding (CABAC) looks at the entire pictures probability distribution & can provide a 30% compression gain ~ 10%* improvement over CAVLC *estimated average, real results are content dependent
No Change in Video Quality Huffman Coding CAVLC CABAC Relative compressed file sizes Significant differences in coding complexities!
Multi Slice Encoding A B C D CPU #0 CPU #1 CPU #2 CPU #3 * Use 1 GOP = 6 frames for Explanation Single CPU Model CPU #0 Multi CPU Model CPU #0 GOP 0 GOP 1 GOP 2 A A B C D CPU #1 CPU #2 CPU #3 B C D Total 4 CPUs
PSNR To GOP or not to GOP I Frame Only Long GOP Time Time I I I I I I I I I B I B B P B B I B GOP
To GOP or not to GOP Still Pictures PSNR Long GOP quality is content dependent Landscape Long GOP Codec AVC-Intra100 : Cut Edit Fast Motion AVC-Intra50 : Cut Edit Flashing lights Confetti fall 1st 5th 10th Generation
In High Profiles Bit Depths >8 Are Available 10 bit vector scope trace 8 bit vector scope trace
PSNR-Y (Luminance) At Higher Data Rates Greater Bit Depth is More efficient! Inverse Bit Penalty 75 70 65 60 55 50 8 bit 10 bit 12bit At Higher Bit Rates, AVC encodes images so accurately, reducing the bit depth, reduces the compression efficiency! 45 Bit Rate Mb/s 50 100 150 200 250 300 350 400 450 500 Intra Frame CODEC Test
CODECs are balanced for each application CPU, GPU, LSI, FPGA Power requirements Thermodynamics Speed requirements Driven by complete production path. Resolution Bit depth Color accuracy Error tolerence Multiple streams Image Qality File Size Complexity What pipe am I using? How expensive is storage? What are my shooting ratios?
New Applications Call for New Implementations 1080p, 2K & 4K GOP Class 50 720 24pN 1080 24pN 720 60p 1080 60i 1080 60p GOP Class 50 Class 100 444 720 24pN 1080 24pN 720 60p 1080 60i 1080 60p Class 100 720 24pN 1080 24pN 720 60p 1080 60i 1080 60p Class 200 Class 200 Compression Level LPCS audio Formats PROXY Resolution
Not used for AVC-Intra Selecting AVC Tools Not used for AVC LongG Integer Transform & Quantization Variable block sizes, 2x2, 4x4 and 8x8 Intra-Frame prediction Improved Inter-frame prediction (long GOP) Finer prediction accuracy to minimize errors Flexible image slicing optimizes multi-node processing Powerful CAVLC and CABAC entropy encoding De-blocking Filters to hide errors
CODEC Design Example AVC-Intra Lossless Lossy Original frame Intra Prediction Integer Transform Quantization adjustable Lossless Intra Prediction data = 21Mb Advanced Entropy coding Intra prediction error 40 Mb Total Integer Transform Quantization adjustable Prediction Error = 12Mb
A simple, yet powerful example of the efficiency of AVC-Ultra. 16 channels of HD Long-G 25Mb/s sent over one Cat-6 Ethernet cable Small parsing server feeds 16 ToughPad PCs via Gig-E router to decode 16 channels of full res HD 4:2:2 10 bit content. LongG enables the movement of high quality HD (at DV Bitrates ) over existing networks while maintaining network speed. As shown at the NAB 2013
File upload by Wired LAN Wireless LAN (with optional dongle AJ-WM30) File upload by 4G/LTE (with supported third party's 4G/LTE dongle)
AJ- WM30(option) Wired LAN ipad/iphone/pc PC direct mode functions Live streaming REC start/stop Metadata/Text memo input Proxy data playback Proxy easy edit
Wireless LAN Wi-Fi router 4G/LTE FTP server AJ- WM30(option) Wireless LAN Public Wi-Fi FTP server AJ- WM30(option) 4G/LTE FTP server Third party 4G/LTE dongle Wired LAN FTP server direct mode functions File upload Streaming (via FTP server)
What Salesforce did for CRM. What SoundCloud is doing for audio. Aframe can do for video.
DYNA Chip IMPLEMENTATION HARDWARE OR SOFTWARE
AVC-Ultra Formats Supported Format Name microp2 Recording covered File Format MXF OP- ATOM MXF OP- 1b QT MOV Class Sampl Ing Unsupported Bit Depth Intra/ GOP Compression Format SD 24p 25p 30p N/A for hardware limitation 1080 720 1080 60i 50i 24p 25p 30p 60p 50p 60p 50p AVC-Intra444 P 444 4:4:4 12bit Intra 200M AVC-Intra200 P 200 4:2:2 10bit Intra 200M 200M 200M AVC-Intra100 P 100 4:2:2 10bit Intra 200M AVC-Intra50 P 50 4:2:0 10bit Intra AVC-LongG50 P G50 4:2:2 10bit GOP 50M AVC-LongG25 P G25 4:2:2 10bit GOP 25M 25M 25M 50M AVC-LongG12 P P G12 4:2:0 8bit GOP 12M 12M 24M AVC-LongG6 P P G6 4:2:0 8bit GOP 6M 6M 12M P 6.0Mbps** 4:2:0 8bit GOP AVC-Proxy P 3.5Mbps 4:2:0 8bit GOP P 1.5Mbps 4:2:0 8bit GOP ** 1920 x 1080 proxy P 800K 4:2:0 8bit GOP DVCPRO HD P 4:2:2 8bit Intra DVCPRO50 P 4:2:2 8bit Intra DVCPRO P 4:1:1 8bit Intra DV P 8bit Intra
Format v Data Rate Class 200 full res 4:2:2 10 bit Class 200 Class 444 HD or 2K 444 Format 720p 60 1080i 60 1080 24pN 1080p 60 Data rate 220 Mbps 180Mbps 440Mbps Class 100 Class 100 full res 4:2:2 10 bit 720 24pN 720p 60 1080i 60 1080 24pN 1080p 60 27 Mbps 110 Mbps 90Mbps 220Mbps Class 50 Class 50 pre-filter 4:2:0 10 bit 720 24pN 720p 60 1080i 60 1080 24pN 1080p 60 15 Mbps 55 Mbps 45Mbps 110Mbps
AVC-ULTRA Codec With Single Dyna Chip Dual Codec Recording AVC Ultra Recording AVC-Intra100 AVC-LongG6 simultaneously Simultaneous Recording AVC-Intra100 AVC-Intra100 simultaneously
AVC-ULTRA as a file format 1 - Select Compression 2 - Select Wrapper
MXF OP Atom or OP1B Very easy to import stand alone Op1b file AVC-Intra ( Op - Atom ) with Proxy CONTENTS CLIP ICON VIDEO AUDIO 0001AB00.MXF 0001AB01.MXF PROXY 0001AB.XML 0001AB.BMP 0001AB.MXF 0001AB.MOV AVC-LongG (Op-1B) with Proxy CONTENTS AVCLIP CLIP ICON 001AB2CD.MXF 001AB2CD.XML 001AB2CD.BM P VIDEO AUDIO PROXY 001AB2CD.MOV AVC-LongG +AVC-Intra with Proxy CONTENTS AVCLIP CLIP ICON 001AB2CD.MXF 0001AB.XML 001AB2CD.XML 0001AB.BMP 001AB2CD.BMP VIDEO 0001AB.MXF AUDIO 0001AB00.MXF 0001AB01.MXF PROXY 0001AB.MOV 001AB2CD.MOV
AVC-LongG uses MXF OP-1b OP-1a uses simple interleaving of the data; okay for broadcast, but not easy to search or manipulate e.g. Jog, Slo-Mo, scrub etc. OP-1a also requires the entire file to arrive before it can be played. OP-1b uses chunking where the A/V data is broken into 2 seconds stand-alone chunks. Chunks can be played and processed individually, audio is parsed in 2 sec chunks also greatly easing head seeks / data buffering. OP-1b can be played after just a few chunks are cached.. Ideal for RT streaming!
AVC-Ultra Partners: IBC 2013
P2 Plug-ins for Avid workflow Import Plug-ins Avid Media Composer 7.0.1 / 6.5.3 ( Windows / OSX ) 1. 1. Export Plug-ins 2. 3. 3. 2. Off-line > On-line editing by Proxy
What about 4K? 4096 (Cinema) 3840 (TV broadcasting) 2160 Full HD 1920 x 1080 For digital cinema (native 4K) 4,096 x 2,160 pixels, 17:9 For TV broadcasting (QFHD) 3,840 x 2,160 pixels, 16:9 Compared to Full HD 1,920 x 1,080 pixels
Why Does 4K Matter? What we should be asking ourselves Does 4K even need to get into the home to be a factor? Is 4K a raster size a new format or a chance to brake the rigidity of current live broadcast formats? Where is video technology growing? How can we use 4K technology today? What is stopping 4K from moving to live production?
Higher picture quality for creative work for production 4Kx2K & 1080p50/60 Class4:4:4, Class200 Low data rate with high picture quality for cost effective workflow LongG50 LongG25 Class 100,50 Extremely low data for network based workflow LongG12 LongG6 Codec Resolution Frame rate Colour sample Bit depth Intra/Long 4096 x 2160 24p to 4096 x 2160 60p 3840 x 2160 4:4:4 12bit Intra 4:2:2 10bit Intra
Michael Bergeron Michael.bergeron@us.panasonic.com THANK YOU
AVC-ULTRA Resources www.panasonic.com/broadcast
P2 HD Camcorders, Recorders, Workflow 2/3 Shoulder 1/3 Shoulder / Hand Recorders / Workflow Cards / Readers AJ-PX5000 AG-HPX370 AG-HPD24 Micro / Full size P2 AJ-HPX3100 AG-HPX250 Ak-HRP200 AJ-PD500 Ak-HRP200 AG-AC90 AG-HMR10 / HCK10 AG-HPX600 AG-HPX255 Ak-HRP200 AW-RP50 Streaming / workflow Ak-HRP200 AW-RP50
AJ-PX270P P2 Hand-held Camcorder Current P2 formats (AVC-Intra 100/50, DVCPRO- HD/50/25) AVC-ULTRA Long G FTP and Dual/Simultaneous codec Optional 3G/4G capability 1080/60p / VFR HD-SDI, HDMI, TC, Sync, Audio Next generation, quieter, more sensitive 1080p 60 3MOS imagers Shipping in March 2013 @ est $6,500
AJ-PX270 Overview Micro & Full-size P2 slots Superb Image Quality in ALL formats; SD, HD**, even Proxy. (**inc 1080p 60) Enjoy efficiency and quality. Simultaneous HD and Proxy! Wireless control, Proxy, Streaming, and metadata workflows. Wireless / LAN IP connectivity. For News, Production, Sports The AVC-Ultra handheld with big 2/3 broadcast camera DNA
AJ-PX5000 - First Native AVC-ULTRA Camcorder Network, Major Sports, Archive Masters, Cinema (2nd unit / action) Master-quality and/or low-bit-rate 10-bit, 4:2:2 recording in Full HD Records in AVC-LongG and AVC- Intra100/50 as standard 2/3-inch, 2.2M 3-MOS sensors Full-resolution, 10-bit 1080/60p (in AVC- Intra100) Optional Class200 (Feb. 2014) Two microp2 cards slots, two P2 card slots Shipping: $25,000 SLP NEW!
AJ-PD500 Recorder MicroP2 half-rack recorder with AVC-Ultra recording Recording in AVC-LongG and AVC-Proxy as standard AVC-LongG50 (10-bit, 4:2:2) and AVC-LongG25 (4:2:2, 10-bit) recording included. Full-resolution, 10-bit 1080/60p in AVC-Intra100 NEW! Optional AVC-Intra200 and AVCHD playback Great for rental and staging playback Shipping: $14,000 SLP
VariCam 3 Master-quality and/or low-bit-rate 10-bit, 4:2:2 recording in Full HD 2/3-inch, 2.2M 3-MOS sensors B4 lens mount enables use of native format prime lenses and servo zooms Exceptional Color Quality Two microp2 cards slots, two P2 card slots 4:4:4 12-bit High Frame rates (Class100 up to 120p) Available in 2014
VariCam 4K