EE 5359 Implementation and evaluation of A/153 ATSC mobile DTV standard Sriniveditha Shivakkumaran (1000628037) Under the guidance of Dr.Rao
What is ATSC? Advanced Television Systems Committee, Inc., is an international organization which develops standards for digital television. ATSC coordinates television standards among various communications media. [1]
A/153 : ATSC mobile DTV standard Developed to support various services. Defines the technical specifications to provide new services to mobile and handheld devices using DTV transmissions. Services include real-time interactive services and file-based content download. [1]
Parts of A/153 standard [1] The A/153 ATSC mobile DTV standard consists of eight parts Part 1 - Mobile/Handheld Digital Television System Part 2 - RF/Transmission Part 3 - Service multiplex and Transport subsystem Part 4 - Announcement Part 5 - Application Framework Part 6 - Service Protection Part 7 - AVC and SVC Video System Part 8 - HE AAC Audio System
AVC and SVC video system characteristics Possible video inputs Standardized video input formats [2]
Video standards SMPTE (Society of Motion Picture and Television Engineers) 274M Specifies representation of uncompressed highdefinition television. Image format is 1920x1080 pixels with progressive and interlaced scanning. SMPTE 296M defines systems with an image size of 1280x720 pixels and progressive scanning. ITU-R BT.601-5 standardizes the format of high-definition television with 16:9 aspect ratio. Number of samples per digital active line is 720 and 483 active lines.
Video processing before AVC compression [3] 1080i formats - Out of 1920 pixels per line of video, 24 pixels each on the left side of the image and the right side of the image are cropped. Resulting 1872 pixels by 1080 line image is de-interlaced to 416 pixels by 240 lines before compression. 720p formats - Out of 1280 pixels per line of video, 16 pixels each on the left side and right side of the image are cropped. Resulting 1248 pixels by 720 line image is de-interlaced to 416 pixels by 240 lines before compression. Standard definition formats with 16 : 9 Aspect Ratio - Of the 720 pixels per line, 8 pixels each on the left side and right side of the image are cropped. Resulting image has 704 pixels per line. The 704 pixel by 480 line image is de-interlaced to 416 pixels by 240 lines prior to compression.
Video processing before AVC compression [3] Standard definition formats with 4:3 Aspect Ratio -Since the M/H video system can encode only 16:9 video formats, 4:3 SD video must be converted to a 16:9 video format before compression. It is converted to a high definition format and the 16:9 frame is converted to 416 pixels by 240 lines.
Image resize 1920 1080i formats 1872 416 1080 1080 240 24 24 1280 720p formats 1248 416 720 720 240 16 720 16 480i and 480p formats 704 416 480 480 240 8 8
H.264 coding standard H.264 is developed for multimedia applications. High compression efficiency In this project, H.264 is used for encoding the video bitstream in the ATSC broadcast system.
Block diagram of H.264 Encoder [11]
4x4 Integer transform Context-based adaptive variable length coding (CAVLC) and Context-based adaptive binary arithmetic coding (CABAC) entropy coding -Match symbol to code. - CAVLC and CABAC for quantized coefficients. - To read the residual data (quantized transform coefficients), zig-zag scan (interlaced) or alternate scan (noninterlaced or field) is used. - For coding the residual data, a more sophisticated method called CAVLC is employed. Also, CABAC is employed in Main and High profiles, CABAC has more coding efficiency but higher complexity compared to CAVLC.
Deblocking filter - H.264 employs a deblocking filter to reduce the blocking artifacts in the block boundaries. - It stops the propagation of accumulated coded noise. The filter is applied after the inverse transform (before reconstructing and storing the macroblock for future predictions) and in the decoder (before reconstructing and displaying the macroblocks).
H.264 intra prediction modes
During intra prediction, the encoder derives a predicted block based on its prediction with previously decoded samples. The predicted block is then subtracted from the current block and then encoded. There are a total of nine prediction modes for each 4x4 luma block, four prediction modes for each 16x16 luma block and four modes for each chroma block.
Block diagram of H.264 decoder [18]
H.264 decoder Includes all the control information such as picture or slice type, macroblock types and subtypes, reference frames index, motion vectors, loop filter control, as well as coded data comprising of quantized transform coefficients. The decoder works similar to the local decoder at the encoder; a simplified description is as follows. - After entropy (CABAC or CAVLC) decoding, the transform coefficients are inverse scanned and inverse quantized prior to being inverse transformed.
H.264 decoder - To the resulting blocks of residual signal, an appropriate prediction signal (intra or motion compensated inter) is added. - The reconstructed video frames undergo deblock filtering prior to being stored for future use for prediction. -The frames at the output of deblocking filter may need to undergo reordering prior to display.
H.264 profiles [12]
Common coding parts for the Profiles I slice (Intra-coded slice) : the coded slice by using prediction only from decoded samples within the same slice P slice (Predictive-coded slice) : the coded slice by using inter prediction from previously-decoded reference pictures, using at most one motion vector and reference index to predict the sample values of each block CAVLC (Context-based Adaptive Variable Length Coding) for entropy coding
Coding parts for Baseline Profile Common parts : I slice, P slice, CAVLC FMO Flexible macroblock order : macroblocks may not necessarily be in the scan order. The map assigns macroblocks to a slice group ASO Arbitrary slice order : the macroblock address of the first macroblock of a slice of a picture may be smaller than the macroblock address of the first macroblock of some other preceding slice of the same coded picture RS Redundant slice : This slice belongs to the redundant coded data obtained by same or different coding rate, in comparison with previous coded data of same slice
Coding parts for Main Profile Common parts : I slice, P slice, CAVLC B slice (Bi-directionally predictive-coded slice) : the coded slice by using inter prediction from previously-decoded reference pictures. Weighted prediction : scaling operation by applying a weighting factor to the samples of motion-compensated prediction data in P or B slice CABAC (Context-based Adaptive Binary Arithmetic Coding) for entropy coding
Sub-blocks of a macroblock [15] Motion Estimation sizes in H.264 A MB can be partitioned into smaller block sizes 4 cases for 16 x 16 MB, 4 cases for 8 x 8 Sub-MB Large partition size : homogeneous areas, small : detailed areas
Performance results Tempete (CIF) sequence
MSE SSIM Tempete (CIF) sequence 400 Bitrate vs. MSE 1 Bitrate vs. SSIM 350 0.95 300 0.9 250 0.85 200 150 0.8 0.75 0.7 100 0.65 50 0.6 0 0 500 1000 1500 0.55 0 500 1000 1500
PSNR (db) Performance results Bus (CIF) sequence 55 Bitrate vs. PSNR (db) 50 45 40 35 30 25 20 0 200 400 600 800 1000 1200 1400
MSE SSIM Bus (CIF) sequence 350 Bitrate vs. MSE 1 Bitrate vs. SSIM 300 0.95 0.9 250 0.85 200 0.8 0.75 150 0.7 100 0.65 50 0.6 0.55 0 0 200 400 600 800 1000 1200 1400 0.5 0 200 400 600 800 1000 1200 1400
PSNR (db) Performance results Coastguard (CIF) sequence 55 Bitrate vs. PSNR(dB) 50 45 40 35 30 25 20 0 200 400 600 800 1000 1200 1400
MSE SSIM Coastguard (CIF) sequence 250 Bitrate vs. MSE 1 Bitrate vs. SSIM 200 0.9 0.8 150 0.7 100 0.6 50 0.5 0 0 200 400 600 800 1000 1200 1400 0.4 0 200 400 600 800 1000 1200 1400
PSNR (db) Performance results Waterfall (CIF) sequence 55 Bitrate vs. PSNR (db) 50 45 40 35 30 25 0 200 400 600 800 1000 1200 1400
MSE SSIM Waterfall (CIF) sequence 200 Bitrate vs. MSE 1 Bitrate vs. SSIM 180 160 0.9 140 120 0.8 100 0.7 80 60 0.6 40 20 0.5 0 0 200 400 600 800 1000 1200 1400 0.4 0 200 400 600 800 1000 1200 1400
PSNR(dB) Performance results Foreman (QCIF) sequence 55 Bitrate vs. PSNR 50 45 40 35 30 25 20 0 50 100 150 200 250
MSE SSIM Foreman (QCIF) sequence 300 Bitrate vs. MSE 1 Bitrate vs. SSIM 250 0.95 200 0.9 150 100 50 0.85 0.8 0.75 0.7 0 0 50 100 150 200 250 0.65 0 50 100 150 200 250
PSNR(dB) Performance results Akiyo (QCIF) sequence 55 Bitrate vs. PSNR(dB) 50 45 40 35 30 25 0 20 40 60 80 100 120
MSE SSIM Akiyo (QCIF) sequence 180 Bitrate vs. MSE 1 Bitrate vs. SSIM 160 0.95 140 120 0.9 100 80 0.85 60 0.8 40 20 0.75 0 0 20 40 60 80 100 120 0.7 0 20 40 60 80 100 120
PSNR(dB) Performance results Claire (QCIF) sequence 55 Bitrate vs. PSNR (db) 50 45 40 35 30 25 0 20 40 60 80 100 120
MSE SSIM Claire (QCIF) sequence 140 Bitrate vs. MSE 1.02 Bitrate vs. SSIM 120 1 100 0.98 0.96 80 0.94 60 40 20 0.92 0.9 0.88 0.86 0 0 20 40 60 80 100 120 0.84 0 20 40 60 80 100 120
PSNR(dB) Performance results News (QCIF) sequence 55 Bitrate vs. PSNR(dB) 50 45 40 35 30 25 20 0 20 40 60 80 100 120 140 160 180
MSE SSIM News (QCIF) sequence 350 Bitrate vs. MSE 1 Bitrate vs. SSIM 300 0.95 250 0.9 200 0.85 0.8 150 0.75 100 0.7 50 0.65 0 0 20 40 60 80 100 120 140 160 180 0 20 40 60 80 100 120 140 160 180
PSNR(dB) Performance results Harbour (HD) sequence 38 36 34 32 30 28 26 24 22 0 50 100 150 200 250 300 350 400
MSE SSIM Harbour (HD) sequence 350 1 300 0.95 250 0.9 0.85 200 0.8 150 0.75 100 0.7 50 0.65 0 0 50 100 150 200 250 300 350 400 0 50 100 150 200 250 300 350 400
PSNR(dB) Performance results Blue sky (HD) sequence 40 35 30 25 0 50 100 150 200 250
MSE SSIM Blue sky (HD) sequence 180 1 160 0.98 140 0.96 120 0.94 0.92 100 80 0.9 0.88 60 0.86 40 0.84 20 0 50 100 150 200 250 0.82 0 50 100 150 200 250
PSNR(dB) Performance results Mobile (HD) sequence 44 42 40 38 36 34 32 30 28 26 24 0 20 40 60 80 100 120 140 160 180 200
MSE SSIM Mobile (HD) sequence 250 1 0.95 200 0.9 0.85 150 0.8 0.75 100 0.7 0.65 50 0.6 0.55 0 0 20 40 60 80 100 120 140 160 180 200 0.5 0 20 40 60 80 100 120 140 160 180 200
REFERENCES [1] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 1 Mobile/Handheld Digital Television System, Doc. A/153 Part 1:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. [2] ATSC: ATSC Digital Television Standard, Part 4 MPEG- 2 Video System Characteristics, Doc. A/53 Part 4:2009, Advanced Television Systems Committee, Washington, D.C., 7 August 2009. [3] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 7 AVC and SVC Video System Characteristics, Doc. A/153 Part 7:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. [4] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 2 RF/Transmission System Characteristics, Doc. A/153 Part 2:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. *5+ ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 3 Service Multiplex and Transport Subsystem Characteristics, Doc. A/153 Part 3:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009.
REFERENCES [6] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 4 Announcement, Doc. A/153 Part 4:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. [7] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 5 Presentation Framework, Doc. A/153 Part 5:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. [8] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 6 Service Protection, Doc. A/153 Part 6:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. [9] ATSC: ATSC Mobile/Handheld Digital Television Standard, Part 8 HE AAC Audio System Characteristics, Doc. A/153 Part 8:2009, Advanced Television Systems Committee, Washington, D.C., 15 October 2009. [10] G.A.Davidson et al, "ATSC video and audio coding", Proc. IEEE, vol. 94, pp. 60-74, Jan.2006 [11] A. Puri, X. Chen and A. Luthra, Video coding using the H.264/MPEG-4 AVC compression standard, Signal Processing: Image Communication, vol. 19, pp. 793-849, Oct. 2004
REFERENCES *12+ S.K.Kwon, A.Tamhankar and K.R.Rao, Overview of H.264 / MPEG-4 Part 10 J. Visual Communication and Image Representation, Vol 17, pp.186-216, April 2006. *13+T.Wiegand, et al Overview of the H.264/AVC video coding standard, IEEE Trans. on Circuits and Systems for Video Technology, Vol.13, pp 560-576, July 2003. *14+ T. Wiegand and G. J. Sullivan, The H.264 video coding standard, IEEE Signal Processing Magazine, vol. 24, pp. 148-153, March 2007 *15+ A. Ravi and K.R. Rao, Performance analysis and comparison of the Dirac video codec with H.264 / MPEG-4 Part 10 AVC, IJWMIP. (under review) *16+ A. Puri, X. Chen and A. Luthra, Video coding using the H.264/MPEG-4 AVC compression standard, Signal Processing: Image Communication, vol. 19, pp. 793-849, Oct. 2004 [17] H.264 AVC JM software: http://iphome.hhi.de/suehring/tml/ [18] A/153 ATSC mobile DTV standard : http://www.atsc.org/standards/a153.php
ACRONYMS AAC Advanced Audio Coding AES Advanced Encryption Standard AT ATSC Time ATSC Advanced Television Systems Committee ATSC-M/H ATSC Mobile/Handheld Standard AVC Advanced Video Coding (ITU-T H.264 ISO/IEC 14496-10) BSD/A Broadcast Service Distribution/Adaptation Center BSM BCAST Subscription Management CIT-MH Cell Information Table for ATSC-M/H CRC Cyclic Redundancy Check DNS Domain Name System DRM Digital Rights Management DVB Digital Video Broadcasting FEC Forward Error Correction HE AAC High Efficiency Advanced Audio Coding HE AAC v2 High Efficiency Advanced Audio Coding version 2 LTKM Long-Term Key Message
ACRONYMS M/H Mobile/pedestrian/handheld MHE M/H Encapsulation MPEG Moving Picture Experts Group N Number of columns in RS Frame payload NTP Network Time Protocol PEK Program Encryption Key RTP Real-time Transport Protocol SDP Session Description Protocol SEK Service Encryption Key SG (Electronic) Service Guide SLT-MH Service Labeling Table for ATSC-M/H STKM Short-Term Key Message SVC Scalable Video Coding (Annex G of ITU-T rec. H.264 ISO/IEC 14496-10) SVG Scalable Vector Graphics TCP Transmission Control Protocol TEK Traffic Encryption Key TPC Transmission parameter channel