FacultyofComputingandInformationTechnology DepartmentofRoboticsandDigitalTechnology TechnicalReport93-11
|
|
- Cathleen Pierce
- 8 years ago
- Views:
Transcription
1 FacultyofComputingandInformationTechnology DepartmentofRoboticsandDigitalTechnology TechnicalReport93-11 TheTheoryofCCITTRecommendationH.261, p64kbit/s"andreviewofsuchacodec \VideoCodecforAudiovisualServicesat December16,1993 AndrewMoore Enquiries:- ClaytonVIC3168 Australia MonashUniversity RoboticsandDigitalTechnology TechnicalReportCoordinator
2 AbstractandKeywords Contents 2TheH.261Standard 1Introduction 2.3VideoCodingAlgorithm::::::::::::::::::::::::::::9 2.2VideoFormat::::::::::::::::::::::::::::::::::6 2.1Background::::::::::::::::::::::::::::::::::: SourceCoder/Decoder::::::::::::::::::::::::: OthercomponentsinH.261:::::::::::::::::::::::::: DierentialPulseCodeModulated/DiscreteCosineTransformHybrid(DPCM/DCT):::::::::::::::::::::::::: DiscreteCosineTransform(DCT):::::::::::::::::::12 2.6Entropyencoding::::::::::::::::::::::::::::::::23 2.5EncodedImageDataStructures:::::::::::::::::::::::: MotionCompensation::::::::::::::::::::::::: Filter:::::::::::::::::::::::::::::::::::19 3AnH.261implementation 3.6TransmissionofpacketvideoviaTCP/IP:::::::::::::::::::30 3.5TheDCTandQuantization::::::::::::::::::::::::::26 3.4MovementDetection::::::::::::::::::::::::::::::26 3.3Inter/Intracodingdecisions::::::::::::::::::::::::::26 3.2VideoPiximaginghardware::::::::::::::::::::::::::25 3.1Overview:::::::::::::::::::::::::::::::::::::25 4Conclusion 3.7Summary:::::::::::::::::::::::::::::::::::: Locatingtheboundarybetweenimages:::::::::::::::: ControllingtheRateofFlow::::::::::::::::::::::31 Bibliography 5Acknowledgements 3.6.3ChoiceofQuantizer:::::::::::::::::::::::::::
3 ListofTables 3.1EectsoncodingduetonumberofDCTcoecientsused::::::::::30 2.1ParametersfortheCCITTVideoFormats::::::::::::::::::7 2
4 ListofFigures 2.1StructureofaMacro-BlockshowingsamplingstructureofLuminanceand 2.4PeriodicnatureofDCTandDFTtransforms:::::::::::::::::13 2.6Complexmotionexample::::::::::::::::::::::::::::17 2.5Simplemotionexample:::::::::::::::::::::::::::::16 2.3BlockdiagramoftheSourcecoder::::::::::::::::::::::11 2.2Blockdiagramofthecompletevideocodec::::::::::::::::::10 2.7Complexmotion,withobjectrevelation::::::::::::::::::::18 Chrominance::::::::::::::::::::::::::::::::::8 2.10ArrangementofGOBsinanimage::::::::::::::::::::::22 2.9Hierarchicalnatureofthedatastructuresofthecoder::::::::::::21 2.8Non-integermotion:::::::::::::::::::::::::::::::20 3.1UsinglessDCTsamples:::::::::::::::::::::::::::: ArrangementofblocksinaMacroBlock::::::::::::::::::: ArrangementofMacroBlocksinaGOB::::::::::::::::::: Humancodingexample::::::::::::::::::::::::::::24 3.2TheeectofQuantizerstepondatarate::::::::::::::::::: Zig-zagsampling::::::::::::::::::::::::::::::::23 3
5 Abstract ThispapergivesinformationaboutH.261,includingbackgroundonthedesignofthe H.261specication.TheimplementationcoveredisanH.261codecdesignedtorunusing Keywords H.261,codec,Internet,video,videoconference,DCT includesinformationaboutandresolutionofproblemsthatresultfromusingtheinternet protocolsasatrasmissionsystem. theinternetprotocolsasitstransmissionsystem.thediscussionoftheimplementation 4
6 Introduction Chapter1 Objective ThispaperdescribestheoperationaltheoryoftheCCITTRecommendationH.261[3,16] discussedinadditiontoinformationaboutandresolutionofproblemspresentbecauseof ponentsoftheh.261specication,nallycoveringparticularsonthenalcodinginthe andthenproceedstocoveranimplementationofacodecsatisfyingtheh.261standard. theuseofaninternetprotocolbasisforcommunications. sectioninformationonthebasicmakeupofasoftwareimplementationofh.261willbe willreviewanimplementationoftheh.261asaninternetprotocolbasedcodec.inthis H.261standard.Indealingwiththeimplementation[26],thesecondpartofthispaper ThispaperwillcoverthebackgroundoftheH.261,itsdesign,informationoncom- 5
7 TheH.261Standard Chapter2 2.1Background Videocodinghasahistorythatstartedinthe1940swhenC.E.Shannonandothersrst postulatedtheprobabilisticviewofinformationanditsrepresentation,transmissionand compression[9,25,7].thegrowthintheimagecompressioneldhasbeensteady,driven byitscontributiontoothereldssuchasmultimediacomputing.asaresult,there Atalaterstageinthestudyperiod,astandardforn64kbit/s(n=1,2,:::,5)wasalso recommendavideocodingstandardfortransmissionatm384kbit/s(m=1,2,:::,5). provideauniversalstandardforvideocodingandtransmissionusingintegratedservices DigitalNetwork(ISDN)[10].Atthistime,theCCITTestablishedaWorkingGroupto techniques. havebeenmanydierentandvarieddevelopmentsinthevideocodingandcompression becameclearthatsinglestandard,p64kbit/s(p=1,2,:::,30),couldcovertheentire considered.withcontinueddevelopmentsinvideocodingandcompressiontechniquesit TheH.261recommendation[3]cametobeaftertheCCITTrecognizedaneedto videoconferencing.therefore,therecommendedvideocodingalgorithmhastobeableto operateinrealtimewithaminimumofdelay.whenp=1or2,becauseoftheseverely limitedbandwidthavailable,onlydesktop,face-to-face,visualcommunication(videophone)isappropriate.forvaluesofpgreaterthan5,withtheadditionalavailablebit Themainapplicationsintendedforthisinternationalstandardareforvideophoneand InDecember1990,theCCITTcompletedandapprovedRecommendationH.261, VideoCodecforAudiovisualServicesatp64kbit/s. ISDNchannelcapacity. CIF(QCIF)asthevideoformatsforvisualtelephony.Thesizesinadditiontothe makesthesehigherdataratesmoresuitableforapplicationssuchasvideoconferencing. 2.2VideoFormat TheCCITTdecidedontheusesoftheCommonIntermediateFormat(CIF)andQuarter- rate,morecompleximagescanbetransmittedwithbetterquality.thisincreaseinquality sizesoftheseformatsarelistedintable2.1.thespecicationofh.261statesthatall codecsmustbeabletooperatewithqcifformatimages.theuseofcifformat(size) luminanceandcolorcodingvaluesareasdenedinccirrecommendation601[2].the 6
8 thecodedpixels. Table2.1:ParametersfortheCCITTVideoFormats.Thevaluesinbracketsrepresent Luminance(Y) Chrominance(CB) Chrominance(CR) Lines/FramePixels/LineLines/FramePixels/Line (352) (176) CIF (176) 7290(88) QCIF frameisoptional.themaximumdataratespeciedforbothformatsis30000/1001( 29.97)frames/second.Thereisadditionalprovisionfor1,2or3framestobedroppedby theencoderbetweentransmittedframes,inthiswayperformingaspatialsubsamplingof theimagesequence :97=24: = (2.1) ratereductionisrequiredtotransportsuchvideosignalsviaisdnchannels(p64kbit/s, QCIFat29.97frames/secondare24.31and6.08Mbit/srespectively.Agreatdealofbit- Equations2.2and2.4showthattheuncompresseddataratesfortransmittingCIFand :97=6: =50688 (2.3) (2.2) Forp=1or2,QCIFisnormallyusedforapplicationssuchasdesktopvideophone.Even p1,2,:::,30).thechoiceofciforqcifdependsontheavailabilityofchannelcapacity. (2.4) ifqcifoperatedat10framespersecond,abit-ratereductionofapproximately92.7to1 isneededtotransportthatsignalusinga64kbit/schannel.suchcompressionisamajor videoconferencing. undertaking. picture.duetoitsincreasedresolution,cifisappropriateforapplicationssuchasfull thecbimageandoneforthecrimage.)fourblocksmakeupamacroblock[3]. Thehierarchicalstructureoftheimagedataisdiscussedingreaterdetaillater.The upof88luminancesamplesandapairof44chrominancesamples(apair:onefor TheBlockisanintegralpartofthehierarchicalencodingstructure,ablockismade Forpgreaterthan5,CIFmaybeusedsincetherearemorebitsavailabletocodea algorithm,whichwillbedescribedinfurtherdetaillater. elaboratehierarchicalblockstructureisessentialforthehigh-compressionvideocoding compositionofamacroblockisshowninfigure chrominance(CBandCR)Blocks.AGroupofBlocks(GOBs)iscomposedof3 11MacroBlocks.ACIFPicturehas12GOBswhileaQCIFhasonlythreeGOBs.This Inthisway,eachMacroBlockiscomposedoffour88luminance(Y)Blocksandtwo 7
9 Figure2.1:StructureofaMacro-BlockshowingsamplingstructureofLuminanceand Chrominance. - Chrominance (sample point) - (sample point) 8
10 compresseddata,therearetwosortsofvideocompression/codingschemes:thereissource codingandthereisentropycoding. removingredundantinformationcarriedinaparticularform.forvideoimages,likeother 2.3VideoCodingAlgorithm Thebasicobjectiveofcompressionofanysortistoreducetherequiredbitrateby techniques. resultswhicharelossy,i.e.,picturequalityisdegraded,whileentropycodingreliesonthe change,interframecodingisusedforsequencesofsimilarimages,includingthosecontainingmovingobjects.intraframecodingremovesredundantspatialinformationwithin animage,whileinterframecodinginadditiontoremovingredundantspatialinformation, alsoremovestemporalredundancybetweenimages. statisticalpropertiesofthesignalsand,intheory,islossless.h.261makesuseofboth traframecodingisusedfortherstpictureinasequenceandforimagesafterascene Sourcecodingcanbedividedintotwofurthertypes:intraframeandinterframe.In- Sourcecodingdealsdirectlywithcharacteristicsofthesourcematerialandyields betweentheoriginalframeandtherecreatedframewillbeprogressivelyaccumulated errorswillbebetweentheoriginalintraframeandthefollowinginterframes.sucherrors thattherewillbeerrortolerancesinthecreationofdierencesbetweentheimages,these systematicerrorincurredfromoneinterframetothenext.thiserrorisduetothefact Apartfromanytransmissionerrorseectingimagedata,therewillbeanaccumulated dierencesbetweenthatframeandthepreviousframe),erroraccumulationismorelikely. DuetothenatureofInterframeencoding(eachframeofdataisactuallyasetof Asaresult,intraframesareregularlysent(every30interframes,forexample1)tostop thisaccumulationoferrorsintheresultantimage. becauseeachnewinterframe(withitsownerrors)iscreatedfromthepreviousframe (interorintra)andnotasadierenceof(forexample)theoriginalintraframereference. correctioncode.theuseofthisoptionalerrorcorrectioncodewillnotbediscussedin additiontoencodingthereistheoptionaladditionofthebch2(511;493)forwarderror coderandsourcedecoderarebasedonlossyinter/intraframestylesourceencoding.in transmissioncoderandreceivingdecoderareentropystylesystems,whereasthesource wellastheinterandintravariationsofsourcecoding. Figure2.2givesadiagramaticoverviewoftheH.261codec.Inthisdiagramthe Undercertaincircumstances,H.261makesuseofbothsourceandentropycodingas thispaper SourceCoder/Decoder tizedandthensenttothevideomultiplexcoder.thissamepictureisalsorecovered tion(dpcm)schemesincorporatingmotionestimation.inintraframecodingmode,the DPCMisnotoperative. AblockdiagramofthesourcedecoderforH.261isshowninFigure2.3.Thissystemis ahybridofthediscretecosinetransform(dct)andadierentialpulsecodemodula- intraframescanbesentmoreoften. 1TheH.261standard[3]denesthatanintraframemustbesentforevery132interframes.Although 2Bose,ChaudhuriandHoequenham(code)[18]9 Each88blockintheimageistransformedintoitsDCTcoecients,linearlyquan-
11 External Control Coding Control Video Signal Video multiplex Transmission Transmission BCH correction Source Coder oryforuseininterframecoding..(throughaninversequantizerandinversedcttransform)andstoredinanimagemem- Coder buffer coder code generator a) Video coder basedonmotionestimationbycomparingeverymacroblock(onlyluminanceblocksare Video Multiplex Receiving Receiving BCH forward error Source decoder decoder buffer decoder forthatparticularmacroblock,insteadonlyamotionvectorisencoded.otherwise, predictedmacroblocksislessthanaparticularthreshold,thennodataistransformed processed)ofthecurrentframewiththemacroblocksintheneighbourhoodofthecorrespondingmacroblockinthepreviousframe.ifthedierencebetweenthecurrentandthe TheDPCMstyleofcodingisusedintheinterframecodingmode.Thepredictionis b) Video decoder thedierenceistransformed(bydct),linearlyquantizedandthensenttothevideo onandotoimproveimagequalityberemovinghigh-frequencynoiseasrequired. multiplexcoderalongwiththemotionvectorinformation.aloopltercanbeswitched therebyincreasingtheamountofinformationgenerated(andtobetransmitted)bythe shouldthetransmissionbuerberelativelyempty,thequantizationstepcanbereduced, consistentamountofdatathroughput)isareductionintheimagequality.alternately, generated(andtobetransmitted)bytheencoding.theimmediateresult(apartfroma thetransmissionbueroftheencoder.whenthetransmissionbuerisclosetobeingfull, thequantizerstepsizecanbeincreased,therebydecreasingtheamountofinformation Thestepsizeofthelinearquantizercanbeadjusteddependentuponthefullnessof encoder. ofthestepsizeofthelinearquantizer.10 coecientsandvariousotherinformation. regulatetheowtoaconstantrateby(asmentionedabove)providingfeedbackforcontrol entropycodingisusedinthevideomultiplexcoderwhichimmediatelyfollowsthesource coderstage.therearevevariableword-lengthcodingtablesforthequantizeddct Theoutputofthevideomultiplexcoderissenttoatransmissionbuer,whichwill Inafurtherattempttoincreasetheeciencyofthecoding,variableword-length Figure2.2:Blockdiagramofthecompletevideocodeccode correction Coded bit stream
12 CC p t qz T Q q Video In - Q -1 To Video multiplex coder -1 T F P v f T. Q P F CC p t qz q v f Transform Quantizer Picture memory with motion compensated variable delay Loop Filter Coding control Figure2.3:BlockdiagramoftheSourcecoder Flag for INTRA/INTER Flag for transmitted or not Quantizer indication Quantizing index for transform coefficients 11 Motion vector Switching on/off of the loop filter
13 2.3.2DiscreteCosineTransform(DCT) TransformcodingsystemsbasedontheKarhunen-Loeve(KLT),discreteFourierTransform(DFT),discreteCosineTransform(DCT),Walsh-HadamardTransform(WHT),and anumberofothertransformshavebeenconstructedandstudiedextensively.thechoice ofaparticulartransforminagivenapplicationdependsuponthepropertiesoftheapplication(forexample,howmuchinter-elementcorrelationispresent),upontheamountof reconstructionerrorthatcanbetoleratedandthecomputationalresourcesavailable. duringthetransformationstep). Thevariablem(u;v)isaparticulartransformcoecientmaskingfunctiondesignedto Themean-squareerrorbetweensubimageF(ofsizenn)andapproximation^Fis Compressionisachievedduringthequantizationofthetransformedcoecients(not eliminatethebasisimagesthatmakethesmallestcontributiontothetotalpost m(u;v)=f0ift(u;v)satisfiesaspecifiedtruncationcriteria 1otherwise transformimages. givenby: Huv=264h(0;0;u;v) Huvisthearrayofbasisimagesofthetransformdenedas: h(0;1;u;v):::h(0;n?1;u;v) (2.5) HuvcanbeusedtocomputetheseriesexpansionweightingcoecientsT(u;v). ems=efkf?^fk2g h(n?1;0;u;v)h(n?1;1;u;v):::h(n?1;n?1;u;v) : : : 3 75(2.6) =Efkn?1 =n?1 Xu=0n?1 Xv=02T(u;v)[1?m(u;v)] Xu=0n?1 Xv=0T(u;v)Huv[1?m(u;v)]k2g Xv=0T(u;v)Huv?n?1 Xu=0n?1 Xv=0T(u;v)m(u;v)Huvk2g (2.9) (2.8) (2.7) abilitytothedftandwht,andthisisusuallythecaseformostnaturallygenerated wheret(u;v)isthe2-dtransformoftheimagef(x,y),kf?^fk,isthematrixnormof Itcanbeshown([7,5,20,31])thatwhileDCThasasuperiorinformationpacking (F?^F)and2T(u;v)isthevarianceofthecoecientattransformlocation(u;v). (2.10) images(i.e.notarandomwhitenoiseimage,)infact,theklt,notthedct,isthe optimaltransforminaninformationpackingsense.thatis,thekltminimizesthe foreachsubimage,ingeneral,isanon-trivialcomputationaltask.forthisreason,the mean-squareerror(equations2.8,2.10)foranyinputimagesandanynumberofretained coecients.however,becausethekltisdatadependent,obtainingthekltbasisimages 12
14 A Figure2.4:PeriodicnatureofDCTandDFTtransforms F (a) DFT A DFTwillcauseGibbsphenomenonattheblockboundaries,therebygivingerroneous packingabilityoftheoptimalklt. odicityofthedctlendsitselftobeinglesspronetoblockingartifacts3.whereasthe KLTisseldomusedinpractice.InsteadoftheKLT,atransformsuchasDCTisused. valuesatthediscontinuitiesandboundaries.thedct,ontheotherhand,reducesthis thecomputationrequired.additionally,thedctcloselyapproximatestheinformation TheDCTusesxedbasisimages(inputindependent)therebydramaticallyreducing GonzalezandWoods(1992)[7]reasonthatincomparisonwiththeDFT,theperi- F eectbecauseofitsimplicit2npointperiodicitydoesnotinherentlyproduceboundary (b) separabletwo-dimensional,88blocks,theseinturnaretransformedusingthedct. Equation2.11showstheforwardtransformationforthegenerationofadiscretecosine discontinuities.theperiodicnatureisshownincomparisontothedftinfigure2.4 computationalrequirements. thedct,whichprovidesagoodcompromisebetweeninformationpackingabilityandits 3Theresultsofboundariesbetweensubimagesbecomingoverlyobvious. Fortheparticularapplicationathand,eachtransmittedblockisrstprocessedinto Asaresultofthesefactors,mostpracticaltransformencodingsystemsarebasedon 13
15 transformoftheoriginal88imageblock. withu;v;x;y=0;1;2;:::;7 where, F(u;v)=1=4C(u)C(v)7Xx=07Xy=0f(x;y)cos[(2x+1)u=16]cos[(2y+1)v=16](2.11) Equation2.12showstheinversetransformationfortherecoveryofanapproximationof C(u)=1=p2foru=0,otherwise1 C(v)=1=p2forv=0,otherwise1 u;v=coordinatesinthetransformdomain x;y=spatialcoordinatesinthepixeldomain theoriginal88imageblock. withu;v;x;y=0;1;2;:::;7 where, f(x;y)=1=47xu=07xv=0c(u)c(v)f(u;v)cos[(2x+1)u=16]cos[(2y+1)v=16](2.12) x;y=spatialcoordinatesinthepixeldomain theleftandtopedgesoftheimage. Note:Withintheblockbeingtransformed,x=0andy=0refertothepixelnearest C(u)=1=p2foru=0,otherwise1 C(v)=1=p2forv=0,otherwise1 u;v=coordinatesinthetransformdomain 2.3.3DierentialPulseCodeModulated/DiscreteCosineTransformHybrid(DPCM/DCT) processing.intraframeencodinginvolvesonlyasingleframe(withnoreferencetothe DierentialPulseCodeModulationisonlyrelevantfortheinterframecaseinimage previousframe),theframeissubdividedandeachcomponentencodedindependently usingadctandquantizationstep. quantizerandaninversedct,thisisthenstoredinaframebuerforuseasfollows.in Ininterframeencoding,thepreviousframeisregeneratedusinganinverseofthe 14
16 theinterframemodeofsourcecoding,onlythedierencesbetweentwoparticularframes information.) needtobesent.(inasequenceofimages/framesthereisoftenmuchredundanttemporal inturnreducestheamountoftransmitteddata,therebygivingadditionalcompression. frameinmemory.nowthesedierencesarethenencodedandquantizedtoformthedata wherebyifpartsoftheimage(particular88blocks)havenotchangedbygreaterthan usethepreviousblockcontents.bynotsendingredundant,duplicatedinformation,this tobetransmitted.often(andinthecaseofh.261)thereisasimplicationprocess aparticularthresholdthesecomponentsarenottransmitted,ineectthedecoderwill Thisisdone,inthesimplestform,bysubtractingthenewframefromthereconstructed 2.4OthercomponentsinH.261 thesemotionvectorshaveintegervaluesnotexceeding15.thisvectormustberepresentativeofthewholemacroblockasitisusedforallfourluminanceblocksinamacro amotionvectorforeachmacroblock(mb.)bothhorizontalandverticalcomponentsof whileintheinterframeencodingmodeofoperation.inthismodeanencoderallocates sationisanadditionaltechniqueofremovingfurthertemporalredundancytransmitted 2.4.1MotionCompensation Block. MotionCompensationisanoptionintheimplementationofanencoder.Motioncompen- thatthepredictionisformedfrompixelsinthepreviousframewhicharespatiallytothe rightorbelowthepixelsbeingproduced. Apositivevalueofthehorizontalorverticalcomponentofthemotionvectorsignies canreducetheamountofinformationrequiredtobetransmitted.inthegure,(a)shows putationrequired,motionestimationisanoptionintheh.261coderimplementation. requiredtobetransmitted. SimpleMotionCompensationFigure2.5showshowmotioncompensationdetection Ifweuseanexample,wecanshowhowmotionestimationcanreduceimagedata Becauseofthenumerousamountofsamplingandthustheinherentamountofcom- identicalexceptforatranslation(oftwototherightandonedown,)thusitshould tothepreviousimage. redundantinformation(oneforeachimage),theencodedinformationshouldcontainthe theoriginal(orreference)frameand(b)showsthenextframe.thetwoimagesare secondcopyoftheimage,downtoonlyavectorconsistingoftwoparts.thisexample beintuitivethatinsteadoftheencodedinformationcontaintwocopiesofsimilarbut greatlyoversimpliestheadditionalinformationrequiredinthecodingprocess,including informationtoindicatewhethermotioncompensationisused,butingeneralshouldshow originalimageandthenthefollowingimagebemarkedtosayitmakesuseofmotion inthisexamplehowmotioncompensationwillreducetheamountofcodedinformation compensationandinthiscase,containsonlyavectorofthemotionofthisimagerelative required. Forthissimpleexample,thiswouldreducetheamountofinformationfromafull 15
17 Image Motion (a) (b) themotionasbrokendownintoitshorizontalandverticalcomponents. Figure2.5:ASimpleMotionexample:(a)showstheoriginal(orreference)frame,(b) showsthenextframe,(c)indicatesthemotionintheimageoftheobjectand(d)shows 2 to right (-2) 1 down (-1) (d) 16
18 Image Motion (a) (b) 2 to the left (+2) 1 down (-1) (c) (d) Figure2.6:AComplexMotionexample:(a)showstheoriginal(orreference)frame,(b) showsthenextframe,(c)indicatesthemotionintheimageoftheobject,(d)showsthe motionasbrokendownintoitshorizontalandverticalcomponents,(e,f)showsthedierencebetweentheoriginalandresultantimages(whenoverlaid)(e)showsthedierences shaded,while(f)showstheoverlayinatransparentway. 17 (e) (f)
19 (f)showthedierencesbetweentheimages.insub-image(e)theseareasareshaded Figure2.7:ASecondComplexMotionexample:(a)showstheoriginal(orreference) frame,(b)showsthenextframe.inthesecondframeanobject(thedonut)hasbeen ComplexMotionCompensationFigure2.6showsamorecomplexmotioncompensationexample.Inthisgure,(a)and(b)showconsecutiveframes.Figure2.6,(e)and revealedbythemotionoftheoriginalobject. thatneedstobeencoded. tical.inthissituation,motioncompensationcanstillsaveontheamountofinformation black. Itcanbeseenthatwhilethereismotion,andtheimagesaresimilar,theyarenotiden- informationwillstillbelessthanifthetwoimages(a)and(b)wereseparatelyencoded. example)andthedierencesbetweentheimagesareencodedaswell.thisamountof secondimage,itencodesamotionvectorforthepreviousimage(similartotheprevious thisexample,themotionofoneobjecthasaddedanobjecttothescene(thetorusshape, ordonut).suchrevealingofanobjectmeansthatinadditiontotheencodingofthemotion AnothercommoncomplexmotioncompensationsituationisshowninFigure2.7.In Forthisexample,theencodedinformationcontainstherstimageandinsteadofthe oftheimage(inthiscasetheashape)theencodedimagewillalsocontaininformation describingtherevealedobject. motionofanobjectrevealsotherobjects,obscuresotherobjectsormakeschangestothe background(forexample,introducingashadoworlter). Somesituationswherethemotioncompensationismadecomplexwilloccurwhenthe [13,22,17].Motionestimationrequiresenormousprocessingtosampleandcomparethe compensationisworthwhileand(b)generatethecodedinformationimages. encodedinformation.thedicultiesofmotioncompensationrelatetotheamountof imageprocessing(comparison,subtraction,etc.)requiredto(a)determineifmotion ispresent,motioncompensationwillgivesomeamountofreductionintheamountof Severaltechniquesforperformingthemotiondetectionandmotionestimationexist Whilesimplifyingtheprocess,thisshowsthatinallimageswhereanamountofmotion havebeendeveloped,thesimplestistosubsamplethetwoimagestocompare.this twoimagesbetweenwhichmotionistobedetected.asaresultofthis,anumber oftechniquestomaximizetheeciencyandminimizethetimerequiredforthistask 18
20 subsamplingtechniqueisuseintheh261encoderexaminedinthesecondpartofthis paper. itself) Filter Thepredictionprocessmaybemodiedthroughtheuseofatwodimensionspatiallter Block,anditactsuponalltheblocksinsideaparticularMB(likethemotionestimation thecaseofmotioncompensationthusthelterisswitchedon/oforaparticularmacro whichoperatesonpixelsinaparticular88block.thelterisusedparticularlyin up.equation2.13showsthetwoseparablecomponentsforverticalandhorizontal,aswell Bothofthesearenon-recursivewithcoecientsof14,12,14exceptatblockedgeswhere valuesonlyatthe2-dlteroutput.valueswhosefractionalpartisonehalfarerounded coecientsof0,1,0.fullarithmeticprecisionisretainedwithroundingto8bitinteger oneofthetapswouldfalloutsidetheblock.inthiscase,the1-dlterischangedtohave Thelterisabletobeseperatedintoone-dimensionalhorizontalandverticalfunctions. asthe33arrayofthe2-dlter. formotioncompensationthereisanassumptionofintegeramountsofmovementbythe =2641 MacroBlock(from1to15pixelwidthmovesineitherup/downorleft/rightdirections.) Asaresult,whenanimagemovesbyless(ormore)thananintegeramount,themotion Thelterbecomesnecessary,especiallyinthecaseofmotioncompensation,because (2.13) ofcausingjumpingbytheimage,withoutsmoothmovement. compensationroutineswillenforceanintegeramountofmovement.thishastheeect adjacentpixels(althoughitispredominantlyplacedinoneparticularset). motion.thedisadvantageofthelteristhatimageswillappearfuzzier. Figure2.8.Inthisgure,themotionwillplacetheimageinapositionwhereitoverlaps images(linesetc)willhavealessclearlydenededgeandappeartobemoresmoothin Theuseofthelterisnotrestrictedtouseincombinationwiththemotioncompensationsystem.Theltercanbeusedatanytime.Thisbecomesusefulwhenimage pictureinformation,itremovessomeoftheinformation(low-bandpass)andthisresults insmoother,softerimages. Acasewheretheimageasplacedandtherealimagedonotactuallyagreeisshownin Alterwillosetthisproblembycausinganimagetobelow-bandltered,asaresult detailsarenerthanthedisplayresolutionand,asaresult,motionwillappeartojumpor appearjagged.usingthelter,theimageoutlineswilltendtobeblurred,theimageswill appearsofter,asaresultmotionwillnotappearasjumpy.thelterdoesnotincreasethe 19
21 (a) (b) 1.75 to right (- 1.75) horizontalandverticalcomponents. Figure2.8:Non-integermotion:(a)showstheoriginal(orreference)frame,(b)shows integerinterpolationofthatmovementand(d)showsthemotionasbrokendownintoits thenextframe,(c)showsthenon-exactmatchbetweentherealimagemovementandthe 0.75 down (-0.75) 20
22 Picture Header GOB data Figure2.9:Hierarchicalnatureofthedatastructuresofthecoder GOB data Picture Layer GOB header MB data MB data Group of Block Layer MB header Block data Block data Macro Layer MacroBlocks(MB)andBlocks.Therelationshipbetweeneachdatastructureisshowin Figure2.9. ThevideocodingalgorithmdescribesamethodwherebytheCIFandQCIFimagesare 2.5EncodedImageDataStructures Variable Length Code TCOFF TCOFF EOB Layer imageheaderincludesa20-bitimagestartcodeinadditiontootherinformationsuch dividedintoahierarchicalblockstructureconsistingofpictures,groupsofblocks(gobs) astheformatofthepicture(ciforqcif),framenumber(temporalreference)etc. DataforeachimageconsistsofapictureheaderfollowedbydatafortheGOBs.The Fixed Length Code Figure2.10showsthearrangementofGOBsinanimage. lteron/o).thisinformationisinturnfollowedbythedataforblocks.figure2.12 forthembaddress,thevlcforthembtype(intra/inter,motionestimationon/o,loop positionofthisgob(intheimage),quantizerinformationforthegob(unlessoverwrittenbyanmbsownquantizerset),etc.thisisfollowedbydataforthembsthemselves. Figure2.11showsthearrangementofMacroBlocksinaGOB. TheMBlayerconsistsofanMBheader,containingthevariablelengthcode(VLC) TheGOBlayerconsistsofaGOBheader,containinga16-bitGOBstartcode,the QCIFformats. showsthearrangementofblocksinamacroblock;notethedierencebetweencifand becomesdependentonthespecicsofthembitself. noblockdatafordctcoecientsneedstobetransmitted.itshouldbenotedthatnot everymbinagobneedstobetransmittedifitcontainsnoinformationforthatpart ofthepicture. VarioussortsofvideosideinformationmayalsobeincludedinanMBheader,this lengthcode,eob,toindicatetheendofablock.thecoecientsarecodedusingtwo Whenmotionestimateinformationforaparticularblockisoftherequiredaccuracy, ifitcontainsnoadditionalinformation.21 dimensionalvlc. TheBlocklayercontainsDCTcoecients(TCOEFF)ofablockfollowedbyaxed Likeallotherlevelsinthehierarchy,noteveryblockinanMBneedstobetransmitted
23 Figure2.10:ArrangementofGOBsinanimage QCIF CIF Figure2.11:ArrangementofMacroBlocksinaGOB Figure2.12:ArrangementofblocksinaMacroBlock Y C C B R
24 0,0 0,7 Figure2.13:Zig-zagsamplingofa2dimensional88datablockintoa64elementlinear 2.6Entropyencoding array. Theentropycoderconsistsoftwomaincomponents: zig-zagreorganizationofsamples thehumanencoding Thezig-zagreorganizationofthesamplesinablock(showninFigure2.13)describes 7,0 7,7 themannerinwhichan88blockofsamplesisconvertedintoa64itemlineararray. ThisarrayrepresentstheresultsfromatwodimensionalDCT,where(0,0)istheDC componentand(7,7)wouldbethehighestfrequency[14]. encodingusingamodiedhumancodingscheme.thisresultsinavariablebitrate encodeforanyparticularblock.modiedhumanencodingisapracticalimplementation ofthehumanalgorithm.(fromjain(1989)[12]):::: Nowthattheblockisinalineararrayformat,theentropyencodercanperform coderepresentingthequotientq,followedbyaterminatorcode,whichisthesameasthe Humancodefortheremainderj;0jL1?1.::: TherstL1symbolsareHumancoded.Theremainingsymbolsarecodedbyaprex i=ql1+j;0qint[(l?1) L1];0jL1?1 (2.14) 23
25 Symbol Binary Code p Huffman code (HC) s 1 s 2 s 3 s s s s beseenthewayinwhichaprobabilitytreeisbuiltupfromastatisticalanalysisofthe s Average Themorepopulartheitemofdata,thelessthenumberofbitsusedtorepresentthat dataandbitsareallocatedtothedataonthebasisofthisprobability. Figure2.14:Humancodingexample. code (entropy) 2.79 data. ThismaybebetterexplainedbyFigure2.14(alsofromJain(1989))inwhichitcan length Code Humancompressiontablestobeusedateachcompressionstage(Block,MacroBlock, TheH.261standardtakestheuseofHumanonestepfurtherbypredeningthe ThekeytoHumancodingistheuseavariablenumberofbitstorepresentthedata. efficiency 92.7% 99.7% GroupofBlocks,andImage.)Suchprecalculationhastheeectofspeedingthroughput H/B inthisstageofthecompressionsequence. 24
26 AnH.261implementation Chapter3 3.1Overview TheimplementationdiscussedisauthoredbyThierryTurlettiofINRIAinFrance.Itis imagesoverthepacketbasednetworksmakinguptheinternet.naturallythishashad referredtoash261encode/h261decode[26]andhasbeenusedasinaninternetprotocol severalmajorimpactsontheimplementation;however,thefunctionalityofthecodec implementationstillstands. [6,11]basedvideoconferencingsystem[27]. thespecicationwasintendedfor[3],insteadthecodechasbeenwrittenfortransferof Theh261softwarecodecisdividedintotwoprogramcomponents: TheH.261codechasnotbeenwrittenforuseoverap64kbit/sdatachannelas useofthex-windowssystemforthepurposesofdisplayoftheimages[23,19]. h261encode-beinganimageencodersatisfyingtheh.261recommendations h261decode-beinganimagedecodercompatiblewithh261encodeandalsosatisfyingtheh.261recommendations imagelesasinput.thecodecthencompressestheimageinaccordancewiththeh.261 forsunmicrosystem'scomputers.although,theencoderalsoworksbytakingundecoded ThesoftwareisdesignedtooperatingundertheUNIXoperatingsystem[24,21]making TheencoderhasbeendesignedtofunctionwiththeVideoPixvideoframegrabber standardandeithertransmitstheimagetoadecoderviatcp/iporstorestheh261 encodedoutputinale. 3.2VideoPiximaginghardware advantageofreducingthecomplexityofthesoftwarecodec,whilestillachievingthe onlydealingwiththeluminancecomponentsofthesignals.)thishastheconsiderable desiredfunctionality. Thesoftwareencoder,atthisstage,onlysupportsBlackandWhiteimages(thereby WhilethecodechasbeendesignedspecicallywiththeVideoPixframegrabberinmind, basedcomputers,withoutmanymajorchanges.onedirectresultofbeingdesignedtouse thesoftwareshouldbeabletobeadaptedtomostotherframegrabbersrunningonunix 25
27 itappearedthatthemajorbottle-neckimpedingtheecienttransferofimagesisthe thevideopixhardwareisabletoreturnacifsizeimageinabout250ms.intesting, thevideopixhardwareisthatthesoftwareexpectsthevideoframegrabbertobeslow, transferoftheimageacrossthebus(ofthehostcomputer)tothemainmemory,where h261encodecanmanipulatetheimage[28]. stagethisonlyeectsthesizeoftheimagegrabbed. 3.3Inter/Intracodingdecisions Therstimageisprocessedinintramode.Asthereisnoimageprecedingthisone, anintermodecodingisnotpossible;asaresult,sourcecodingwillonlyreducespatial ThesoftwareissetuptotakeeitherPALorNTSCformatimagesasinput,atthis intraframe,theeliminationofredundanciesinthetemporaldomainisalsopossible redundanciesintheimage. 3.4MovementDetection throughtheuseofmotioncompensationroutines. (e.g.,unchangedpartsofthepicture).additionaltemporalredundanciescanberemoved Withtheintermodeofcoding,possibleafterthecoding(andtransmission)ofan marked.onlymarkedblocksareencodedintheintermode(therestarenotconsideredto Themovementdetectionalgorithmaimsatidentifyingtheblocksinanimagewhichare aremadeinordertodetectvariations.ifthesumofthefourabsolutedierencesexceeds sucientlydierentfromcorrespondingblocksinthepreviousimage.theseblocksare havechangedenoughtowarranttransmission.)ineachblock,foursuccessivecomparisons 44blockforeach88block(i.e.4pixelsperblock.) pixelsthataresucientlyscatteredtocoverthewholeblock.onepixelischosenper fromimagetoimage.thesecomparisonsaredoneforasignicantnumberofpixels,i.e. vectorisencodedforthemacroblock. athreshold,adecisionismadetoencodethemacroblock. Ifthesumofthefourabsolutedierencesdoesnotexceedthethreshold,amotion Itisinterestingtonote,asaresult,thatthechoiceofthresholdbecomesacompromisebetweenthetimetakentodotheencodingandthesensitivitytomovementthatis evengroupofblockslevel,theseimagecomponentsaresimplynottransmitted. 3.5TheDCTandQuantization Thecodingalgorithmtakesasinputasetofblocks(i.e.88)pixels,andgeneratesthe transformcoecientsfortheseblocks.inintermodecoding,theinputblocksareonly If,ininterframecodingmode,theencoderndsredundancyattheMacroBlockor approximately2-3timesaslongtocomputeassimplycodingtheinter-framedierence. Evenwiththissub-samplingoftheimage,detectionofmotioncompensationtakes Inordertotestallregionsoftheblock,thepixelstestedarenotfromthesamepoint required. thoseblocksmarkedbythemovementdetectionalgorithm. 26
28 mendationdoesnotspecifyatwhatpointtochooseinterorintrastyleencoding(thisis leftuptotheimplementer.)inthisimplementation,afullintramodecodingisusedfor therstimage,forchangeofsceneandeachmbthatisencodedusesintramodeafter30 interencodingmodeframes.ascenechangeissaidtohaveoccurredwhenthenumber ofblocksmarkedbythemovementdetectionalgorithmexceedssomethreshold. Inintramodecoding,theinputblocksarealltheblocksofanMB.TheH.261recom- ThenthealgorithmcalculatestheInverseDCT(IDCT)andreversesthequantization madeupofan88groupofsamples. processtorecoverwhatwillbecomethepreviousimageforthenextinterpass. follows: AspertheH.261recommendation,attheinputofthecoder,sourceimageblocksare Thecodingalgorithmcomputesforeachblockof88pixels,itsDCTandquantization. PerformH.261encodingofalldetectedblocks: Inthisway,theencodinganddecodingprocessesforthecodeccanbesummarisedas Forencoding: Performmovementdetectionforeachblockoftheimage {Interframe/IntraframedecisionIFInterframeTHEN: performaninversequantizationandinversedctthensumtheresultwith performadctofthisdierenceandthenquantizethedctresults computethedierencebetweenthepreviousblockandthenewblock {performh.261encodingoftheimage,groupofblocksandmacroblocksusing ELSEIFIntraframeTHEN: performaninversequantizationandinversedctthenstoretheresultas performadctoftheoriginalimageandthenquantizethedctresults thepreviousblockandstorethisasthenewpreviousblock Fordecoding: Ifintraframecoding: {Inversequantization,InverseDCTofallblocksintheMBthenstorethisas Humantables. Ifinterframecoding: OnaMacroBlockbyMacroBlockbasis: {IftheMacroBlockisencodedwithamotionvector,computeandapplythe thepreviousimage. Nowdisplaytheimage. {IftheMacroBlockisnotencodedwithamotionvector: motionvectortothemacroblockofthepreviousimage. performaninversequantizationandaninversedctoftheencodedblocks Sumtheresultswiththepreviouslystoredblock. inthemb; 27
29 PointsofInterest Thecalculationsareonlyeectivefortheblockswhichhaveneverbeensucientlymod- ofthetransmissionofcodeddatavariesasafunctionofthemovementintheparticular tionaltothequantityofnewinformationwhichistobecarried.additionally,thetime ied.inconsequence,thechangesnecessaryforcodingofanimagearedirectlypropor- sequenceofimages. conference/videotelephoney,forwhichtheoriginalstandardwasconceived).asaresult, thesoftwaremustattempttomeetthisrequirementofindependenceofthedurationof codingfromtheparticularimagetypecarried. Thissituationisparticularlyirritatingforthereal-timescenario(suchasavideo- Tomeetthisrequirementanumberofsolutionsareimplementable: reductionofthenumberofblockstocalculateperimage.forthistowork,itis Thisparameter(thenumberofblocksperimage)hasthemostdirecteectonthe durationofencodingrequired.ifsuchatechniqueisused,oneneedstomakeapass oftheentireimage,(preprocessingtheimage)inordertodetecttheblocksthathave necessarytolimitthedetectionofmovementinaccordancewiththetypeofimage. changingthequantizationstepswhenasignicantchangetotheimageoccurs.however,suchasolutionmaynothavethedesiredeectsincethisstage(quantization) Anothersolutionconsistsofonlytransmittinganumberofthecoecientsofthe changedmost.thissolutionwouldnotworkifmanyoftheblocksinanimagehad beenchangedsimultaneously,asforexampleinascenechange. isnecessarythatsuchchangesarerepresentativeofchangestothewholeblock,then coecientscanbechosenwhichencodethelowfrequenciesoftheimage.forthis, DCTinthesituationwhereonlysomeofthesampleshavechanged.Asaresult,it itisalsonecessarytoperformapreliminarypassovertheimage,butitisuselessto isperformedafterthecalculationoftheinter-imagedierenceandofthedct. Figure3.1showshowsmallerregionsofthe16x16DCTcoecientsblockisactually brightnesslevels.forthe22example,fourdctcoecientsaretransmitted,for trytouseblockdetectionsincethevaluesaretheresultsofpreviouscalculations. becausethisisthedccomponent,theresultisablockconsistingofonlytwo transmitted.forthe11caseonlytherstofthecoecientsistransmitted, the33,9aretransmitted.thefull88(64)dctcoecientsarealsotransmitted asareference. Usingthistechnique,astudytriedseveralsizetransforms:88,44,33,22 and11.theconsideredopinionofthestudywasthat11,22,and33did nottransferenoughinformationtobeofuse.table3.1showsresultsobtainedfor betweenthelengthofcodingandtherateofcompressionissought. stateofthecommunicationsnetwork.inthecaseofcongestion,thedecodercanorderthe mustbeaparameterofcodingmodiableonadecoderbydecoderbasis,basedonthe codertoreducetherateofowbetweenthecoderandit;inthiswaythebestcompromise Thelengthofthecoding,inadditiontothemaximumnumberofbitsforanimage thetestsequencemissamerica(consistingof71frames)[28]. 28
30 0,0 0,7 0,0 0,7 7,0 1x1 7,7 7,0 2x2 7,7 0,0 0,7 0,0 0,7 (1coecient),22(4coecients),33(9coecients)and44(16coecients) Figure3.1:Thisdiagramshowshowonlysomeofthe64DCTcoecientsareused.11 examplesareshown. 29 7,0 7,7 7,0 7,7 3x3 4x4
31 Table3.1:EectsoncodingduetonumberofDCTcoecientsused NumberofCoecients1x12x23x34x48x8 Meanrateoftransfer Meantimetoencode Meansizeofimage ReportedS/N (inimage/s) (inoctets) (inms) 3.6TransmissionofpacketvideoviaTCP/IP Theh261encode/decodecodecisdesignedtoexchangedataoveraTCP/IPbasednetwork;asaresult,severalextraconsiderationsmustbemadeforthepeculiaritiesofthe networkbeingused. (indb) links.thisisinstarkcontrasttothetcp/ipnetworkwheretheactualdatarateis imposedonacommunicationslinkbyotherusers. carrierortcp/ipcouldbeaslowas9600bit/s,10mbit/sinperfectethernetupto100 TCP/IPrunsasfastasitcan,thisspeedisdynamicdependingupontheparticularload Mbit/sinFDDIandevenhigherratesintheWideAreaNetworksystems.Inthisway dependentonthecommunicationsmediacarryingthevideodata.thecommunications TheH.261recommendationisforthetransmissionofH.261overp64kbit/sdata (nisdnchannels)andtcp/ip(basedonethernet):isdnassumesasetrateavailable (64kbit/sperchannel),whereastherateinTCP/IPmightbeaslowasseveralkbit/s consumptionaccordinglysoasnottobecomeanetworkbandwidthpig,consumingall thenetworktothedetrimentofotherusers. orashighasseveralmbit/s;thisistotallydependentontheloadandcapacityofa particularchannel.asaresult,theh261decode/encodesoftwaremustadjustitsnetwork ThisistherstmajordierencebetweentheH.261assumedcommunicationsnetwork basedcommunicationsisthatisdncommunicationsprotocolsassumeasteadystream ensuredofcomingouttheotherend,unduplicated,unreplicatedandinorder. styleconnection,thatis,alldataputinoneendofthecommunicationsconnectionis ispacketizedandsentthroughthenetwork.dataisnotsentinacontinualstream,at themostbasiclevel,reliabilityisnotguaranteed,additionallythereremainsthechance ThesecondmajordierencebetweentheISDNstyleofcommunicationsandTCP/IP oflosingpacketsalltogetheraswellasreceivingthemoutoforderorevenreplicated. (TCP))givesareliablepseudo-streamofdata,althoughdatadelayisacertaintyona busynetworkwiththeworkrequiredtomakeaparticularstreamofdatareliable. Incomparison,thebasicInternetProtocolisbaseduponapacketnetworkwheredata TheprotocolsintheInternetnetwork(inthiscasetheTransmissionControlProtocol 30
32 imagesarecoded.atransmittedimagehasnotgotasetlength,infactitssizeis Humanencoding.Inaddition,inintermode,onlythedierencesbetweentwosuccessive octetalignmentofthedatatransmittedovertheinternet.asaresult,thedecoderonly recognizesinformationattheendofanimagewhenitreceivesthethenextframespicture Inordertoincreasetherateofthecompresseddatastream,H.261utilizesmodied notknownuntilthetransmissioniscomplete.thisisasadirectresultofthenon Locatingtheboundarybetweenimages StartCode(PCS). willtransmitthedatastream. EvenpaddingoutdatatothesizeofabytewillnotguaranteethemomentatwhichTCP isdecoded,itisnecessarytocontainthepcsofthefollowingimageinthesamebyte. bitsof)remainsofthepreviousimageapushthroughthechanneltothedecoder. InTCP,thenotionofbitsdoesnotexistsinceprogramsworkwithastreamofoctets. AsaresultiftheincomingimageistobedisplayedassoonasthelastMacroBlock ThePCSislargeenoughtollgreaterthanoneoctetthusgivingthe(uptoseven userquitstheprogramoranotherimageisreceived). receivingasetsequenceofimagesthelastimagewillnotbedisplayed(either,untilthe 3.6.2ControllingtheRateofFlow Thereisaneedtocontroltherateofdataowoutofthecodectoenabletimetoreact Theresulttotheenduserisatleastoneframelag,aswellasthepossibilitythatafter principalfactors: incaseofcongestiononthenetworks.therateofowisafunctionofthefollowing Thenumberofallocatedbitsperimage,determinedby: Thefrequencyoftheimagesampling(adjustablebyunder-sampling) 3.6.3ChoiceofQuantizer {thesettingofthethresholdofblockchangewhichcontrolsthedecisionof {thestepsizeofthequantizer(thestepsizeofthequantizerisininverseproportionaltothequalityoftheimage); Thechoiceofthequantizerstepuseddependsuponthecoecientswhichhavetobe coded.itisobviousthatlargecoecientvaluesmaynotbeabletobecodedwitha quantizerthatusestoosmallastep;alargecoecientcorrespondingtoaquickchange whethertocodeornot. foranabnormallylongamountoftime(takesalongamountoftimetooperate),thestep thet.turlettipaperdescribingthecodec[28]. dierentquantizationvaluesusingtheturlettih.261codec.thisgureistakenfrom ofscene.itisforthisreasonahazeisobservedatthetimeofascenechange. However,asaresultofincreasingthestepsizetheimagequalitywillbedegraded.Using sizeofthequantizercouldbeincreased,therebyreducingtheamountofdatatotransmit. Fortherstimagethenetworkisseentobecongested,ifthesend()operationblocks Figure3.2showsthedatarateforthecodingoftheMissAmericasequenceforseveral 31
33 Figure3.2:TheeectofQuantizerstepondatarate.Source:T.Turletti(1992)[28] 32
34 3.7Summary arougherdct(fewercoecientsperblock)thiswillalsoincreasethroughputofthe Fromthisimplementationseveralitemsofinterestdevelop: balancebetweenimagequalityandimagerate. images;however,withacorrespondingloweringofreconstructedimagequality. Asaresult,inaneorttoachievethebestqualityimages,thetaskistondthebest Motioncompensationtakes2-3longerthanjustusinginter,thusifmotioncompensationistobeused,thethresholdchoice(onwhetherablockhaschangedsuciently Inordertoachievethebestqualitypictures,thereisabalancebetweenimage Thetimeoftransmissionvariesasafunctionofthemovementinaparticularimage sequence. torequireretransmission)isacompromisebetweenencodetimeandsensitivityto movement. theavailablebandwidth.)fortheprivilegingofrate,twochangescanbemade: quality.inthesecondselection,thesoftwareattemptstoselectthebestquantizer(for ofthecodec,theuserisonlyabletoselectbetweentheprivilegingofimagerateorimage ifthenetworkiscongested,thequantizationstepisincreasedtherebydecreasing Intheoperationoftheencoder,theuserdoesnothavecontrolofmanyofthefunctions qualityandimagerate. iftherearealotofblockstoencode,theuseofarougherdct,whilelowering theamountofdatatransferred; infrastructuresofatm(asynchronoustransfermode)communicationswhichhaveat Videooverpacketswitchnetworks(andformodicationstotheencodingsystemtobe requiredforadequateresults),willbecomemoreimportantwiththedeploymentoflarger ThiscoderisaninterestingapplicationoftheH.261systemandthebasisofsending imagequality,willalsolowerthenumberofcoecientsgeneratedperblock,and theirheartpacketswitchtechnology. thustheamountofdatatransferred. 33
35 Conclusion Chapter4 currentdevelopments;andassuch,h.261givesagoodinsightintootherdevelopments. andcompression.partsofthisrecommendationbeenincorporatedintomanyofthe TheH.261recommendationformsanexcellentintroductiontotheworldofvideocoding works.asaresult,theimplementationcoverswaysinwhichh.261canbemodiedto suitethissituation. TheimplementationisfascinatingbecauseithastoworkinwithInternetbasednet- 34
36 Acknowledgements Chapter5 IwouldliketoextendmythankstoDrWuforgivinghisstudentsenthusiasminthe subjectmaterialandforpresentingmanyinformativeanddynamicsessionsonvideo available,andhismakingavailableanumberofreferencepapersusedinthepreparation CodingandCompression.IwouldalsoliketoextendmythankstoThierryTurletti ofthispaper. forhisassistanceinmyattemptstounderstandthesoftwarehehasgraciouslymade 35
37 Bibliography [1]AngP.H.,RuetzP.A.,andAuldD.,\Videocompressionmakesbiggains",IEEE [2]CCIR,\Recommendation601-IDigitalMethodsofTransmittingTelevisionInformation",1986. Spectrum,vol.?,pp.16{19,October1991. [4]ChanS.C.andHoK.L.,\Anewtwo-dimensionalfastcosinetransformalgorithm", [3]CCITT,RecommendationH.261,Videocodecforaudiovisualservicesatp64 [5]ClarkeR.J.,TransformCodingofImages,AcademicPress,24{28OvalRd.,London kbit/s,ccitt,1990. [6]ComerD.,InternetworkingwithTCP/IPVolume1;Principles,ProtocolsandArchitecture,volume2,Prentice-HallInternational,Inc.,April1991. NW17DX,1985. IEEETransactionsonSignalProcessing,vol.39,pp.481{485,February1991. [8]HaqueM.A.,\Atwo-dimensionalfastcosinetransform",IEEETransactionson [7]GonzalezR.C.andWoodsR.E.,DigitalImageProcessing,Addison-Wesley,1992. [10]IEEE,\SpecialIssueonISDN",IEEECommunicationsMagazine,vol.28,,April [9]HorganJ.,\ClaudeE.Shannon",IEEESpectrum,vol.,pp.72{75,April1992. Acoustic,SpeechandSignalProcessing,vol.ASSP-33,pp.1532{1539,December [11]ISI,\Internetprotocol",RequestForComment:791,vol.?,,September1981, [12]JainA.K.,FundamentalsofDigitalImageProcesing,Prentice-Hall,1989. [13]JainJ.R.andJainA.K.,\DisplacementMeasurementandItsApplicationin WritterninassociationwithDARPA. [14]JayantN.,\SignalCompression:TechnologyTargetsandResearchDirections", [15]leGallD.,\Mpeg:Avideocompressionstandardformultimediaapplications", InterframeImageCoding",IEEETransactionsonCommunications,vol.COM-29, CommunicationsoftheACM,vol.34,pp.47{58,April1991. pp.1799{1808,1981. IEEEJournalonSelectedareasinCommunications,vol.10,pp.796{818,June
38 [16]LiouM.,\Overviewofthep*64kbit/svideocodingstandard",Communicationof [17]NetravaliA.N.andStullerJ.O.,\Motioncompensatedtransformcoding",Bell [18]PetersonW.W.andWeldonJrE.J.,ErrorCorrectingCodes,MITPress,1972, theacm,vol.34,pp.60{63,april1991. [19]QuerciaV.andO'ReillyT.,XWindowSystemUsersGuideforX11R3andR4, AppendicesCandDareusefulforndingg(x)forthebinaryBCHcodes. SystemsTechnicalJournal,vol.88,pp.1703{1718,September1979. [22]RoccaF.andZanolettiS.,\Bandwidthreductionviamovementcompensationon [20]RaoK.R.andYipP.,DiscreteCosineTransform,AcademicPress,Inc,1990. [21]RitchieD.andThompsonK.,\TheUNIXTime-SharingSystem",Communications oftheacm,vol.17,pp.365{375,july1974. O'Reilly&Associates,Inc.,Sebastapol,CA,May1990. [23]ScheierR.andGettysJ.,\TheXWindowSystem",ACMTransactionsonGraphics,vol.5,pp.79{109,April1986. amodeloftherandomvideoprocess",ieeetransactionsoncommunications, [24]SobellM.G.,APracticalGuidetotheUNIXSystemV,BenjaminCummings, vol.com-20,pp.960{965,october1972. [25]StixG.,\Encodingthe\Neatness"ofOnesandZeros",ScienticAmerican,vol., [26]TurlettiT.,\H.261Codec",1992,Availableusinganonymousftpfrom MenloPark,CA,1985. pp.27{28,september1991. [28]TurlettiT.,\Logicieldecodeur-decodeurH.261",September1992,Paperasyet [27]TurlettiT.,\INRIAvideoconferencesystem",1992,Availableusinganonymousftp fromavahi.inria.fr:/pub/videoconference/ivs.tar.z. avahi.inria.fr:/pub/h261/h261.tar.z. [29]WuH.,\RDT4630VideoCodingandCompression",July1992,Syllabusguidelines [30]WuH.,\RDT4630VideoCodingandCompression:PracticalWorkInstruction onlypublishedinfrench,aspartofinriaprojectrodeo. Technology,FacultyofComputingandInformationSystems,MonashUniversity. forvideocodingandcompression(rdt4630),departmentofrobiticsanddigital [31]WuH.,\RDT4630VideoCodingandCompression:SubjectNotes",July1992, Notes",August1992,SubmissionguidelinesforVideoCodingandCompression (RDT4630),DepartmentofRobiticsandDigitalTechnology,FacultyofComputing andinformationsystems,monashuniversity. Coursenotesforthesubject:VideoCodingandCompression(RDT4630),DepartmentofRobiticsandDigitalTechnology,FacultyofComputingandInformation 37
Huffman Movement DCT. Encoding H.261 Detection. video Raw video Interframe coding data. Inverse Inverse Memory
CopyrightIEEE/TransactionsonNetworking,June1996 VideoconferencingintheInternet ThierryTurlettiandChristianHuitema Abstract ThispaperdescribestheINRIAVideoconferencingSystem(ivs),alowbandwidthtool forreal-timevideobetweenworkstationsonthe
More informationModule 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur
Module 8 VIDEO CODING STANDARDS Version ECE IIT, Kharagpur Lesson H. andh.3 Standards Version ECE IIT, Kharagpur Lesson Objectives At the end of this lesson the students should be able to :. State the
More informationVideo Coding Basics. Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu
Video Coding Basics Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu Outline Motivation for video coding Basic ideas in video coding Block diagram of a typical video codec Different
More informationOverview: Video Coding Standards
Overview: Video Coding Standards Video coding standards: applications and common structure Relevant standards organizations ITU-T Rec. H.261 ITU-T Rec. H.263 ISO/IEC MPEG-1 ISO/IEC MPEG-2 ISO/IEC MPEG-4
More informationVIDEOTELEPHONY AND VIDEOCONFERENCE OVER ISDN
VIDEOTELEPHONY AND VIDEOCONFERENCE OVER ISDN Fernando Pereira Instituto Superior Técnico Digital Video Video versus Images Still Image Services No strong temporal requirements; no realtime notion. Video
More informationVideo Coding Standards. Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu
Video Coding Standards Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu Yao Wang, 2003 EE4414: Video Coding Standards 2 Outline Overview of Standards and Their Applications ITU-T
More informationTHE EMERGING JVT/H.26L VIDEO CODING STANDARD
THE EMERGING JVT/H.26L VIDEO CODING STANDARD H. Schwarz and T. Wiegand Heinrich Hertz Institute, Germany ABSTRACT JVT/H.26L is a current project of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC
More informationRECOMMENDATION ITU-R BO.786 *
Rec. ITU-R BO.786 RECOMMENDATION ITU-R BO.786 * MUSE ** system for HDTV broadcasting-satellite services (Question ITU-R /) (992) The ITU Radiocommunication Assembly, considering a) that the MUSE system
More informationImage Compression through DCT and Huffman Coding Technique
International Journal of Current Engineering and Technology E-ISSN 2277 4106, P-ISSN 2347 5161 2015 INPRESSCO, All Rights Reserved Available at http://inpressco.com/category/ijcet Research Article Rahul
More informationRate-Constrained Coder Control and Comparison of Video Coding Standards
688 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003 Rate-Constrained Coder Control and Comparison of Video Coding Standards Thomas Wiegand, Heiko Schwarz, Anthony
More information)454 ( #/$%#3 &/2 6)$%/#/.&%2%.#).' 53).' 02)-!29 $)')4!, '2/50 42!.3-)33)/. ,).% 42!.3-)33)/. /&./.4%,%0(/.% 3)'.!,3. )454 Recommendation (
INTERNATIONAL TELECOMMUNICATION UNION )454 ( TELECOMMUNICATION (03/93) STANDARDIZATION SECTOR OF ITU,).% 42!.3-)33)/. /&./.4%,%0(/.% 3)'.!,3 #/$%#3 &/2 6)$%/#/.&%2%.#).' 53).' 02)-!29 $)')4!, '2/50 42!.3-)33)/.
More informationMathematical Modelling of Computer Networks: Part II. Module 1: Network Coding
Mathematical Modelling of Computer Networks: Part II Module 1: Network Coding Lecture 3: Network coding and TCP 12th November 2013 Laila Daniel and Krishnan Narayanan Dept. of Computer Science, University
More informationSteganographyinaVideoConferencingSystem? AndreasWestfeld1andGrittaWolf2 2InstituteforOperatingSystems,DatabasesandComputerNetworks 1InstituteforTheoreticalComputerScience DresdenUniversityofTechnology
More informationMultidimensional Transcoding for Adaptive Video Streaming
Multidimensional Transcoding for Adaptive Video Streaming Jens Brandt, Lars Wolf Institut für Betriebssystem und Rechnerverbund Technische Universität Braunschweig Germany NOSSDAV 2007, June 4-5 Jens Brandt,
More informationWe are presenting a wavelet based video conferencing system. Openphone. Dirac Wavelet based video codec
Investigating Wavelet Based Video Conferencing System Team Members: o AhtshamAli Ali o Adnan Ahmed (in Newzealand for grad studies) o Adil Nazir (starting MS at LUMS now) o Waseem Khan o Farah Parvaiz
More informationTransform-domain Wyner-Ziv Codec for Video
Transform-domain Wyner-Ziv Codec for Video Anne Aaron, Shantanu Rane, Eric Setton, and Bernd Girod Information Systems Laboratory, Department of Electrical Engineering Stanford University 350 Serra Mall,
More informationVideo Coding Technologies and Standards: Now and Beyond
Hitachi Review Vol. 55 (Mar. 2006) 11 Video Coding Technologies and Standards: Now and Beyond Tomokazu Murakami Hiroaki Ito Muneaki Yamaguchi Yuichiro Nakaya, Ph.D. OVERVIEW: Video coding technology compresses
More informationEvaluating Wavelet Tranforms for Video Conferencing Applications. Second quarter report (Oct Dec, 2008)
ICT R&D Funded Project Evaluating Wavelet Tranforms for Video Conferencing Applications Second quarter report (Oct Dec, 2008) Principal Investigators: Dr. Shahid Masud and Dr. Nadeem Khan Dept of Computer
More informationH 261. Video Compression 1: H 261 Multimedia Systems (Module 4 Lesson 2) H 261 Coding Basics. Sources: Summary:
Video Compression : 6 Multimedia Systems (Module Lesson ) Summary: 6 Coding Compress color motion video into a low-rate bit stream at following resolutions: QCIF (76 x ) CIF ( x 88) Inter and Intra Frame
More informationIntroduction to image coding
Introduction to image coding Image coding aims at reducing amount of data required for image representation, storage or transmission. This is achieved by removing redundant data from an image, i.e. by
More informationPerformance Analysis and Comparison of JM 15.1 and Intel IPP H.264 Encoder and Decoder
Performance Analysis and Comparison of 15.1 and H.264 Encoder and Decoder K.V.Suchethan Swaroop and K.R.Rao, IEEE Fellow Department of Electrical Engineering, University of Texas at Arlington Arlington,
More informationChapter 3 ATM and Multimedia Traffic
In the middle of the 1980, the telecommunications world started the design of a network technology that could act as a great unifier to support all digital services, including low-speed telephony and very
More informationPeter Eisert, Thomas Wiegand and Bernd Girod. University of Erlangen-Nuremberg. Cauerstrasse 7, 91058 Erlangen, Germany
RATE-DISTORTION-EFFICIENT VIDEO COMPRESSION USING A 3-D HEAD MODEL Peter Eisert, Thomas Wiegand and Bernd Girod Telecommunications Laboratory University of Erlangen-Nuremberg Cauerstrasse 7, 91058 Erlangen,
More informationHow To Improve Performance Of The H264 Video Codec On A Video Card With A Motion Estimation Algorithm
Implementation of H.264 Video Codec for Block Matching Algorithms Vivek Sinha 1, Dr. K. S. Geetha 2 1 Student of Master of Technology, Communication Systems, Department of ECE, R.V. College of Engineering,
More informationVideo-Conferencing System
Video-Conferencing System Evan Broder and C. Christoher Post Introductory Digital Systems Laboratory November 2, 2007 Abstract The goal of this project is to create a video/audio conferencing system. Video
More informationFigure 13.1 shows the main interfaces to a video encoder and video decoder: of uncompressed video (send to a display unit); status
Video Codec Design ain E. G. Richardson Copyright q 2002 John Wiley & Sons, Ltd SBNs: 0-471-48553-5 (Hardback); 0-470-84783-2 (Electronic) Video CODEC Design 13.1 NTRODUCTON n this chapter we bring together
More informationStudy and Implementation of Video Compression Standards (H.264/AVC and Dirac)
Project Proposal Study and Implementation of Video Compression Standards (H.264/AVC and Dirac) Sumedha Phatak-1000731131- sumedha.phatak@mavs.uta.edu Objective: A study, implementation and comparison of
More informationSurvey of Dirac: A Wavelet Based Video Codec for Multiparty Video Conferencing and Broadcasting
Survey of Dirac: A Wavelet Based Video Codec for Multiparty Video Conferencing and Broadcasting Ahtsham Ali, Nadeem A. Khan, Shahid Masud, and Syed Farooq Ali * Abstract. The basic aim of this book chapter
More informationDepartment of Electrical and Computer Engineering, Northwestern University, e-mail: faggk,faisal,lkon,hongg@ece.nwu.edu,
ERROR RESILIENCE AND CONCEALMENT IN VIDEO CODING A. K. Katsaggelos, F. Ishtiaq, L. P. Kondi, M.-C. Hong, M. Banham +,J.Brailean + Department of Electrical and Computer Engineering, Northwestern University,
More informationA FAST WAVELET-BASED VIDEO CODEC AND ITS APPLICATION IN AN IP VERSION 6-READY SERVERLESS VIDEOCONFERENCING SYSTEM
A FAST WAVELET-BASED VIDEO CODEC AND ITS APPLICATION IN AN IP VERSION 6-READY SERVERLESS VIDEOCONFERENCING SYSTEM H. L. CYCON, M. PALKOW, T. C. SCHMIDT AND M. WÄHLISCH Fachhochschule für Technik und Wirtschaft
More informationMPEG-1 and MPEG-2 Digital Video Coding Standards
Please note that the page has been produced based on text and image material from a book in [sik] and may be subject to copyright restrictions from McGraw Hill Publishing Company. MPEG-1 and MPEG-2 Digital
More informationOverview of the Scalable Video Coding Extension of the H.264/AVC Standard
To appear in IEEE Transactions on Circuits and Systems for Video Technology, September 2007. 1 Overview of the Scalable Video Coding Extension of the H.264/AVC Standard Heiko Schwarz, Detlev Marpe, Member,
More informationDigital Video Coding Standards and Their Role in Video Communications
Digital Video Coding Standards and Their Role in Video Communications RALF SCHAFER AND THOMAS SIKORA, MEMBER, IEEE Invited Paper The eficient digital representation of image and video signals has been
More informationDCT-JPEG Image Coding Based on GPU
, pp. 293-302 http://dx.doi.org/10.14257/ijhit.2015.8.5.32 DCT-JPEG Image Coding Based on GPU Rongyang Shan 1, Chengyou Wang 1*, Wei Huang 2 and Xiao Zhou 1 1 School of Mechanical, Electrical and Information
More informationBroadband Networks. Prof. Dr. Abhay Karandikar. Electrical Engineering Department. Indian Institute of Technology, Bombay. Lecture - 29.
Broadband Networks Prof. Dr. Abhay Karandikar Electrical Engineering Department Indian Institute of Technology, Bombay Lecture - 29 Voice over IP So, today we will discuss about voice over IP and internet
More informationVoice over IP (VoIP) Part 1
Kommunikationssysteme (KSy) - Block 5 Voice over IP (VoIP) Part 1 Dr. Andreas Steffen 1999-2001 A. Steffen, 9.12.2001, KSy_VoIP_1.ppt 1 VoIP Scenarios Classical telecommunications networks Present: separate
More informationVideo coding with H.264/AVC:
Feature Video coding with H.264/AVC: Tools, Performance, and Complexity Jörn Ostermann, Jan Bormans, Peter List, Detlev Marpe, Matthias Narroschke, Fernando Pereira, Thomas Stockhammer, and Thomas Wedi
More informationVideo codecs in multimedia communication
Video codecs in multimedia communication University of Plymouth Department of Communication and Electronic Engineering Short Course in Multimedia Communications over IP Networks T J Dennis Department of
More informationBandwidth Adaptation for MPEG-4 Video Streaming over the Internet
DICTA2002: Digital Image Computing Techniques and Applications, 21--22 January 2002, Melbourne, Australia Bandwidth Adaptation for MPEG-4 Video Streaming over the Internet K. Ramkishor James. P. Mammen
More informationComparison of Video Compression Standards
Comparison of Video Compression Standards S. Ponlatha and R. S. Sabeenian Abstract In order to ensure compatibility among video codecs from different manufacturers and applications and to simplify the
More informationVideo Authentication for H.264/AVC using Digital Signature Standard and Secure Hash Algorithm
Video Authentication for H.264/AVC using Digital Signature Standard and Secure Hash Algorithm Nandakishore Ramaswamy Qualcomm Inc 5775 Morehouse Dr, Sam Diego, CA 92122. USA nandakishore@qualcomm.com K.
More informationVideo streaming test bed for UMTS network
D I P L O M A R B E I T Video streaming test bed for UMTS network unter der Leitung von Prof. Dr. Markus Rupp DI Michal Ries Institut fur Nachrichtentechnik und Hochfrequenztechnik eingereicht an der Technischen
More informationA Guide to MPEG Fundamentals and Protocol Analysis (Including DVB and ATSC)
(Including DVB and ATSC) M P E G T u t o r i a l A Guide to MPEG Fundamentals and Protocol Analysis (Including DVB and ATSC) ii www.tektronix.com/video_audio/ A Guide to MPEG Fundamentals and Protocol
More informationNote! The problem set consists of two parts: Part I: The problem specifications pages Part II: The answer pages
Part I: The problem specifications NTNU The Norwegian University of Science and Technology Department of Telematics Note! The problem set consists of two parts: Part I: The problem specifications pages
More informationARIB STD-T64-C.S0042 v1.0 Circuit-Switched Video Conferencing Services
ARIB STD-T-C.S00 v.0 Circuit-Switched Video Conferencing Services Refer to "Industrial Property Rights (IPR)" in the preface of ARIB STD-T for Related Industrial Property Rights. Refer to "Notice" in the
More informationEfficient Motion Estimation by Fast Three Step Search Algorithms
Efficient Motion Estimation by Fast Three Step Search Algorithms Namrata Verma 1, Tejeshwari Sahu 2, Pallavi Sahu 3 Assistant professor, Dept. of Electronics & Telecommunication Engineering, BIT Raipur,
More informationPerformance Evaluation of AODV, OLSR Routing Protocol in VOIP Over Ad Hoc
(International Journal of Computer Science & Management Studies) Vol. 17, Issue 01 Performance Evaluation of AODV, OLSR Routing Protocol in VOIP Over Ad Hoc Dr. Khalid Hamid Bilal Khartoum, Sudan dr.khalidbilal@hotmail.com
More informationFor Articulation Purpose Only
E305 Digital Audio and Video (4 Modular Credits) This document addresses the content related abilities, with reference to the module. Abilities of thinking, learning, problem solving, team work, communication,
More informationCompression techniques
Compression techniques David Bařina February 22, 2013 David Bařina Compression techniques February 22, 2013 1 / 37 Contents 1 Terminology 2 Simple techniques 3 Entropy coding 4 Dictionary methods 5 Conclusion
More informationPERFORMANCE ANALYSIS OF VIDEO FORMATS ENCODING IN CLOUD ENVIRONMENT
Suresh Gyan Vihar University Journal of Engineering & Technology (An International Bi Annual Journal) Vol. 1, Issue 1, 2015, pp 1 5 ISSN: 2395 0196 PERFORMANCE ANALYSIS OF VIDEO FORMATS ENCODING IN CLOUD
More informationELEC3028 Digital Transmission Overview & Information Theory. Example 1
Example. A source emits symbols i, i 6, in the BCD format with probabilities P( i ) as given in Table, at a rate R s = 9.6 kbaud (baud=symbol/second). State (i) the information rate and (ii) the data rate
More informationCM0340 SOLNS. Do not turn this page over until instructed to do so by the Senior Invigilator.
CARDIFF UNIVERSITY EXAMINATION PAPER Academic Year: 2008/2009 Examination Period: Examination Paper Number: Examination Paper Title: SOLUTIONS Duration: Autumn CM0340 SOLNS Multimedia 2 hours Do not turn
More informationMobile IP Network Layer Lesson 01 OSI (open systems interconnection) Seven Layer Model and Internet Protocol Layers
Mobile IP Network Layer Lesson 01 OSI (open systems interconnection) Seven Layer Model and Internet Protocol Layers Oxford University Press 2007. All rights reserved. 1 OSI (open systems interconnection)
More informationVideo Transmission over Wireless LAN. Hang Liu Hang.liu@thomson.net
Video Transmission over Wireless LAN Hang Liu Hang.liu@thomson.net Page 1 Introduction! Introduction! Wi-Fi Multimedia and IEEE 802.11e for QoS Enhancement! Error Control Techniques Page 2 Introduction!
More informationHow To Understand The Technical Specifications Of Videoconferencing
Videoconferencing Glossary Algorithm A set of specifications that define methods and procedures for transmitting audio, video, and data. Analog Gateway A means of connecting dissimilar codecs. Incoming
More information(Refer Slide Time: 01:46)
Data Communication Prof. A. Pal Department of Computer Science & Engineering Indian Institute of Technology, Kharagpur Lecture - 38 Multimedia Services Hello viewers, welcome to today's lecture on multimedia
More informationBosch Video Management System Scheduled Recording Settings as of Bosch VMS 3.0. Technical Note
Bosch Video Management System Scheduled Recording Settings as of Bosch VMS 3.0 en Technical Note Bosch Video Management System Table of Contents en 3 Table of Contents 1 Overview 4 2 Basic stream settings
More informationThe H.264/MPEG-4 Advanced Video Coding (AVC) Standard
International Telecommunication Union The H.264/MPEG-4 Advanced Video Coding (AVC) Standard Gary J. Sullivan, Ph.D. ITU-T T VCEG Rapporteur Chair ISO/IEC MPEG Video Rapporteur Co-Chair Chair ITU/ISO/IEC
More informationModule 7 Internet And Internet Protocol Suite
Module 7 Internet And Internet Protocol Suite Lesson 21 Internet and IPv4 LESSON OBJECTIVE General The lesson will discuss a popular network layer protocol, i.e. the Internet Protocol Specific The focus
More informationFigure 1: Relation between codec, data containers and compression algorithms.
Video Compression Djordje Mitrovic University of Edinburgh This document deals with the issues of video compression. The algorithm, which is used by the MPEG standards, will be elucidated upon in order
More informationQuality Estimation for Scalable Video Codec. Presented by Ann Ukhanova (DTU Fotonik, Denmark) Kashaf Mazhar (KTH, Sweden)
Quality Estimation for Scalable Video Codec Presented by Ann Ukhanova (DTU Fotonik, Denmark) Kashaf Mazhar (KTH, Sweden) Purpose of scalable video coding Multiple video streams are needed for heterogeneous
More informationHow To Encode Data From A Signal To A Signal (Wired) To A Bitcode (Wired Or Coaxial)
Physical Layer Part 2 Data Encoding Techniques Networks: Data Encoding 1 Analog and Digital Transmissions Figure 2-23.The use of both analog and digital transmissions for a computer to computer call. Conversion
More informationSimple Voice over IP (VoIP) Implementation
Simple Voice over IP (VoIP) Implementation ECE Department, University of Florida Abstract Voice over IP (VoIP) technology has many advantages over the traditional Public Switched Telephone Networks. In
More informationA Scalable Video Compression Algorithm for Real-time Internet Applications
M. Johanson, A Scalable Video Compression Algorithm for Real-time Internet Applications A Scalable Video Compression Algorithm for Real-time Internet Applications Mathias Johanson Abstract-- Ubiquitous
More informationFast Arithmetic Coding (FastAC) Implementations
Fast Arithmetic Coding (FastAC) Implementations Amir Said 1 Introduction This document describes our fast implementations of arithmetic coding, which achieve optimal compression and higher throughput by
More informationExam 1 Review Questions
CSE 473 Introduction to Computer Networks Exam 1 Review Questions Jon Turner 10/2013 1. A user in St. Louis, connected to the internet via a 20 Mb/s (b=bits) connection retrieves a 250 KB (B=bytes) web
More information4 Digital Video Signal According to ITU-BT.R.601 (CCIR 601) 43
Table of Contents 1 Introduction 1 2 Analog Television 7 3 The MPEG Data Stream 11 3.1 The Packetized Elementary Stream (PES) 13 3.2 The MPEG-2 Transport Stream Packet.. 17 3.3 Information for the Receiver
More informationTECHNICAL OVERVIEW OF VP8, AN OPEN SOURCE VIDEO CODEC FOR THE WEB
TECHNICAL OVERVIEW OF VP8, AN OPEN SOURCE VIDEO CODEC FOR THE WEB Jim Bankoski, Paul Wilkins, Yaowu Xu Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA, USA {jimbankoski, paulwilkins, yaowu}@google.com
More informationMike Perkins, Ph.D. perk@cardinalpeak.com
Mike Perkins, Ph.D. perk@cardinalpeak.com Summary More than 28 years of experience in research, algorithm development, system design, engineering management, executive management, and Board of Directors
More informationVideo Conferencing Unit. by Murat Tasan
Video Conferencing Unit by Murat Tasan Video Conferencing Standards H.320 (ISDN) Popular in small business sector H.323 (Internet) More common with advancing cable modem and broadband access to homes H.324
More informationA High-Yield Area-Power Efficient DWT Hardware for Implantable Neural Interface Applications
Proceedings of the 3rd International IEEE EMBS Conference on Neural Engineering Kohala Coast, Hawaii, USA, May 2-5, 2007 A High-Yield Area-Power Efficient DWT Hardware for Implantable Neural Interface
More informationH.263 Based Video Codec for Real-Time Visual Communications Over Wireless Radio Networks
Based Video Codec for Real-Time Visual Communications Over Wireless Radio Networks Abstract Paramvir Bahl Microsoft Corporation Redmond, Washington, USA bahl@microsoft.com With the emergence of the International
More informationREIHE INFORMATIK 7/98 Efficient Video Transport over Lossy Networks Christoph Kuhmünch and Gerald Kühne Universität Mannheim Praktische Informatik IV
REIHE INFORMATIK 7/98 Efficient Video Transport over Lossy Networks Christoph Kuhmünch and Gerald Kühne Universität Mannheim Praktische Informatik IV L15, 16 D-68131 Mannheim Efficient Video Transport
More information1932-4553/$25.00 2007 IEEE
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, VOL. 1, NO. 2, AUGUST 2007 231 A Flexible Multiple Description Coding Framework for Adaptive Peer-to-Peer Video Streaming Emrah Akyol, A. Murat Tekalp,
More informationVideo Conferencing Standards
Video Conferencing Standards TANDBERG Application Notes D10740, Rev 2.3 This document is not to be reproduced in whole or in part without the permission in writing from TANDBERG ITU DEFINED STANDARDS...3
More informationMPEG Digital Video Coding Standards
MPEG Digital Video Coding Standards Thomas Sikora, HHI Berlin Preprint from Digital Consumer Electronics Handbook First Edition (Editor R.Jurgens) to be published by McGRAW-Hill Book Company Chapter 9
More informationINTERNATIONAL TELECOMMUNICATION UNION. SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Characteristics of visual telephone systems
INTERNATIONAL TELECOMMUNICATION UNION CCITT H.120 THE INTERNATIONAL TELEGRAPH AND TELEPHONE CONSULTATIVE COMMITTEE (11/1988) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Characteristics of visual telephone
More informationCoding and Patterns of Data Streams
Characterizing Video Coding Computing in Conference Systems By G. Tuquerres (tuquerre@cs.utwente.nl) Telematics Systems and Services Twente University Abstract In this paper, a number of coding operations
More informationIntroduction to Packet Voice Technologies and VoIP
Introduction to Packet Voice Technologies and VoIP Cisco Networking Academy Program Halmstad University Olga Torstensson 035-167575 olga.torstensson@ide.hh.se IP Telephony 1 Traditional Telephony 2 Basic
More informationMichael W. Marcellin and Ala Bilgin
JPEG2000: HIGHLY SCALABLE IMAGE COMPRESSION Michael W. Marcellin and Ala Bilgin Department of Electrical and Computer Engineering, The University of Arizona, Tucson, AZ 85721. {mwm,bilgin}@ece.arizona.edu
More informationBosch Video Management System Scheduled Recording Settings as of Bosch VMS 3.0. Technical Note
Bosch Video Management System Scheduled Recording Settings as of Bosch VMS 3.0 en Technical Note Bosch Video Management System Table of Contents en 3 Table of Contents 1 Overview 3 2 Basic stream settings
More informationDVB-S2 and DVB-RCS for VSAT and Direct Satellite TV Broadcasting
Hands-On DVB-S2 and DVB-RCS for VSAT and Direct Satellite TV Broadcasting Course Description This course will examine DVB-S2 and DVB-RCS for Digital Video Broadcast and the rather specialised application
More informationJPEG Image Compression by Using DCT
International Journal of Computer Sciences and Engineering Open Access Research Paper Volume-4, Issue-4 E-ISSN: 2347-2693 JPEG Image Compression by Using DCT Sarika P. Bagal 1* and Vishal B. Raskar 2 1*
More informationParametric Comparison of H.264 with Existing Video Standards
Parametric Comparison of H.264 with Existing Video Standards Sumit Bhardwaj Department of Electronics and Communication Engineering Amity School of Engineering, Noida, Uttar Pradesh,INDIA Jyoti Bhardwaj
More informationImplementing an In-Service, Non- Intrusive Measurement Device in Telecommunication Networks Using the TMS320C31
Disclaimer: This document was part of the First European DSP Education and Research Conference. It may have been written by someone whose native language is not English. TI assumes no liability for the
More informationBIT RATE CONTROL FOR REAL-TIME MULTIPOINT VIDEO CONFERENCING. Xiaoping Hu. BS, Shanghai Jiaotong University, 2001
BIT RATE CONTROL FOR REAL-TIME MULTIPOINT VIDEO CONFERENCING by Xiaoping Hu BS, Shanghai Jiaotong University, 2001 Submitted to the Graduate Faculty of School of Engineering in partial fulfillment of the
More informationAlarms of Stream MultiScreen monitoring system
STREAM LABS Alarms of Stream MultiScreen monitoring system Version 1.0, June 2013. Version history Version Author Comments 1.0 Krupkin V. Initial version of document. Alarms for MPEG2 TS, RTMP, HLS, MMS,
More informationConceptual Framework Strategies for Image Compression: A Review
International Journal of Computer Sciences and Engineering Open Access Review Paper Volume-4, Special Issue-1 E-ISSN: 2347-2693 Conceptual Framework Strategies for Image Compression: A Review Sumanta Lal
More informationVoIP QoS. Version 1.0. September 4, 2006. AdvancedVoIP.com. sales@advancedvoip.com support@advancedvoip.com. Phone: +1 213 341 1431
VoIP QoS Version 1.0 September 4, 2006 AdvancedVoIP.com sales@advancedvoip.com support@advancedvoip.com Phone: +1 213 341 1431 Copyright AdvancedVoIP.com, 1999-2006. All Rights Reserved. No part of this
More informationA NEW LOSSLESS METHOD OF IMAGE COMPRESSION AND DECOMPRESSION USING HUFFMAN CODING TECHNIQUES
A NEW LOSSLESS METHOD OF IMAGE COMPRESSION AND DECOMPRESSION USING HUFFMAN CODING TECHNIQUES 1 JAGADISH H. PUJAR, 2 LOHIT M. KADLASKAR 1 Faculty, Department of EEE, B V B College of Engg. & Tech., Hubli,
More informationNetwork administrators must be aware that delay exists, and then design their network to bring end-to-end delay within acceptable limits.
Delay Need for a Delay Budget The end-to-end delay in a VoIP network is known as the delay budget. Network administrators must design a network to operate within an acceptable delay budget. This topic
More informationOgg Vorbis Audio Decoder Jon Stritar and Matt Papi 6.111 December 14, 2005
Ogg Vorbis Audio Decoder Jon Stritar and Matt Papi 6.111 December 14, 2005 Abstract The goal of this project was to design and implement an Ogg Vorbis decoder in hardware. Ogg Vorbis is a highly dynamic
More informationSolutions to the Sample Questions on Introduction
Solutions to the Sample Questions on Introduction NOTE: Pay close attention to units. A byte of storage is 8-bits, and 1 kilobits of storage is1024 bits. By convention, the rules are different between
More informationProbability Interval Partitioning Entropy Codes
SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY 1 Probability Interval Partitioning Entropy Codes Detlev Marpe, Senior Member, IEEE, Heiko Schwarz, and Thomas Wiegand, Senior Member, IEEE Abstract
More informationThor High Efficiency, Moderate Complexity Video Codec using only RF IPR
Thor High Efficiency, Moderate Complexity Video Codec using only RF IPR draft-fuldseth-netvc-thor-00 Arild Fuldseth, Gisle Bjontegaard (Cisco) IETF 93 Prague, CZ July 2015 1 Design principles Moderate
More informationA Guide to MPEG Fundamentals and Protocol Analysis (Including DVB and ATSC)
A Guide to MPEG Fundamentals and Protocol Analysis (Including DVB and ATSC) M P E G T u t o r i a l Section 1 Introduction to MPEG...1 1.1 Convergence...1 1.2 Why Compression Is Needed...1 1.3 Principles
More informationEfficient Stream-Reassembling for Video Conferencing Applications using Tiles in HEVC
Efficient Stream-Reassembling for Video Conferencing Applications using Tiles in HEVC Christian Feldmann Institut für Nachrichtentechnik RWTH Aachen University Aachen, Germany feldmann@ient.rwth-aachen.de
More informationA HIGH PERFORMANCE SOFTWARE IMPLEMENTATION OF MPEG AUDIO ENCODER. Figure 1. Basic structure of an encoder.
A HIGH PERFORMANCE SOFTWARE IMPLEMENTATION OF MPEG AUDIO ENCODER Manoj Kumar 1 Mohammad Zubair 1 1 IBM T.J. Watson Research Center, Yorktown Hgts, NY, USA ABSTRACT The MPEG/Audio is a standard for both
More informationThree Key Design Considerations of IP Video Surveillance Systems
Three Key Design Considerations of IP Video Surveillance Systems 2012 Moxa Inc. All rights reserved. Three Key Design Considerations of IP Video Surveillance Systems Copyright Notice 2012 Moxa Inc. All
More information