Media - Video Coding 1. Scenarios for Multimedia Applications - Motivation - Requirements 15 Min 2. Principles for Media Coding 75 Min Redundancy - Irrelevancy 10 Min Quantization as most important principle of Irrelevancy Reduction 10 Min Entropy Coding (Run length, Hufman) as Redundancy Reduction 10 Min Predictive Coding and DPCM based on decorrelation of signals 10 Min Intraframe Coding (Motion Compensation) for temporal prediction 10 Min Transform Coding (DCT) for decorrelation of signals 10 Min Hybrid Coding the basic coding principle for all standards 15 Min 3. Standards 120 Min Overview, importance of standards 15 Min ITU - H.263 + H.26L, principles, demos (video quality at various rates) 15 Min MPEG-2; MPEG-4, principles, demos (Functionality of MPEG-4) 30 Min MPEG-7: principles, applications, demos 30 Min JPEG-2000: Principles,demos (Functionality of JPEG-2000) 30 Min 1 Dr. Eckart Hundt; Siemens AG, CT IC 2; D-81730 München; Tel.: +49-89-636 53388; eckart.hundt@mchp.siemens.de
Technological Trends & Requirements for Advanced Coding Networks Networks Internet Internet & & Increasing Increasing bandwidth bandwidth Wide Wide availability availability QoS QoS provision provision Terminals Terminals processing processing power power Affordable Affordable Merging Merging functionalities functionalities (CCC) (CCC) Users Users Interactive Interactive role role Demand Demand for: for: quality quality Excitement Excitement Ease Ease of of use use New advanced multimedia applications Domination of AV content e.g. E-Commerce, Services, Entertainment, Services,... Compression Compression Improved Improved coding coding efficiency efficiency Wide Wide bit bit rate rate / / quality quality range range CCC: Consumer, Computer & Communication Functionalities Functionalities Interaction Interaction with with content content Network Network adaption adaption Scalability Scalability Error Error Robustness Robustness Synthetic-natural Synthetic-natural hybrid hybrid coding coding 2-D 2-D and and 3-D 3-D presentation presentation Meta Meta IPR IPR / / Copyright Copyright management management management management Retrieval Retrieval support support 2 Representation Representation adaption adaption User User preferences preferences
Applications Overview and Trends TV / FILM Audio/Video Data Business Services Maintenance / Repair CSCW / Teleworking Entertainment Digital TV Video on Demand Games /Multimedia Archives/Databases Production & Processing Sevices Service Telebanking Homeshopping Communication Videophone/-conference Video Multimedia Mail Industrial applications Process surveillance Security Computer interactivity & intelligent processing Medicine PACS Telemedicine Communication global access
Multimedia Environment Cellular Net Broadband ISDN LAN PSTN ISDN Internet Satelite x DSL Cable Storage Video Surveillance Camera Videophone / Videoconference Multimedia Workstation Database / Archive / Server MM-Terminal Set Top Box Digital Camera Computer Home PC Digital TV Video & on Demand Communication and and UMTS UMTS will will enforce multimedia and and data data services and and promise a huge huge market market for for networks, terminals, services, components UMTS UMTS will will start start operation in in 2001 2001 in in Japan Japan and and in in 2002 2002 in in Europe Europe Video Video is is fundamental innovation for for communication and and multimedia Terminals are are PCs PCs Tvswith STB, STB, Viedophones, Multimedia Workstations 4
Multimedia Applications Business Sphere Private Sphere Public Sphere Application Application & Service Service Requirements: Requirements: Network: Network: Bandwidth Bandwidth Delay Delay Error Error rate rate Jitter Jitter Symmetric/ Symmetric/ Asymmetric Asymmetric Reatime/Download Reatime/Download Terminal: Terminal: Display Display Size Size and and Resolution Resolution Processing Processing power power Man Man Machine Machine Interface Interface Size Size 5 Network Network Connection Connection Security Security
Communication Scenario Broadband Network (e.g. UMTS) Driving Driving Forces: fast fast broadband networks powerfull processors for for high high end end mobile mobile terminals increasing use use of of multimedia standards and and algorithms for for transmission and and signal signal processing Multimedia Notebook Gateway Fixed Network (ATM, ISDN, ADSL) INTERNET Multimedia Terminal Multimedia Server for Broadcast and Request 6
Scenario Homenetwork Surveillance Camera Broadcast Netwoks Cellular Networks TV-Set TV-Set /STB DVD-Player Multimedia PC PC Cable xdsl Telco Control Heating Wireless Home Network Wired Home Network: Ethernet,Hyper Lan, Home RF;... Hub PSTN/ ISDN 7 Internet
Scenario IT-driven Maintenance & Service Internet Multimedia- Server Multimedia-Terminals with Video conference Multimedia- Server Surveillance Camera 01001 01001 01001 Wireless Network Multimedia- Notebook 01001 01001 01001 Wireless LAN Wired Network/ Internet LAN Service Terminal ISDN/PSTN Partner Multimedia- Workstation Control station (Process control) Network Internet Intranet Transmission of of process & measurement data data Retrieval of of Multimedia for for service, sales, sales, training,... Transmission of of life life video video for for surveillance, diagnosis, service,... Communication enhanced by by video, video, multimedia messaging, videophone,... 8
Scenario Multimedia in the car Base station/ Service Provider Home Office Internet / WSD/ISDN Added Value Services (Emergency, Car Service, stock exchange,... Entertainment TV/Radio Games Retrieval Travel Navigation Route finding Drving assistence Telematics Car Service Communication e-mail 9
Network Requirements for Multimedia Application / Service Traffic User Terminal Distribution Retrieval Messaging Dialogue TV; Radio; Web Access Multimedia Videophone Pay TV VoD messaging Videoconference Web TV E-Commerce e-mail Surveillance Business TV Training/service Unidirectional Realtime Streaming TV-Set TV STB PC Video: 1 8 Mbit/s Audio: 64 384 kbit/s Resolution quality Interactice TV Bidirectional Asymmetric Non realtime Streaming PC, (TV) Special terminals terminals Bidirectional Asymmetric Non realtime Streaming PC, (TV) Special terminals terminals Bidirectional Symmetric/ Asymmetric Realtime PC, (TV) Special terminals terminals Typical Datarates 10 Mbit/s peak 64 kbit/s 1Mbit/s 64 kbit/s 1Mbit/s 64 kbit/s 1Mbit/s QoS to reduced Reduced quality Reduced quality resolution/quality Bit error rate 10 8 10-10 10-4 to 10-6 0 (ARQ) 10-4 to 10-6 Delay / Jitter Extremely low Non critical Non critical Very low; critical Network MPEG TS UDP/IP;IETF TCP/IP; IETF UDP/IP, IETF Protocol (ATM, UDP/IP) ITU-H.32x ITU-H.32x ITU-H.32x Network Terrestrial Antenna Internet, Satellite (UMTS) Cable Network ISDN Internet xdsl (UMTS) ISDN Internet, xdsl (UMTS) ISDN 10
Video Requirements for MM-Applications Image Type Typical Applications Typical Bitrates Quality Demands Compression Standard Photographic Still Images Studio Press Desktop < 24 bit/pixel 1-2 bit/pixel < 1 bit/pixel PCM JPEG/JPEG 2000 JPEG/JPEG 2000 Video TV Studio 166 Mbit/s PCM TV Broadcast 2-6 Mbit/s MPEG-2 Video on Demand < 5 Mbit/s MPEG 1, 2, 4 Desktop Video 384 kbit/s to 2 Mbit/s JPEG/JPEG 2000 H.263 MPEG 1, 2, 4 Videophone & Videoconference 20 kbit/s to 1 Mbit/s Low to H.263/MPEG4 Internet- Terminal 5 kbit/s to 1 Mbit/s Low to MPEG 4