Over-the-Top Video Delivery using HTTP Adaptive Bit Rate Streaming CCSA Mont Tremblant QC September 22 2013 CCBE Horseshoe Resort - ON September 26 2013 Louis Sebastiani, IPTV Project Director 1
Our Markets IPTV Our Know-How MPEG-2/4 Compression and test t equipment DTV headend (live), VOD, EPG (guide), PVR DTV, IPTV and OTT delivery Satellite Fiber Transport Cable TV and RF distribution TV and FM Broadcast PSIP / PSI-SI (Metadata and Guide) Digital TV headend design RF distribution (QPSK, QAM, 8VSB) Carrier Ethernet / DWDM solutions RF Test and Measurement CATV Network Powering Wireless Point-to-Point and Multipoint HFC and PON distribution design Network Management L-Band Signal Management and transport 2
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Broadcast TV, Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 3
1. Video Delivery on Managed and Unmanaged Networks Broadcast TV / Cable TV / IPTV / Satellite Internet Over-The-Top Delivery (OTT) 4
1. Video Delivery on Managed and Unmanaged Networks MPEG-2-TS on Managed Network IP Video Streaming (unmanaged) 0110011010110101001101 video video audio MPEG-2 TS (or) ASI IP QAM (Cable) QPSK/8PSK (Satellite) 8VSB (Broadcast) DSL (Telco) GPON/EPON (FTTH) TCP/IP Direct Connection from Headend to Customer Packet-Switched Best Effort Network 5
1. Video Delivery on Managed and Unmanaged Networks Difference between Managed and Unmanaged Networks Managed Network (ATSC, HFC, DSL, FTTH, Satellite) Bandwidth is controlled and constant audio video video Jitter is controlled Network Engineering allows stable conditions (QoS is assured) MPEG-TS is the preferred mechanism to deliver video (QAM, IPTV, Satellite). Because MPEG-TS requires stable network conditions and no packet loss: need Managed Network Unmanaged Network (Internet) Bandwidth varies / Conditions are not stable Quality of Service is not guaranteed ( Best Effort ) MPEG-TS is not a good solution So, need to use IP video streaming techniques to deliver video over-the- top (OTT) 6
1. Video Delivery on Managed and Unmanaged Networks What is OTT Video Streaming? For the purpose p of this presentation: - A toolkit of different technologies - Making Use of the Public Internet and its Standard d Protocols - To deliver multimedia content - Either Live or On-Demand 7
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 8
2. Live Demo (Block Diagram) 9
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 10
3. Adaptive Bit Rate streaming technology overview IP Stack Standard Protocols Key Words Application Layer Tra ansport Layer TELNET FTP HTTP Clients/ Servers DHCP RTP DNS SNMP RTMP/ RTSP TCP (acknowledgement) UDP (no acknowledgement) Internet Layer IP IGMP 4 layer model (Internet Protocol Suite) From Wikipedia: http://en.wikipedia.org/wiki/internet_protocol_suite Link Layer Ethernet (Media Access Control) MAC address 11
3. Adaptive Bit Rate streaming technology overview An example with MPEG-TS Application Layer Tra ansport Layer TELNET FTP HTTP Clients/ Servers DHCP RTP DNS SNMP RTMP/ RTSP TCP (acknowledgement) UDP (no acknowledgement) Internet Layer IP IGMP Link Layer Ethernet (Media Access Control) 12
3. Adaptive Bit Rate streaming technology overview Video Streaming Protocols All streaming protocols are in the application layer Application Layer Tran nsport La ayer Internet Layer TELNET FTP Clients/ Cets/ Servers TCP (acknowledgement) DHCP DNS SNMP RTMP/ UDP (no acknowledgement) Clients and servers exchange messages in a request-response messaging pattern HTTP Streaming Protocols use the layers RTP RTSP below to transport content IP IGMP HTTP TCP IP RTSP/ RTMP UDP Link Layer Ethernet (Media Access Control) MAC Video streaming over the Internet 13
3. Adaptive Bit Rate streaming technology overview Video Streaming Protocols Evolution 1. Progressive Download using HTTP (eg. Youtube) 2. RTSP/RTMP Streaming RTMP (Flash Players) RTSP (QuickTime, Android) 3. Adaptive HTTP Streaming Microsoft Smooth Streaming, Apple HLS, Flash HDS 14
3. Adaptive Bit Rate streaming technology overview Video Streaming Protocols Evolution App plication Layer ort r Transp Laye Int ternet Layer Link Layer Hypertext Transfer Protocol (HTTP) is the foundation of data communication for the World Wide Web. TELNET FTP HTTP Clients/ Servers TCP (acknowledgement) IP DHCP RTSP means Real Time Streaming Protocol RTMP means Real Time Messaging Protocol RTP DNS SNMP UDP (no acknowledgement) Ethernet (Media Access Control) 1 HTTP 3 HTTP 2 RTSP/ RTMP RTSP/ RTMP 1. Progressive Download uses HTTP (eg. Youtube) 2. RTSP/RTMP Streaming RTMP (Flash Players) RTSP IGMP (QuickTime, Android) 3. Adaptive HTTP Streaming (Microsoft Smooth Streaming, Apple HLS, Flash HDS) 15
3. Adaptive Bit Rate streaming technology overview Progressive Download principles Progressive Download is supported by: Flash, HTML5 browsers, the ipad/iphone and On the server side: every regular webhoster supports downloads, as does every Content Delivery Network (CDN) Youtube uses Progressive Download Features and Characteristics Simplest to implement HTTP protocol (using TCP/IP) When hit Play the media player starts downloading the file until the whole file is received. Playback as soon as enough data in buffer Trick play (seeking in the video) if system is provisioned for pseudostreaming Downsides A lot of bandwidth is wasted for data downloaded but unwatched Inhability to change the video quality at midstream Full screen looks bad (even if would have the bandwith for a higher resolution); or Playback stutters upon network congestion Not possible to do live streaming Conclusion Good solution for short clips and when no live streaming Simple to implement Alternate solutions RTMP/RTSP streaming Adaptive HTTP streaming Info from http://www.longtailvideo.com/blog/19578/what-is-video-streaming 16
3. Adaptive Bit Rate streaming technology overview RTMP/RTSP Streaming principles RTMP (Real Time Messaging Protocol) is what Flash uses RTSP was developed by the Multiparty Multimedia Session Control Working Group (MMUSIC WG) and published as RFC2326 in 1998 RTMP (Flash) is the most widely used streaming protocol Almost all PCs have flash players * Not supported by iphones / ipads Hulu uses RTMP Streaming Features and Characteristics RTMP/RTSP are Stateful protocol (vs HTTP which is a Stateless protocol) Requires a dedicated Streaming Server. The media player initiates a communication with a Streaming Servers Uses RTP/UDP streaming with a remote control protocol (TCP/IP to maintain end-to-end connection) RTMP uses port 1935; RTSP uses port 554 Downsides RTP(UDP) has no retransmit capability so packet loss will result in issues RTMP/RTSP packets may be blocked by certain firewalls (because of ports 1935/554) RTMP packets can t leverage standard HTTP caching mechanisms The required server may also limit scalability as compared to HTTP-based streaming, since there are many more HTTP servers than RTMP. Conclusion RTMP distribution is still widely and beneficially used by many websites today. However, at this point if you re considering implementing a streaming technology, the overwhelming sentiment is to deliver via HTTP. For adaptive delivery to Apple devices (and Android 3.0 and higher?), HLS is your only option. Info from http://www.longtailvideo.com/blog/19578/what-is-video-streaming and http://www.streamingmedia.com/articles/editorial/what-is-.../what-is-a- Streaming-Media-Protocol-84496.aspx and Wikipedia. 17
3. Adaptive Bit Rate streaming technology overview Adaptive HTTP Streaming principles Profile A Profile B Profile C Features and Characteristics Creation of fragments of encoded video (2 seconds or 10 seconds chunks) hosted on regular HTTP server HTTP is firewall friendly (vs RTMP) Support for different resolutions i.e. each fragment can be encoded in different quality levels IDR Frame alignement and equal duration of fragments to switch between resolutions during playback H.264 video Codec and AAC audio Note: see upcoming slide for discussion i on WebM and VP8 Downsides Requires more overhead because of TCP which requires acknowledgement (vs RTP/UDP transport) A lot of small files to manage (chunks) No Single and Widely used implementation Currently, some of the options are: Apple HLS Microsoft Smooth Streaming Adobe HDS Lack of standardization, except effort from: MPEG-DASH (MPEG consortium) Video is encoded in several resolutions to adapt for network conditions (different Profiles ) Cients play the video stream by requesting segments in a profile from a Web Server (via HTTP) Adaptive delivery enables a client to adapt to fluctuating network conditions by selecting video segments from different profiles (Intelligence in client) Objective: join the merits of RTMP/RTSP Streaming (bandwidth efficiency, quality switching) with those of Progressive Download (no special servers or protocol needed simple HTTP). CDN Friendly. The list of available profiles is called a manifest file or playlist. This is used by the client to know what to expect and download Info from http://www.longtailvideo.com/blog/19578/what-is-video-streaming and RGB white paper Comparing Adaptive HTTP Streaming Technologies 18
3. Adaptive Bit Rate streaming technology overview Adaptive HTTP Streaming High Quality Video H.264 Encoder H.264 Multi Bit Rate Transport Streams Creation of several bit rates/resolutions ti for delivery to different devices (STB, PC,Tablets, Phones, etc.) Pac ckaging / Seg gmenting Lower Bit Rate -------------------- Higher Bit Rate + Playlist/Manifest File Creation of small chunks (2 or 10 seconds) for each resolution and streaming format (HLS, HDS, MSS) * For HDS, a Flash Media Server is required; For MSS, a IIS-7 Server is required HTTP Server* Managed Network or Delivery to CDN The video files are published over the Network like any other HTTP file for delivery on the Internet Client dynamically selects best size chunk according to network conditions Adaptive Streaming Client High Bit Rate Network Congestion Low Bit Rate Time 19
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 20
4. Comparing HTTP Streaming Technologies HLS: HTTP Live Streaming (Apple) 2009 MSS: Smooth Streaming (Microsoft) 2009 ISO Standard in order to provide a Universal Delivery Format HDS: HTTP Dynamic Streaming (Flash) 2010 Features Apple HLS Microsoft Smooth Streaming Adobe HDS mpeg-dash Codec Used H.264 H.264, VC-1 H.264, VP-6 H.264 (or other MPEG codec family) Open Standard No No No Yes Subtitle Support Partial Yes Partial Yes Multiple Audio Support V4 only Yes Yes Yes Trick Mode Support Partial Yes Partial Yes CDN-Friendly Requires Chunk Carriage Optimization Requries specific IIS-7 origin server Requires specific Flash Media Server(origin) Yes Common Encryption No No No Yes Summary of HTTP Protocol Differences. Excerpts from Harmonic August 2012 Article: Dash: A Universal Standard for Streaming Video Content to Multiple Devices, by Thierry Fautier. 21
4. Comparing HTTP Streaming Technologies What about WebM and VP8? WebM is an media file format designed for the web Open and royalty-free A WebM file (.webm) consists of : VP8 video codec (vs H.264 video codec) Vorbis audio codec (vs AAC audio vs) In a container based on Matroska (.mkv) Embed video directly in HTML5 web page with simple tag No need for plug-in in web page The project's development is sponsored by Google Type of Format: Media Container Internet Media Type (MIME Type) video/webm audio/webm Native WebM support by Mozilla Firefox, Opera and Google Chrome browsers More Information http://www.webmproject.org/about/ 22
4. Comparing HTTP Streaming Technologies The State of HTML5 support Information from: http://www.longtailvideo.com/html5/ Last updated April 10, 2013 23
4. Comparing HTTP Streaming Technologies Summary: Streaming Support This table sums up support for the various streaming methods across devices and servers. Posted by Jeroen Wijering on April 27, 2011 Devices Progressive Download (only on demand) RTMP/RTSP Streaming (live and on demand) Adaptive HTTP Streaming (live and on demand) Adobe Flash Player MP4, FLV RTMP HLS, HDS, Smooth HTML5 (Safari & IE9) MP4 - - HTML5 (Firefox & Chrome) WebM - - ios (ipad/iphone) MP4 - HLS Android Devices MP4, WebM RTSP HLS (as of 3.0) CDNs (e.g. CloudFront) MP4, FLV, WebM RTMP HLS Web Servers (e.g. S3) MP4, FLV, WebM - HLS Info from http://www.longtailvideo.com/blog/19578/what-is-video-streaming 24
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 25
5. Multiscreen Video Delivery from the Cable/Telco Operator s perspective Broadcast TV / Cable TV / IPTV / Satellite Internet Over-The-Top Delivery (OTT) 26
5. Multiscreen Video Delivery from the Cable/Telco Operator s perspective The Threat Content Providers, Consumer Electronics Manufacturers and new Aggregators can offer TV services directly to consumers OTT *HEVC should provide 40-50% reduction in bitrate vs H.264 27
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 28
6. Overview of the multiscreen video delivery ecosystem audio video video Managed Network Internet Un-Managed Network 29
6. Overview of the multiscreen video delivery ecosystem TV Everywhere challenges Authentication This is the biggest hurdle to adoption of TV everywhere needs to be simple for all users High reliability live streaming Multiplicity of devices and streaming formats makes the headend more complicated ipads, iphones, Android, XBOX, PCs, Connected TVs, STB, etc Security Complexity of Digital Rights Management Advertising i Measurement 30
6. Overview of the multiscreen video delivery ecosystem MPEG-TS over Managed Networks 4 components to unify the delivery of TV content on managed/unmanaged networks Internet Over-The-Top Delivery (OTT) Adaptive Bit Rate Streaming over Un-Managed Networks 31
6. Overview of the multiscreen video delivery ecosystem Interactive TV service delivery platform (middleware for IPTV and Multiscreen/Over-the-Top TV) http://www.beenius.tv/ Hardware MPEG-4 Transcoder (40 channels 1RU) with integrated segmenter and publishing for HLS, MSS http://www.mysticvideo.net Edgeware provides the video delivery servers needed to offer video services across managed and unmanaged networks, with the ability to reach any screen, at any time, with any content. These services include: - video on demand (VOD), - Live TV, time shift TV and network Personal Video Recorder (npvr), - as well as offering wholesale Content Delivery Network (CDN) management services Edgeware is a hardware (server) manufacturer and software provider. http://www.edgeware.tv/ Multiscreen (OTT) adaptive bit rate streams and MPEG transport streams monitoring probes http://www.bridgetech.tv/ 32
6. Overview of the multiscreen video delivery ecosystem IPTV/OTT middleware Multiscreen support Enables interactive TV on smartphones, tablets, PCs and TVs Same look and feel regardless if content is coming from managed (IPTV) or unmanged network (OTT). Social TV and Interactive TV Direct link on user interface to Facebook, Twitter and Flickr 33
6. Overview of the multiscreen video delivery ecosystem Same Look and Feel iphone GUI ipad GUI Television (STB) GUI 34
6. Overview of the multiscreen video delivery ecosystem Mystic One MPEG Video Transcoding Platform Transcoder Overview 40 independent 1080i/p transcode channels. Up to 60 ABR or SD transcode channels. Any-to-Any or Any-to-Many modes including GOP aligned and aspect ratio matched profile streams. All broadcast and film formats including progressive and interlaced at all applicable frame rates. 35
6. Overview of the multiscreen video delivery ecosystem Very long tail: npvr (> 10TB) Content/Service/ Server Management Long tail: Central servers / logical clusters (~5 10TB) CDNs, OTT operators, telco/cable core networks Network Short to mid tail: Distributed servers (~1TB storage) Telco/cable metro & access networks 20% Core N/W 80% Edge Caches Demand Short Tail Mid Tail Long Tail Storage & streaming close to user: Most demanded closest: Short tail Frequently demanded between: Mid tail Least demanded at centre: Long tail Ranking 36
6. Overview of the multiscreen video delivery ecosystem Simultaneous managed and unmanaged network support with hardware acceleration MTBF measured in decades Up to 24TB of Flash Storage Up to 20Gbps Transmission (up to 32,000 concurrent streams/users) 85W peak power 37
6. Overview of the multiscreen video delivery ecosystem OTT monitoring probes SUPPORTS: - Microsoft Smoothstream - Apple HLS - Adobe HDS Alarm categories are: - Transport errors (e.g bandwidth) - HTTP errors (e.g missing files on servers) - XML structure errors (e.g wrong structure of manifest files) 38
Agenda 1. Video delivery on managed and unmanaged networks a) Differences between Cable TV, IPTV and Over the Top delivery (OTT) using the Internet b) Difference between MPEG2-Transport Stream delivery and HTTP streaming 2. Live Demo (IPTV and Multiscreen Video Delivery) 3. Adaptive Bit Rate streaming technology overview 4. Comparing HTTP streaming technologies 5. Multiscreen video delivery from the Cable/Telco operator s perspective 6. Overview of the multiscreen video delivery ecosystem (from content to consumer devices) 7. Live Demo with MPEG and OTT Test Equipment 39
7. Live Demo (Block Diagram) with Test Equipment 40
7. Live Demo (Block Diagram) with Test Equipment 41
7. Live Demo (Block Diagram) with Test Equipment 42
Our Markets IPTV Our Know-How MPEG-2/4 Compression and test t equipment DTV headend (live), VOD, EPG (guide), PVR DTV, IPTV and OTT delivery Satellite Fiber Transport Cable TV and RF distribution TV and FM Broadcast PSIP / PSI-SI (Metadata and Guide) Digital TV headend design RF distribution (QPSK, QAM, 8VSB) Carrier Ethernet / DWDM solutions RF Test and Measurement CATV Network Powering Wireless Point-to-Point and Multipoint HFC and PON distribution design Network Management L-Band Signal Management and transport 43
Understanding TV Everywhere/ Multiscreen Video Delivery Thank you / Merci to the CCSA and CCBE members Louis Sebastiani LSebastiani@incospec.com Serving the industry since 1978 with pride, integrity and commitment 44