Bandwidth Trends on the Internet A Cable Data Vendor s Perspective Tom Cloonan, Chief Strategy Officer, ARRIS
Agenda Introduction Observed Bandwidth Trends (& Predictions for the Future) Networking Equipment Trends Conclusions 2 ARRIS Talk for IEEE - September 2011
Monitoring Bandwidth Trends for the Cable Industry We need to predict the capacities for these products in the future Customer Premise EPON and RFOG Outside Plant Nodes and Amplifiers Head-end Headend Optics and Transmitters Hosted Service Portal Fixed Mobility Convergence Residential Gateways Taps and Splitters Local Encoders Universal Edge QAM Video Gateways and Players SMB Gateways CMTS Edge Routers Wireless Networking Wi-Fi Solutions Indoor/Outdoor Encoders Transcoders VOD and Advertising Tools & Services 3 ARRIS Talk for IEEE - September 2011
Agenda Introduction Observed Bandwidth Trends (& Predictions for the Future) Networking Equipment Trends Conclusions 4 ARRIS Talk for IEEE - September 2011
Some Basic Terms Used In This Talk Max Possible BW=120 Mbps (w/ 3-Channel Bonding Modems) Instantaneous BW Max Permitted BW=20 Mbps Average Busy-hour BW=600 kbps Average Consumed BW=300 kbps Min BW=0 Mbps On-line (busy-hour) Off-line On-line time Average Busy-hour BW & Average Consumed BW tend to be used quite extensively for Traffic Engineering calculations (determining how much Bandwidth Capacity is required to satisfy a given Service Group (pool) of subscribers) www.arrisi.com 5 ARRIS Investor Conference
Max Permitted Bandwidth Trends for Modems (First Charted in 2008) 100G 10G 1G 100M 10M 1M 100k 10k 1k 100 10 Max Permitted Bandwidth for Modems (bps) 1.2 kbps 300 bps After Curve-Fitting, the Past 25-years Show a Constant Increase of ~1.5x every year... resulting in Max Permitted BW=288 Mbps in 2016 9.6 kbps 2.4 kbps 5 Mbps 1 Mbps 256 kbps 512 kbps 56 kbps 28 kbps 128 kbps 33 kbps 14.4 kbps The Era of Cable Modems The Era of Dial-Up Modems 1 1982 1986 1990 1994 1998 6 12 Mbps 2002 2006 The Era of Wideband Cable Modems 2010??? (1.5) (2006-1982) = 5M/300 (1.5) (2016-2006) = 288M/5M 2014 2016 100 Gbps 10 Gbps 1 Gbps ~288 Mbps 50 Mbps 12 Mbps Year
Giving Credit Where Credit Is Due: Nielsen s Law of Internet Bandwidth (1998) 7 ARRIS Talk for IEEE - September 2011
Max DS Permitted Bandwidth for Modems (bps) Bandwidth (bps) Bandwidth Trends and Predictions 100G 10G 1G 100M 10M The past 29-years show a constant bandwidth increase of ~1.5x every year... 50 Mbps 12 Mbps The Era of Wideband Cable Modems 200 Mbps ~300 Mbps? Modem Bandwidth (bps) vs Year 250000000 200000000 1M 100k 10k 1k 100 10 300 bps 9.6 kbps 2.4 kbps 1.2 kbps 256 kbps 56 kbps 28 kbps The Era of Dial-Up Modems 128 kbps 5 Mbps 1 Mbps 512 kbps 33 kbps 14.4 kbps The Era of Cable Modems 150000000 100000000 50000000 1 1982 1986 1990 1994 1998 2002 2006 2010 2014 2016 Year 0 1980 1990 2000 2010 2020 Year 8
Average Bandwidth Trends for Modems (First Charted in 2008) Average Downstream Bandwidth for Modems 100M (1.5) (2016-2007) = 3.5M/90k 10M 1M 100k 10k Assume a Constant Increase of ~1.5x every year 30 kbps 135 kbps 90 kbps 456 kbps Useful for estimating the required Bandwidth for a Service Group Per-sub Bandwidth must rise Bandwidth # Subs 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 3.5 Mbps (A ~10x increase over the Avg. BW of Today) 2017 2018 2019 Year 2016 Sanity Check: Predicted Concurrency=(Avg BW)/(Max Permitted BW)=3.5/288= ~1.2%... This roughly matches the predictions from a Comcast conference paper: Saifur Rahman, "DOCSIS Migration Methodology: From A to B to 3", Communication Technology (SCTE, Vol. 24, No. 11, November 2007), pp. 34-40. 9
2011 2008 Example Of How Some MSOs Might Choose To Manage Their BW/Subscriber Metric CMTS Fiber Node 800 Home Service Group (320 subs) 40 Mbps 30 Mbps As more Bandwidth per Subscriber is Needed... CMTS 80 Mbps Bonding Group 40 Mbps 40 Mbps Fiber Node Avg DS BW per sub = 40 Mbps/320 subs = 125 kbps/sub 400 Home Service Group (160 subs) 30 Mbps 30 Mbps Avg DS BW per sub = 80 Mbps/160 subs = 500 kbps/sub 10 60 Mbps Bonding Group
Max DS Permitted Bandwidth for Modems (bps) Avg DS Bandwidth for Single Modem ((bps) Extended View of HSD Downstream Bandwidth Trends (Per Subscriber) Max. Downstream BW/sub Avg. Downstream BW/sub 100G 10G ~73 Gbps? 100G 10G 1G 100M 10M 1M 100k 10k 1.2 kbps 1k The past 29-years show a constant bandwidth increase of ~1.5x every year... 200 Mbps 50 Mbps 12 Mbps 1 Mbps 5 Mbps 9.6 kbps 2.4 kbps 256 kbps 56 kbps 28 kbps 33 kbps 14.4 kbps 512 kbps 128 kbps 1G 100M 10M 1M 100k 10k 1k Assume that DS Tavg is 220 kbps in 2010 and grows by 1.5x per year ~731 Mbps? 100 10 1 300 bps The Era of Dial-Up Modem s The Era of Cable Modems The Era of Wideband Cable Modems 1982 1990 1998 2006 2014 2022 1986 1994 2002 2010 2018 Year 2030 2026 100 10 1 1982 1990 1998 1986 1994 2006 2014 2022 2002 2010 2018 2026 2030 Year 11
A Philosophical Side-Bar on Downstream Bandwidth Growth (Better Done Over Beers) Some argue that we will soon hit an asymptotic limit in Downstream Bandwidth Growth due to the limit of the human eye and mind to absorb information Ex: If a 20 Mbps, 3D-HD, H.264 video feed is sent to (on average) 2.3 people per home, then each home should be satiated with an average bandwidth offer of (20 Mbps)*(2.3)=46 Mbps which we predict we will hit by ~2023 (in ~12 years). Maybe BUT What about the impact of DVR pumping bandwidth? What about the impact of cloud technologies (like Apples icloud)? What about machine-to-machine transfers for video search engines looking for our optimal content for each night? What about holography? What about the smell & touch & taste technologies that are yet-to-be invented? It may be a while before we hit the asymptotic limit Source: ARRIS Estimates 12 ARRIS Talk for IEEE - September 2011
Upstream Bandwidth Growth Max US Permitted Bandwidth for Modems (bps) The Past 10 years Show a Constant Increase of ~1.1x every year... Will that pace continue? Recent activity suggests an accellerating rate of increase we will assume it will increase to the 1.5x growth rate in the next slide. 100G 10G 1G 100M 10M 1M 100k 10k 1k 100 10 The Era of Cable Modems The Era of Wideband Cable Modems 1 Mbps kbps 450 kbps768 128 kbps 5 Mbps??? 1998 2002 2006 2010 2014 2016 Year 13
Max US Permitted Bandwidth for Modems (bps) Avg US Bandwidth for Single Modem (bps) Extended View of HSD Upstream Bandwidth Trends (Per Subscriber) Max. Upstream BW/sub Avg. Upstream BW/sub 100G 100G 10G ~14.6 Gbps? 10G 1G 100M 10M 1M Assume the US Tmax is always 1/5 of the DS Tmax (ex: 50 Mbps DS tier has 10 Mbps US today) 1G 100M 10M 1M Assume that US Tavg is 73 kbps in 2010 and grows by 1.5x per year ~241 Mbps? 100k 10k 100k 10k 1k 100 10 1k 100 10 1 1982 1990 1998 2006 2014 2022 2030 1986 1994 2002 2010 2018 2026 1 1982 1990 1998 2006 2014 2022 2030 1986 1994 2002 2010 2018 2026 Year Year 14
Some Notes On Upstream Bandwidth Upstream Bandwidth is comprised of two types of traffic: Protocol Messages (ex: HTTP GETs, TCP ACKs, etc.) Uploads (ex: P2P torrents, Web-Page inputs, FTP transfers) The Protocol Message Bandwidth is predictable and almost calculable (if you know the Downstream Bandwidth & assume typical TCP ACK behavior): US Protocol Message BW = ~DS BW * (64 bytes/ack pkt)/(2*1500 bytes/tcp pkt) = ~DS BW * (0.0213) = ~2% * DS BW The Upload Bandwidth is harder to predict it is highly dependent on the popularity of apps at any given time Ex: When P2P was big in 2008, US BW was ~41% of DS BW Ex: When OTT IP Video became big in 2010, US BW dropped to ~28% of DS BW Source: ARRIS Estimates 15 ARRIS Talk for IEEE - September 2011
Percent of Total Bandwidth Avg Bandwidth/Sub (kbps) Per Service Group Jan-04 Feb-05 Mar-06 Apr-07 Jun-08 Jul-09 Aug-10 Sep-11 Over-The-Top (OTT) Streaming Media Is Dominating the DOCSIS HSD Growth 100% 80% 60% 40% 20% Mix of Traffic Protocol Types vs. Time 160 120 80 40 Per-Subscriber Avg. Bandwidth Is Being Rapidly Increased Downstream Bandwidth/Sub (kbps) Upstream Bandwidth/Sub (kbps) Note slope change due to OTT video (since 2009) Source for both graphs: Top 5 US MSO 0% January-10 Streaming Media Web Browsing January-11 Peer-to-Peer Other Protocols The traffic mix is changing fast Service Providers must respond quickly The ratio of Downstream-to-Upstream bandwidth is growing as IP Video increases ~2.4 in 2008 and ~3.5 in 2010 16 0
Amount of Bandwidth Bandwidth Trends for Different Traffic Mixes 160 Mix of Traffic Types vs Time 140 120 100 80 60 Other Protocols Web Browsing Peer-to-Peer Streaming Media 40 20 0 Jan-10 Date Jan-11 17 ARRIS Talk for IEEE - September 2011
% of Overall Traffic IP Video Trends Over Time May 2010 March 2011 20.00% Avg IP Video from the Internet 18.00% 16.00% 14.00% 12.00% 10.00% 8.00% 6.00% 4.00% 2.00% 0.00% 5/1/2010 6/1/2010 7/1/2010 8/1/2010 9/1/2010 10/1/2010 11/1/2010 12/1/2010 1/1/2011 2/1/2011 3/1/2011 You Tube Flash Itunes RSTP Netflix Windows Media Hulu Unbox Source: Top 10 US MSO 18
Overall IP Video Traffic Details (March 2011) Internet to Subscribers Subscribers to Internet Max Downstream Bandwidth Consumption (Gb/s) Overall IP Video Downstream 185.67 Percentage of Overall Traffic Netflix (Add all Netflix Values) 65.73 18.19% You Tube (Add all You tubes and Google Video) 52.36 14.49% Flash (Add Flash and Shockwave) 25.12 6.95% RSTP (RTSP, RTMP and RTSP over UDP) 13.26 3.67% Itunes 10.45 2.89% Windows Media (WMP and MS ASF) 5.66 1.57% 19 Hulu 2.15 0.60% Source: Top 10 US MSO Max Upstream Bandwidth Consumption (Gb/s) Overall IP Video Upstream 6.64 Percentage of Overall Traffic You Tube (Add all You Tube and Google Video) 1.59 1.52% Netflix (Add all Netflix Values) 1.44 1.38% Flash (Add Flash and Shockwave) 0.98 0.94% RSTP (RTSP, RTMP and RTSP over UDP) 0.93 0.89% Slingbox 0.40 0.39% Itunes 0.27 0.26% Windows Media (WMP and MS ASF) 0.18 0.17% CCTV 0.17 0.17% Qvod 0.11 0.11% Hulu 0.08 0.07%
Snapshot of Packet Size Trends 20 ARRIS Talk for IEEE - September 2011
Average Downstream Bandwidth per Subscriber (kbps) Bandwidth Trend Differences Between Different Service Providers Bandwidth Trends at Five Service Providers in 2010 160 150 140 130 120 110 100 90 80 70 60 50 1Q10 Source: Top 10 US MSO 1Q11 33% Growth 33% Growth 100% Growth 60% Growth 40% Growth This may represent an un-congested subscriber s bandwidth level in 2011 These may represent congested subscriber bandwidth levels in 2011 Subscriber Satisfaction Issues Will Drive Service Providers to Increase Investment to Retain and Attract Customers 21 ARRIS Talk for IEEE - September 2011
Agenda Introduction Observed Bandwidth Trends (& Predictions for the Future) Networking Equipment Trends Conclusions 22 ARRIS Talk for IEEE - September 2011
Why Discuss Equipment In A Talk On Bandwidth Trends? In order for the Bandwidth Trends to materialize, the available Equipment MUST be able to support the predicted Bandwidths at acceptable cost levels We will explore this topic from the point-of-view of DOCSIS CMTS Equipment, which serve 20-50 Service Groups For an Typical Single High-Speed Data Service Group with ~500 Homes Passed, MSOs predict: 2008: 1 DOCSIS Downstream (~40 Mbps) 2011: 4 DOCSIS Downstreams (~160 Mbps) 2015: ~20 DOCSIS Downstreams (~800 Mbps) Source: ARRIS Estimates 23 ARRIS Talk for IEEE - September 2011
Downstreams Per DS-SG Bandwidth Trends (for ~500-Homes Passed DS-SG) 24
CCAP The Cable Industry Response Rear View to Rapid Bandwidth Growth 16U Chassis Converged Cable Access Platform CMTS (HSD, VoIP) UEQ (VoD, SDV, M-CMTS) IP Video EPON Highly Available Fully redundant design, no single point of failure Separate upstream and downstream modules supporting dynamic mix of services Future Proof Terabit-plus capacity in backplane Extreme Density 20x-80x increase in capacity 14x-60x power reduction 20x-80x space reduction Support for up to ~6.3 Gbps of Downstream Bandwidth to each Service Group The CCAP Architecture Has Been Designed to Carry the Cable Industry Deep Into the Next Decade and Beyond... 25 Exhaust Air Primary 100-Gig-E Ports Secondary 100-Gig-E Ports 12 Ports/DS Card 32/48/64 Narrowcast QAMs/Port 96 Broadcast QAMs/Port Primary Switch/Route Engine Secondary Switch/Route Engine Power Supply Modules XR2 XR1 DS Redundancy DS DS DS DS DS US Redundancy US US US Front View 16U Chassis US US 24 Ports/US Card (Implemented using high density UCH w/ MCX-75 connectors) Fan Modules Intake Air
1 DS 4 DS 8 DS 16 DS 32-160 DS Downstream Channels Per Service Group Today CMTS Edge Router Evolution Ongoing Capacity Expansion based on Moore s Law 2004 2006 2008 2010 2012 2014 2016 26 ARRIS Talk for IEEE - September 2011
Moore s Law & a Perfect Storm of New Technologies Will Enable Required Features for this Decade Building Blocks L2/L3 Switch Chips High-Speed Digital-to-Analog Converters Burst Receivers 2007 Capabilities 2011 Capabilities Increase 60 Gbps 640 Gbps 10x 1 Downstream Channel per DAC 2 Upstream Channels per Receiver 100+ Downstream Channels per DAC 12 Upstream Channels per Receiver 100x Processor Chips 2 Cores per Chip 32 Cores per Chip 16x Allows higher capacities within a given chassis size Allows increased densities Allows for a single chassis that supports all services Allows Lower Cost/Channel Allows Next-Gen Networking Equipment to support the Need 6x 27
Agenda Introduction Observed Bandwidth Trends (& Predictions for the Future) Networking Equipment Trends Conclusions 28 ARRIS Talk for IEEE - September 2011
Conclusions Bandwidth growth on Service Provider networks has been growing exponentially for ~30 years The Downstream growth rate has been roughly 1.5x per year Web-Surfing was the driver of growth in 2000 P2P was the driver of growth in 2008 IP Video is the driver of growth today The growth is expected to continue for many years into the future as new yet-to-be-invented applications are created Network equipment providers are capitalizing on Moore s Law to provide the capacities that will support this growth The Internet will continue to grow to support the newly-evolving Applications & the higher Bandwidth Goals (ex: 1 Gbps to every home ) that will dominate the markets of the future 29 ARRIS Talk for IEEE - September 2011
THANK YOU