Help! My Big Expensive Router Is Really Expensive!



Similar documents
Netflix Open Connect. 2 Terabits from 6 racks

Cisco Network Convergence System 6000 Series 10-Port 100-Gbps Multiservice Line Cards with Cisco AnyPort Technology

Why Software Defined Networking (SDN)? Boyan Sotirov

100 Gigabit Ethernet is Here!

Building A Cheaper Peering Router. (Actually it s more about buying a cheaper router and applying some routing tricks)

基 於 SDN 與 可 程 式 化 硬 體 架 構 之 雲 端 網 路 系 統 交 換 器

Cisco s Massively Scalable Data Center

Core and Pod Data Center Design

BUILDING A NEXT-GENERATION DATA CENTER

Use Cases for the NPS the Revolutionary C-Programmable 7-Layer Network Processor. Sandeep Shah Director, Systems Architecture EZchip

Optical interconnection networks for data centers

Definition of a White Box. Benefits of White Boxes

Data Center Network Evolution: Increase the Value of IT in Your Organization

Brocade Solution for EMC VSPEX Server Virtualization

Demonstrating the high performance and feature richness of the compact MX Series

Business Case for BTI Intelligent Cloud Connect for Content, Co-lo and Network Providers

The Software Defined Hybrid Packet Optical Datacenter Network SDN AT LIGHT SPEED TM CALIENT Technologies

OpenFlow Technology Investigation Vendors Review on OpenFlow implementation

Cloud-Based Apps Drive the Need for Frequency-Flexible Clock Generators in Converged Data Center Networks

TRILL for Service Provider Data Center and IXP. Francois Tallet, Cisco Systems

How To Understand The New Ethernet Switch Market

Datacenter Networks Are In My Way

Optimizing Data Center Networks for Cloud Computing

The Future of Cloud Networking. Idris T. Vasi

Towards Rack-scale Computing Challenges and Opportunities

Data Center Use Cases and Trends

Virtualized Converged Data Centers & Cloud how these trends are effecting Optical Networks

SDN and Data Center Networks

The Case Against Jumbo Frames. Richard A Steenbergen <ras@gtt.net> GTT Communications, Inc.

Pluribus Netvisor Solution Brief

STRUCTURE AND DESIGN OF SOFTWARE-DEFINED NETWORKS TEEMU KOPONEN NICIRA, VMWARE

Overview of Requirements and Applications for 40 Gigabit and 100 Gigabit Ethernet

VMDC 3.0 Design Overview

Software Defined Networks

SDN CONTROLLER. Emil Gągała. PLNOG, , Kraków

Why 25GE is the Best Choice for Data Centers

Optics Technology Trends in Data Centers

VxRACK : L HYPER-CONVERGENCE AVEC L EXPERIENCE VCE JEUDI 19 NOVEMBRE Jean-Baptiste ROBERJOT - VCE - Software Defined Specialist

Unified Computing Systems

White Paper. Juniper Networks. Enabling Businesses to Deploy Virtualized Data Center Environments. Copyright 2013, Juniper Networks, Inc.

When Does Colocation Become Competitive With The Public Cloud? WHITE PAPER SEPTEMBER 2014

When Does Colocation Become Competitive With The Public Cloud?

InfiniBand Switch System Family. Highest Levels of Scalability, Simplified Network Manageability, Maximum System Productivity

MPLS RSVP-TE Auto-Bandwidth: Practical Lessons Learned

How Solace Message Routers Reduce the Cost of IT Infrastructure

Large-Scale Distributed Systems. Datacenter Networks. COMP6511A Spring 2014 HKUST. Lin Gu

MPLS RSVP-TE Auto-Bandwidth: Practical Lessons Learned. Richard A Steenbergen <ras@gt-t.net>

Brocade SDN 2015 NFV

How Router Technology Shapes Inter-Cloud Computing Service Architecture for The Future Internet

Architecting Low Latency Cloud Networks

Cloud Networking: A Novel Network Approach for Cloud Computing Models CQ1 2009

Data Center Fabrics What Really Matters. Ivan Pepelnjak NIL Data Communications

CloudEngine Series Data Center Switches

L2-L7 BASED SERVICE REDIRECTION WITH SDN/OPENFLOW

CloudEngine Series Data Center Switches. Cloud Fabric Data Center Network Solution

SDN and Open Ethernet Switches Empower Modern Data Center Networks

THE ON-DEMAND DATA CENTER NETWORK TRANSFORMATION IN A CHANGING INDUSTRY. Ken Cheng, CTO, Brocade October, 2013

Broadcom Ethernet Network Controller Enhanced Virtualization Functionality

M.Sc. IT Semester III VIRTUALIZATION QUESTION BANK Unit 1 1. What is virtualization? Explain the five stage virtualization process. 2.

Network Virtualization and Application Delivery Using Software Defined Networking

Virtual Routing: What s The Goal? And What s Beyond? Peter Christy, NetsEdge Research Group, August 2001

ioscale: The Holy Grail for Hyperscale

Fibre Channel over Ethernet in the Data Center: An Introduction

datacenter networking

How To Switch A Layer 1 Matrix Switch On A Network On A Cloud (Network) On A Microsoft Network (Network On A Server) On An Openflow (Network-1) On The Network (Netscout) On Your Network (

VMware Virtual SAN 6.2 Network Design Guide

Software Defined Networking What is it, how does it work, and what is it good for?

Building Tomorrow s Data Center Network Today

Netvisor Software Defined Fabric Architecture

How To Buy A Crikit For A Fraction Of The Price

How Microsoft IT Developed a Private Cloud Infrastructure

Juniper Update Enabling New Network Architectures. Debbie Montano Chief Architect, Gov t, Edu & Medical dmontano@juniper.

Transform Your Business and Protect Your Cisco Nexus Investment While Adopting Cisco Application Centric Infrastructure

BROCADE NETWORKING: EXPLORING SOFTWARE-DEFINED NETWORK. Gustavo Barros Systems Engineer Brocade Brasil

The Rise of Optical Data Center Networks

SOFTWARE-DEFINED NETWORKS

Support a New Class of Applications with Cisco UCS M-Series Modular Servers

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Radware ADC-VX Solution. The Agility of Virtual; The Predictability of Physical

Testing Software Defined Network (SDN) For Data Center and Cloud VERYX TECHNOLOGIES

Panel: Cloud/SDN/NFV 黃 仁 竑 教 授 國 立 中 正 大 學 資 工 系 2015/12/26

Steve Worrall Systems Engineer.

Switching Architectures for Cloud Network Designs

Microsoft s Cloud Networks

Data Center Switch Fabric Competitive Analysis

Business Case for NFV/SDN Programmable Networks

Next Steps Toward 10 Gigabit Ethernet Top-of-Rack Networking

SDN Services at the Customer Edge

Intel Ethernet Switch Load Balancing System Design Using Advanced Features in Intel Ethernet Switch Family

RIDE THE SDN AND CLOUD WAVE WITH CONTRAIL

Software-Defined Wide Area Networking (SD-WAN) Software-Defined Wide Area Network: Does it hold the potential to disrupt MPLS VPNs?

Concepts Introduced in Chapter 6. Warehouse-Scale Computers. Important Design Factors for WSCs. Programming Models for WSCs

Enabling the Use of Data

WHITE PAPER. Data Center Fabrics. Why the Right Choice is so Important to Your Business

CloudEngine Series Data Center Switches. Cloud Fabric Data Center Network Solution

Transcription:

Help! My Big Expensive Router Is Really Expensive! 1

Panelists David Temkin, Netflix Craig Pierantozzi, Microsoft Richard Turkburgen, GTT Mark Berly, Arista Kevin Wollenweber, Cisco 2

Let me be clear 3

Netflix Background We began the Open Connect project approximately two years ago We are at 100% of our traffic served from the Open Connect platform We have 18 Terabits of network and server capacity located around the world 4

5

My network is very simple (drawing to scale) The Internet (You may have heard of it) Big, Expensive Router Server with content you ll complain to me about 6

Transit Peering Big Expensive Router ~5000 ports deployed Server Server Server 7

Enter SSD-based Open Connect Appliances.. In sites with 1+ Tbps of Netflix traffic at peak: 28 TB of storage per 1U system Commodity SSD (< 60c/GB, Micron m500) 2 TB in 2.5" form factor 4x 10 Gbps SFP+ NIC Total system power 150W per 1U 8

900Gbit/sec in another rack 9

This scale us unprecedented Our goal is to deliver 2Tbit from 2 clusters split across 6 racks 40 servers @ 2 ports each = 80 10G ports 60 servers @ 4 ports each = 240 10G ports Uplinks = 320 10G ports = 640 routed 10G ports (X2) 10

This is not optimal Routers are expensive List price of $10-15,000 per 10GE They do lots of things I don t need them to They do a few things I absolutely need them to I don t run a data center Little opportunity for aggregation I have a Layer 7 content routing engine How can I apply that to Layer 3 routing decisions? I make my own server hardware I can buy most of it at Fry s I don t want to make my own network hardware So now what? 11

What we do is pretty simple (the complexity is the scale) The Internet (You may have heard of it) Big, Expensive Router Server with content you ll complain to me about 12

So how do I bring this all together? Routers are terrible at making routing decisions We haven t improved the BGP path selection algorithm in 20 years Segment Routing gives me hope It s doubtful that anything comes along at the edge that factors actual path performance into the decision matrix anytime soon My control plane knows whether a path is performing well or poorly Most of my routing decisions are based on path performance, not path cost 13

Routers are really expensive My network cost is >50% of my server cost. I don t need MPLS I don t need Carrier Ethernet I don t need IPv6 (is anyone still paying attention to this presentation?) I don t need L3VPN I posit that I don t even need a full-scale FIB if I do this right 14

So, audience Your turn. What now? Content providers: You have to feel the same pain to some extent Please refrain from using acronyms and other buzzwords to describe your solution SDN Big Data The Cloud Big Data In the Cloud 15

Global Network Services, Microsoft Corporation

Microsoft Network AS8075 PR

Network Design: Topology 3-Stage Folded CLOS. Full bisection bandwidth (m n). WAN Router Horizontal Scaling (scale-out vs. scale-up) Service control plane managed workloads Viable with dense commodity hardware. Border Router Build large virtual boxes out of small components... Parallel Spines... AA01.. AA02 BB01 BB02 CC01.. CC02 DD01.. DD02 Leafs AA BB CC DD AA BB CC DD ToR Container 1 18 ToR Container n

Data Center Design: Requirements ~100 Spines ~200 Leafs ~2K ToR ~100K Applications: Map/Reduce: Social Media, Web Index and Targeted Advertising Public and Private Cloud Computing: Elastic Compute and Storage Real-Time Analytics: Low latency computing leveraging distributed memory across discrete nodes East ß à West traffic profile drives need for large bisectional 19 bandwidth

Data Center Trends Costs shifting over time from silicon to optics and cabling infrastructure Switching costs continue to decline with silicon economics but not reflected in large, feature-rich core routing devices Power and cooling on large network elements continues to be a major concern 20

What can we do Optimizations around service resiliency in software and not solely reliant on network resiliency End to end optimization of WAN, DC networks as well as server resources Equipment failure is an operating condition and software opportunity Removes requirements such as fast boot, graceful-restart etc. Increase scale at a lower cost Cheap label switching Lower cost, integrated WDM solutions Fewer or no protocols on the network elements Lower power consumption and trade off density/capacity Hardware ubiquity - Leverage same chipsets across network layers Smaller, stupider, cheaper. But not too small or too stupid.

Richard A Steenbergen <ras@gtt.net> GTT Communications, Inc. How To Make Big Expensive Routers Less Expensive (but probably still big) 22

Ethernet CAN BE Really Freaking Cheap Simple hardware is actually really, really cheap. Half of the planet now makes a Broadcom derived box. Now with 640Gbps+ in 1U for hundreds of dollars. 23

So Why Is My Expensive Router Still Expensive? So why does my MX960 blade cost a couple of orders of magnitude more than a 1U HP switch? It s not ALL about your router vendor trying to bilk you. Some of these are complex technical problems to solve. But then again, sometimes those complex technical problems never needed to exist in the first place. You probably want your big expensive router to do some fancy things that a small cheap router doesn t. But is that because it CAN T? Or is there some other reason that it doesn t? 24

Example: Core MPLS Switching Consider the case of Core MPLS switching. MPLS switching is actually really freaking easy in HW. This is one of the reasons it was invented in the first place. Simple exact-match lookups, very little state to maintain, very simple headers to parse, etc. In fact, most commodity hardware can do it today. So where is my cheap MPLS-only core platform? The Juniper PTX is barely any better than the Juniper MX. Why do I need a million-dollar core box to do something a thousanddollar box CAN do today? 25

Core MPLS Switching The answer: They don t have the software. It turns out MPLS is actually pretty complex in SW. Signaling, bandwidth reservations, fast reroute, etc. Only the incumbent router vendors actually understand it. Which is no surprise, considering they wrote it in the first place. And none of the guys who know how to make cheap hardware know the first thing about RSVP/LDP/etc. So why would Cisco/Juniper make a 1U MPLS core? They d only be cannibalizing from their own carrier biz. And they face no competition in this market segment. 26

SDN Big Data Cloud Hadoop!!!! 27

But Before We Fire Up The Hype Machine Software Defined Networking? I ve been using software to define my network for years. If you don t, you must have a lot of unmanaged switches. Is SDN just another FAD? As Avi would say, Funding Augmentation Device. Or is there actually a ray of hope in there somewhere? But First What did you actually spend your money on? 28

Some Fundamental Truths 29

Blowing Your Mind Without CDP or MAC Addresses So what did you just spend all that money on? If the hardware needed to forward 1.21 jiggabits is actually commodity That means what you re actually buying is software. Software is hard. Routing protocols, CLIs, network management platforms, and feature after feature after feature after feature Software is what you re actually buying. The hardware is just a delivery vehicle, so you don t feel so bad for spending millions on invisible electrons. But the software is what you actually care about. 30

So Why Do We Care About SDN? It turns out that some people are good at one thing but not another (try not to act shocked). Commodity silicon manufacturers can produce hardware that forwards untold numbers of packets for pennies, but they can t write routing protocols or CLIs. Somewhere, there exists people who know how to write routing protocols, but who can t fab an ASIC. SDN is about the threat of getting these two groups of people together in a way that isn t an incumbent router vendor. 31

Take My Money!!! So is there an SDN product out that that will revolutionize anything? If it exists, I haven t seen it yet. But as a concept, SDN has a lot of merit. And maybe some day soon, your big expensive router will be a little bit less expensive. 32

Send questions, comments, complaints to: Richard A Steenbergen <ras@gtt.net> 33

BW vs PPS FIB Scale Queuing Buffering Volume/GB Electronics Optics Time

Silicon capability has grown more rapidly than the decrease of power usage. This creates a paradigm where unit power decreases, but total power increases. Because bandwidth in exploding, although the silicon is faster and consumes less power, we use more of it which increases the overall power consumption of devices.

The increase of fan trays at 50 C represents a significant shift in the amount of power draw from the line card power.

CRS-1(2004) Cooling 15% NCS 6008 (50C) Cooling 13% Linecards 50% Power eff. 15% Power eff. 8% RP 2% Fabric 6% RP 5% Linecards 71% Fabric 15% Total ~12KW at 50C Total ~13.4KW at 50C

Functionality and Optimization High-scale, multiservice IPv4/IPv6/MPLS forwarding LSR for label switching Integrated Ethernet MACs and OTN framers Advanced Memory Management System ZPL/ZTL smart support Flexibility Fully programmable with 336 on-chip multi-threaded packet processors Support for a wide range of Ethernet interfaces (10 GE, 40 GE, 100 GE) Integration and Low Power Consumption High integration (MAC, NPUs, OTN) provides low power consumption and reduced footprint 4 Billion Transistors

$ 1000 100 $ 10 $ 1$ 0.1$ 0.01$ Time/Performance/Level of Integration Electrical Ics Moore s Law Traditional Optical Solutions Optics ~25 years behind Electronics level of integration, manufacturability etc & Gap is widening due to orders of magnitude larger investment in infra-structure 39

Si Photonics for Efficient Integration Switch Fabric or Multicore CPU die RX/TX & SERDES Only 1 full duplex SERDES required Fiber array connector Optical I/O Die Interposer Substrate 3D stacking of Optoelectronics ICs with passive alignment to external WGs

optics NPU ASIC Fabric Interface ASIC Optical integration optics Elec Opt. Silicon integration NPU + Fabric ASIC All 4 are independent and being investigated optics optics optics NPU ASIC NPU ASIC NPU ASIC NPU ASIC Fabric ASIC NPU Fabric ASIC Fabric ASIC NPU ASIC