Chapter 6. Paper Study: Data Center Networking
|
|
- Sherman Green
- 8 years ago
- Views:
Transcription
1 Chapter 6 Paper Study: Data Center Networking 1
2 Data Center Networks Major theme: What are new networking issues posed by large-scale data centers? Network Architecture? Topology design? Addressing? Routing? Forwarding? Please do the required readings! 2
3 Data Center Interconnection Structure Nodes in the system: racks of servers How are the nodes (racks) inter-connected? Typically a hierarchical inter-connection structure Today s typical data center structure Cisco recommended data center structure Starting from the bottom level Rack switches 1-2 layers of (layer-2) aggregation switches Access routers Core routers Is such an architecture good enough? 3
4 Cisco Recommended Data Center Structure Internet Data Center Layer 3 Internet CR CR AR AR AR AR aggregation Layer 2 LB S S LB S S S S Key: CR = L3 Core Router AR = L3 Access Router S = L2 Switch LB = Load Balancer A = Rack of 20 servers with Top of Rack switch 4
5 Data Center Design Requirements Data centers typically run two types of applications Outward facing (e.g., serving web pages to users) Internal computations (e.g., MapReduce for web indexing) Workloads often unpredictable: Multiple services run concurrently within a DC Demand for new services is unexpected Failures of servers are the norm Recall that GFS, MapReduce, etc., resort to dynamic reassignment of chunkservers, jobs/tasks (worker servers) to deal with failures; data is often replicated across racks, Traffic matrix between servers are constantly changing 5
6 Data Center Costs Amortized Cost* Component Sub-Components ~45% Servers CPU, memory, disk ~25% Power infrastructure UPS, cooling, power distribution ~15% Power draw Electrical utility costs ~15% Network Switches, links, transit *3 yr amortization for servers, 15 yr for infrastructure; 5% cost of money Total cost varies Power consumption in data center Server costs dominate Network costs significant Long provisioning timescales: New servers purchased quarterly at best Source: The Cost of a Cloud: Research Problems in Data Center Networks, Sigcomm CCR Greenberg, Hamilton, Maltz, Patel. 6
7 Overall Data Center Design Goal Agility Any service, Any Server Turn the servers into a single large fungible pool Let services breathe : dynamically expand and contract their footprint as needed Benefits This is done in terms of Google s GFS (Google File System), BigTable, MapReduce. Increase service developer productivity Lower cost Achieve high performance and reliability 7
8 Achieving Agility These are the three motivators for most data center infrastructure projects! 1. Workload Management Means for rapidly installing a service s code on a server Dynamical cluster scheduling and server assignment E.g., MapReduce, Bigtable, Virtual machines, disk images 2. Storage Management Means for a server to access persistent data Distributed file systems (e.g., GFS) 3. Network Management 8 Means for communicating with other servers, regardless of where they are in the data center Achieve high performance and reliability
9 Networking Objectives 1. Uniform high capacity Capacity between servers limited only by their NICs No need to consider topology when adding servers High capacity between two any servers no matter which racks they are located! 2. Performance isolation Traffic of one service should be unaffected by others 3. Ease of management: Plug-&-Play (layer-2 semantics) Flat addressing, so any server should have IP address Server configuration is the same as in a LAN Legacy applications depending on broadcast must work 9
10 10 Is Today s DC Architecture Adequate? Hierarchical network; 1+1 redundancy Components of higher DC architecture have capacity to handle more traffic More expensive, more efforts made at availability scale-up design Servers connect via 1 Gbps link to Top-of-Rack switches Other links are mix of 1G, 10G; fiber, copper Uniform high capacity? Performance isolation? Typically via VLANs Agility in terms of dynamically adding or shrinking servers? Agility in terms of adapting to failures, and to traffic dynamics? Ease of management? Internet Data Center Layer 3 Layer 2 S LB Internet CR CR AR AR AR AR S S S S LB S Key: CR = L3 Core Router AR = L3 Access Router S = L2 Switch LB = Load Balancer A = Top of Rack switch
11 Papers Study 1. A Scalable, Commodity Data Center Network Architecture A new Fat-tree inter-connection structure (topology) to increases bi-section bandwidth Needs new addressing, forwarding/routing 2. VL2: A Scalable and Flexible Data Center Network Consolidate layer-2/layer-3 into a virtual layer 2 Separating naming and addressing, also deal with dynamic load-balancing issues Optional Materials PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric BCube: A High-Performance, Server-centric Network Architecture for Modular Data Centers 11
12 A Scalable, Commodity Data Center Network Architecture Main Goal: addressing the limitations of today s data center network architecture To avoid the failure of single link or point To provide oversubscription of links in the topology Trade-offs between cost and providing Key Design Considerations/Goals Allows host communication at line speed No matter where they are located! Backwards compatible with existing infrastructure No changes in application & support of layer 2 (Ethernet) Cost effective Cheap infrastructure Low power consumption & heat dissemination M. Al-Fares, A. Loukissas, and A. Vahdat, A scalable,commodity data center network architecture, In Proceedings of the ACM SIGCOMM 2008 conference on Data communication, pages 63 74, 2008.
13 Fat-Tree Based DC Architecture Inter-connect racks (of servers) using a fat-tree topology Fat-Tree: a special type of Clos Networks K-ary fat tree: three-layer topology (edge, aggregation, and core) Each pod consists of (k/2) 2 servers and 2 layers of k/2 k-port switches Each edge switch connects to k/2 servers and k/2 aggr. switches Each aggr. switch connects to k/2 edge and k/2 core switches (k/2) 2 core switches: each connects to k pods Fat-tree with K=4 13
14 Why Fat-Tree? Fat-Tree Based Topology Fat tree has identical bandwidth at any bisections Each layer has the same aggregated bandwidth Can be built using cheap devices with uniform capacity Each port supports same speed as end host All devices can transmit at line speed if packets are distributed uniform along available paths Great scalability: k-port switch supports k 3 /4 servers Fat tree network with K = 3 supporting 54 hosts 14
15 Cost of Maintaining Switches 1G Switch 10G Switch 15
16 Fat-tree Topology is Great, But Does using fat-tree topology to inter-connect racks of servers in itself sufficient? What routing protocols should we run on these switches? Layer 2 switch algorithm: data plane flooding! Layer 3 IP routing: shortest path IP routing will typically use only one path despite the path diversity in the topology if using equal-cost multi-path routing at each switch independently and blindly, packet reordering may occur; further load may not necessarily be well-balanced Aside: control plane flooding! 16
17 FAT-Tree Modified Enforce a special (IP) addressing scheme in DC unused.podnumber.switchnumber.endhost Allows host attached to same switch to route only through switch Allows inter-pod traffic to stay within pod Use two level look-ups to distribute traffic and maintain packet ordering First level is prefix lookup Second level is a suffix lookup 17
18 More on Fat-Tree DC Architecture Diffusion Optimizations Flow classification Eliminates local congestion Assign to traffic to ports on a per-flow basis instead of a per-host basis Flow scheduling Eliminates global congestion Prevent long lived flows sharing the same links Assign long lived flows to different links What are potential drawbacks of this architecture? 18
19 VL2: A Scalable and Flexible Data Center Network Main Goal: support agility & be cost-effective A virtual (logical) layer 2 architecture for connecting racks of servers (network as a big virtual switch ) Employs a 3-level Clos topology (full-mesh in top-2 levels) with non-uniform switch capacities Also provides identity and location separation application-specific vs. location-specific addresses Employs a directory service for name resolution Needs a direct host participation Explicitly accounts for DC traffic matrix dynamics Employs the Valiant load-balancing (VLB) technique Using randomization to cope with volatility A. Greenberg, J. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. Maltz, P. Patel, and S. Sengupta, Vl2: A scalable and flexible data center network, 19 In Proceedings of the ACM SIGCOMM 2009 conference on Data communication, pages 51 62, 2009.
20 Clos network Clos network is a kind of multistage circuit switching network. Charles Clos proposed in 1953 It represents a theoretical idealization of practical multistage telephone switching systems. Clos networks are required when the physical circuit switching needs exceed the capacity of the largest feasible single crossbar switch. The key advantage of Clos networks is that the number of crosspoints (which make up each crossbar switch) required can be much fewer than were the entire switching system implemented with one large crossbar switch. 20
21 Clos network Clos networks have three stages: the ingress stage, middle stage, and egress stage. Each stage is made up of a number of crossbar switches (see diagram below), often just called crossbars. Each call entering an ingress crossbar switch can be routed through any of the available middle stage crossbar switches, to the relevant egress crossbar switch. A middle stage crossbar is available for a particular new call if both the link connecting the ingress switch to the middle stage switch. the link connecting the middle stage switch to the egress switch, are free. 21
22 Clos network Clos networks are defined by three integers n, m, and r. n represents the number of sources which feed into each of r ingress stage crossbar switches. Each ingress stage crossbar switch has m outlets, and there are m middle stage crossbar switches. 22
23 Bidirectional Paths
24 Routing in Bidirectional Paths Networks are multi-path Routing takes place in two steps: route to an intermediate node followed by routing to destination 1. Multiple intermediate nodes can be selected 2. Path from intermediate node to destination is unique
25 Moving to Fat Trees Folded Clos = Folded Benes = Fat tree network Nodes at tree leaves Network Bisection Switches at tree vertices Total link bandwidth is constant across all tree levels, with full bisection bandwidth Equivalent to folded Benes topology Preferred topology in many system area networks T.M. Pinkston, J. Duato, with major contributions by J. Filch
26 Fat Trees: Another View Forward Backward Equivalent to the preceding multistage implementation Common topology in many supercomputer installations
27 27 Specific Objectives and Solutions
28 Scale-out vs. Scale-up VL2 Topology Design Argue for and exploit the gap in switch-to-switch capacity vs. switch-to-server capacities current: 10Gbps vs. 1Gbps future: 40 Gpbs vs. 10 Gbps A scale-out design with broad layers 28 E.g., a 3-level Clos topology with full-mesh in top-2 levels ToR switches, aggregation switches, & core (intermediate) switches Less wiring complexity, and more path diversity Same bisection capacity at each layer No oversubscription Extensive path diversity Graceful degradation under failure
29 29 VL2 Topology: Example
30 Addressing and routing Address resolution and Packet forwarding LA (location-specific IP address) Assigned IP for all switches and interfaces. Forward any packets encapsulated with LAs along the shortest path. AA (application-specific IP address) Associated with an LA. ToR switch s IP to which app. server is connected.
31 Addressing and routing(cont.) Packet forwarding step Server receive sender s packet to encapsulate. Setting the dest. of the outer header to the LA of the dest. AA. Once the packet arrives at the LA. Dest. switch decapsulates the packet and delivers to dest. AA. Address resolution and access control When first time to send, the host generate ARP request for AA. Source s network stack intercepts ARP request and converts it to a unicast query to directory server (DS).
32 Address Resolution and Packet Forwarding
33 Addressing and Routing: Name-Location Separation Cope with host churns with very little overhead Allows to use low-cost switches Protects network and hosts from host-state churn Obviates host and switch reconfiguration Switches run link-state routing and maintain only switch-level topology ToR 1 ToR 2 ToR 3 ToR 4 Directory Service x ToR 2 y ToR 3 z ToR 43 ToR 3 ToR 43 y z payload payload x y, y z z Lookup & Response 33 Servers use flat names
34 Maintain host information using DS DS provides 2 key functions 1. Lookups and update for AA-to-LA mapping. 2. A reactive cache update mechanism that ensures eventual consistency of the mapping with very litter update overhead. The differ performance in DS architecture Read-optimized Replicated lookup server that cache AA-to-LA mapping and communicated with agents. Write-optimized Asynchronous replicated state machine (RSM) server offering a strongly consistent, reliable store of AA-to-LA mapping.
35 Directory System Replicated state machine (RSM): Offer a strongly consistent, reliable store of AA-to-LA mapping
36 D/2 ports D/2 ports Use Randomization to Cope with D ports 10G D switches 20 ports [D 2 /4] * 20 Servers D/2 switches Valiant Load Balancing Volatility Top Of Rack switch Intermediate node switches in VLB Aggregation switches Every flow bounced off a random intermediate switch Provable hotspot free for any admissible traffic matrix Servers could randomize flow-lets if needed Node degree (D) of available switches & # servers supported D # Servers in pool , , ,680
37 VL2 Summary VL2 achieves agility at scale via 1. L2 semantics 2. Uniform high capacity between servers 3. Performance isolation between services Lessons Randomization can tame volatility Add functionality where you have control There s no need to wait! 38
38 Additional Case Studies Optional Material PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric Main idea: new hierarchical addressing scheme to facilitate dynamic and fault-tolerant routing/forwarding 39 R. Niranjan Mysore, A. Pamboris, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, V. Subramanya, and A. Vahdat, Portland: a scalable fault-tolerant layer 2 data center network fabric, In Proceedings of the ACM SIGCOMM 2009 conference on Data communication, pages 39 50, 2009
39 PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric PortLand is a single logical layer 2 data center network fabric that scales to millions of endpoints PortLand internally separates host identity from host location uses IP address as host identifier introduces Pseudo MAC (PMAC) addresses internally to encode endpoint location PortLand runs on commodity switch hardware with unmodified hosts 40
40 PortLand Requirements Any VM may migrate to any physical machine. Migrating VMs should not have to change their IP addresses. However, this action will break pre-existing TCP connections and application-level state. An administrator should not need to configure any switch before deployment. Any end host should be able to efficiently communicate with any other end host in the data center along any of the available physical communication paths. There should be no forwarding loops. Failures will be common at scale, so failure detection should be rapid and efficient. Existing unicast and multicast sessions should proceed unaffected to the extent allowed by underlying physical connectivity. 41
41 Design Goals for Network Fabric Support for Agility! Easy configuration and management: plug-&-play Fault tolerance, routing and addressing: scalability Commodity switch hardware: small switch state Virtualization support: seamless VM migration What are the limitations of current layer-2 and layer-3? layer-2 (Ethernet w/ flat-addressing) vs. layer-3 (IP w/ prefix-based addressing): 42 plug-&-play? scalability? small switch state? seamless VM migration?
42 PortLand Solution Assuming: a Fat-tree network topology for DC Introduce pseudo MAC addresses to balance the pros and cons of flat- vs. topology-dependent addressing PMACs are topology-dependent hierarchical addresses Only used host locators, not host identities IP addresses used as host identities (for compatibility w/ apps) Pros: Small switch state & Seamless VM migration Eliminate flooding in both data & control planes But requires a IP-to-PMAC mapping and name resolution A location directory service A location discovery protocol & fabric manager For support of plug-&-play 43
43 PMAC Addressing Scheme PMAC (48 bits): pod.position.port.vmid Pod: 16 bits; position and port (8 bits); vmid: 16 bits Assign only to servers (end-hosts) by switches pod position 44
44 Location Discovery Protocol Location Discovery Messages (LDMs) exchanged between neighboring switches LDMS contain the following information: switch identifier, pod number, position, tree level and up/down. 45
45 46 PortLand: Name Resolution Edge switch listens to end hosts, and discover new source MACs Installs <IP, PMAC> mappings, and informs fabric manager 1 2 3
46 PortLand: Name Resolution 1. Edge switch intercepts ARP messages from end hosts 2. Send request to fabric manager, which replies with PMAC 47
47 PortLand: Fabric Manager Fabric Manager: logically centralized, multi-homed server Maintains topology and <IP,PMAC> mappings in soft state 48
48 Loop-free Forwarding and Fault-Tolerant Routing Switches build forwarding tables based on their position Include edge, aggregation, and core switches Use strict up-down semantics to ensure loop-free forwarding Load-balancing: use any equal-cost multipath routing (ECMP) path via flow hashing to ensure packet ordering Fault-tolerant routing: Mostly concerned with detecting failures Fabric manager maintains logical fault matrix with per-link connectivity info to inform affected switches Affected switches re-compute forwarding tables 49
49 Fault-Tolerant Routing 1. Upon not receiving an LDM (also referred to as a keepalive in this context) for some configurable period of time, a switch assumes a link failure. 1. A keepalive (KA) is a message sent by one device to another to check that the link between the two is operating, or to prevent this link from being broken 2. The detecting switch informs the fabric manager about the failure. 50
50 Fault-Tolerant Routing 3. The fabric manager maintains a logical fault matrix with per-link connectivity information for the entire topology and updates it with the new information. 4. The fabric manager informs all affected switches of the failure, which then individually recalculate their forwarding tables based on the new version of the topology. 51
51 Multicast: Fault detection and action There are one sender (pod 1) and three receivers, spread across pods 0 and 1. A sender forwards packets to the designated core, which in turn distributes the packets to the receivers. In step 1, two highlighted links in pod 0 simultaneously fail. 52
52 Multicast: Fault detection and action Two aggregation switches detect the failure in step 2 and notify the fabric manager, which in turn updates its fault matrix in step 3. The fabric manager calculates forwarding entries for all affected multicast groups in step 4. 53
53 BCube: A High-Performance, Server-centric Network Architecture for Modular Data Centers Main Goal: network architecture for shippingcontainer based modular data centers Designed for shipping-container modular DC BCube construction: level structure BCube k recursively constructed from BCube 1 Server-centric: Servers perform routing and forwarding Consider a variety of communication patterns one-to-one, one-to-many, one-to-all, all-to-all single path and multi-path routing (Will not discuss in details; please read the paper!) 54
54 Bcube construction (Bcube k,n) switch server n : sever number K : level
55 Bcube 1
56 Speedup for One-to-all Traffic In one-to-all, a source server delivers a file to all the other servers. It is easy to see that under tree and fat-tree, the time for all the receivers to receive the file is at least L. A source can deliver a file of size L to all the other servers in L /k+1 time in a BCube k. Constructing k+1 edge-disjoint server spanning trees from the k + 1 neighbors of the source. 57
57 58 One-to-All Traffic Forwarding Using a spanning tree Speed-up: L/(k+1) for a file of size L Two-edge disjoint (server) spanning trees in BCube 1 for one-to-traffic
Data Center Network Topologies: FatTree
Data Center Network Topologies: FatTree Hakim Weatherspoon Assistant Professor, Dept of Computer Science CS 5413: High Performance Systems and Networking September 22, 2014 Slides used and adapted judiciously
More informationData Center Networking
Malathi Veeraraghavan Charles L. Brown Dept. of Elec. & Comp. Engr. University of Virginia Charlottesville, VA 22904-4743, USA mvee@virginia.edu http://www.ece.virginia.edu/mv Jogesh K. Muppala Dept. of
More informationAdvanced Computer Networks. Datacenter Network Fabric
Advanced Computer Networks 263 3501 00 Datacenter Network Fabric Patrick Stuedi Spring Semester 2014 Oriana Riva, Department of Computer Science ETH Zürich 1 Outline Last week Today Supercomputer networking
More informationLecture 7: Data Center Networks"
Lecture 7: Data Center Networks" CSE 222A: Computer Communication Networks Alex C. Snoeren Thanks: Nick Feamster Lecture 7 Overview" Project discussion Data Centers overview Fat Tree paper discussion CSE
More informationData Center Network Topologies: VL2 (Virtual Layer 2)
Data Center Network Topologies: VL2 (Virtual Layer 2) Hakim Weatherspoon Assistant Professor, Dept of Computer cience C 5413: High Performance ystems and Networking eptember 26, 2014 lides used and adapted
More informationLoad Balancing Mechanisms in Data Center Networks
Load Balancing Mechanisms in Data Center Networks Santosh Mahapatra Xin Yuan Department of Computer Science, Florida State University, Tallahassee, FL 33 {mahapatr,xyuan}@cs.fsu.edu Abstract We consider
More informationPortland: how to use the topology feature of the datacenter network to scale routing and forwarding
LECTURE 15: DATACENTER NETWORK: TOPOLOGY AND ROUTING Xiaowei Yang 1 OVERVIEW Portland: how to use the topology feature of the datacenter network to scale routing and forwarding ElasticTree: topology control
More informationRadhika Niranjan Mysore, Andreas Pamboris, Nathan Farrington, Nelson Huang, Pardis Miri, Sivasankar Radhakrishnan, Vikram Subramanya and Amin Vahdat
Radhika Niranjan Mysore, Andreas Pamboris, Nathan Farrington, Nelson Huang, Pardis Miri, Sivasankar Radhakrishnan, Vikram Subramanya and Amin Vahdat 1 PortLand In A Nutshell PortLand is a single logical
More informationPortLand:! A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric
PortLand:! A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric Radhika Niranjan Mysore, Andreas Pamboris, Nathan Farrington, Nelson Huang, Pardis Miri, Sivasankar Radhakrishnan, Vikram Subramanya,
More informationData Center Network Architectures
Servers Servers Servers Data Center Network Architectures Juha Salo Aalto University School of Science and Technology juha.salo@aalto.fi Abstract Data centers have become increasingly essential part of
More informationOutline. VL2: A Scalable and Flexible Data Center Network. Problem. Introduction 11/26/2012
VL2: A Scalable and Flexible Data Center Network 15744: Computer Networks, Fall 2012 Presented by Naveen Chekuri Outline Introduction Solution Approach Design Decisions Addressing and Routing Evaluation
More informationScale and Efficiency in Data Center Networks
Scale and Efficiency in Data Center Networks Amin Vahdat Computer Science and Engineering Center for Networked Systems UC San Diego vahdat@cs.ucsd.edu UC San Diego Center for Networked Systems Member Companies
More informationApplying NOX to the Datacenter
Applying NOX to the Datacenter Arsalan Tavakoli UC Berkeley Martin Casado and Teemu Koponen Nicira Networks Scott Shenker UC Berkeley, ICSI 1 Introduction Internet datacenters offer unprecedented computing
More informationOpenFlow based Load Balancing for Fat-Tree Networks with Multipath Support
OpenFlow based Load Balancing for Fat-Tree Networks with Multipath Support Yu Li and Deng Pan Florida International University Miami, FL Abstract Data center networks are designed for satisfying the data
More informationAIN: A Blueprint for an All-IP Data Center Network
AIN: A Blueprint for an All-IP Data Center Network Vasileios Pappas Hani Jamjoom Dan Williams IBM T. J. Watson Research Center, Yorktown Heights, NY Abstract With both Ethernet and IP powering Data Center
More informationData Center Networks
Data Center Networks (Lecture #3) 1/04/2010 Professor H. T. Kung Harvard School of Engineering and Applied Sciences Copyright 2010 by H. T. Kung Main References Three Approaches VL2: A Scalable and Flexible
More informationData Center Challenges Building Networks for Agility
Data Center Challenges Building Networks for Agility reenivas Addagatla, Albert Greenberg, James Hamilton, Navendu Jain, rikanth Kandula, Changhoon Kim, Parantap Lahiri, David A. Maltz, Parveen Patel udipta
More informationTRILL Large Layer 2 Network Solution
TRILL Large Layer 2 Network Solution Contents 1 Network Architecture Requirements of Data Centers in the Cloud Computing Era... 3 2 TRILL Characteristics... 5 3 Huawei TRILL-based Large Layer 2 Network
More informationOVERLAYING VIRTUALIZED LAYER 2 NETWORKS OVER LAYER 3 NETWORKS
OVERLAYING VIRTUALIZED LAYER 2 NETWORKS OVER LAYER 3 NETWORKS Matt Eclavea (meclavea@brocade.com) Senior Solutions Architect, Brocade Communications Inc. Jim Allen (jallen@llnw.com) Senior Architect, Limelight
More informationPortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric
PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Radhika Niranjan Mysore, Andreas Pamboris, Nathan Farrington, Nelson Huang, Pardis Miri, Sivasankar Radhakrishnan, Vikram Subramanya, and
More informationIEEE COMMUNICATIONS SURVEYS & TUTORIALS, VOL. 15, NO. 1, FIRST QUARTER 2013 39
IEEE COMMUNICATIONS SURVEYS & TUTORIALS, VOL. 15, NO. 1, FIRST QUARTER 2013 39 On Architecture Design, Congestion Notification, TCP Incast and Power Consumption in Data Centers Yan Zhang, Student Member,
More informationCIT 668: System Architecture
CIT 668: System Architecture Data Centers II Topics 1. Containers 2. Data Center Network 3. Reliability 4. Economics Containers 1 Containers Data Center in a shipping container. 4-10X normal data center
More informationDATA center infrastructure design has recently been receiving
1 A Survey of Data Center Network Architectures Yang Liu, Jogesh K. Muppala, Senior Member, IEEE, Malathi Veeraraghavan, Senior Member, IEEE Abstract Large-scale data centers form the core infrastructure
More informationTRILL for Service Provider Data Center and IXP. Francois Tallet, Cisco Systems
for Service Provider Data Center and IXP Francois Tallet, Cisco Systems 1 : Transparent Interconnection of Lots of Links overview How works designs Conclusion 2 IETF standard for Layer 2 multipathing Driven
More informationAxon: A Flexible Substrate for Source- routed Ethernet. Jeffrey Shafer Brent Stephens Michael Foss Sco6 Rixner Alan L. Cox
Axon: A Flexible Substrate for Source- routed Ethernet Jeffrey Shafer Brent Stephens Michael Foss Sco6 Rixner Alan L. Cox 2 Ethernet Tradeoffs Strengths Weaknesses Cheap Simple High data rate Ubiquitous
More informationTorii-HLMAC: Torii-HLMAC: Fat Tree Data Center Architecture Elisa Rojas elisa.rojas@uah.es University of Alcala (Spain)
Torii-HLMAC: Torii-HLMAC: Fat Tree Data Center Architecture Elisa Rojas elisa.rojas@uah.es University of Alcala (Spain) April 2013 1 Outline Introduction Protocol description Tree-based Multiple Addresses
More informationLarge-Scale Distributed Systems. Datacenter Networks. COMP6511A Spring 2014 HKUST. Lin Gu lingu@ieee.org
Large-Scale Distributed Systems Datacenter Networks COMP6511A Spring 2014 HKUST Lin Gu lingu@ieee.org Datacenter Networking Major Components of a Datacenter Computing hardware (equipment racks) Power supply
More informationAlbert Greenberg Principal Researcher albert@microsoft.com
Networking The Cloud Albert Greenberg Principal Researcher albert@microsoft.com (work with James Hamilton, rikanth Kandula, Dave Maltz, Parveen Patel, udipta engupta, Changhoon Kim) Agenda Data Center
More informationInternational Journal of Emerging Technology in Computer Science & Electronics (IJETCSE) ISSN: 0976-1353 Volume 8 Issue 1 APRIL 2014.
IMPROVING LINK UTILIZATION IN DATA CENTER NETWORK USING NEAR OPTIMAL TRAFFIC ENGINEERING TECHNIQUES L. Priyadharshini 1, S. Rajanarayanan, M.E (Ph.D) 2 1 Final Year M.E-CSE, 2 Assistant Professor 1&2 Selvam
More informationTRILL for Data Center Networks
24.05.13 TRILL for Data Center Networks www.huawei.com enterprise.huawei.com Davis Wu Deputy Director of Switzerland Enterprise Group E-mail: wuhuajun@huawei.com Tel: 0041-798658759 Agenda 1 TRILL Overview
More informationA Reliability Analysis of Datacenter Topologies
A Reliability Analysis of Datacenter Topologies Rodrigo S. Couto, Miguel Elias M. Campista, and Luís Henrique M. K. Costa Universidade Federal do Rio de Janeiro - PEE/COPPE/GTA - DEL/POLI Email:{souza,miguel,luish}@gta.ufrj.br
More informationNetwork Virtualization and Data Center Networks 263-3825-00 Data Center Virtualization - Basics. Qin Yin Fall Semester 2013
Network Virtualization and Data Center Networks 263-3825-00 Data Center Virtualization - Basics Qin Yin Fall Semester 2013 1 Walmart s Data Center 2 Amadeus Data Center 3 Google s Data Center 4 Data Center
More informationScaling 10Gb/s Clustering at Wire-Speed
Scaling 10Gb/s Clustering at Wire-Speed InfiniBand offers cost-effective wire-speed scaling with deterministic performance Mellanox Technologies Inc. 2900 Stender Way, Santa Clara, CA 95054 Tel: 408-970-3400
More informationVMDC 3.0 Design Overview
CHAPTER 2 The Virtual Multiservice Data Center architecture is based on foundation principles of design in modularity, high availability, differentiated service support, secure multi-tenancy, and automated
More informationEnabling Flow-based Routing Control in Data Center Networks using Probe and ECMP
IEEE INFOCOM 2011 Workshop on Cloud Computing Enabling Flow-based Routing Control in Data Center Networks using Probe and ECMP Kang Xi, Yulei Liu and H. Jonathan Chao Polytechnic Institute of New York
More informationPortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric
PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Radhika Niranjan Mysore, Andreas Pamboris, Nathan Farrington, Nelson Huang, Pardis Miri, Sivasankar Radhakrishnan, Vikram Subramanya, and
More informationResolving Packet Loss in a Computer Centre Applications
International Journal of Computer Applications (975 8887) olume 74 No., July 3 Resolving Packet Loss in a Computer Centre Applications M. Rajalakshmi C.Angel K. M. Brindha Shree ABSTRACT The modern data
More informationChapter 3. Enterprise Campus Network Design
Chapter 3 Enterprise Campus Network Design 1 Overview The network foundation hosting these technologies for an emerging enterprise should be efficient, highly available, scalable, and manageable. This
More informationEvaluating the Impact of Data Center Network Architectures on Application Performance in Virtualized Environments
Evaluating the Impact of Data Center Network Architectures on Application Performance in Virtualized Environments Yueping Zhang NEC Labs America, Inc. Princeton, NJ 854, USA Email: yueping@nec-labs.com
More informationProActive Routing in Scalable Data Centers with PARIS
ProActive Routing in Scalable Data Centers with PARIS Dushyant Arora Arista Networks dushyant@arista.com Theophilus Benson Duke University tbenson@cs.duke.edu Jennifer Rexford Princeton University jrex@cs.princeton.edu
More informationEthernet-based Software Defined Network (SDN) Cloud Computing Research Center for Mobile Applications (CCMA), ITRI 雲 端 運 算 行 動 應 用 研 究 中 心
Ethernet-based Software Defined Network (SDN) Cloud Computing Research Center for Mobile Applications (CCMA), ITRI 雲 端 運 算 行 動 應 用 研 究 中 心 1 SDN Introduction Decoupling of control plane from data plane
More informationDatacenter Networks Are In My Way
Datacenter Networks Are In My Way Principals of Amazon James Hamilton, 2010.10.28 e: James@amazon.com blog: perspectives.mvdirona.com With Albert Greenberg, Srikanth Kandula, Dave Maltz, Parveen Patel,
More informationNetwork Technologies for Next-generation Data Centers
Network Technologies for Next-generation Data Centers SDN-VE: Software Defined Networking for Virtual Environment Rami Cohen, IBM Haifa Research Lab September 2013 Data Center Network Defining and deploying
More informationData Center Network Virtualization: A Survey
1 Data Center Network Virtualization: A Survey Md. Faizul Bari, Raouf Boutaba, Rafael Esteves, Lisandro Zambenedetti Granville, Maxim Podlesny, Md. Golam Rabbani, Qi Zhang, Mohamed Faten Zhani D.R. Cheriton
More informationData Center Challenges Building Networks for Agility
Data Center Challenges Building Networks for Agility reenivas Addagatla, Albert Greenberg, James Hamilton, Navendu Jain, rikanth Kandula, Changhoon Kim, Parantap Lahiri, David A. Maltz, Parveen Patel udipta
More informationA previous version of this paper was published in the Proceedings of SIGCOMM 09 (Barcelona, Spain, Aug. 17 21, 2009). ACM, New York.
VL2: A Scalable and Flexible Data Center Network By Albert Greenberg, James R. Hamilton, Navendu Jain, Srikanth Kandula, Changhoon Kim, Parantap Lahiri, David A. Maltz, Parveen Patel, and Sudipta Sengupta
More informationA Hybrid Electrical and Optical Networking Topology of Data Center for Big Data Network
ASEE 2014 Zone I Conference, April 3-5, 2014, University of Bridgeport, Bridgpeort, CT, USA A Hybrid Electrical and Optical Networking Topology of Data Center for Big Data Network Mohammad Naimur Rahman
More informationVirtual PortChannels: Building Networks without Spanning Tree Protocol
. White Paper Virtual PortChannels: Building Networks without Spanning Tree Protocol What You Will Learn This document provides an in-depth look at Cisco's virtual PortChannel (vpc) technology, as developed
More informationSummitStack in the Data Center
SummitStack in the Data Center Abstract: This white paper describes the challenges in the virtualized server environment and the solution Extreme Networks offers a highly virtualized, centrally manageable
More informationEthernet Fabrics: An Architecture for Cloud Networking
WHITE PAPER www.brocade.com Data Center Ethernet Fabrics: An Architecture for Cloud Networking As data centers evolve to a world where information and applications can move anywhere in the cloud, classic
More informationAdaptive Routing for Layer-2 Load Balancing in Data Center Networks
Adaptive Routing for Layer-2 Load Balancing in Data Center Networks Renuga Kanagavelu, 2 Bu-Sung Lee, Francis, 3 Vasanth Ragavendran, Khin Mi Mi Aung,* Corresponding Author Data Storage Institute, Singapore.E-mail:
More informationNon-blocking Switching in the Cloud Computing Era
Non-blocking Switching in the Cloud Computing Era Contents 1 Foreword... 3 2 Networks Must Go With the Flow in the Cloud Computing Era... 3 3 Fat-tree Architecture Achieves a Non-blocking Data Center Network...
More informationNetwork Virtualization for Large-Scale Data Centers
Network Virtualization for Large-Scale Data Centers Tatsuhiro Ando Osamu Shimokuni Katsuhito Asano The growing use of cloud technology by large enterprises to support their business continuity planning
More informationExtending Networking to Fit the Cloud
VXLAN Extending Networking to Fit the Cloud Kamau WangŨ H Ũ Kamau Wangũhgũ is a Consulting Architect at VMware and a member of the Global Technical Service, Center of Excellence group. Kamau s focus at
More informationDatacenter architectures
Datacenter architectures Paolo Giaccone Notes for the class on Router and Switch Architectures Politecnico di Torino January 205 Outline What is a data center 2 Datacenter traffic 3 Routing and addressing
More informationCloud-Scale Data Center Network Architecture. Cheng-Chun Tu Advisor: Tzi-cker Chiueh
Cloud-Scale Data Center Network Architecture Cheng-Chun Tu Advisor: Tzi-cker Chiueh September 10, 2011 Abstract Cloud-scale data center network imposed unique requirements that are different from the tradition
More informationBrocade One Data Center Cloud-Optimized Networks
POSITION PAPER Brocade One Data Center Cloud-Optimized Networks Brocade s vision, captured in the Brocade One strategy, is a smooth transition to a world where information and applications reside anywhere
More informationProActive Routing in Scalable Data Centers. with PARIS
ProActive Routing in Scalable Data Centers with PARIS Dushyant Arora Master s Thesis Presented to the Faculty of Princeton University in Candidacy for the Degree of Master of Science in Engineering Recommended
More informationWalmart s Data Center. Amadeus Data Center. Google s Data Center. Data Center Evolution 1.0. Data Center Evolution 2.0
Walmart s Data Center Network Virtualization and Data Center Networks 263-3825-00 Data Center Virtualization - Basics Qin Yin Fall emester 2013 1 2 Amadeus Data Center Google s Data Center 3 4 Data Center
More informationData Center Network Topologies
Data Center Network Topologies. Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu These slides and audio/video recordings of this class lecture are at: 3-1 Overview
More informationAnt Rowstron. Joint work with Paolo Costa, Austin Donnelly and Greg O Shea Microsoft Research Cambridge. Hussam Abu-Libdeh, Simon Schubert Interns
Ant Rowstron Joint work with Paolo Costa, Austin Donnelly and Greg O Shea Microsoft Research Cambridge Hussam Abu-Libdeh, Simon Schubert Interns Thinking of large-scale data centers Microsoft, Google,
More information基 於 SDN 與 可 程 式 化 硬 體 架 構 之 雲 端 網 路 系 統 交 換 器
基 於 SDN 與 可 程 式 化 硬 體 架 構 之 雲 端 網 路 系 統 交 換 器 楊 竹 星 教 授 國 立 成 功 大 學 電 機 工 程 學 系 Outline Introduction OpenFlow NetFPGA OpenFlow Switch on NetFPGA Development Cases Conclusion 2 Introduction With the proposal
More informationLayer-3 Multipathing in Commodity-based Data Center Networks
Layer-3 Multipathing in Commodity-based Data Center Networks Ryo Nakamura University of Tokyo Email: upa@wide.ad.jp Yuji Sekiya University of Tokyo Email: sekiya@wide.ad.jp Hiroshi Esaki University of
More informationIntegrating Servers and Networking using an XOR-based Flat Routing Mechanism in 3-cube Server-centric Data Centers
Integrating Servers and Networking using an XOR-based Flat Routing Mechanism in 3-cube Server-centric Data Centers Rafael Pasquini 1, Fábio L. Verdi 2 and Maurício F. Magalhães 1 1 Department of Computer
More informationEVOLVING ENTERPRISE NETWORKS WITH SPB-M APPLICATION NOTE
EVOLVING ENTERPRISE NETWORKS WITH SPB-M APPLICATION NOTE EXECUTIVE SUMMARY Enterprise network managers are being forced to do more with less. Their networks are growing in size and complexity. They need
More informationSTATE OF THE ART OF DATA CENTRE NETWORK TECHNOLOGIES CASE: COMPARISON BETWEEN ETHERNET FABRIC SOLUTIONS
STATE OF THE ART OF DATA CENTRE NETWORK TECHNOLOGIES CASE: COMPARISON BETWEEN ETHERNET FABRIC SOLUTIONS Supervisor: Prof. Jukka Manner Instructor: Lic.Sc. (Tech) Markus Peuhkuri Francesco Maestrelli 17
More informationhp ProLiant network adapter teaming
hp networking june 2003 hp ProLiant network adapter teaming technical white paper table of contents introduction 2 executive summary 2 overview of network addressing 2 layer 2 vs. layer 3 addressing 2
More informationCisco s Massively Scalable Data Center
Cisco s Massively Scalable Data Center Network Fabric for Warehouse Scale Computer At-A-Glance Datacenter is the Computer MSDC is the Network Cisco s Massively Scalable Data Center (MSDC) is a framework
More informationBUILDING A NEXT-GENERATION DATA CENTER
BUILDING A NEXT-GENERATION DATA CENTER Data center networking has changed significantly during the last few years with the introduction of 10 Gigabit Ethernet (10GE), unified fabrics, highspeed non-blocking
More informationScalable Approaches for Multitenant Cloud Data Centers
WHITE PAPER www.brocade.com DATA CENTER Scalable Approaches for Multitenant Cloud Data Centers Brocade VCS Fabric technology is the ideal Ethernet infrastructure for cloud computing. It is manageable,
More informationA Comparative Study of Data Center Network Architectures
A Comparative Study of Data Center Network Architectures Kashif Bilal Fargo, ND 58108, USA Kashif.Bilal@ndsu.edu Limin Zhang Fargo, ND 58108, USA limin.zhang@ndsu.edu Nasro Min-Allah COMSATS Institute
More informationObjectives. The Role of Redundancy in a Switched Network. Layer 2 Loops. Broadcast Storms. More problems with Layer 2 loops
ITE I Chapter 6 2006 Cisco Systems, Inc. All rights reserved. Cisco Public 1 Objectives Implement Spanning Tree Protocols LAN Switching and Wireless Chapter 5 Explain the role of redundancy in a converged
More informationMMPTCP: A Novel Transport Protocol for Data Centre Networks
MMPTCP: A Novel Transport Protocol for Data Centre Networks Morteza Kheirkhah FoSS, Department of Informatics, University of Sussex Modern Data Centre Networks FatTree It provides full bisection bandwidth
More informationOperating Systems. Cloud Computing and Data Centers
Operating ystems Fall 2014 Cloud Computing and Data Centers Myungjin Lee myungjin.lee@ed.ac.uk 2 Google data center locations 3 A closer look 4 Inside data center 5 A datacenter has 50-250 containers A
More informationBURSTING DATA BETWEEN DATA CENTERS CASE FOR TRANSPORT SDN
BURSTING DATA BETWEEN DATA CENTERS CASE FOR TRANSPORT SDN Abhinava Sadasivarao, Sharfuddin Syed, Ping Pan, Chris Liou (Infinera) Inder Monga, Andrew Lake, Chin Guok Energy Sciences Network (ESnet) IEEE
More informationTechBrief Introduction
TechBrief Introduction Leveraging Redundancy to Build Fault-Tolerant Networks The high demands of e-commerce and Internet applications have required networks to exhibit the same reliability as the public
More informationData Center Networking with Multipath TCP
Data Center Networking with Costin Raiciu, Christopher Pluntke, Sebastien Barre, Adam Greenhalgh, Damon Wischik, Mark Handley University College London, Universite Catholique de Louvain ABSTRACT Recently
More informationSoftware-Defined Networking for the Data Center. Dr. Peer Hasselmeyer NEC Laboratories Europe
Software-Defined Networking for the Data Center Dr. Peer Hasselmeyer NEC Laboratories Europe NW Technology Can t Cope with Current Needs We still use old technology... but we just pimp it To make it suitable
More information20. Switched Local Area Networks
20. Switched Local Area Networks n Addressing in LANs (ARP) n Spanning tree algorithm n Forwarding in switched Ethernet LANs n Virtual LANs n Layer 3 switching n Datacenter networks John DeHart Based on
More informationTowards a Next Generation Data Center Architecture: Scalability and Commoditization
Towards a Next Generation Data Center Architecture: Scalability and Commoditization Albert Greenberg, Parantap Lahiri, David A. Maltz, Parveen Patel, Sudipta Sengupta Microsoft Research, Redmond, WA, USA
More informationSummitStack in the Data Center
SummitStack in the Data Center Abstract: This white paper describes the challenges in the virtualized server environment and the solution that Extreme Networks offers a highly virtualized, centrally manageable
More informationElectronic Theses and Dissertations UC San Diego
Electronic Theses and Dissertations UC San Diego Peer Reviewed Title: LDP : location discovery protocol for data center networks Author: Pamboris, Andreas Acceptance Date: 2009 Series: UC San Diego Electronic
More informationTorii: Multipath Distributed Ethernet Fabric Protocol for Data Centers with Zero-Loss Path Repair
TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES Trans. Emerging Tel. Tech. 2014; 00:1 20 RESEARCH ARTICLE Torii: Multipath Distributed Ethernet Fabric Protocol for Data Centers with Zero-Loss
More informationTeachCloud: A Cloud Computing Educational Toolkit
TeachCloud: A Cloud Computing Educational Toolkit Y. Jararweh* and Z. Alshara Department of Computer Science, Jordan University of Science and Technology, Jordan E-mail:yijararweh@just.edu.jo * Corresponding
More informationMigrate from Cisco Catalyst 6500 Series Switches to Cisco Nexus 9000 Series Switches
Migration Guide Migrate from Cisco Catalyst 6500 Series Switches to Cisco Nexus 9000 Series Switches Migration Guide November 2013 2013 Cisco and/or its affiliates. All rights reserved. This document is
More informationCS 91: Cloud Systems & Datacenter Networks Networks Background
CS 91: Cloud Systems & Datacenter Networks Networks Background Walrus / Bucket Agenda Overview of tradibonal network topologies IntroducBon to soeware- defined networks Layering and terminology Topology
More informationSurvey on Routing in Data Centers: Insights and Future Directions
CHEN LAYOUT 6/28/11 4:33 PM Page 2 Survey on Routing in Data Centers: Insights and Future Directions Kai Chen, Northwestern University Chengchen Hu, Xi an Jiaotong University Xin Zhang, Carnegie Mellon
More informationScafida: A Scale-Free Network Inspired Data Center Architecture
Scafida: A Scale-Free Network Inspired Data Center Architecture László Gyarmati, Tuan Anh Trinh Network Economics Group Department of Telecommunications and Media Informatics Budapest University of Technology
More informationMultipath TCP in Data Centres (work in progress)
Multipath TCP in Data Centres (work in progress) Costin Raiciu Joint work with Christopher Pluntke, Adam Greenhalgh, Sebastien Barre, Mark Handley, Damon Wischik Data Centre Trends Cloud services are driving
More informationHow To Make A Vpc More Secure With A Cloud Network Overlay (Network) On A Vlan) On An Openstack Vlan On A Server On A Network On A 2D (Vlan) (Vpn) On Your Vlan
Centec s SDN Switch Built from the Ground Up to Deliver an Optimal Virtual Private Cloud Table of Contents Virtualization Fueling New Possibilities Virtual Private Cloud Offerings... 2 Current Approaches
More informationDahu: Commodity Switches for Direct Connect Data Center Networks
Dahu: Commodity Switches for Direct Connect Data Center Networks Sivasankar Radhakrishnan, Malveeka Tewari, Rishi Kapoor, George Porter, Amin Vahdat University of California, San Diego Google Inc. {sivasankar,
More informationFibre Channel over Ethernet in the Data Center: An Introduction
Fibre Channel over Ethernet in the Data Center: An Introduction Introduction Fibre Channel over Ethernet (FCoE) is a newly proposed standard that is being developed by INCITS T11. The FCoE protocol specification
More informationCloud Networking Disruption with Software Defined Network Virtualization. Ali Khayam
Cloud Networking Disruption with Software Defined Network Virtualization Ali Khayam In the next one hour Let s discuss two disruptive new paradigms in the world of networking: Network Virtualization Software
More informationVXLAN: Scaling Data Center Capacity. White Paper
VXLAN: Scaling Data Center Capacity White Paper Virtual Extensible LAN (VXLAN) Overview This document provides an overview of how VXLAN works. It also provides criteria to help determine when and where
More informationDATACENTER NETWORKS AND RELEVANT STANDARDS
CHAPTER 4 DATACENTER NETWORKS AND RELEVANT STANDARDS Daniel S. Marcon, Rodrigo R. Oliveira, Luciano P. Gaspary and Marinho P. Barcellos Institute of Informatics, Federal University of Rio Grande do Sul,
More informationData Center Infrastructure of the future. Alexei Agueev, Systems Engineer
Data Center Infrastructure of the future Alexei Agueev, Systems Engineer Traditional DC Architecture Limitations Legacy 3 Tier DC Model Layer 2 Layer 2 Domain Layer 2 Layer 2 Domain Oversubscription Ports
More informationPeregrine: An All-Layer-2 Container Computer Network
Peregrine: An All-Layer-2 Container Computer Network Tzi-cker Chiueh Cloud Computing Research Center for Mobile Applications (CCMA) 雲 端 運 算 行 動 應 用 研 究 中 心 ICPADS 2011 1 1 Copyright 2008 ITRI 工 業 技 術 研
More informationData Center Fabrics What Really Matters. Ivan Pepelnjak (ip@ioshints.info) NIL Data Communications
Data Center Fabrics What Really Matters Ivan Pepelnjak (ip@ioshints.info) NIL Data Communications Who is Ivan Pepelnjak (@ioshints) Networking engineer since 1985 Technical director, later Chief Technology
More informationDeploying Brocade VDX 6720 Data Center Switches with Brocade VCS in Enterprise Data Centers
WHITE PAPER www.brocade.com Data Center Deploying Brocade VDX 6720 Data Center Switches with Brocade VCS in Enterprise Data Centers At the heart of Brocade VDX 6720 switches is Brocade Virtual Cluster
More informationPaolo Costa costa@imperial.ac.uk
joint work with Ant Rowstron, Austin Donnelly, and Greg O Shea (MSR Cambridge) Hussam Abu-Libdeh, Simon Schubert (Interns) Paolo Costa costa@imperial.ac.uk Paolo Costa CamCube - Rethinking the Data Center
More information