New Switch Architectures and. in the Data Center. Gary Bernstein, RCDD, CDCD

Transcription

1 New Switch Architectures and the Impact to 40/100G Migration in the Data Center Gary Bernstein, RCDD, CDCD Leviton Network Solutions

2 Agenda Bandwidth Drivers & Expected Growth Existing 40 & 100G Equipment Available Today TIA-942-A-1 Standard Network Architectures New Switch 40/100G Architectures Available Today Impact of the New Architectures on Cabling Topologies & Designs

3 The Equation Remains the Same

4 2015 Global Users and Network Connections 15 Billion Total Network Connections by 2015

5 Computing & Networking Growth 2012 study confirms data from 2007» Source: IEEE Bandwidth Assessment» Report, July 2012

6 Server Bandwidth Growth

7 100G Equipment Available Today Brocade MLX Series Juniper T1600 Series Cisco CRS-3 Series

8 40G Equipment Available Today Extreme Networks Summit ToR & Black Diamond Core Switch Cisco Nexus 3064 ToR Switch Extreme X670 ToR with 10GBaseT

9 40G Equipment Available Today Force 10 S4810 ToR & E-Series Core Switch Arista 7050S ToR Switch Arista 7050Q High Density Switch

10 Switch Density Continues to Increase Mellanox SX1024 ToR switch with 12x40G Extreme BlackDiamondX8 with 192x40G ports in 15U

11 New 40G Extended Reach Transceivers QSFP+ 40G Short Reach Transceiver Available Soon Exceeds IEEE802.3ba 40G requirements Capable of extended reach for 40G over MMF 300 meters over OM3 fiber 400 meters over OM4 fiber Backwards compatible to 10G Source: Avago Several leading switch manufacturers will be offering option in 2013 Bottom Line MMF can support 40G beyond 150 meters Lower cost option than current Single-mode links Will likely l impact future network designs

12 Equipment Architecture Trends Leading active equipment manufacturers like Cisco, Brocade, Juniper, Extreme Networks and others have developed new fabric architectures There is a new TIA addendum which addresses some of these new architectures Data center trends driving change: Virtualization Cloud Computing Lower latency requirements Mobile device apps driving east-west flow in DC

13 TIA-942-A-1 Proposed Standard New addendum which specifies recommendations for telecommunications cabling to support data center switch fabrics Switch Fabric architectures are intended to provide the following between any 2 points in data center: Low-latency High-bandwidth Non-blocking ports Primary Switch Fabric Architectures: Fat-Tree Full-Mesh Interconnected Mesh Centralized Switch Virtual Switch

14 TIA-942-A-1: Traditional Data Center Architecture This content, from the draft ANSI/TIA-942-A-1 Standard, Telecommunications Infrastructure Standard for Data Centers, is reproduced d under written permission i from Telecommunications Industry Association.

15 Example: Traditional 3-Tier Architecture» Source: Cisco Systems

16 Example: Traditional 3-Tier Architecture» Source: Brocade

17 Cabling to Support 3-Tier Architecture

18 TIA-942-A-1: Fat-Tree (or Leaf-Spine) This content, from the draft ANSI/TIA-942-A-1 Standard, Telecommunications Infrastructure Standard for Data Centers, is reproduced under written permission from Telecommunications Industry Association.

19 Fat-Tree Architecture All Access Switches are connected to every Interconnection Switch Flattens and scales out Layer 2 network at the edge Creates a non-blocking, low latency fabric Size and Performance of Interconnection Switches will limit size of fabric Very scalable fabric Typically implemented din large data center with Access Switches in HDAs

20 Example: Fat-Tree Architecture» Source: Extreme Networks

21 Cabling to Support Fat-Tree Architecture 40G Uplinks

22 TIA-942-A-1: Full Mesh This content, from the draft ANSI/TIA-942-A-1 Standard, Telecommunications Infrastructure Standard for Data Centers, is reproduced d under written permission i from Telecommunications Industry Association.

23 Full Mesh Architecture All switches are connected to every other switch Does not scale very well Primarily used in small data centers Switches are not typically in EDA Fabric is not used for ToR topology

24 TIA-942-A-1: Interconnected Mesh This content, from the draft ANSI/TIA-942-A-1 Standard, Telecommunications Infrastructure Standard for Data Centers, is reproduced under written permission from Telecommunications Industry Association.

25 Interconnected Mesh Architecture Typically has 1 3 Interconnection switches Typically non-blocking within each POD Fabric within POD is a full-mesh Access switches may be in HDAs or EDAs Very scalable fabric architecture

26 Example: Interconnected Full Mesh 40/100G-A & B 40G-A 40G-B 10G-B 10G-A» Source: Extreme Networks

27 TIA-942-A-1: Centralized This content, from the draft ANSI/TIA-942-A-1 Standard, Telecommunications Infrastructure Standard for Data Centers, is reproduced under written permission from Telecommunications Industry Association.

28 Centralized Architecture All servers are connected to all fabric switches Simple and low latency Does not scale well because of port limitations Primarily used in small data centers

29 TIA-942-A-1: Virtual switch This content, from the draft ANSI/TIA-942-A-1 Standard, Telecommunications Infrastructure Standard for Data Centers, is reproduced under written permission from Telecommunications Industry Association.

30 Virtual Switch Architecture Similar to Centralized, except switches are interconnected to form a single, virtual switch Each server may be connected to multiple switches for redundancy Latency may be higher Does not scale well, unless a fat-tree or full- mesh implemented between virtual switches

31 Example: Virtual Switch Architecture» Source: Extreme Networks

32 Impact to Cabling Design & Topologies Critical to understand client switch architecture Flexibility in design is critical Design needs to be scalable Pre-terminated 12 or 24fiber MPO/MTP cabling is best option in order to support higher bandwidth requirements in data center Make sure cabling design maximizes fiber utilization throughout infrastructure migration 10/40/100G Make sure there is an easy migration path to support current or future IEEE 40 & 100G bandwidth

33 Impact to Future Needs In order to support these newer architectures, IEEE is working on new physical layer requirements Next generation 100GbE 802.3bm Standard Lower cost Reduced power Increased density 400G Call for interest scheduled in March 2013 Higher uplink speeds will be needed to support architectures Needed for scalability

34 Summary Bandwidth demand continues to grow dramatically Surge in 40G & 100G active equipment available today and in development Several new Fabric Architectures Understand impact of new fabrics to cabling designs End-users ask for help from experts that understand the data center environment

35 Questions? Contact Gary Bernstein Thank you for your time!