Redefining Data Center Switching UK Network Operators Group
A bit about Arista Networks 10GbE Switches for the Virtualized Datacenter, but a software company at the core >1200 Customers >300 Employees Profitable, self-funded, pre-ipo network infrastructure provider Open Linux-based OS Fully automated testing, and SW development
Just as flowing water avoids the heights and hastens to the lowlands, so an army avoids strength and strikes weakness. --Sun Tzu, The Art of War
Where to Use Arista Switches Where your create competitive advantage through both infrastructure and applications Sample Applications Hadoop Data Mining VM Farms/ Consolidation Private Clouds for developers VM Farms for Customer Service Equities Trading Risk Analysis Exploratory Geophysics Signals Intelligence
How is EOS Different? Lessons from Unix Lessons from IT Lessons from The Cloud Lessons from Competitors
How is EOS Different? No Kernel Modifications Truly Open Development Environment Separation of State from Processing more stable and self-healing architecture Automate SW Builds, Testing, Interprocess Communications Single Binary Image on all platforms Focus on Simplifying Operations
What do Cloud Networks Look Like? Choice of Large L2 or Massive L3 Scale All Links Active Cabinet/Subnet 1 VMware Integration Dual-Homed Host Support for Resilience Cabinet/Subnet 2 Server 1 Mgmt Node Wire Speed Intra-Rack Serverfor 2 Performance Scale from 10 Server 20 servers to 100,000 Servers Deep Buffers for Congestion Management Cabinet/Subnet 94 Server 1 Server 2 Server 48 New Cabinets can be Server 1 deployed with Zero Touch Server 2 Servers can be bare-metal provisioned Server 48 from network
Workflow Based Development = Handsfree Automation Upgrade Software Replace failed hardware Scale out capacity Model configuration changes
Upgrade Automation Demonstration L3 Core ZTP OOB Mgmt GE302 GE209 xmppnet_a xmppnet_b TM115 TM225 TM221 TM106 xmppnet_a xmppnet_b xmppnet_a xmppnet_b MLAG ESX Host MLAG ESX Host
Redefining Data Center Switching
Traditional Stateful vmotion 128.218.10.x 128.218.10.4
Non-Stateful vmotion Across L3 Subnets 128.218.10.x 128.218.10.4 128.218.11.x 128.218.11.4
What Virtualization Admins Really Want! 128.218.10.x 128.218.10.4 128.218.11.x
Virtual extensible LAN 128.218.10.x 128.218.11.x Outer: 128.218.11.2 128.218.12.4 128.218.12.5 Inner: 128.218.12.1 128.218.12.6
How does VXLAN work? 11.2 MAC&IP are UDP Encapsulated 10.67 128.218.12.4 128.218.12.6 11.2 L2 11.1 9.1 9.2 10.1 10.67 Encapsulation is transparent to traditional switch/router nodes
VXLAN means I can put any VM, on any server, in seconds, software provisioned, without forklifting my network
How do we troubleshoot a tunneled, encapsulated, multicast environment???
VM Tracer - Multi-Tenancy Arista EOS can be connected to multiple vcenter instances Each vcenter instance can be assigned a nonoverlapping VLAN range that is supported for Adaptive Segmentation Lab The attempted creation of a VM outside of the allowed VLAN range creates an alert/alarm in vcenter RANGE 100-199 esx1 Prod RANGE 200-399 esx2 Pvt Cloud RANGE 400-499 esx3
VM Tracer - Host Discovery show vmtracer interface host 6 4 h Et esx1 Eth47 Ethernet46 : esx-1.aristanetworks.com Manufacturer: Dell Inc. Model: PowerEdge 2950 CPU type: Intel(R) Xeon(R) CPU 5110 @ 1.60GHz CPUs : 1 CPU Cores: 2 NIC Manufacturer: NetXen NIC Model: NetXen NX3031 Dual Port SFP+ 10GbE Server Adapter Service Tag: ABCDEF1234 esx2 Eth 48 esx3
VM Tracer - VM Discovery show vmtracer interface Ethernet48 Ethernet48: esx1.aristanetworks.com/ndstest/dvuplink1 vswitch/uplink VM Name Network Adapter VLAN Status State ------------------------------------------------------Exchange Network adapter 4 7 up/up -Apache Network adapter 3 6 up/up vmotion MySQL Network adapter 1 5 up/up FT-A VM Name Adapter Name VLAN/Status/State Eth48 Host/Domain Eth47 Switchport dvuplink0 dvuplink1 vswitch Exchange Apache MySQL VLAN 5 VLAN 6 VLAN 7 esx1
VM Tracer - VM Adaptive Segmentation VM Tracer automatically creates, prunes, and un-prunes VLANs on 802.1q VLAN Trunks to ESX Hosts. Routed subnets are not auto-created for IP stability. VM Tracer Operation VLAN VLAN2,6,7 2,7 VLAN 2,5,6,7 PERMITVLAN VLAN2,6,7 2,7 PERMIT PERMIT VLAN 2,5,6,7 VMK0 - VLAN2 VLAN 7 esx 1 esx 0 MySQL VMK0 - VLAN2 Exchange Apache Apache MySQL VLAN 5 VLAN 6 VLAN 6 VLAN 7
Automated Provisioning of VXLAN Create new VNI Segment Add Multicast Route IYVMWARE Setup Rendezvous Point 128.218.11.x 128.218.10.x VNI Test: 224.0.0.12