Scaling the S in SDN at Azure. Albert Greenberg Distinguished Engineer & Director of Engineering Microsoft Azure Networking

Transcription

1 Scaling the S in SDN at Azure Albert Greenberg Distinguished Engineer & Director of Engineering Microsoft Azure Networking

2 ExpressRoute Partners Coming 2014: 2015: Host soon: Contoller SDN Containers and Express and 2013: SDN in the Cloud SONiC Route SmartNIC

3 SDN in Windows Server 2016 Bringing Cloud-scale Technology to Enterprise on Premises with Windows Server 2016 Apps Azure Resource Manager Azure Resource Manag Create Virtual Networks, Load Balancers, Security Groups, and more from Azure in Private Cloud Supports Future Protocols OVSDB, VxLAN for open integration of control + data plane, using VFP, Azure s Virtual Switch AZURE STACK Consistency MICROSOFT AZURE

4 What s New In Data Plane? Improving Scale

5 PacketDirect New Windows direct I/O model for accelerating virtual networking and NFV CPUs managed by PD client CPU CPU CPU CPU Port of VFP (Azure Virtual Switch) to PD: Up to 2x improvement in throughput/core for heavy VNET workloads Up to 4x PPS improvement E2E Supported on major merchant silicon NICs PD Buffers managed by PD client Host PacketDirect Client (VFP, virtual appliance, ) PacketDirect Platform Initially for public cloud, coming to Windows Server 2016 soon! Q1 Q2 Queues managed by PD client NIC - PacketDirect Provider

6 SmartNIC Bringing the Flexibility and Serviceability of the Cloud to Hardware HW is needed for scale, perf, and COGS at 40G+ Multi-year ASIC cycle too slow Need agility and serviceability SDN SmartNIC combines agility of SDN with speed+cogs of HW Roll out Hardware as we do Software! NIC ASIC Blade CPU SmartNIC FPGA Bump in the Wire: Reconfigurable FPGA + NIC ASIC ToR

7 What s New In Control Plane? SDN for Containers

8 Containers Improve Density 10X utilization: 100s of VMs per host to 1000s of Containers per VM, each with its own network Container 1 Container 2 Container 3 Container 4 Container 5 Container 6 VM 1 VM 2 VM OS files and libraries Host Host

9 Goals for Container Management Speed Instantly provision container network Scale 100s of 1000s of containers in same virtual network Seamless DevOps Common APIs for VMs and Containers

10 Open SDN Solution for Containers Principles Consistent solution: Works across VMs and containers Cross platform: Works on Linux and Windows Open API: Works with Mesos, Docker, Chronos, Kubernetes How: New primitives Network namespace isolation extended to VFP: tremendous scale without being limited by OS/port limitations SDN policies: ACLs, IPAM, Routes, QOS extended to containers

11 Open SDN for Containers in Public Cloud VM Container 1 Container eth0 Eth0 Container policies VM (Linux / Windows) Container 1 Container eth0 eth0 veth Bridge veth NAT bridge0 Eth VM policies Veth Bridge bridge0 Eth veth Container + VM policies vswitch namespace VFP namespace NAT-based Container Network Underlay Container Network

12 Demo Network Controller On Prem Azure Ubuntu VM Windows VM (Media Client) GW Container 1 (PHP server) Ubuntu VM Container 2 (PHP server)

13 What s New In Physical Network? Software for Open Networking in the Cloud (SONiC)

14 Goals Velocity Feature agility weekly Bug mitigation daily Serviceability Modular, fine-grained hitless upgrades and restarts.deb/.rpm/container preferred over reload OS image Reliability Improvements with zero customer impact.

15 SAI SONiC OCP Contribution Dec 2014 OCP Acceptance July 2015 OCP Contribution March 2016 Common API and behavior model across multiple ASICs Provides L2/L3 functionalities ready for cloud Hardware/software disaggregation. Loosely-coupled modular design Independent evolution of hardware and software. Separation of states and logic

16 SONiC Completes the Open-Source Switch Stack Linux Network Applications Object Library Switch State Service Various OCP Kernel User Space Object Library PAS SDI PAL - sysfs HW Peripheral drivers netdev Network device drivers SAI ASIC SDK ASIC PCI driver Chassis Supplier ASIC Supplier Linux Fan/Power/LED Switch Hardware Transceiver ASIC

17 SONiC Demo: Servicing BGP BGP session Sender SONiC Commercial Switch Receive r Quagga -> Gobgpd Vendor BGP

18 Unlocks Simpler, Best in Breed Technology Enables Ecosystem Old Vs. New techniques Monitoring: Push Vs. Pull Identity: AD Vs. TACACS Configuration: Ansible Vs. CLI Monitoring example SNMP pulling not very efficient Mapping counters to MIB and back? Streaming: faster, direct Marching towards direct cloud

19 Want to be a part of Scaling the S in SDN? We re Hiring! albert@microsoft.com