State of the Art Cloud Infrastructure Motti Beck, Director Enterprise Market Development WHD Global I April 2014
Next Generation Data Centers Require Fast, Smart Interconnect Software Defined Networks OpenFlow Virtual Network Management Overlay Network Tunnels End-to-End & Virtual Network Ready InfiniBand and Ethernet Portfolio ICs Adapter Cards Switches/Gateways Host/Fabric Software Metro / WAN Cables/Modules 3
Virtual Protocol Interconnect (VPI) Technology VPI Adapter VPI Switch Unified Fabric Manager Applications Switch OS Layer Networking Storage Clustering Management Acceleration Engines 3.0 Ethernet: 10/40/56 Gb/s InfiniBand:10/20/40/56 Gb/s 64 ports 10GbE 36 ports 40/56GbE 48 10GbE + 12 40/56GbE 36 ports IB up to 56Gb/s 8 VPI subnets From data center to campus and metro connectivity LOM Adapter Card Mezzanine Card 4
Next Generation Software Defined Networks Efficient Virtualized Network (EVN) Fully Integrated Solution Combines SDN/Virtualization, RDMA & Convergence VIRTUALIZATION ACCELERATION CONVERGENCE EVN: More than SDN - Efficient Clouds Need an Efficient Virtualized Network 5
Accelerate All Three Elements Required for SDN Networks = + + Software Defined Networks Virtual Network Management Overlay Network Tunnels OpenFlow 1. Centralized Software Based Control Plane Open Daylight Enables network virtualization 2. Overlay Networks NVGRE/VXLAN/DOVE Isolation, Scalability, Simplicity Mellanox accelerates overlay networks to offer bare metal speed 3. Industry Standard API OpenFlow Enables an industry ecosystem and innovation 6
ConnectX-3 Pro Accelerates Overlay Networks OpenFlow Virtual Network Management API Virtual View NVGRE/VXLAN Overlay Networks Virtual Domain 1 Virtual Domain 2 Virtual Domain 3 Virtual Overlay Networks Simplifies Management and VM Migration ConnectX-3 Pro Overlay Accelerators Enable Bare Metal Performance Physical View VM1 VM2 VM3 VM4 Server VM5 VM6 VM7 VM8 Server Mellanox SDN Switches & Routers Overlay Network Virtualization: Isolation, Simplicity, Scalability 7
Cloud Overlay Acceleration Results With ConnectX-3 Pro 10GbE 65% Improvement 79% Improvement Higher Is Better Lower Is Better NVGRE Initial Results Higher Throughput for Less CPU Transport Overhead 8
Cloud Overlay Acceleration Results - ConnectX-3 Pro 10GbE - VXLAN 600% Improvement 360% Improvement Higher Is Better Lower Is Better VXLAN Initial Results Higher Throughput for Less CPU Transport Overhead 9
Convergence: VPI Eliminates Dedicated Storage Network Storage prio1 Management prio2 vmotion prio3 Single Interconnect for Compute, Networking, Storage RDMA: InfiniBand & Ethernet (RoCE*) There is no Fibre Channel in the Modern Cloud! Networking prio4 Compute Networking Storage Converged Fabrics 56Gb/s InfiniBand 10/40Gb/s Ethernet * RoCE: RDMA over Converged Ethernet Web 2.0, Public & Private Clouds Converging on Fast RDMA Interconnects 10
Maximizing Cloud Return on Investment 56Gb/s per port with RDMA 2us for VM to VM connectivity 3.5X faster VM Migration 6X faster storage access Higher Performance Cost Effective Storage Higher storage density No need for SAN to every server Utilizing existing disk bays Reduction in software costs Centralized management (e.g. SDN) Simplified and Integrated Solutions Higher Infrastructure Efficiency Support more VMs per server Offload hypervisor CPU I/O consolidation (one wire) Unlimited scalability Efficiency, Performance, Integration 11
Accelerating Cloud Performance iser 40GbE VMs Write 6X Storage Fibre Channel 8Gb Migration of Active VM Migration Time [s] 50 40 30 20 10 0 38 10 10GE-A GbE 40GE-A GbE 3.5X Virtualization Latency [us] 50 40 30 20 10 0 VM-to-VM Latency Performance 40 2 Message Size - 256 [bytes] TCP ParaVirtualization RDMA Direct Access 20X 12
Mellanox Enables Lowest Application Cost in the Cloud Microsoft Windows Azure 90.2% Cloud Efficiency 33% Lower Cost per Application Cloud Application Performance Improved up to 10X 3X Increase in VMs per Physical Server Consolidation of Network and Storage I/O 32% Lower Cost per Application 694% Higher Network Performance 13
Microsoft Keynotes at Open Networking Summit 2014 on RDMA To make storage cheaper we use lots more network! How do we make Azure Storage scale? RoCE (RDMA over Ethernet) enabled at 40GbE for Windows Azure Storage, achieving massive COGS savings RDMA at 40GbE Enables Massive Cloud Saving For Microsoft Azure 14
Oracle Cloud Services* 7.6 Million users Oracle Cloud Announcement At Oracle Open World 2012 500 New SaaS customers in Q4FY13 5000 PaaS customers 16.5 Billion transactions per day 13,000 VMs 70 Petabytes of storage *Source: Oracle earning call Q4FY 13 What we are offering is our OS, our VM, our Compute and Storage services running over Exadata, Exalogic, SuperCluster all connected together with the most modern network, InfiniBand Interconnected with World Fastest Network InfiniBand 15
Enabling Best Cost-Effective Clouds Cloud Instance Configuration ECU* (Elastic Compute Unit) RAM (GB) HD (GB) User Cost (Month)** ProfitBricks Amazon User Saving % 2 3.75 410 $77.8 $115.2 40% 4 7.5 850 $117.92 $230.4 55% Maximizing Cloud Return on Investment *ECU compute performance equivalent to 2007 Intel Xeon or AMD Opteron CPU running at 1 GHz to 1.2 GHz ** Based on 16
Comprehensive OpenStack Integration for Switch and Adapter Native integration with Neutron Integrated with Major OpenStack Distributions Accelerating storage access by up to 5x Neutron : Hardware support for security and isolation InfiniBand In-Box With Havana Ethernet OpenStack Plugins Create Seamless Integration, Control, & Management 17
Mellanox Accelerates Storage: More than 4X Greater Throughput RDMA Accelerates iscsi Storage Compute Servers VM OS VM OS VM OS Hypervisor (KVM) Open-iSCSI w iser Adapter Storage Servers OpenStack (Cinder) iscsi/iser Target (tgt) RDMA Adapter Cache Local Disks GBytes/s 6 5 4 3 2 1 OpenStack Storage Performance * 1,3 5,5 0 iscsi over TCP iser Switching Fabric * iser patches are available on OpenStack branch: https://github.com/mellanox/openstack Built-in OpenStack Components/Management & Cinder/iSER to Accelerate Storage Access 18
Red Hat Enterprise Linux OpenStack Platform What is Red Hat Enterprise Linux OpenStack Platform? Better OpenStack performance and functionality A reliable base for OpenStack Massively scalable and elastic platform Built-in Cloud security Mellanox is a certified partner for Networking (Neutron) Block Storage (Cinder) Mellanox Plugins offers Best Performance Native integration with Neutron 19
First End-to-End SDN Interconnect Solution VM OS VM OS VM OS VM OS Servers Cloud Management OpenStack Manager tap Paravirtual tap SR-IOV to the VM Neutron Agent OpenFlow Agent Neutron Plug-In SDN Applications SDN Controller 10/40GbE or InfiniBand Ports Embedded Switch Create/delete, configure policy per VM vnic OpenFlow control over switch and NIC Adapter Hardware acceleration for OpenFlow and overlay functions Native integration to OpenStack, and SDN controllers Adapter Hardware based traffic isolation and security features Coming Up - Switch Discover topology & Configure VLANs integration 20
Mellanox s eswitch & SR-IOV Integrated Adapter Technology Performance Impact TCP Streams (High-bandwidth) TCP RR Client (Low-latency) Stream Server Messaging Server Server 10GbE 10GbE Server Hardware QoS Delivers Significant Performance Improvement 21
Mellanox, BigSwitch and Radware Integrated Solution World's first demonstration of SDN application utilizing OpenFlow enabled adapter Leveraging OpenFlow & Software Defined Networking (SDN) Cost-effective solution via accelerated data retrieval Offloading vswitches/hypervisor processing to Mellanox ConnectX-3 NICs Enabling elastic mobile cloud services 22
Australian National University OpenStack Cloud OpenStack Cloud Computing needs I/O consolidation: storage, inter-node and TCP/IP Fat-tree topology High-performance Ceph storage for fault tolerance Change customer perception Shift thinking from maximizing core count to maximizing VMs Uplift requirements from 10G to 40G+ The Mellanox advantage 40/56GbE throughput VPI Ethernet and InfiniBand 23
Fully Modular Rack Performance and Flexibility Rack Level Modular Flexibility CPU Flexibility Network Flexibility InfiniBand / Ethernet Flash/HDD Storage Flexibility Fully Modular Rack OS, CPU, & Interconnect Flexibility Interconnect Flexibility 100G Optical/Copper Flexible Topologies - Full or Mesh Connectivity Efficient Virtualized Network Software Defined Networking - Overlays, Open Daylight, OpenFlow RDMA Acceleration Acceleration Hypervisor CPU + Mem Network Storage Modular Server CPU Flexibility Efficient Virtual Network Modular Network Flexibility 100G Switch Interconnect Copper/MBOM Modular Flash/HDD Storage 24
CloudX - Unleash The Cloud Performance Unbounded cloud performance Lower your IT costs by 50% On-demand compute, storage and networking OpenCloud Architecture: Open Platform / Open Source 25
CloudX OpenCloud Architecture Any Software Open NIC, Open Switch, Open Server, Open Rack 26
Delivering a World Class OpenStack & SDN Interconnect Solution Performance OpenStack Storage (Cinder) over RDMA SR-IOV accelerated performance VXLAN & NVGRE HW offloads Automation Seamless Integration with Nova, Cinder and Neutron core projects Multi-tenancy End to end hardware based traffic isolation and security features Built in and production ready Compatible with leading OpenStack Vendors Support for Ethernet and InfiniBand 27
Thank Thank You You 28
Cloud Advisory Council 15 founding members including Mellanox Over 70 members Mission Outreach and research around Cloud computing Development of next generation Cloud architecture - Providing open specification for Cloud infrastructures - Publications of best practices for optimizing Cloud efficiency and utilization - Enable ease-of-use with comprehensive Cloud management and tools Publish Cloud best practices Groups: Open Source Eco-System Cloud Performance High Performance Cloud Webinars, workshops, events http://cloudadvisorycouncil.com/members.php 2014 Mellanox Cloud ADVISORY Technologies COUNCIL - Mellanox Confidential Internal Use Only - 29 41
Year 1 - Cloud Advisory Council Members 2014 Mellanox Cloud ADVISORY Technologies COUNCIL - Mellanox Confidential Internal Use Only - 30 42