State of the Art Cloud Infrastructure



Similar documents
High Performance OpenStack Cloud. Eli Karpilovski Cloud Advisory Council Chairman

Solving I/O Bottlenecks to Enable Superior Cloud Efficiency

SMB Direct for SQL Server and Private Cloud

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Connecting the Clouds

Storage, Cloud, Web 2.0, Big Data Driving Growth

Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions

Connecting Flash in Cloud Storage

Enabling High performance Big Data platform with RDMA

Introduction to Cloud Design Four Design Principals For IaaS

Global Headquarters: 5 Speen Street Framingham, MA USA P F

Mellanox Reference Architecture for Red Hat Enterprise Linux OpenStack Platform 4.0

Mellanox Cloud and Database Acceleration Solution over Windows Server 2012 SMB Direct

Choosing the Best Network Interface Card for Cloud Mellanox ConnectX -3 Pro EN vs. Intel XL710

Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks

Mellanox OpenStack Solution Reference Architecture

Achieving a High-Performance Virtual Network Infrastructure with PLUMgrid IO Visor & Mellanox ConnectX -3 Pro

Mellanox Academy Online Training (E-learning)

CON Software-Defined Networking in a Hybrid, Open Data Center

Virtual Compute Appliance Frequently Asked Questions

Network Function Virtualization Using Data Plane Developer s Kit

Pluribus Netvisor Solution Brief

Outline. Why Neutron? What is Neutron? API Abstractions Plugin Architecture

Telecom - The technology behind

Choosing the Best Network Interface Card Mellanox ConnectX -3 Pro EN vs. Intel X520

Cloud Computing and the Internet. Conferenza GARR 2010

Successfully Deploying Globalized Applications Requires Application Delivery Controllers

RoCE vs. iwarp Competitive Analysis

Advancing Applications Performance With InfiniBand

Building a Scalable Storage with InfiniBand

From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller

I/O Virtualization Using Mellanox InfiniBand And Channel I/O Virtualization (CIOV) Technology

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

An Oracle White Paper December Consolidating and Virtualizing Datacenter Networks with Oracle s Network Fabric

InfiniBand Software and Protocols Enable Seamless Off-the-shelf Applications Deployment

Data Center Op+miza+on

Unified Computing Systems

Private cloud computing advances

Part 1 - What s New in Hyper-V 2012 R2. Clive.Watson@Microsoft.com Datacenter Specialist

Virtual Network Exceleration OCe14000 Ethernet Network Adapters

The Future of Computing Cisco Unified Computing System. Markus Kunstmann Channels Systems Engineer

ALCATEL-LUCENT ENTERPRISE DATA CENTER SWITCHING SOLUTION Automation for the next-generation data center

Software-Defined Networks Powered by VellOS

Overview: X5 Generation Database Machines

Building the Virtual Information Infrastructure

Michael Kagan.

Extreme Networks: Building Cloud-Scale Networks Using Open Fabric Architectures A SOLUTION WHITE PAPER

Top Ten Reasons for Deploying Oracle Virtual Networking in Your Data Center

Building Enterprise-Class Storage Using 40GbE

How To Make A Vpc More Secure With A Cloud Network Overlay (Network) On A Vlan) On An Openstack Vlan On A Server On A Network On A 2D (Vlan) (Vpn) On Your Vlan

Accelerating Network Virtualization Overlays with QLogic Intelligent Ethernet Adapters

Windows TCP Chimney: Network Protocol Offload for Optimal Application Scalability and Manageability

Enabling Technologies for Distributed Computing

3G Converged-NICs A Platform for Server I/O to Converged Networks

Can High-Performance Interconnects Benefit Memcached and Hadoop?

With Red Hat Enterprise Virtualization, you can: Take advantage of existing people skills and investments

AMD SEAMICRO OPENSTACK BLUEPRINTS CLOUD- IN- A- BOX OCTOBER 2013

SMB Advanced Networking for Fault Tolerance and Performance. Jose Barreto Principal Program Managers Microsoft Corporation

RED HAT ENTERPRISE VIRTUALIZATION FOR SERVERS: COMPETITIVE FEATURES

Parallels Server 4 Bare Metal

FOR SERVERS 2.2: FEATURE matrix

Enabling Technologies for Distributed and Cloud Computing

White Paper. Advanced Server Network Virtualization (NV) Acceleration for VXLAN

Simplifying Virtual Infrastructures: Ethernet Fabrics & IP Storage

SDN and Data Center Networks

ConnectX -3 Pro: Solving the NVGRE Performance Challenge

Network Virtualization for Large-Scale Data Centers

Where IT perceptions are reality. Test Report. OCe14000 Performance. Featuring Emulex OCe14102 Network Adapters Emulex XE100 Offload Engine

Open Ethernet. April

Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA

Cloud Fabric. Huawei Cloud Fabric-Cloud Connect Data Center Solution HUAWEI TECHNOLOGIES CO.,LTD.

ALCATEL-LUCENT ENTERPRISE DATA CENTER SWITCHING SOLUTION Automation for the next-generation data center

Software Defined Network (SDN)

New Data Center architecture

EMC Unified Storage for Oracle Database 11g/10g Virtualized Solution. Enabled by EMC Celerra and Linux using NFS and DNFS. Reference Architecture

Software Defined Networks Virtualized networks & SDN

Definition of a White Box. Benefits of White Boxes

Using SouthBound APIs to build an SDN Solution. Dan Mihai Dumitriu Midokura Feb 5 th, 2014

Netvisor Software Defined Fabric Architecture

Pre-Conference Seminar E: Flash Storage Networking

Fabrics that Fit Matching the Network to Today s Data Center Traffic Conditions

Zadara Storage Cloud A

Brocade One Data Center Cloud-Optimized Networks

How To Orchestrate The Clouddusing Network With Andn

Scalable Approaches for Multitenant Cloud Data Centers

Open Source Networking for Cloud Data Centers

Microsoft Hybrid Cloud IaaS Platforms

Optimize Server Virtualization with QLogic s 10GbE Secure SR-IOV

NVGRE Overlay Networks: Enabling Network Scalability for a Cloud Infrastructure

Hyper-V over SMB: Remote File Storage Support in Windows Server 2012 Hyper-V. Jose Barreto Principal Program Manager Microsoft Corporation

Cloud Networking Disruption with Software Defined Network Virtualization. Ali Khayam

Mit Soft- & Hardware zum Erfolg. Giuseppe Paletta

Exploring Software-Defined Networking with Brocade

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance

A Platform Built for Server Virtualization: Cisco Unified Computing System

Transcription:

State of the Art Cloud Infrastructure Motti Beck, Director Enterprise Market Development WHD Global I April 2014

Next Generation Data Centers Require Fast, Smart Interconnect Software Defined Networks OpenFlow Virtual Network Management Overlay Network Tunnels End-to-End & Virtual Network Ready InfiniBand and Ethernet Portfolio ICs Adapter Cards Switches/Gateways Host/Fabric Software Metro / WAN Cables/Modules 3

Virtual Protocol Interconnect (VPI) Technology VPI Adapter VPI Switch Unified Fabric Manager Applications Switch OS Layer Networking Storage Clustering Management Acceleration Engines 3.0 Ethernet: 10/40/56 Gb/s InfiniBand:10/20/40/56 Gb/s 64 ports 10GbE 36 ports 40/56GbE 48 10GbE + 12 40/56GbE 36 ports IB up to 56Gb/s 8 VPI subnets From data center to campus and metro connectivity LOM Adapter Card Mezzanine Card 4

Next Generation Software Defined Networks Efficient Virtualized Network (EVN) Fully Integrated Solution Combines SDN/Virtualization, RDMA & Convergence VIRTUALIZATION ACCELERATION CONVERGENCE EVN: More than SDN - Efficient Clouds Need an Efficient Virtualized Network 5

Accelerate All Three Elements Required for SDN Networks = + + Software Defined Networks Virtual Network Management Overlay Network Tunnels OpenFlow 1. Centralized Software Based Control Plane Open Daylight Enables network virtualization 2. Overlay Networks NVGRE/VXLAN/DOVE Isolation, Scalability, Simplicity Mellanox accelerates overlay networks to offer bare metal speed 3. Industry Standard API OpenFlow Enables an industry ecosystem and innovation 6

ConnectX-3 Pro Accelerates Overlay Networks OpenFlow Virtual Network Management API Virtual View NVGRE/VXLAN Overlay Networks Virtual Domain 1 Virtual Domain 2 Virtual Domain 3 Virtual Overlay Networks Simplifies Management and VM Migration ConnectX-3 Pro Overlay Accelerators Enable Bare Metal Performance Physical View VM1 VM2 VM3 VM4 Server VM5 VM6 VM7 VM8 Server Mellanox SDN Switches & Routers Overlay Network Virtualization: Isolation, Simplicity, Scalability 7

Cloud Overlay Acceleration Results With ConnectX-3 Pro 10GbE 65% Improvement 79% Improvement Higher Is Better Lower Is Better NVGRE Initial Results Higher Throughput for Less CPU Transport Overhead 8

Cloud Overlay Acceleration Results - ConnectX-3 Pro 10GbE - VXLAN 600% Improvement 360% Improvement Higher Is Better Lower Is Better VXLAN Initial Results Higher Throughput for Less CPU Transport Overhead 9

Convergence: VPI Eliminates Dedicated Storage Network Storage prio1 Management prio2 vmotion prio3 Single Interconnect for Compute, Networking, Storage RDMA: InfiniBand & Ethernet (RoCE*) There is no Fibre Channel in the Modern Cloud! Networking prio4 Compute Networking Storage Converged Fabrics 56Gb/s InfiniBand 10/40Gb/s Ethernet * RoCE: RDMA over Converged Ethernet Web 2.0, Public & Private Clouds Converging on Fast RDMA Interconnects 10

Maximizing Cloud Return on Investment 56Gb/s per port with RDMA 2us for VM to VM connectivity 3.5X faster VM Migration 6X faster storage access Higher Performance Cost Effective Storage Higher storage density No need for SAN to every server Utilizing existing disk bays Reduction in software costs Centralized management (e.g. SDN) Simplified and Integrated Solutions Higher Infrastructure Efficiency Support more VMs per server Offload hypervisor CPU I/O consolidation (one wire) Unlimited scalability Efficiency, Performance, Integration 11

Accelerating Cloud Performance iser 40GbE VMs Write 6X Storage Fibre Channel 8Gb Migration of Active VM Migration Time [s] 50 40 30 20 10 0 38 10 10GE-A GbE 40GE-A GbE 3.5X Virtualization Latency [us] 50 40 30 20 10 0 VM-to-VM Latency Performance 40 2 Message Size - 256 [bytes] TCP ParaVirtualization RDMA Direct Access 20X 12

Mellanox Enables Lowest Application Cost in the Cloud Microsoft Windows Azure 90.2% Cloud Efficiency 33% Lower Cost per Application Cloud Application Performance Improved up to 10X 3X Increase in VMs per Physical Server Consolidation of Network and Storage I/O 32% Lower Cost per Application 694% Higher Network Performance 13

Microsoft Keynotes at Open Networking Summit 2014 on RDMA To make storage cheaper we use lots more network! How do we make Azure Storage scale? RoCE (RDMA over Ethernet) enabled at 40GbE for Windows Azure Storage, achieving massive COGS savings RDMA at 40GbE Enables Massive Cloud Saving For Microsoft Azure 14

Oracle Cloud Services* 7.6 Million users Oracle Cloud Announcement At Oracle Open World 2012 500 New SaaS customers in Q4FY13 5000 PaaS customers 16.5 Billion transactions per day 13,000 VMs 70 Petabytes of storage *Source: Oracle earning call Q4FY 13 What we are offering is our OS, our VM, our Compute and Storage services running over Exadata, Exalogic, SuperCluster all connected together with the most modern network, InfiniBand Interconnected with World Fastest Network InfiniBand 15

Enabling Best Cost-Effective Clouds Cloud Instance Configuration ECU* (Elastic Compute Unit) RAM (GB) HD (GB) User Cost (Month)** ProfitBricks Amazon User Saving % 2 3.75 410 $77.8 $115.2 40% 4 7.5 850 $117.92 $230.4 55% Maximizing Cloud Return on Investment *ECU compute performance equivalent to 2007 Intel Xeon or AMD Opteron CPU running at 1 GHz to 1.2 GHz ** Based on 16

Comprehensive OpenStack Integration for Switch and Adapter Native integration with Neutron Integrated with Major OpenStack Distributions Accelerating storage access by up to 5x Neutron : Hardware support for security and isolation InfiniBand In-Box With Havana Ethernet OpenStack Plugins Create Seamless Integration, Control, & Management 17

Mellanox Accelerates Storage: More than 4X Greater Throughput RDMA Accelerates iscsi Storage Compute Servers VM OS VM OS VM OS Hypervisor (KVM) Open-iSCSI w iser Adapter Storage Servers OpenStack (Cinder) iscsi/iser Target (tgt) RDMA Adapter Cache Local Disks GBytes/s 6 5 4 3 2 1 OpenStack Storage Performance * 1,3 5,5 0 iscsi over TCP iser Switching Fabric * iser patches are available on OpenStack branch: https://github.com/mellanox/openstack Built-in OpenStack Components/Management & Cinder/iSER to Accelerate Storage Access 18

Red Hat Enterprise Linux OpenStack Platform What is Red Hat Enterprise Linux OpenStack Platform? Better OpenStack performance and functionality A reliable base for OpenStack Massively scalable and elastic platform Built-in Cloud security Mellanox is a certified partner for Networking (Neutron) Block Storage (Cinder) Mellanox Plugins offers Best Performance Native integration with Neutron 19

First End-to-End SDN Interconnect Solution VM OS VM OS VM OS VM OS Servers Cloud Management OpenStack Manager tap Paravirtual tap SR-IOV to the VM Neutron Agent OpenFlow Agent Neutron Plug-In SDN Applications SDN Controller 10/40GbE or InfiniBand Ports Embedded Switch Create/delete, configure policy per VM vnic OpenFlow control over switch and NIC Adapter Hardware acceleration for OpenFlow and overlay functions Native integration to OpenStack, and SDN controllers Adapter Hardware based traffic isolation and security features Coming Up - Switch Discover topology & Configure VLANs integration 20

Mellanox s eswitch & SR-IOV Integrated Adapter Technology Performance Impact TCP Streams (High-bandwidth) TCP RR Client (Low-latency) Stream Server Messaging Server Server 10GbE 10GbE Server Hardware QoS Delivers Significant Performance Improvement 21

Mellanox, BigSwitch and Radware Integrated Solution World's first demonstration of SDN application utilizing OpenFlow enabled adapter Leveraging OpenFlow & Software Defined Networking (SDN) Cost-effective solution via accelerated data retrieval Offloading vswitches/hypervisor processing to Mellanox ConnectX-3 NICs Enabling elastic mobile cloud services 22

Australian National University OpenStack Cloud OpenStack Cloud Computing needs I/O consolidation: storage, inter-node and TCP/IP Fat-tree topology High-performance Ceph storage for fault tolerance Change customer perception Shift thinking from maximizing core count to maximizing VMs Uplift requirements from 10G to 40G+ The Mellanox advantage 40/56GbE throughput VPI Ethernet and InfiniBand 23

Fully Modular Rack Performance and Flexibility Rack Level Modular Flexibility CPU Flexibility Network Flexibility InfiniBand / Ethernet Flash/HDD Storage Flexibility Fully Modular Rack OS, CPU, & Interconnect Flexibility Interconnect Flexibility 100G Optical/Copper Flexible Topologies - Full or Mesh Connectivity Efficient Virtualized Network Software Defined Networking - Overlays, Open Daylight, OpenFlow RDMA Acceleration Acceleration Hypervisor CPU + Mem Network Storage Modular Server CPU Flexibility Efficient Virtual Network Modular Network Flexibility 100G Switch Interconnect Copper/MBOM Modular Flash/HDD Storage 24

CloudX - Unleash The Cloud Performance Unbounded cloud performance Lower your IT costs by 50% On-demand compute, storage and networking OpenCloud Architecture: Open Platform / Open Source 25

CloudX OpenCloud Architecture Any Software Open NIC, Open Switch, Open Server, Open Rack 26

Delivering a World Class OpenStack & SDN Interconnect Solution Performance OpenStack Storage (Cinder) over RDMA SR-IOV accelerated performance VXLAN & NVGRE HW offloads Automation Seamless Integration with Nova, Cinder and Neutron core projects Multi-tenancy End to end hardware based traffic isolation and security features Built in and production ready Compatible with leading OpenStack Vendors Support for Ethernet and InfiniBand 27

Thank Thank You You 28

Cloud Advisory Council 15 founding members including Mellanox Over 70 members Mission Outreach and research around Cloud computing Development of next generation Cloud architecture - Providing open specification for Cloud infrastructures - Publications of best practices for optimizing Cloud efficiency and utilization - Enable ease-of-use with comprehensive Cloud management and tools Publish Cloud best practices Groups: Open Source Eco-System Cloud Performance High Performance Cloud Webinars, workshops, events http://cloudadvisorycouncil.com/members.php 2014 Mellanox Cloud ADVISORY Technologies COUNCIL - Mellanox Confidential Internal Use Only - 29 41

Year 1 - Cloud Advisory Council Members 2014 Mellanox Cloud ADVISORY Technologies COUNCIL - Mellanox Confidential Internal Use Only - 30 42