SMB Direct for SQL Server and Private Cloud



Similar documents
Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Mellanox Cloud and Database Acceleration Solution over Windows Server 2012 SMB Direct

State of the Art Cloud Infrastructure

Hyper-V over SMB Remote File Storage support in Windows Server 8 Hyper-V. Jose Barreto Principal Program Manager Microsoft Corporation

High Throughput File Servers with SMB Direct, Using the 3 Flavors of RDMA network adapters

SMB Advanced Networking for Fault Tolerance and Performance. Jose Barreto Principal Program Managers Microsoft Corporation

Advancing Applications Performance With InfiniBand

Storage, Cloud, Web 2.0, Big Data Driving Growth

Hyper-V over SMB: Remote File Storage Support in Windows Server 2012 Hyper-V. Jose Barreto Principal Program Manager Microsoft Corporation

Solving I/O Bottlenecks to Enable Superior Cloud Efficiency

Mellanox Accelerated Storage Solutions

Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks

Enabling High performance Big Data platform with RDMA

Microsoft Windows Server Hyper-V in a Flash

Removing Performance Bottlenecks in Databases with Red Hat Enterprise Linux and Violin Memory Flash Storage Arrays. Red Hat Performance Engineering

Building a Scalable Storage with InfiniBand

Microsoft Windows Server in a Flash

Connecting the Clouds

StarWind Virtual SAN for Microsoft SOFS

Microsoft Windows Server Hyper-V in a Flash

IOmark- VDI. Nimbus Data Gemini Test Report: VDI a Test Report Date: 6, September

Windows TCP Chimney: Network Protocol Offload for Optimal Application Scalability and Manageability

Michael Kagan.

Oracle Exadata: The World s Fastest Database Machine Exadata Database Machine Architecture

Building Enterprise-Class Storage Using 40GbE

Overview: X5 Generation Database Machines

Microsoft SQL Server 2014 in a Flash

Microsoft Hybrid Cloud IaaS Platforms

Replacing SAN with High Performance Windows Share over a Converged Network

High Performance OpenStack Cloud. Eli Karpilovski Cloud Advisory Council Chairman

Microsoft SMB Running Over RDMA in Windows Server 8

Optimizing Large Arrays with StoneFly Storage Concentrators

broadberry.co.uk/storage-servers

Bringing the Public Cloud to Your Data Center

Software Defined Microsoft. PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation

The safer, easier way to help you pass any IT exams. Exam : Storage Sales V2. Title : Version : Demo 1 / 5

Block based, file-based, combination. Component based, solution based

The last 18 months. AutoScale. IaaS. BizTalk Services Hyper-V Disaster Recovery Support. Multi-Factor Auth. Hyper-V Recovery.

From Ethernet Ubiquity to Ethernet Convergence: The Emergence of the Converged Network Interface Controller

2009 Oracle Corporation 1

Achieving Mainframe-Class Performance on Intel Servers Using InfiniBand Building Blocks. An Oracle White Paper April 2003

Doubling the I/O Performance of VMware vsphere 4.1

Diablo and VMware TM powering SQL Server TM in Virtual SAN TM. A Diablo Technologies Whitepaper. May 2015

Virtual Compute Appliance Frequently Asked Questions

HP 3PAR StoreServ 8000 Storage - what s new

Mit Soft- & Hardware zum Erfolg. Giuseppe Paletta

Performance Analysis: Scale-Out File Server Cluster with Windows Server 2012 R2 Date: December 2014 Author: Mike Leone, ESG Lab Analyst

Connecting Flash in Cloud Storage

Storage Spaces. Storage Spaces

The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays

Introduction to Cloud Design Four Design Principals For IaaS

Mellanox Academy Online Training (E-learning)

RoCE vs. iwarp Competitive Analysis

Private cloud computing advances

I/O Virtualization Using Mellanox InfiniBand And Channel I/O Virtualization (CIOV) Technology

Driving IBM BigInsights Performance Over GPFS Using InfiniBand+RDMA

WHITE PAPER. How To Build a SAN. The Essential Guide for Turning Your Windows Server Into Shared Storage on Your IP Network

Solution Brief July All-Flash Server-Side Storage for Oracle Real Application Clusters (RAC) on Oracle Linux

InfiniBand vs Fibre Channel Throughput. Figure 1. InfiniBand vs 2Gb/s Fibre Channel Single Port Storage Throughput to Disk Media

Choices for implementing SMB 3 on non Windows Servers Dilip Naik HvNAS Pty Ltd Australians good at NAS protocols!

E4 UNIFIED STORAGE powered by Syneto

Windows 8 SMB 2.2 File Sharing Performance

3G Converged-NICs A Platform for Server I/O to Converged Networks

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

Can High-Performance Interconnects Benefit Memcached and Hadoop?

SUN ORACLE EXADATA STORAGE SERVER

High Performance Server SAN using Micron M500DC SSDs and Sanbolic Software

Oracle Exadata Database Machine for SAP Systems - Innovation Provided by SAP and Oracle for Joint Customers

Big data Devices Apps

Choosing the Best Network Interface Card for Cloud Mellanox ConnectX -3 Pro EN vs. Intel XL710

Choosing the Best Network Interface Card Mellanox ConnectX -3 Pro EN vs. Intel X520

MESOS CB220. Cluster-in-a-Box. Network Storage Appliance. A Simple and Smart Way to Converged Storage with QCT MESOS CB220

Dell Converged Infrastructure

High Performance MySQL Cluster Cloud Reference Architecture using 16 Gbps Fibre Channel and Solid State Storage Technology

Oracle Maximum Availability Architecture with Exadata Database Machine. Morana Kobal Butković Principal Sales Consultant Oracle Hrvatska

Windows Server Infrastructure for SQL Server

Evaluation Report: Accelerating SQL Server Database Performance with the Lenovo Storage S3200 SAN Array

Performance characterization report for Microsoft Hyper-V R2 on HP StorageWorks P4500 SAN storage

Improving IT Operational Efficiency with a VMware vsphere Private Cloud on Lenovo Servers and Lenovo Storage SAN S3200

A virtual SAN for distributed multi-site environments

Converged storage architecture for Oracle RAC based on NVMe SSDs and standard x86 servers

Oracle Acceleration with the SanDisk ION Accelerator Solution

Solution Brief Network Design Considerations to Enable the Benefits of Flash Storage

Unitrends Recovery-Series: Addressing Enterprise-Class Data Protection

Flash Performance for Oracle RAC with PCIe Shared Storage A Revolutionary Oracle RAC Architecture

SOLUTION BRIEF AUGUST All-Flash Server-Side Storage for Oracle Real Application Clusters (RAC) on Oracle Linux

Accelerating I/O- Intensive Applications in IT Infrastructure with Innodisk FlexiArray Flash Appliance. Alex Ho, Product Manager Innodisk Corporation

Integration of Microsoft Hyper-V and Coraid Ethernet SAN Storage. White Paper

How To Connect Virtual Fibre Channel To A Virtual Box On A Hyperv Virtual Machine

Accelerating Real Time Big Data Applications. PRESENTATION TITLE GOES HERE Bob Hansen

Nutanix Solutions for Private Cloud. Kees Baggerman Performance and Solution Engineer

10th TF-Storage Meeting

EMC Unified Storage for Oracle Database 11g/10g Virtualized Solution. Enabled by EMC Celerra and Linux using NFS and DNFS. Reference Architecture

Pre-Conference Seminar E: Flash Storage Networking

High Availability with Windows Server 2012 Release Candidate

HP ProLiant BL660c Gen9 and Microsoft SQL Server 2014 technical brief

Transcription:

SMB Direct for SQL Server and Private Cloud Increased Performance, Higher Scalability and Extreme Resiliency June, 2014

Mellanox Overview Ticker: MLNX Leading provider of high-throughput, low-latency server and storage interconnect FDR 56Gb/s InfiniBand and 10/40/56GbE Reduces application wait-time for data Dramatically increases ROI on data center infrastructure Company headquarters: Yokneam, Israel; Sunnyvale, California ~1,432 employees* worldwide Solid financial position FY13 revenue of $390.9M 1Q14 revenue of $98.7M 2Q14 guidance ~$100M to $105M Cash + investments @ 3/31/14 = $340.1M * As of March 2014 2

Leadership in Strategic Markets with an End to End Portfolio Big Data DB/Enterprise Cloud Storage Web 2.0 End-to-End - Cloud, Enterprise, and Storage Optimized - InfiniBand and Ethernet Portfolio ICs Adapter Cards Switches/Gateways Host/Fabric Software Metro / WAN Cables/Modules 3

Mellanox Unique Value Proposition ZERO Copy Remote Data Transfer USER KERNEL Application Buffer Application Buffer HARDWARE Kernel Bypass Low Latency, High Performance Data Transfers Protocol Offload InfiniBand - 56Gb/s RoCE* 40Gb/s * RDMA over Converged Ethernet 4

RDMA How it Works HARDWARE KERNEL USER Application 1 OS Buffer 1 Buffer 1 Buffer 1 NIC Buffer 1 RDMA over InfiniBand or Ethernet HCA TCP/IP HCA Buffer 1 Buffer 1 Buffer 1 Buffer 1 Application 2 OS NIC RACK 1 RACK 2 5

Microsoft Windows Server 2012 R2 SMB Direct New class of enterprise file storage with RDMA support File Client File Server Lower latency, higher throughout, lower CPU overhead Application User Kernel Fibre Channel replacement at a lower cost and higher performance SMB Client SMB Server Leverages Windows Server 2012 R2 Mellanox inbox InfiniBand & Ethernet RDMA drivers Accelerates Microsoft Hyper-V over SMB and Microsoft SQL Server over SMB solutions Network w/ RDMA support RDMA Adapter Network w/ RDMA support RDMA Adapter NTFS SCSI Disk 5X Performance Improvement Over 10GbE 6

Measuring SMB Direct Performance SMB Client IO Micro Benchmark SMB Client IO Micro Benchmark SMB Client IO Micro Benchmark 10GbE QDR IB FDR IB SMB Server 10GbE SMB Server QDR IB SMB Server FDR IB Single Server IO Micro Benchmark Fusion Fusion Fusion Fusion-IO IO IO IO Fusion Fusion Fusion Fusion-IO IO IO IO Fusion Fusion Fusion Fusion-IO IO IO IO Fusion Fusion Fusion Fusion-IO IO IO IO 7

Microsoft Delivers High-End Storage at a Fraction of the Cost FDR 56Gb/s InfiniBand delivers 5X higher throughput with 50% less CPU overhead vs. 10GbE Native Throughput Performance over FDR InfiniBand 8

Performance and Resiliency Similar to a Traditional SAN Scale-Out File Server Cluster using Windows Server 2012 R2 SMB Direct 1.1 Million IOPS for 8KB random reads 700K IOPS for 8KB random writes 100Gbps aggregate read bandwidth * 92Gbps aggregate write bandwidth Source: http://www.mellanox.com/related-docs/applications/achieving-1.1m-iops-over-smb-direct.pdf *Cluster Shared Volumes FDR InfiniBand enables Native Performance 9

Hyper-V Live Migration on SMB Direct with Mellanox Interconnect SMB as a transport for Live Migration of VMs Delivers the power of SMB to provide: RDMA (SMB Direct) Streaming over multiple NICs (SMB Multichannel) Provides highest bandwidth and lowest latency Seconds 70 60 50 40 30 Live Migration Times* New in Windows Server 2012 R2 20 10 0 * Lower is better Click To Watch Video Live migration can stream over multiple networks for improved bandwidth Live Migration can take advantage of high speed networking RDMA enables offloading CPU resources to NIC during live migration Source: TechED 13 Opening Keynote Session with Satya Nadella 10

Success Story: Edgenet Reduced complexity vs. FC storage management Creates a more manageable storage subsystem - SMB easier to provision than Fibre Channel devices The storage server manages all the connections - Client Servers only need to know one path via SMB 10x Acceleration vs FC Allows consolidation of many FC arrays over SMB Live migration between servers at record speeds Mellanox VPI solutions Provides user access to the Hyper-V hosted application Source: http://www.mellanox.com/related-docs/case_studies/cs_edgenet_boost_performance_lower_cost.pdf 11

Accelerating Microsoft SQL 2012 Parallel Data Warehouse V2 Analyze 1 Petabyte of Data in 1 Second Up to 100X faster performance than legacy data warehouse queries Up to 50X faster data query, up to 2X the data loading rate Unlimited storage scalability for future proofing Accelerated by Mellanox FDR 56Gb/s InfiniBand end-to-end solutions 12

Microsoft SQL Server Appliance 10X Faster & 50% Lower Capital Cost Parallel Data Warehouse Appliance V1 Parallel Data Warehouse Appliance V2 Control Node Pure hardware costs are ~50% lower Mgmt. Node Price per raw TB is close to 70% lower due to higher capacity LZ 70% more disk I/O bandwidth Backup Node Ethernet, InfiniBand & Fibre Channel InfiniBand Estimated total HW component list $ price: $1M 160 cores on 10 compute nodes 1.28 TB of RAM on compute Up to 30 TB of temp DB Up to 150 TB of user data 128 cores on 8 compute nodes 2TB of RAM on compute Up to 168 TB of temp DB Up to 1PB of user data Estimated total HW component list $ price: $500K 13

SMB Direct Storage Solutions 14

File Storage Controller FSC 2200 X-IO Technologies Confidential

X-IO FSC 2200 File Storage Controller (FSC) 2200 is a certified Cluster-in-a-Box appliance that brings together the very best of Microsoft Windows Storage Server 2012 and the X-IO Intelligent Storage Element (ISE) family of enterprise disk and hybrid storage products. Provides 400 to 8000 IOPS for every 1 TB of provisioned storage. This range is above that of utility and archival (Tier 2) storage, and below that of real-time, ultra-high-performance applications. Supports IP client connectivity using CIFS/SMB 3, NFS 4.1 and iscsi 16 Minimum configuration is two servers (controllers) running Windows Storage Server 2012 directly connected to an ISE unit, but can be expanded both in terms of servers and ISE X-IO Technologies Confidential

X-IO FSC 2200 Client Connectivity Controllers CPU per Controller Memory per controller Fibre channel Ports Ethernet Ports per controller Supported ISE IP, iscsi Two HP DL360e Gen8 2x Quad-core per controller (Intel E5-2403, 1.8GHz) 32GB 2x 8Gb 4x 1Gb Ethernet, 2x 10/40Gb Ethernet ports (Infiniband-capable) ISE 200-series or ISE 700 series 17 File Services CIFS/SMB, NFS X-IO Technologies Confidential

Introducing The Windows Flash Array Violin Memory, Inc. 2014 CONFIDENTIAL 18

Windows in a Flash! >1 year of Joint Violin - Microsoft Development SMB Direct for Microsoft applications RDMA as a Storage Superhighway Transformative Speed in Storage Consolidation and cost savings Enables file server functions Increases server utilization Encryption Dedupe Live Migration Mirroring Scale-Out Violin Memory, Inc. 2014 CONFIDENTIAL 19

Beta Site Performance: SQL* and Hyper-V 2x Increase SQL Writes 54% Increase SQL Reads 41% Increase Hyper-V Writes IOPS 1.2M 1.0M 800K 600K 400K WFA AFA WFA AFA WFA AFA 30% Decrease Application Server CPU Utilization 50% Decrease Latency at Load 200K SQL READS* SQL WRITES* HYPER-V WRITES SMB Direct reduces CPU load up to 30% Latency averages 500 microseconds at Load *All Microsoft SQL results based on SQLIO load test with Infiniband connectivity Violin Memory, Inc. 2014 CONFIDENTIAL 20

DataOn Cluster-in-a-Box over RDMA Extremely economical Simplified architecture Easy to install appliance CiB interconnects: ConnectX-3 40GbE ConnectX-3 56Gbs InfiniBand Deployed at: 21

EchoStreams: InfiniBand Enables Near Linear Scalability File Client (SMB 3.0) File Server (SMB 3.0) RDMA NIC RDMA NIC SQLIO RDMA NIC RDMA NIC RDMA NIC RDMA NIC 8KB random reads from a mirrored space (disk) ~600,000 IOPS SAS HBA SAS SAS HBA SAS Storage Spaces SAS HBA SAS SAS HBA SAS SAS HBA SAS SAS HBA SAS 8KB random reads from cache (RAM) ~1,000,000 IOPS JBOD JBOD JBOD JBOD JBOD JBOD 32KB random reads from a mirrored space (disk) ~500,000 IOPS ~16.5 GBytes/sec 22

Iron Networks IRON POD Preconfigured Microsoft Hyper-V cloud IaaS hardware platform Full integrated converged data center solution Iron Pod Description Fault tolerant Mellanox 40/56GbE server and storage network - Fully redundant network for high availability ConnectX-3 Pro adapters for RDMA and NVGRE acceleration - Dual 40/56GbE network adapters More info about Iron Networks: http://www.mellanox.com/relateddocs/solutions/iron_networks_microsoft_fast_track_architecture.pdf http://ironnetworks.com/microsoft-converged-infrastructure/ironpod-cloud- Building-Blocks http://ironnetworks.com/microsoft-converged-infrastructure/ironpod-system-500 23

Thank You