The next step in Software-Defined Storage with Virtual SAN

Similar documents
Software-Defined Storage & VMware Virtual SAN 5.5

VMware Software-Defined Storage & Virtual SAN 5.5.1

Software-Defined Storage & VMware Virtual SAN

VMware Software-Defined Storage Vision

VMware Software-Defined Storage and EVO:RAIL

New Generation of IT self service vcloud Automation Center

VMware VMware Inc. All rights reserved.

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

Copyright 2015 EMC Corporation. All rights reserved.

MaxDeploy Hyper- Converged Reference Architecture Solution Brief

Whitepaper. NexentaConnect for VMware Virtual SAN. Full Featured File services for Virtual SAN

VMware VSAN och Virtual Volumer

SDDC: A New Architecture for a New Era of Ed IT

What s New: VMware Virtual SAN 6.0

Software-Defined Storage: What it Means for the IT Practitioner WHITE PAPER

VMware Virtual SAN Design and Sizing Guide TECHNICAL MARKETING DOCUMENTATION V 1.0/MARCH 2014

(R)Evolution im Software Defined Datacenter Hyper-Converged Infrastructure

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

The Future of IT is Software-Defined

Nutanix Tech Note. Configuration Best Practices for Nutanix Storage with VMware vsphere

VirtualclientTechnology 2011 July

What s New in VMware Virtual SAN TECHNICAL WHITE PAPER

VMware Software-defined Data Center Technical Strategy and Customer Benefits

What s New: VMware Virtual SAN 6.0

Now I get the same great benefits of virtualization for my storage. Virtual SAN is as budget-friendly as it is simple.

Copyright 2015 EMC Corporation. All rights reserved.

VMware Software-Defined Datacenter

VMware Virtual SAN Backup Using VMware vsphere Data Protection Advanced SEPTEMBER 2014

FlashSoft Software from SanDisk : Accelerating Virtual Infrastructures

VMware Virtual SAN Hardware Guidance. TECHNICAL MARKETING DOCUMENTATION v 1.0

Maxta Storage Platform Enterprise Storage Re-defined

VMware Virtual SAN Proof of Concept Guide

Forward-Looking Statements

SPECIAL ISSUE. for DataCore Software. provided by. nt4admins.de

Nutanix Complete Cluster Reference Architecture for Virtual Desktop Infrastructure

VMware Virtual SAN Design and Sizing Guide for Horizon View Virtual Desktop Infrastructures TECHNICAL MARKETING DOCUMENTATION REV A /JULY 2014

VMware Virtual SAN 6.0 Design and Sizing Guide

VMware and Primary Data: Making the Software-Defined Datacenter a Reality

Virtual SAN Design and Deployment Guide

Best Practices for Managing Storage in the Most Challenging Environments

A virtual SAN for distributed multi-site environments

OmniCube. SimpliVity OmniCube and Multi Federation ROBO Reference Architecture. White Paper. Authors: Bob Gropman

What s New: vsphere Virtual Volumes

Efficient Storage Strategies for Virtualized Data Centers

VMware s Virtualization & Cloud Computing Solutions for Enterprise

Introduction to VMware EVO: RAIL. White Paper

Hyperscale Use Cases for Scaling Out with Flash. David Olszewski

Microsoft Private Cloud Fast Track

Deep Dive on SimpliVity s OmniStack A Technical Whitepaper

Understanding Data Locality in VMware Virtual SAN

A Virtual Filer for VMware s Virtual SAN A Maginatics and VMware Joint Partner Brief

What s New in VMware vsphere Flash Read Cache TECHNICAL MARKETING DOCUMENTATION

What s New with VMware Virtual Infrastructure

vsphere 6.0 Advantages Over Hyper-V

Simplifying Storage Operations By David Strom (published 3.15 by VMware) Introduction

Increasing Storage Performance

Why Choose VMware vsphere for Desktop Virtualization? WHITE PAPER

Nimble Storage for VMware View VDI

SimpliVity OmniStack with Vormetric Transparent Encryption

Nutanix Tech Note. Data Protection and Disaster Recovery

Simplifying Storage Scalability with VMware Virtual SAN on System x Servers

SimpliVity OmniStack with the HyTrust Platform

Storage Solutions to Maximize Success in VDI Environments

REDEFINE SIMPLICITY TOP REASONS: EMC VSPEX BLUE FOR VIRTUALIZED ENVIRONMENTS

Luxembourg June

Unleash the Performance of vsphere 5.1 with 16Gb Fibre Channel

WHITE PAPER 1

VMware vsphere 5.1 Advanced Administration

Configuration Maximums

Increasing Storage Performance, Reducing Cost and Simplifying Management for VDI Deployments

EMC SCALEIO OPERATION OVERVIEW

Nimble Storage VDI Solution for VMware Horizon (with View)

High-Availability Fault Tolerant Computing for Remote and Branch Offices HA/FT solutions for Cisco UCS E-Series servers and VMware vsphere

Building the Virtual Information Infrastructure

How the Software-Defined Data Center Is Transforming End User Computing

Implementing a Holistic BC/DR Strategy with VMware

vcloud Virtual Private Cloud Fulfilling the promise of cloud computing A Resource Pool of Compute, Storage and a Host of Network Capabilities

Diablo and VMware TM powering SQL Server TM in Virtual SAN TM. A Diablo Technologies Whitepaper. May 2015

Using VMWare VAAI for storage integration with Infortrend EonStor DS G7i

QNAP in vsphere Environment

IOmark- VDI. Nimbus Data Gemini Test Report: VDI a Test Report Date: 6, September

NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION. Copyright 2013 EMC Corporation. All rights reserved.

2011 VMware Inc. All rights reserved

Microsoft SMB File Sharing Best Practices Guide

Delivering SDS simplicity and extreme performance

VMware vsphere 5.0 Boot Camp

Virtual Desktop Infrastructure (VDI) Overview

EMC BACKUP-AS-A-SERVICE

Enterprise Storage Solution for Hyper-V Private Cloud and VDI Deployments using Sanbolic s Melio Cloud Software Suite April 2011

Pivot3 Desktop Virtualization Appliances. vstac VDI Technology Overview

VMware Horizon 6 on Coho DataStream Reference Architecture Whitepaper

VMware vcenter Site Recovery Manager 5 Technical

BEST PRACTICES FOR DEPLOYING VNX IN THE HYBRID CLOUD

VDI Without Compromise with SimpliVity OmniStack and Citrix XenDesktop

The Changing Role of Software in the New Era George L. Lotridge Senior Partner Technology Strategist VMware, Inc.

High Performance Server SAN using Micron M500DC SSDs and Sanbolic Software

Virtualizing Microsoft SQL Server on Dell XC Series Web-scale Converged Appliances Powered by Nutanix Software. Dell XC Series Tech Note

What s New in vsphere 5.5. Enhancements for CPU C-States. Virtual Machine Enhancements. VM Compatibility with ESXi 5.5. Expanded vgpu Support

Transcription:

The next step in Software-Defined Storage with Virtual SAN VMware vforum, 2014 Lee Dilworth, principal SE @leedilworth 2014 VMware Inc. All rights reserved.

The Software-Defined Data Center Expand virtual compute to all applications Virtualize the network for speed and efficiency Transform storage by aligning it with app demands Management tools give way to automation 2

The Software-Defined Data Center Transform storage by aligning it with app demands 3

Today s Challenge: Massive Increase in Storage Demand & Complexity 120M 100M 80M 60M Storage Growth Terabytes Sold 41% YoY Meeting SLA Troublesho oting Data Migrations Most Pressing Storage Challenges 31% 28% 42% 40M Time/budge t 28% 20M M 2008 2009 2010 2011 2012 2013 2014 2015 2016 Terabytes Sold Provisioning Manageme nt Complexity 26% 24% Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293 Source: IDC, Storage Predictions 2014, January 2014, General Storage QuickPoll, #243511, n=307 4

Storage Market in Midst of Disruption Server Storage Shared Storage 20-30 years ago 10-15 years ago New Forms Today Key Drivers Server flash Falling storage prices Abundant CPU cycles Hypervisor-converged infrastructure Cloud economics 5

The Hypervisor Opens Up New Opportunities The virtualization platform: vsphere Knows the needs of all apps in real time Sits directly in the I/O path x86 Servers SAN / NAS Cloud Storage Global view of underlying infrastructure Hardware agnostic 6

Leveraging The Hypervisor We Can Transform Storage Today Software-defined Storage LUN LUN LUN Replicati on Hypervisor Converged Pool Snapshot s SAN/NAS Pool Object-based Pool Automate SLAs via VM-centric policies (Policy-based Control Plane) VM level Data services (Virtual Data Services) LUN Array A LUN Array B vsphere Abstract and pool (Virtualized Data Plane) x86 Servers SAN / NAS Cloud Object Storage 7

VMware Virtual SAN Radically Simple Hypervisor-Converged Storage

VMware Virtual SAN Hypervisor-Converged storage platform vsphere + Virtual SAN SSD Hard disks SSD SSD Hard disks Hard disks Virtual SAN Shared Datastore Storage scale out architecture built into the hypervisor Simple cluster level feature tick to enable! Aggregates locally attached storage from each ESXi host in a cluster Dynamic capacity and performance scalability Flash optimized storage solution Fully integrated with vsphere and interoperable: vmotion, DRS, HA, VDP, VR VM-centric data operations 9

Unprecedented Customer Interest And Validation 12,000+ Virtual SAN Beta Participants 95% Beta customers Recommend VSAN 90% Believe VSAN will impact Storage like vsphere did to Compute 10

Virtual SAN Simplifies And Automates Storage Management Per VM Storage Service Levels From a Single Self-tuning Datastore Per VM Storage Policies Policies Set Based on Application Needs Software Automates Control of Service Levels Capacity Storage Policy-Based Management Performance vsphere + Virtual SAN SLAs Availability Virtual SAN Shared Datastore No more LUNs/Volumes! 11

Virtual SAN Puts The App In Charge Simpler and Automated Storage Management Through Applicationcentric Approach Today Today Virtual SAN 1. Pre-define storage configurations 2. Pre-allocate static bins 3. Expose pre-allocated bins 4. Select appropriate bin 5. Consume from pre-allocated bin Overprovisioning (Better safe than sorry!) Wasted resources, wasted time Frequent data migrations Virtual SAN Shared Datastore 1. Define storage policy 2. Apply policy at VM creation Resource and data service are automatically provisioned and maintained. No overprovisioning Less resources, less time Easy to change 12

Virtual SAN Delivers Enterprise-Grade Scale Maximum Scalability per Virtual SAN Cluster 32 Hosts 2M IOPS 3,20 0 VMs 4.4 Petabytes Virtual SAN allows us to build out scalable heterogeneous storage infrastructure like the Facebooks and Googles of the world. Virtual SAN allows us to add scale, add resources, while being able to service high performance workloads. Dave Burns VP of Tech Ops, Cincinnati Bell 13

Virtual SAN Enables Elastic Linear Scaling of Performance and Capacity No More Complex Forecasting & Large Upfront Investments Scale OUT Add more nodes Scale UP Add more Disks Elastic Grow or shrink on demand Granular Add single nodes or disks 4.4 PB 400 TB 40 TB Capacity IOPS Non-disruptive No app downtime Virtual SAN enables us to scale our storage infrastructure and while providing the necessary redundancy. This allows us to be more agile and bring our solutions to market faster. Frans Van Rooyen, Cloud Architect, Adobe 14

Virtual SAN Use Cases Use Cases for Virtual SAN 5.5 Virtual Desktop (VDI) Tier 2 / Tier 3 / Staging DR Target Site A Site B Handle peak performance requirements (boot, login, read/write storms) Granularly scale from POC to production without huge upfront investments Support high VDI density Rapid storage provisioning and complete automation Ideal price/performance Enables Cloud Architect to easily provision storage Integrated with vsphere Replication and VMware SRM Reduces cost of storage Minimizes data center footprint 15

Virtual SAN: Deeply Integrated with VMware Stack Ideal for VMware Environments vsphere Data Protection Virtual Desktop vmotion vsphere HA DRS Storage vmotion Snapshots Linked Clones VDP Advanced vsphere Replication VMware View Cloud Ops and Automation vcenter Operations Mgr vcloud Automation Center Disaster Recovery Site Recovery Manager Storage Policy-Based Management IaaS Site A Site B 16

Virtual SAN Implementation Requirements Virtual SAN requires: Minimum of 3 hosts in a cluster configuration All 3 host MUST!!! contribute storage vsphere 5.5 U1 or later Maximum of 32 hosts vsphere 5.5 U1 Cluster local storage local storage local storage HDD HDD HDD Locally attached disks cluster Magnetic disks (HDD) Flash-based devices (SSD) esxi-01 esxi-02 esxi-03 Network connectivity 1GB Ethernet 10GB Ethernet (preferred) 17

Two Ways to Build a Virtual SAN Node Completely Hardware Independent 1. Virtual SAN Ready Node Preconfigured server ready to use Virtual SAN 2. Build Your Own Choose individual components Any Server on vsphere Hardware Compatibility List SSD or PCIe SAS/NL-SAS/ SATA HDDs HBA/RAID Controller with multiple options available at GA + 30 using the Virtual SAN Compatibility Guide* Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page Components for Virtual SAN must be chosen from Virtual SAN HCL, using any other components is unsupported 18

Virtual SAN Disk Groups Virtual SAN uses the concept of disk groups to pool together flash devices and magnetic disks as single management constructs Disk groups are composed of at least 1 flash device and 1-7 magnetic disks Flash devices are use for performance (Read cache + Write buffer) Magnetic disks are used for storage capacity Disk groups cannot be created without a flash device Each host: 5 disk groups max. Each disk group: 1 SSD + 1-7 HDDs disk group disk group disk group disk group disk group 19

Virtual SAN Datastore Virtual SAN is an object store solution that is presented to vsphere as a file system The object store mounts the VMFS volumes from all hosts in a cluster and presents them as a single shared datastore Only members of the cluster can access the Virtual SAN datastore Not all hosts need to contribute storage, but its recommended vsandatastore Single VSAN datastore per cluster disk group disk group disk group disk group esxi-01 esxi-02 esxi-03 esxi-04 20

Virtual SAN I/O flow Write Acknowledgement esxi-01 esxi-02 esxi-03 esxi-04 raid-1 vsan network vmdk vmdk witness Destaging to HDD is done independently between hosts. VSAN mirrors write IOs to all active mirrors, these are acknowledged when they hit the flash buffer!

VSAN IO flow Reads esxi-01 esxi-02 esxi-03 Read block 1 and 2. Block 1 is owned by esxi-01 and block 2 by esxi-03. vsan network Read Cache 1MB (1) Write Buffer Read Cache Write Buffer Magnetic Disks vmdk witness Magnetic Disks vmdk 1MB (2) VSAN track of where IO resides and reads from where located

Virtual SAN Network New Virtual SAN traffic VMkernel interface. Dedicated for Virtual SAN intra-cluster communication and data replication. Supports both Standard and Distributes vswitches Leverage NIOC for QoS in shared scenarios NIC teaming used for availability and not for bandwidth aggregation. Layer 2 Multicast must be enabled on physical switches. Much easier to manage and implement than Layer 3 Multicast uplink1 uplink2 vmk0 vmk1 vmk2 Management Virtual Machines vmotion Virtual SAN 20 shares 30 shares 50 shares 100 shares Distributed Switch 19

Virtual SAN Is Highly Resilient Against Any Hardware Failure Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures esxi-01 esxi-02 esxi-03 esxi-04 Simple to set up via policy raid-1 vsan network vsphere + Virtual SAN Delivered on per VM basis Zero data loss in case of disk, network or host failures Interoperable with vsphere HA and Maintenance Mode vmdk vmdk ~50% of I/O ~50% of I/O witness Virtual SAN Policy: Number of failures to tolerate = 1 24

Virtual SAN Key Benefits Radically Simple High Performance Lower TCO Installs in two clicks Managed from vsphere Client Policy-based management Self-tuning and elastic Deep integration with VMware stack Embedded in vsphere kernel Flash-accelerated Matches the VDI density of all flash array Best price/performance 100 kazillion IOps Eliminates large upfront investments (CAPEX) Grow-as-you-go (OPEX) Flexible choice of industry standard hardware Does not require specialized skills 25

Thank You