Software-Defined Storage & VMware Virtual SAN Luc Gallet lgallet@vmware.com June, 2014 2014 VMware Inc. All rights reserved.
VMware Delivers: The Foundation for the Software-Defined Enterprise End User Computing Desktop Mobile Virtual Workspace Applications Traditional Modern SaaS Software-Defined Data Center Policy-based Management & Automation Cloud Automation Cloud Operations Cloud Business Virtualized Infrastructure Abstract & Pool Hybrid Cloud VMware & vcloud Data Center Partners Compute Abstraction = Server Virtualization Network Abstraction = Virtual Networking Storage Abstraction = Software-Defined Storage Private Clouds Public Clouds Physical Hardware Compute Network Storage 2
The Software-Defined Data Center Expand virtual compute to all applications Transform storage by aligning it with app demands Virtualize the network for speed and efficiency Management tools give way to automation 3
The Software-Defined Data Center Transform storage by aligning it with app demands 4
Today s Challenge: Massive Increase in Storage Demand & Complexity Storage Growth Most Pressing Storage Challenges Terabytes Sold 120M 100M 41% YoY Meeting SLA Troubleshooting 31% 42% 80M 60M Data Migrations 28% 40M Time/budget 28% 20M Provisioning 26% M 2008 2009 2010 2011 2012 2013 2014 2015 2016 Terabytes Sold Management Complexity 24% Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293 Source: IDC, Storage Predictions 2014, January 2014, General Storage QuickPoll, #243511, n=307 5
Storage Market in Midst of Disruption Server Storage Shared Storage New Forms Key Drivers 20-30 years ago 10-15 years ago Today Server flash Falling storage prices Abundant CPU cycles Hypervisor-converged infrastructure Cloud economics 6
New Storage Tiers Are Rapidly Growing Flash: Enables New Storage Architectures Cloud: Enables Cost-Effective Storage Cloud Storage Flash is 50x 2,000x faster than HDD 110K/140K IOPs R/W from 360GB MLC PCIe card 1 Less than $0.10 per IOP Eliminates the need to stripe across 100s of HDDs Enables high performance server-side storage Highly scalable, pay-as-you-go Access through standard APIs Low cost for capacity $0.05 per GB per month 2 Forecasted to grow at 40% annually to 2018 3 1. Source: FusionIO iodrive2, Feb 2014 2. Source: Amazon S3, Feb 2014 3. Source: MarketsandMarkets Cloud Storage report - http://www.marketsandmarkets.com/pressreleases/cloud-storage.asp 7
The Hypervisor Opens Up New Opportunities The virtualization platform: Knows the needs of all apps in real time vsphere Sits directly in the I/O path Global view of underlying infrastructure Hardware agnostic x86 Servers SAN / NAS Cloud Storage 8
Leveraging The Hypervisor We Can Transform Storage Today Software-defined Storage Automate SLAs via VM-centric policies (Policy-based Control Plane) LUN LUN LUN LUN LUN Replication Hypervisor Converged Pool SAN/NAS Pool Snapshots Object-based Pool VM level Data services (Virtual Data Services) Abstract and pool (Virtualized Data Plane) Array A Array B vsphere Device specific management Lack of VM awareness Rigid SLAs management from LUNs x86 Servers SAN / NAS Cloud Object Storage Virtual SAN 9
VMware Virtual SAN Radically Simple Hypervisor-Converged Storage
Virtual SAN: Radically Simple Hypervisor-Converged Storage The Basics vsphere + Virtual SAN Software-defined storage embedded in vsphere Runs on any standard x86 server Pools HDD/flash into a shared datastore SSD Hard disks SSD Hard disks SSD Hard disks Managed through storage policy-based management framework Virtual SAN Shared Datastore High performance through flash acceleration Highly resilient - zero data loss in the event of hardware failures Deeply integrated with the VMware stack 11
Two Ways to Build a Virtual SAN Node Completely Hardware Independent 1. Virtual SAN Ready Node Preconfigured server ready to use Virtual SAN 2. Build Your Own Choose individual components Any Server on vsphere Hardware Compatibility List SSD or PCIe SAS/NL-SAS/ SATA HDDs HBA/RAID Controller with multiple options available at GA + 30 using the Virtual SAN Compatibility Guide* Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page Components for Virtual SAN must be chosen from Virtual SAN HCL, using any other components is unsupported 12
Flexibly Configure For Performance And Capacity Performance Capacity 2xCPU 8-core 128GB Memory 2xCPU 8-core 128GB Memory 2xCPU 8-core 128GB Memory 1x 400GB MLC SSD (~15% of usable capacity) 1x 400GB MLC SSD (~10% of usable capacity) 2x 400GB MLC SSD (~4% of usable capacity) 5x 1.2TB 10K SAS 7x 2TB 7.2K NL-SAS 10x 4TB 7.2K NL-SAS IOPS 1 ~20-15K ~15-10K ~10-5K Raw Capacity 6TB 14TB 40TB 1. Mix workload 70% Read, 80% Random Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) 13
Why Virtual SAN? Radically Simple High Performance Lower TCO Two click Install Single pane of glass Policy-driven Self-tuning Integrated with VMware stack Embedded in vsphere kernel Flash-accelerated Up to 2M IOPs from 32 nodes Granular and linear scaling Server-side economics No large upfront investments Grow-as-you-go Easy to operate with powerful automation No specialized skillset 14
Virtual SAN Components Virtual SAN components are chunks of objects distributes across multiple hosts in a cluster in order to tolerate simultaneous failures and meet performance requirements. Virtual SAN utilizes a Distributed RAID architecture to distribute data across the cluster. Components are distributed with the use of two main techniques: Striping (RAID0) Mirroring (RAID1) vsandatastore RAID1 replica-1 disk group disk group disk group disk group disk group replica-2 HDD HDD HDD HDD HDD VSAN network VSAN network VSAN network VSAN network VSAN network Number of component replicas created is based on the object policy definition. 15
Virtual SAN Is Highly Resilient Against Any Hardware Failure Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures Simple to set up via policy Delivered on per VM basis vsphere + Virtual SAN Zero data loss in case of disk, network or host failures Ensures zero downtime from disk or network failures Interoperable with vsphere HA and Maintenance Mode 16
Virtual SAN Enables Elastic Linear Scaling of Performance and Capacity No More Complex Forecasting & Large Upfront Investments Scale OUT Add more nodes Scale UP Add more Disks Elastic Grow or shrink on demand Granular Add single nodes or disks Non-disruptive No app downtime 4.4 PB 400 TB 40 TB Capacity IOPS Virtual SAN enables us to scale our storage infrastructure and while providing the necessary redundancy. This allows us to be more agile and bring our solutions to market faster. Frans Van Rooyen Cloud Architect, Adobe 17
Virtual SAN Delivers Enterprise-Grade Scale Maximum Scalability per Virtual SAN Cluster 32 Hosts 3,200 VMs 2M IOPS 4.4 Petabytes 18
High Performance with Elastic and Linear Scalability Up to 2M IOPs in 32 Node Cluster Comparable VDI density to an All Flash Array 2M Number of VDI VMs 677 767 805 1.5M 473 IOPS 80K 253K 160K 505K 320K 1M 480K 640K 286 4 8 16 24 32 Number of Hosts In Virtual SAN Cluster Notes: based on IOmeter benchmark Mixed = 70% Read, 4K 80% random Mixed 100% Read 3 5 7 8 Number of Hosts In Virtual SAN Cluster VSAN Notes: Based on View Planner benchmark All SSD Array 19
Virtual SAN Simplifies Storage If You Know vsphere, You Know Virtual SAN Two clicks to deploy! 20
Virtual SAN is Deeply Integrated with VMware Stack Ideal for VMware Environments vsphere Data Protection Virtual Desktop vmotion vsphere HA DRS Storage vmotion Snapshots Linked Clones VDP Advanced vsphere Replication VMware View Cloud Ops and Automation Disaster Recovery Storage Policy-Based Management vcenter Operations Manager vcloud Automation Center Site Recovery Manager IaaS Site A Site B 21
Virtual SAN Puts The App In Charge Simpler and Automated Storage Management Through Application-centric Approach Today Today Virtual SAN 1. Pre-define storage configurations 2. Pre-allocate static bins 3. Expose pre-allocated bins 4. Select appropriate bin 5. Consume from pre-allocated bin Overprovisioning (Better safe than sorry!) Wasted resources, wasted time Frequent data migrations Virtual SAN Shared Datastore 1. Define storage policy 2. Apply policy at VM creation Resource and data service are automatically provisioned and maintained. No overprovisioning Less resources, less time Easy to change 22
Virtual SAN Simplifies And Automates Storage Management Per VM Storage Service Levels From a Single Self-tuning Datastore Per VM Storage Policies Policies Set Based on Application Needs Software Automates Control of Service Levels Capacity Storage Policy-Based Management Performance vsphere + Virtual SAN SLAs Virtual SAN is easy to deploy, just a few check boxes. No need to configure RAID. Jim Streit IT Architect, Thomson Reuters Availability No more LUNs/Volumes! Virtual SAN Shared Datastore 23
Virtual SAN Reduces CAPEX and OPEX for Better TCO CAPEX Server-side economics No Fibre Channel network Pay-as-you-grow OPEX Simplified storage configuration No LUNs Managed directly through vsphere Web Client Automated VM provisioning Simplified capacity planning As Low as $0.25/IOPS As Low as $50/Desktop 1 As Low as $0.50/GB 2 5X Lower OPEX 4 Up to 50% TCO Reduction 1. Full clones 2. Usable capacity 3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) 4. Source: Taneja Group 24
VMware Virtual SAN 5.5 Use Cases
Use Cases Tier 2 / Tier 3 Test / Dev / Staging Private cloud Backup and DR Target Virtual Desktop VDI Site A Site B Management Clusters DMZ / Isolated Small environments / ROBO VSAN vsphere 26
Why Virtual SAN? Radically Simple High Performance Lower TCO Two click Install Single pane of glass Policy-driven Self-tuning Integrated with VMware stack Embedded in vsphere kernel Flash-accelerated Up to 2M IOPs from 32 nodes Granular and linear scaling Server-side economics No large upfront investments Grow-as-you-go Easy to operate with powerful automation No specialized skillset 27
Introducing VMware EVO:RAIL TM Hyper-Converged Infrastructure Appliance Powered by VMware 29
VMware EVO:RAIL Simplify How You Buy, Deploy and Operate Your SDDC EVO:RAIL software with vsphere and Virtual SAN technology is the key enabler Single SKU procurement model creates design and price predictability Simple, streamlined deployment and ongoing SDDC lifecycle management One support call 30
VMware EVO:RAIL Offers Unique Customer Value 100% Powered By VMware Choice of Qualified EVO:RAIL Partner Transformational User Experience Built on core vsphere that you already know and use Built with Virtual SAN Highly resilient by design Compatible with existing VMware infrastructure products and ecosystem Broad and expanding partner ecosystem Support from your Preferred EVO:RAIL Partner Single SKU purchase for hardware, software, and support Time to Value to first VM in minutes Simple configuration and management Automated scale out Non-disruptive patching and upgrade 31
VMware EVO:RAIL Delivers Hyper-Converged Infrastructure VMware EVO:RAIL Appliance New New EVO:RAIL Software Bundle EVO:RAIL rapid deployment, configuration, and management engine Compute, network & storage virtualization with vsphere and Virtual SAN VMware Support & Services (SnS) Software bundle provided to qualifying partners via a Franchise Like Model 2U/4-Node hardware platform optimized for EVO:RAIL 4 independent nodes for compute, network, and storage Each node has dual processors & 192GB of Memory Total of 16TB of Flash and HDD Storage via Virtual SAN Phone and in-field HW & SW Support & Services (SnS) Simplicity Transformed Power-on to VM creation in minutes, radically easy VM deployment, one-click non-disruptive patch and upgrades, simplified management Software Defined Building Block Delivering compute, network, and storage resources for server or desktop workloads Trusted Foundation 100% VMware software Highly Resilient by Design Fault tolerance within and across appliances Infrastructure at the Speed of Innovation Simplify design with predictable sizing and scaling, streamline purchase and deployment Freedom of Choice Variety of partner systems & value-add offerings
High Level Specifications Per Node Per Appliance Dual Intel E5-26x0v2 6 core processors 192 GB memory 3 x 1.2 TB HDD 1 x 400 GB Intel SSD 2 x 10 GbE NIC port 1 x 1GbE management port 48 CPU cores ~ 100 GHz 768 GB memory capacity 14.4 TB storage capacity 1.6 TB flash capacity 80 GbE network bandwidth Dual redundant power supplies 33
Introducing the EVO:RAIL Software 34
Configuration - Time to Value: Power on to Creating VMs in minutes 35
Configuration - Time to Value: Power on to Creating VMs in minutes 36
Configuration - Time to Value: Power on to Creating VMs in minutes 37
Easy VM Creation & Management Intuitive UI with simplified VM creation and lifecycle management Grid view of all the VMs across multiple appliances 38
Easy VM Creation & Management Intuitive UI with simplified VM creation and lifecycle management Grid View of all the VMs across multiple appliances 39
Simplified Hardware Management Hardware Summary Status of each node, appliance, or cluster Warning and fault notifications Integration with vcenter Log Insight 40
Zero-Downtime Patch and Upgrade Management Easy upgrade and patch with no workload downtime Full redundancy as each appliance has 4 independent nodes Updates pre-validated for the appliance before application 41
Ideal Environments for EVO:RAIL Virtual Desktop Solution POC and Pay & Scale as you grow R&D and Test Environments Tight budget for compute/storage; Quick deployment of infrastructure Remote/Branch Office Locations Data Center in a Box Private Cloud Infrastructure On-site cloud for employees or customers; Off-site co-located Limited IT staff General Purpose VDI ROBO - Simplified, repeatable deployment/management Geographic Data Locality Limited footprint for in-country solution Virtual Private Cloud 42
Global Reach and Customer Choice Availability starting in 2H of 2014 43
Thank You