VMware Software-Defined Storage & Virtual SAN 5.5.1 Peter Keilty Sr. Systems Engineer Software Defined Storage pkeilty@vmware.com @keiltypeter Grant Challenger Area Sales Manager East Software Defined Storage VMware, Inc. gchallenger@vmware.com May, 2014 2014 VMware Inc. All rights reserved.
The Software-Defined Data Center Expand virtual compute to all applications Transform storage by aligning it with app demands Virtualize the network for speed and efficiency Management tools give way to automation 2
The Software-Defined Data Center Transform storage by aligning it with app demands 3
New Storage Tiers Are Rapidly Growing Flash: Enables New Storage Architectures Cloud: Enables Cost-Effective Storage Cloud Storage Flash is 50x 2,000x faster than HDD 110K/140K IOPs R/W from 360GB MLC PCIe card 1 Less than $0.10 per IOP Eliminates the need to stripe across 100s of HDDs Enables high performance server-side storage Highly scalable, pay-as-you-go Access through standard APIs Low cost for capacity $0.05 per GB per month 2 Forecasted to grow at 40% annually to 2018 3 1. Source: FuisionIO iodrive2, Feb 2014 2. Source: Amazon S3, Feb 2014 3. Source: MarketsandMarkets Cloud Storage report - http://www.marketsandmarkets.com/pressreleases/cloud-storage.asp 4
The Hypervisor Opens Up New Opportunities The virtualization platform: Knows the needs of all apps in real time vsphere Sits directly in the I/O path Global view of underlying infrastructure Hardware agnostic x86 Servers SAN / NAS Cloud Storage 5
VMware Leads the Way to A New Approach Software-Defined Storage represents the next step in Storage Evolution VI 3.x VMFS Snapshots Storage vmotion NAS & iscsi support vsphere 4.x Thin Provisioning Storage I/O control Boot from SAN VAAI Linked mode 2008-2010 vsphere 5.x Storage DRS Profile-driven Storage VASA SPBM vsphere Storage Appliance vsphere Data Protection vsphere Replication vsphere Flash Read 2011-2013 Software-defined Storage 2014+ Virtual SAN VASA Storage Policy Based Management (SPBM) Virtual Volumes 2005-2007 6
Software-Defined Storage Bringing the efficient operational model of virtualization to storage Policy-driven Control Plane Virtual Data Services Data Protection Mobility Performance Hypervisor-converged Storage pool Virtual Data Plane SAN/NAS Pool Object Storage Pool VVOL VASA x86 Servers Virtual SAN SAN / NAS Cloud Object Storage 7
VMware Virtual SAN 5.5 Radically Simple Hypervisor-Converged Storage
Disk Group 1 Disk Group 1 Virtual SAN Scale Out esxi-01 esxi-02 esxi-03 SDD 1 HDD 1 esxi-01 esxi-02 esxi-03 esxi-04 SDD 1 HDD 1
Disk Group 1 Disk Group 1 Virtual SAN Scale Up - Capacity esxi-01 esxi-02 esxi-03 SDD 1 HDD 1 esxi-01 esxi-02 esxi-03 SDD 1 HDD 1 HDD 2 HDD 3 HDD 4 HDD 5 HDD 6 HDD 7
Virtual SAN Enabled vsphere Cluster Scaled Up and Out 3 Hosts
Virtual SAN Enabled vsphere Cluster Scaled Up and Out 8 Hosts
Virtual SAN Enabled vsphere Cluster Scaled Up and Out 16 Hosts 1M IOPS 2.2 Petabytes
Virtual SAN Enabled vsphere Cluster Scaled Up and Out 32 Hosts 2M IOPS 4.4 Petabytes
Virtual SAN (VSAN) is NOT a Virtual Storage Appliance (VSA) Virtual SAN is fully integrated with vsphere (ESXi & vcenter) Drivers embedded in ESXi 5.5 contain the Virtual SAN smarts Kernel modules: Provide the shortest path for I/O Remove unnecessary management overheads when dealing with an appliance Do not consume resources unnecessarily VSA Virtual SAN Not a VSA Virtual SAN Embedded into vsphere 15
Virtual SAN: Radically Simple Hypervisor-Converged Storage The Basics vsphere + Virtual SAN Software-defined storage embedded in vsphere Runs on any standard x86 server Pools HDD/flash into a shared datastore SSD Hard disks SSD Hard disks SSD Hard disks Managed through storage policy-based management framework Virtual SAN Shared Datastore High performance through flash acceleration Highly resilient - zero data loss in the event of hardware failures Deeply integrated with the VMware stack 16
Virtual SAN Is Highly Resilient Against Any Hardware Failure Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures Simple to set up via policy Delivered on per VM basis Zero data loss in case of disk, network or host failures vsphere + Virtual SAN Ensures zero downtime from disk or network failures w Interoperable with vsphere HA and Maintenance Mode 17
Maintenance Mode planned downtime 3 Maintenance mode options: Ensure accessibility Full data migration No data migration
Virtual SAN Simplifies Storage If You Know vsphere, You Know Virtual SAN Two clicks to deploy! 19
Simplified Provisioning For Applications 1 2 3 Policies Set Based on Application Needs Per VM Storage Policies Software Automates Workload Placement Automate SLAs via VM-centric policies (Policy-based Control Plane) Capacity VM level Data services (Virtual Data Services) Performance Storage Policy-Based Management vsphere Abstract and pool (Virtualized Data Plane) Availability Replication Snapshots Virtual SAN External Array External Array 4 Storage vmotion External Array 20
Two Ways to Build a Virtual SAN Node Completely Hardware Independent http://www.vmware.com/resources/compatibility/search.php?devicecategory=vsan 1. Virtual SAN Ready Node Preconfigured server ready to use Virtual SAN 2. Build Your Own Choose individual components Any Server on vsphere Hardware Compatibility List SSD or PCIe SAS/NL-SAS/ SATA HDDs HBA/RAID Controller with multiple options available at GA + 30 using the Virtual SAN Compatibility Guide* Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page Components for Virtual SAN must be chosen from Virtual SAN HCL, using any other components is unsupported 21
Flexibly Configure For Performance And Capacity Performance Capacity 2xCPU 8-core 128GB Memory 2xCPU 8-core 128GB Memory 2xCPU 8-core 128GB Memory 1x 400GB MLC SSD (~15% of usable capacity) 1x 400GB MLC SSD (~10% of usable capacity) 2x 400GB MLC SSD (~4% of usable capacity) 5x 1.2TB 10K SAS 7x 2TB 7.2K NL-SAS 10x 4TB 7.2K NL-SAS IOPS 1 ~20-15K ~15-10K ~10-5K Raw Capacity 6TB 14TB 40TB $0.32/IOPS $0.57/IOPS $1.38/IOPS $2.12/GB $1.02/GB $0.52/GB 1. Mix workload 70% Read, 80% Random Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) 22
Broad Partner Ecosystem Support for Virtual SAN Server / Systems Solution Storage Data Protection Solution 23
Virtual SAN is Deeply Integrated with VMware Stack Ideal for VMware Environments vsphere Data Protection Virtual Desktop vmotion vsphere HA DRS Storage vmotion Snapshots Linked Clones VDP Advanced vsphere Replication VMware View Cloud Ops and Automation Disaster Recovery Storage Policy-Based Management vcenter Operations Manager vcloud Automation Center Site Recovery Manager IaaS Site A Site B 24
Observing performance Monitor performance: esxtop Performance Manager UI Ruby vsphere Console & VSAN Observer In-depth monitoring of VSAN s physical disk layer performance, cache hit rates, latencies, etc. Deploy a separate VCVA appliance to use for the Observer Increase the data gathering time beyond the default (2 hours) if necessary.
IOPS High Performance with Elastic and Linear Scalability Up to 2M IOPs in 32 Node Cluster Comparable VDI density to an All Flash Array 2M Number of VDI VMs 803 1.5M 508 1M 305 80K 253K 160K 505K 320K 480K 640K 4 8 16 24 32 Number of Hosts In Virtual SAN Cluster Notes: based on IOmeter benchmark Mixed = 70% Read, 4K 80% random Mixed 100% Read 3 5 8 Number of Hosts In Virtual SAN Cluster VSAN Notes: Based on View Planner benchmark All SSD Array 26
Storage Cost Per Desktop Granular Scaling Eliminates Overprovisioning Delivers Predictable Scaling and ability to Control Costs $240 $/VDI Storage Cost Virtual SAN Midrange Hybrid Array $190 Spikes correspond to scaling out due to IOPs requirements $140 $90 VSAN enables predictable linear scaling $40 500 1000 1500 2000 2500 3000 Number of Desktops Compared to external storage at scale Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) Additional savings come from reduced Opex through automation Virtual SAN configuration: 9 VMs per core, with 40GB per VM, 2 copies for availability and 10% SSD for performance 27
Virtual SAN Reduces CAPEX and OPEX for Better TCO CAPEX Server-side economics No Fibre Channel network Pay-as-you-grow OPEX Simplified storage configuration No LUNs Managed directly through vsphere Web Client Automated VM provisioning Simplified capacity planning As Low as $0.25/IOPS As Low as $50/Desktop 1 As Low as $0.50/GB 2 5X Lower OPEX 4 Up to 50% TCO Reduction 1. Full clones 2. Usable capacity 3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs) 4. Source: Taneja Group 28
Virtual SAN Use Cases Use Cases for Virtual SAN 5.5 Virtual Desktop (VDI) Tier 2 / Tier 3 / Staging DR Target Site A Site B Handle peak performance requirements (boot, login, read/write storms) VSAN is easy to use and will allow us to scale out a VDI environment using existing hardware without impacting our existing storage environment. Granularly scale from POC to production without huge System upfront Admin, investments OfficeMax Joshua Stark Support high VDI density Rapid storage provisioning and complete automation Virtual SAN s simple storage setup and Ideal ability price/performance to scale make it a compelling technology for our Tier II and Enables III workloads. Cloud Virtual Architect SAN greatly to reduces the complexity in managing storage easily compared provision to a traditional storage SAN or NAS. Harry Le System Admin, Travelocity.com Integrated with vsphere Replication and VMware SRM Virtual SAN allows us to build geographically dispersed clusters in a metro area, allowing a level of redundancy Reduces previously cost of storage not available. More importantly, Virtual SAN provides an unmatched TCO for private cloud infrastructures. Minimizes data center footprint Dave Burns VP of Tech Ops, Cincinnati Bell 29
Use Cases Tier 2 / Tier 3 Test / Dev / Staging Private cloud Backup and DR Target Virtual Desktop VDI Site A Site B Management Clusters DMZ / Isolated ROBO VSAN vsphere 30
Why Virtual SAN? Radically Simple High Performance Lower TCO Two click Install Single pane of glass Policy-driven Self-tuning & Self-healing Integrated with VMware stack Embedded in vsphere kernel Flash-accelerated Up to 2M IOPs from 32 nodes Granular and linear scaling Server-side economics No large upfront investments Grow-as-you-go Easy to operate with powerful automation No specialized skillset 31
Additional Resources Product Page http://www.vmware.com/products/virtual-san/ VSAN Community https://communities.vmware.com/community/vmtn/vsan VIP Tool vip.vmware.com/salessignup Hands-On-Lab http://vmware.com/go/vsanlab Virtual SAN 60-day Free Evaluation http://www.vmware.com/go/try-vsan-en Software-defined Storage Sales Team sdssales@vmware.com mylearn VMware Virtual SAN Fundamentals [V5.5] VMware Virtual SAN: Deploy and Manage [V5.5] 32
Thank You Peter Keilty Sr. Systems Engineer - East Software Defined Storage VMware, Inc. 603-498-3979 pkeilty@vmware.com @keiltypeter http://livevirtually.wordpress.com Grant Challenger Area Sales Manager East Software Defined Storage VMware, Inc. 617-413-3113 gchallenger@vmware.com