Copyright 2015 EMC Corporation. All rights reserved. 1
VMWARE SOFTWARE DEFINED STORAGE ALBERTO FARRONATO DIRECTOR, PRODUCT MARKETING VIJAY RAMACHANDRAN DIRECTOR, PRODUCT MANAGEMENT Copyright 2015 EMC Corporation. All rights reserved. 2
Agenda The Software-Defined Data Center Hyper-Converged Storage and VMware Virtual SAN Virtual SAN 6 A Closer Look VMware vsphere Virtual Volumes VMware and EMC Integrations For Software-Defined Storage
The Software-Defined Data Center Expand virtual compute to all applications Transform storage by aligning it with app demands Virtualize the network for speed and efficiency Management tools give way to automation 4
The Software-Defined Data Center Transform storage by aligning it with app demands 5
Customers Face Several Challenges with Storage Today Specialized Expensive HW Device-centric Silos Complex Processes App Admin VI Admin Storage Admin Not commodity Low utilization Overprovisioning Static classes of service Rigid provisioning Lack of granular control Frequent data migrations Time consuming processes Lack of automation Slow reaction to request 6
A New Approach is Needed: Software-Defined Storage Storage Today Software-Defined Storage New Control Plane From Hardware-centric to App-centric Policy-driven automation Common across arrays Dynamic control New Data Plane From Specialized to Industry Standard Hardware Server SAN Flash accelerated Distributed 7
The Hypervisor is Best Positioned to Deliver the Software-Defined Storage Transformation Why the Hypervisor: Over 70% of x86 server workloads are virtualized 1 vsphere It s inherently app-aware Sits directly in the I/O path Has global view of underlying storage resources It s hardware agnostic (1) Gartner Market Trends: x86 Server Virtualization, Worldwide, 2013 8
The VMware Software-Defined Storage Vision Transforming Storage the Way Server Virtualization Transformed Compute VMware vsphere Storage Policy-Based Mgmt App-centric storage automation Common mgmt across heterogeneous arrays vsphere VMware Virtual SAN Hyper-converged architecture Data persistence delivered from the hypervisor 9
vsphere Virtual Volumes Extends the Control Plane of Software-Defined Storage to the Ecosystem VMware Software-Defined VMware Storage Software-Defined Storage vsphere vsphere Storage Policy-Based Mgmt Storage Policy-Based Mgmt Virtual SAN vsphere vsphere Virtual Volumes VVOL-enabled arrays 10
The Storage Partner Ecosystem has Rallied behind Virtual SAN and Virtual Volumes VMware Software-Defined Storage vsphere Storage Policy-Based Mgmt Virtual SAN vsphere Virtual Volumes VVOL-enabled arrays 11
Hyper-Converged Storage and VMware Virtual SAN
Storage Is Moving Into The Server Converging compute and pooled storage onto a single virtualized platform Hypervisor Hypervisor Server SAN External Storage Arrays 13
Key Trends Driving Adoption of Hyper-Converged Infrastructure High Density Flash High performance and predictably low latencies Becoming more affordable; leading to better $/IOP Emergence of new form factors like UltraDimm, NVMe Increasing CPU Densities Higher cores and exascale computing power: 18 core CPUs already available today Increasing memory density and faster throughput Virtualization Virtualization lets you run application VMs next to storage software 14
What s Good About Hyper-Convergence In Virtual Environments Simplified Management Scale Out Cost-Effective Integration with the hypervisor and VMawareness VM-centric provisioning, monitoring, management Compute and storage can scale together or separately Budget-friendly grow-asyou-go scaling Uses commodity hardware Easy to manage Buy and scale what you need, when you need it 15
Future Points Towards Large Capacity, High Performance Persistent Storage On Servers THE NEWS TECH NEWS A Flashy World Exascale Computing 16
VMware Virtual SAN 6.0 Radically Simple Hypervisor-Converged Storage for VMs Overview Software-defined storage optimized for VMs vsphere + Virtual SAN Hypervisor-converged architecture Runs on any standard x86 server Pools HDD/SSD into a shared datastore SSD Hard disks SSD Hard disks SSD Hard disks Delivers enterprise-level scalability and performance Managed through per-vm storage policies Deeply integrated with the VMware stack Virtual SAN Datastore 17
Virtual SAN Is Hypervisor-converged Virtual Storage Appliance Virtual SAN is embedded in the vsphere Kernel Consumes <10% CPU Virtual SAN is Embedded inside VM Kernel vsphere... Simple to manage No need to install and manage separate virtual appliances No single point of failure Provides the shortest path for I/O Seamless integration with vsphere and VMware stack 18
Virtual SAN Simplifies Storage If You Know vsphere, You Know Virtual SAN Two clicks to deploy! 19
Virtual SAN Simplifies And Automates Storage Management Per-VM Storage Service Levels From a Single Self-tuning Datastore Per VM Storage Policies Policies Set Based on Application Needs Software Automates Control of Service Levels Capacity Storage Policy-Based Management Performance vsphere + Virtual SAN SLAs Availability Virtual SAN Shared Datastore No more LUNs/Volumes! 20
Virtual SAN 6.0 Ready For Business-Critical Apps Virtual Infrastructure Best storage for VMs Optimized for Virtual Infrastructure Enterprise-class Business Critical Apps VDI DR Test/Dev Ready for business critical apps 21
Virtual SAN Trophy Room! Best of Interop Storage Winner (2014) Best of Interop Audience Choice Winner (2014) Best of TechEd Winner North America 2014 InfoWorld Technology of the Year (2015) InfoWorld Editors Choice Award (2014) By 2017 one-third of midmarket organizations will deploy Virtual SAN for at least 30% of their total storage capacity... 22
Unprecedented Customer Momentum 1000+ Customers in the first 9 months In my experience VMware solutions are rock solid we re ready to nearly double our VSAN deployment. It really did work as advertised the fact that I have been able to set it and forget it is huge!
Why Customers Love Virtual SAN? Radically Simple High, Predictable Performance with Elastic Scalability Lower TCO Two clicks to enable Single pane of glass Policy-driven Self-tuning Integrated with VMware stack Flash caching and SSD persistence Consistent IOPS with submillisecond response times Linear, non-disruptive scaling Embedded in vsphere kernel Server-side economics No large upfront investments Grow-as-you-go Easy to operate with powerful automation No specialized skillset needed 24
What Virtual SAN Customers Were Able to Achieve TIME TO MANAGE STORAGE REDUCED STORAGE LATENCY REDUCED STORAGE COST -90% <1 ms -60% 25
Virtual SAN 6 A Closer Look 26
Virtual SAN Architecture Minimum of 3 hosts in a cluster configuration All 3 host MUST!!! contribute storage VSAN datastore Recommended that hosts are configured with similar hardware Hosts: Scales up to 64 REPLICA-1 REPLICA-2 vsphere Cluster esxi-01 esxi-02 esxi-03 Disks: Locally attached disks o Hybrid: Magnetic disks and flash devices o All-Flash: Flash devices only Network o 1GB Ethernet OR o 10GB Ethernet (preferred) Witness component (only metadata) acts as tie-breaker during availability decisions VSAN network 27
Virtual SAN Can Be Deployed With A Tiered Hybrid Or All-Flash Architecture Hybrid All-Flash New! SSD PCIe Ultra DIMM Caching SSD PCIe Ultra DIMM Read and Write Cache Writes cached first, Reads go direct to capacity tier Virtual SAN Capacity Tier SAS/NL SAS/SATA/Direct-attached JBOD Data Persistence Capacity Tier Flash Devices Reads go directly to capacity tier 40K IOPS per Host 90K IOPS per Host + sub-millisecond latency 28
What s New in Virtual SAN 6.0 All Flash Architecture 4x Performance 2x Scale Enterprise Data Services Broader Hardware Support Data persistence on SSD Intelligent caching and twotier architecture 90K IOPS/host (4.5x more) Scale to 64 nodes (2x more) 200 VMs/host (2x more) 62 TB max. virtual disk size New high performance snapshots & clones Rack awareness to tolerate rack failures HW-based checksum & Expand scalability for blades with direct-attached JBODs Expanded HCL and more ready nodes encryption 29
Virtual SAN Enables Elastic Scaling of Performance and Capacity No More Complex Forecasting & Large Upfront Investments Scale OUT Add more nodes Scale UP Add more Disks Elastic Grow or shrink on demand Granular Add single nodes or disks Non-disruptive No app downtime 8.8 PB 100 TB 10 TB Capacity IOPS Virtual SAN lets us buy what we need when we need it. With non-disruptive scaling we can add capacity or increase performance at any time without interrupting our operations. Chris Reynolds Senior Systems Engineer 30
Virtual SAN 6.0 Ready for Enterprise-Class Applications Virtual SAN 5.5 Virtual SAN 6.0 Hybrid Virtual SAN 6.0 All-Flash Hosts per Cluster 32 64 64 VMs per Host 100 200 200 IOPS per Host 20K 40K 90K Snapshot depth per VM 2 32 32 Virtual Disk size 2TB 62TB 62TB 2x 2x 4.5x 16x 31x 31
High Performance with Elastic and Linear Scalability Up to 5.8M IOPS in 64 Node Cluster IOPS 80K VSAN Hybrid 5.5 VSAN Hybrid 6.0 VSAN All-Flash 6.0 360K 160K 160K 320K 720K 320K 640K 1.4M 1M 1.3M 2.9M 2.6M 4 8 16 32 64 Number of Hosts In Virtual SAN Cluster 5.8M We now have an environment that we can grow organically or shrink organically depending on what our needs are very linear scaling. It allows to scale our deployments the way we want to and not get locked in. This is the right way to do storage, it really is! Alan Sprague System Administrator Oregon State University, College of Business Notes: based on IOMeter 70/30 Read/Write benchmark 32
Virtual SAN Is Resilient To Rack, Host, Network or Disk Failures Automated and controlled through VM-level policy Virtual SAN Datastore Zero data loss and zero downtime despite hardware failures: Disk Host Network Rack NEW Interoperable with vsphere HA and Maintenance Mode Rack A Rack B Rack C 33
Virtual SAN is Hardware Independent Component Based Software + Hardware Virtual SAN Ready Node VMware EVO:RAIL Hyper-Converged Infrastructure Choose individual components Any Server on vsphere Hardware Compatibility List SSD or PCIe 40 OEM validated server configurations ready for Virtual SAN deployment (2) A Hyper-Converged Infrastructure Appliance (HCIA) for the SDDC SAS/NL-SAS/ SATA HDDs HBA/RAID Controller using the VMware Virtual SAN Compatibility Guide (VCG) (1) Maximum Flexibility Each EVO:RAIL HCIA is pre-built on a qualified and optimized 2U/4 Node server platform. Sold via a single SKU by qualified EVO:RAIL partners (3) Maximum Ease of Use Note: 1) Components must be chosen from Virtual SAN HCL, using any other components is unsupported see Virtual SAN VMware Compatibility Guide Page 2) VMware continues to update/add list of the available Ready Nodes, please refer to Virtual SAN VMware Compatibility Guide Page for latest list 3) EVO:RAIL availability in 2H 2014. Exact dates will vary depending on the specific EVO:RAIL partner 34
2015 & 2016 Support for Blade-only Direct Attached JBODs Manage disks in enclosures SAS Connection Blade Servers Storage Blades Enables Virtual SAN to scale on blade servers by adding more storage to blade servers with few or no local disks Flash acceleration provided on the server or in the subsystem Supported on both VSAN 5.5 and 6.0 Examples: IBM Flex SEN with x240 Blade Series Dell FX2 with 12G Controllers Direct Attach Compute:Storage 1:1
VMware vsphere Virtual Volumes Integration Framework for VM-aware Storage 2014 VMware Inc. All rights reserved.
Legacy Operational Model is Inefficient for Storage and VI Admin Lack of granular control over individual VMs vsphere Lengthy cycles with Storage Admin for provisioning, data migrations, and troubleshooting VI Admin Snapshot Replication Encryption Device Mgmt. Device Mgmt. Device Mgmt. Fragmented device management Enterprises have 3 vendors and different models IDC (1) Rigid capacity and data services allocation on LUNs Storage Admin SAN NAS All-flash 37
Virtual Volumes Transforms Storage in Virtualized Environments Storage Today Storage with vsphere 6.0 Deliver a new control plane on VM-aware storage Storage Policy Policy-Driven Automation Finer control at VM granularity Data services controlled at the hypervisor Leverage existing array capabilities Single control plane that works across heterogeneous storage Virtual Disk 38
VMware vsphere Virtual Volumes Integration Framework for VM-Aware Storage Virtual Volumes Overview Virtual disks are natively represented on arrays Enables VM granular storage operations using array-based data services Extends vsphere Storage Policy-Based Management to the storage ecosystem Supports existing storage I/O protocols (FC, iscsi, NFS) Based on T10 industry standards Industry-wide initiative supported by major storage vendors Included with vsphere 39
Virtual Volumes Introduces a New Architecture vsphere Cloud And Management Automation Data Path NFS, iscsi, FC Storage Policy-Based Management IO Device VASA APIs Control Path Bi-directional out of band communication with VASA VASA Provider specific to vendor Controllable automation through policies Protocol Endpoint (PE) directs IO from VM to Virtual Volume Protocol Endpoint PE VP VASA Provider Control Path Non disruptive follows T10 industry standards VVOL-enabled array 40
Virtual Volumes Simplifies Storage Operations Storage Policies vsphere VI Admin Consume storage using VVOL datastore VI Admin Provision VMs on the fly Capacity Access VVOL Datastore Dynamic adjustments through policies Published Capabilities Snapshot Replication PE PE VP Storage Admin Define capabilities, capacity, access using a logical pool Storage Admin Deduplication QoS SAN / NAS 41
Why vsphere Virtual Volumes? Enabling a simpler operational model for VM storage Finer Control Streamlined Operations Flexible Choice 42
Virtual Volumes Is An Industry-wide Initiative [ ] brings a relevant solution...reducing cost and complexity in virtual environments Christopher Ratcliffe Senior VP of Marketing, Core Technologies [ ] one of the most important storage technology advancements[ ] Ravi Chalaka VP Solutions Marketing [ ] as a key design partner, we ve worked very closely with VMware [ ] storage operations will be fundamentally simplified. Tim Russell VP of Product Management for Data Center Solutions Laura Guio VP and Business Line Executive, Storage Systems VMware Alliance Executive [ ] will transform the way you consume storage in your VMware environment. Craig Nunes VP of Storage Marketing This is a huge shift from the LUNcentric model of today Peter Waugh Marketing Director of Storage and Servers 43
VMware and EMC Integrations For Software-Defined Storage vsphere Storage Policy Based Mgmt. Multi Hypervisor Physical Virtual SAN Virtual Volumes VASA ViPR Controller SSD HDD SSD HDD SSD HDD Virtual SAN Shared Datastore ViPR Data Services Hypervisor-Converged Storage 3 rd Party VNX Isilon XIO VMAX SAN / NAS 44
Thank You