VMware Software-Defined Storage Vision Lee Dilworth (@leedilworth) Principal Systems Engineer 2014 VMware Inc. All rights reserved.
The Software-Defined Data Center Expand virtual compute to all applications Transform storage by aligning it with app demands Virtualize the network for speed and efficiency Management tools give way to automation 2
The Software-Defined Data Center Transform storage by aligning it with app demands 3
Legacy Operational Model Creates Several Challenges vsphere Storage Consumer Challenges: Lengthy provisioning cycles Difficult to make adjustments Lack of granular control Complex troubleshooting Frequent data migrations Snapshot Replication Encryption Device Mgmt. Device Mgmt. SAN NAS All-flash Device Mgmt. Storage Provider Challenges: Fragmented device management Rigid capacity and data services allocation Complex LUN/Volume management 4
The Hypervisor Opens Up New Opportunities The Virtualization Platform: Knows the needs of all apps in real time vsphere Sits directly in the I/O path Global view of underlying infrastructure Hardware agnostic x86 Servers Cloud Storage SAN / NAS 5
The Hypervisor Opens Up New Opportunities New application centric control plane Common consumption model across all storage tiers Dynamic composition of storage services Granular control of service levels vsphere Virtualize The Data Plane Abstract and pool infrastructure x86 Servers SAN / NAS Cloud Storage Make the virtual disk the primary unit of data management Enable new hot-edge for vsphere: Hypervisor-converged storage tier on x-86 6
Storage Policy-Based Management Simplifies Provisioning And Delivers Agility Today Today Hardware centric Vendor specific management Static pre-allocation of shared storage container (LUN) Data services aligned to storage container Storage Policy-Based Management Application-centric Common management across heterogeneous devices Policy-based dynamic composition of services Granular control of data services to individual VMs SDS Long provisioning cycles Overprovisioning of resources Management complexity Frequent data migrations Raid provisioning No overprovisioning of resources Efficiency through automation Simple change management 7
Enabling New Storage Tiers With Common Control Plane vcloud Automation Center Cloud And Management Automation OpenStack Storage Policy Based Mgmt. Storage Policy Based Mgmt. Storage Policy Based Mgmt. vsphere Virtual Volumes Virtual SAN vcloud Air Virtual Datastore SSD HDD SSD HDD SSD HDD Virtual SAN Shared Datastore Cloud Storage SAN / NAS SAN / NAS 8
VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage Policy-driven Control Plane Virtual Data Plane Virtual Data Services Data Protection Mobility Performance Virtual Datastores x86 Servers VSAN SAN / NAS Cloud Object Storage 9
Virtual SAN: Product goals 1. Targeted customer: vsphere admin vsphere 1. Compelling Total Cost of Ownership (TCO) CAPEX: capacity, performance OPEX: ease of management Virtual SAN 1. The Software-Defined Storage for VMware Strong integration with all VMware products and features CONFIDENTIAL 10
What is Virtual SAN? vsphere VSAN esxi-01 esxi-02 esxi-03 Software-based storage built in ESXi No hardware RAID Aggregates local Flash (R/W cache) and HDDs (Capacity) Cluster wide object datastore for VM consumption Converged compute + storage Distributed architecture, no single point of failure Deeply integrated with VMware stack
Simplified Provisioning For Applications Legacy 5. Consume from pre-allocated bin 4. Select appropriate bin VSAN 1. Define storage policy 2. Apply policy at VM creation 3. Expose pre-allocated bins 2. Pre-allocate static bins 1. Pre-define storage configurations VSAN Shared Datastore Resource and data services are automatically provisioned and maintained Overprovisioning (better safe than sorry!) Wasted resources, wasted time Frequent Data Migrations No overprovisioning Less resources, less time Easy to change 12
Virtual SAN Scale Out esxi-01 esxi-02 esxi-03 esxi-01 esxi-02 esxi-03 esxi-04
Virtual SAN Scale Up esxi-01 esxi-02 esxi-03 esxi-01 esxi-02 esxi-03
Virtual SAN Is Highly Resilient Against Hardware Failures Simple to set resiliency goals via policy Enforced per VM and per vmdk vsphere + Virtual SAN Zero data loss in case of disk, network or host failures High availability even during network partitions Automatic, distributed data reconstruction after failures Interoperable with vsphere HA and Maintenance Mode 15
Single Virtual SAN datastore scalability Cluster: 3-32 nodes; up to 5 SSDs, 35 HDDs per host Capacity: 4.4 Petabytes Performance: 2M IOPS 100% reads 640K IOPS 70% reads
How To Deploy A Virtual SAN Cluster Component Based Software + Hardware Virtual SAN Ready Node VMware EVO:RAIL Hyper-Converged Infrastructure Choose individual components Any Server on vsphere Hardware Compatibility List SSD or PCIe 40 OEM validated server configurations ready for Virtual SAN deployment (2) A Hyper-Converged Infrastructure Appliance (HCIA) for the SDDC SAS/NL-SAS/ SATA HDDs HBA/RAID Controller using the VMware Virtual SAN Compatibility Guide (VCG) (1) Maximum Flexibility Each EVO:RAIL HCIA is pre-built on a qualified and optimized 2U/4 Node server platform. Sold via a single SKU by qualified EVO:RAIL partners (3) Maximum Ease of Use Note: 1) Components must be chosen from Virtual SAN HCL, using any other components is unsupported see Virtual SAN VMware Compatibility Guide Page 2) VMware continues to update/add list of the available Ready Nodes, please refer to Virtual SAN VMware Compatibility Guide Page for latest list 17
VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage Policy-driven Control Plane Virtual Data Plane Virtual Data Services Data Protection Mobility Performance Virtual Datastores x86 Servers SAN / NAS vvol Cloud Object Storage 18
VMware Software-Defined Storage Vision For External Storage Storage Policy Storage Policy Based Management Capacity Performance Policy driven, VM-centric control plane Availability Data Protection Security Dynamic composition of storage services Storage Policy-Based Mgmt. vsphere Virtual Volumes Intelligent placement and transparent remediation Common across heterogeneous devices Virtual Datastore Published Capabilities Virtual Volumes Device Mgmt. Device Mgmt. Snapshot Replication Deduplication QoS Virtual disks natively represented on external storage Granular control of native array data services on a per VM basis No more LUNs/Volumes SAN / NAS SAN / NAS 19
VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage Policy-driven Control Plane Virtual Data Plane Virtual Data Services Data Protection Mobility Performance Virtual Datastores x86 Servers SAN / NAS Cloud Object Storage object 20
Ever Growing Challenges of Storage Unstructured* vs. Structured Data Growth of unstructured data* is 5X times faster than structured data 70% of this data is untouched after initial creation Traditional storage (NAS/SAN) is expensive and does not scale well for unstructured data Traditional file hierarchies does not support global access use cases Static Storage Budgets Exponential growth of digital data but YoY decrease in storage budgets resulting in insufficient storage resources to meet business demands Long term data retention regulations consumes a large part of storage budgets * Information that is not structured in a predefined manner CONFIDENTIAL 21
VMware vcloud Air Object Storage Extremely Scalable Easy Access & Dependable Cost Effective Petabyte scale data Single object can be up to 20 TB 1000 buckets and unlimited Objects per tenant Easy access from any device, anywhere, anytime (Supports HTTP, HTTPS) High durability Granular object-level security Pay only for what you use Per minute metering Convenient monthly billing Inexpensive and elastic Sign-up for beta http://www.vmware.com/go/getobjectstorage
VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage Policy-driven Control Plane Virtual Data Plane Virtual Data Services Data Protection Mobility Performance Virtual Datastores x86 Servers SAN / NAS Cloud Object Storage 23
Thank you