. Software Defined Storage The New Storage Platform PRESENTATION TITLE GOES HERE Anil Vasudeva President & Chief Analyst IMEX Research www.imexresearch.com.
IT Industry Journey - Roadmap IT Industry Roadmap (Source: IMEX Research) Integration/Consolidation Integrate Physical Infrast./Blades to meet CAPSIMS IMEX Cost, Availability, Performance, Scalability, Inter-operability, Manageability & Security Standardization Cloudization On-Premises > Private Clouds > Public Clouds DC to Cloud-Aware Infrast. & Apps. Cascade migration to SPs/Public Clouds. Virtualization Pools Resources. Provisions, Optimizes, Monitors Shuffles Resources to optimize Delivery of various Business Services Standard IT Infrastructure- Volume Economics HW/Syst SW (Servers, Storage, Networking Devices, System Software (OS, MW & Data Mgmt. SW) Big Data Analytics Predictive Analytics - Unstructured Data From Dashboards Visualization to Prediction Engines using Big Data. Automation Automatically Maintains Application SLAs (Self-Configuration, Self-Healing IMEX, Self-Acctg. Charges etc.) 2
Data Centers & Cloud Infrastructure Public CloudCenter Enterprise VZ Data Center On-Premise Cloud Vertical Clouds IaaS, PaaS SaaS Servers VPN Switches: Layer 4-7, Layer 2, 10GbE, FC Stg Supplier/Partner s Remote/Branch Office Cellular Wireless ISP ISP ISP ISP Internet Core Optical Edge ISP Web 2.0 Social Ntwks. Facebook, Twitter, YouTube Cable/DSL Home Networks ISP ISP Caching, Proxy, FW, SSL, IDS, DNS, LB, Web Servers Tier-1 Edge Apps Application Servers HA, File/Print, ERP, SCM, CRM Servers FC/IPSANs ScaleOut NAS Database Servers, Middleware, Data Mgmt Tier-3 Data Base Servers Tier-2 Apps Directory Security Policy Management Middleware Platform 3
4 R A I D S O F T W A R E D I S K C O N T R O L L E R H O S T High Availability RAID-1 Cost RAID-5 Performance RAID-3 JBOD/DASD RAID First SW Defined Storage 1988 RAID SW Creates Specific Storage Capabilities (HA, Performance, Cost) Sources: Vasudeva, Anil A Case for Disk Arrays Presented at LAN Conference, Santa Clara, CA Aug 1988 Patterson D., Katz R, Gibson G A case for Redundant Array of Inexpensive Disks (RAID) UC Berkeley 1988 D I S K C O N T R O L L E R H O S T
Apps: Key to Infrastructure Architectr. IOPS* (*Latency-1) 1000 K 100 K 10K 1K Transaction Processing (RAID - 1, 5, 6) OLTP ecommerce Data Warehousing Business Intelligence OLAP Scientific Computing (RAID - 0, 3) HPC 100 TP HPC Imaging Audio Video Web 2.0 10 1 5 10 50 *IOPS for a required response time ( ms) *=(#Channels*Latency-1) 100 MB/sec Workloads need Infrastructure > Optimized for Cost, Availability, Performance 500 5
Virtualization: Impact on IT Infrastr. WW Spending on Servers Power/Cooling & Data Management Multiple s create I/O Blender Effect & Bottlenecks in Physical Servers sharing Memory Virtualization: TCO Savings 995 Pre-Virtualization (VZ) Servers 78 VZ Servers Cost over 3 years VZ SW & Support 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Virtualized Server Penetration 50% of all servers in 2011 growing to 85% by 2016 Virtualized Servers Penetration 2011 2012 2013 2014 2015 2016 Time Virtualization led Workload Consolidation provided >20x Savings in RE, Pwr., HA 6
NextGen Applications Exploding # Applications (#K) 250 200 150 100 50 Applications Growth 2013-17 70 % growth 14 % growth NextGen Cloud Apps Traditional Applications 0 2013 2014 2015 2016 2017 NexGen Cloud Applications Traditional Applications 7
Apps Driven Cloud Infrastructure Cloud Computing Private Cloud Enterprise Hybrid Cloud Public Cloud Service Providers SaaS PaaS App SLA Applications/Software as a Service App SLA App SLA App SLA Platform Tools & Services / APIs Operating Systems App SLA Management IaaS Virtualization Resources (Servers, Storage, Networks) Application s SLA dictates the Resources Required to meet specific requirements of Availability, Performance, Cost, Security, Manageability etc. 8
Next IT Frontier: Big Data Analytics RealTime DB Graph DB Rev $B $25 $20 $15 $10 $5 $- Big Data Market Syst.& Services 2011 2012 2013 2014 2015 2016 Srvcs SW Ntwk Storage Srvrs Hadoop NoSQL 9 9
Next IT Frontier: Object Storage Source: Dell 10
ITaaS: Apps leveraging SDDC/SDS Biz Intelligence Big Data Entertainment- Social Netwks HPC & Commercial Bioinformatics & Healthcare Productivity/ VDI Data: IMEX Research & Panasas 11 2010-13 IMEX Research, Copying prohibited. 2010-14 All rights IMEX reserved. Research, All rights reserved. 11
Virtualization Opens New Opportunities App OS App OS App OS App OS Virtualization Platform Has Virtualization Platform vsphere / Hyper-V / Xen / K / Inherent knowledge of Application s Requirements Global View of Infrastructure Is Hardware agnostic Converged Storage Pools 12
Need: A New Storage Architecture 1 Key Tenets of Virtualization (VZ) Resources Utilization Costs Utilization Physical Servers 15% Virtual Servers 63% Compute & Networking 2 Storage Performance Issues in VZ The I/O Blender A key Culprit Storage Underperforms in Environments Very Random, Write intensive I/Os from some s get blended with Sequential, Read Heavy I/Os from other s resulting in: o Degraded Storage Performance by 30-50% Legacy Soln: Larger, more expensive storage configs created to meet needed IOPs o Storage Capacity wastage Other Effects o Poor Thin Provisioning & Snapshots/Cloning o Inefficient Management 3 Solution: Storage Defined Storage Improves Perf., Mgmt, Cost/Provisioning,Snaps Create a storage abstraction layer o Do for Storage like Hypervisor for Compute Virtualizes Storage for Optimum Mgmt. Unlock the Performance & Wasted Capacity of Existing Storage by provisioning Storage as fast as S can be created o Improves storage performance by 10x o Improves Thin Provisioning & Snapshots o Reduces capacity consumption up to 90% Provide a -Centric Management paradigm o -Centric Management Integrate Seamlessly into existing Hypervisor 1 vdisk 2 vdisk 3 vdisk Hypervisor Storage Hypervisor n vdisk Storag e Pool 13
Storage Hypervisor: Key to SDS Storage Hypervisor Characteristics Improves Perf., Mgmt, Cost/Provisioning,Snaps Software Solution that deploys in each Host Improves Storage Performance by up to 10x Reduces Capacity Cosumption by up to 90% Instantly provisions high performance Storage Provides -Centric Mgmt. for Ease-of-use Virtual Storage Appliance 1 vdisk vdisk vdisk Hypervisor 2 n Storage Hypervisor Architecture Removes Random Write I/Os to remove storage IO inefficiencies from Hypervisor Thin- Provisions vdisks to Outperform DKs to cut storage costs in half Enable CDP making fast and scalable High Performance Snapshots/Cloning Provides Instant Provisioning of High Performance Storage Provides transparent DK level Mgmt. Lowers VDI Costs/desktop by 50% Writes vlogs Optimized de-staging vspace Reads 14
Storage Hypervisor Overview Automated Storage Management - Storage Policies per derived from App/WorkLoad Requirements Integrated with Hypervisor & Managed in vcenter SLA Requirements per managed by Intelligent Data Placement Instant Storage Provisioning Built-In Resiliency/Protection from HW failures Dynamic Scalability to Grow from TB to PB Storage designed for s Dynamic, Fast & Resilient 50% Lower TCO 15
Software Defined Storage: Bringing Operational Mode of Compute to Storage 16
SDS Drives App-Centric Data Services Storage Policy Capacity Performance Availability De-Dupe Replication Snapshots Caching Compression Encryption Back Up 17
SDS-Control Plane Automates & Manages vcenter Opns.Mgr. vsphere vsan/vvols vcloud Automation Center Control Plane 2 1 Data Plane Block Storage File Storage Object Storage Scale Out NAS Storage High End Storage Mid-Range Storage Open Storage 1 2 18
Storage Hypervisor (vsan) 19
Self-Tuning Dynamic Storage for s 20
Storage Policies Built in Advance Storage Policy Capacity Performance Availability 21
SDS is a Programmable Platform vcloud Infrastructure & Application Software Vendors REST APIs REST APIs Control Plane Data Plane Block Storage File Storage Object Storage Scale Out NAS Storage High End Storage Mid-Range Storage OpenStack Storage 22
vdatastore Capabilities visible to vcenter 1. At the time vsan Cluster is created, the capabilities available in vsan Datastores are read and automatically sent to vcenter 2. vcenter looks at these capabilities available in Datastores and sets Storage Policies 3. Storage Policies then have the Requirements of the Application running on the (Requirements such as Availability, Performance and Provisioning etc.) 23
New Role of IT: ITaaS Virtual Workspace Manages Access to Services, Applications and Data for Any Device Hybrid Cloud Seamlessly Extends Data Center to Public Cloud Software-Defined Data Center Virtualizes the Entire Data Center Automation & Management Storage & Availability Compute Network & Security 24
ITaaS - From vcenter to vstores vcenter 25
ITaaS Cloud Model using SDDC 26
Outlook: Software Defined Storage SDS - Key to Next Big Thing in ITaaS Built-In strong features for Virtualized Data Centers & Cloud Federation SDS Features Services Based Infrastructure provides Automation, Unifies Control and Efficiency Provisioning via Policies and Workload-aware services to match specific requirements of Each App Utilizes Open Standards and Interfaces based resilient, commodity Data Storage deployable on any platform of choice Covers full spectrum of block, file and object storage Cost-effective and Highly Automated Highly Scalable (Capacity, Throughput, Performance) 27
. Software Defined Storage The New Storage Platform PRESENTATION TITLE GOES HERE Anil Vasudeva President & Chief Analyst IMEX Research www.imexresearch.com.