EMC VNX kettaseadmed #1 valik serverite virtualiseerimiseks Madis Pärn Senior Technology Consultant EMC madis.parn@emc.com 1
Agenda EMC VNX ja virtualiseerimine Demo VMware admin view Storage admin view vsphere storage provisioning vsphere IO offload 2
Best Storage for Virtual Environments By 2014, 50% of storage capacity will be in virtualized environments* VNX is rated #1 as the best product for VMware integration EMC 53% 5% 3% 3% 6% 29% January 2012 #1 VNX and VNXe wins 2012 award in Storage Virtualization category 2012 Virtualization Review Reader s Choice Awards and Buyers Guide EMC 39% Which is your storage vendor of choice in virtualized server environments? 2% 12% 12% 15% 13% Source: VMware Storage Integration Journey, Wikibon, April 2011 Source: Goldman Sachs IT Spending Survey, July 2012 * Worldwide Storage and Virtualized x86 Environments 2010 2014 Forecast, IDC, August 2010 3
Next-Generation Unified Storage Optimized for today s virtualized IT VNXe3150 VNXe3300 VNX5100 VNX5300 VNX5500 VNX5700 VNX7500 Affordable. Simple. Efficient. Powerful. 4
Virtualization Changes Everything To move to virtual servers demands new storage solutions Static RAID Groups Discrete servers Self-Optimizing Storage Pools Virtual server pool AUTOMATIC APPLICATION OPTIMIZATION AUTOMATIC DATA OPTIMIZATION RAID groups Storage pool Storage system Storage system 5
More Power, Less Management The most efficient and automated system ever Next-generation architecture Intel Xeon 5600 multi-core processors Expanded UltraFlex I/O: Fibre Channel over Ethernet (FCoE), Fibre Channel, iscsi, CIFS, NFS, pnfs Redundant 6 Gb/s SAS back end Optimized for Flash SSDs and highcapacity SAS drives Designed for the enterprise FAST Suite self-optimizing storage pools Ideal for virtualized applications Unified protocol support: file, block, and object 6
VNX Series Key Innovations Optimized for today s virtualized IT SAN BLOCK iscsi FC FCoE Highperformance FLASH NAS FILE CIFS NFS pnfs MPFS FAST Cache CLOUD OBJECT REST SOAP AUTOMATIC DATA OPTIMIZATION Highspeed HDDs Highcapacity HDDs Designed for FLASH FLASH 1st strategy FAST Cache Automatic Data Optimization Virtual Storage Pools FAST VP Deduplication & Compression Unified multi-protocol Full support for any network Unified block, file and object support 7
Flash Has Changed Storage Forever Flash for transactions and large HDDs for capacity Flash Highperformance enterprise Flash Classic 15K HDD trying to do both High-capacity HDD 8
Data Activity FLASH 1st Data Strategy Hot data on FAST Flash SSDs, cold data on dense disks Hot High Activity Highly active data is stored on Flash SSDs for fastest response time As data ages, activity falls, triggering automatic movement to highcapacity disk drives for lowest cost Flash SSD Highcapacity HDD Movement Trigger Cold Low Activity Data Age 9
The FAST Suite A FLASH 1 st strategy enabler Real-time caching with FAST Cache FAST Cache continuously ensures that the hottest data is served from high-performance Flash SSDs Flash SSD 15K HDD Highcapacity HDD FAST VP (Virtual Pools)* optimizes storage pools automatically, ensuring that active data is being served from SSDs, while cold data is moved to lower-cost disk tiers Together they deliver a fully automated FLASH 1 st storage strategy for optimal performance at the lowest cost attainable Scheduled optimization with FAST VP * Not available for VNX5100 Monitor and tune the whole system with the complementary Unisphere QoS Manager and Unisphere Analyzer 10
I/Os FAST Cache and VMWare: Block 150 Desktop Linked Clone Boot and Logon Storm w/fully Warmed Cache CX4-240 w/133gb FAST Cache 150 Linked Clones on 2+2 RAID 10 25 20 Time to Boot Desktops 14000 12000 10000 Boot FAST Cache I/Os User Login Steady State 15 8000 10 5 0 Baseline FAST Cache 6000 4000 2000 0 Disk - Total Throughput (IO/s) FAST Cache Read Hits/s FAST Cache Write Hits/s Observations and Conclusions Time to boot all desktops reduced from 20 minutes to AS LITTLE AS 4 minutes with FAST Cache (after workload burn-in) FAST Cache absorbs 99% of I/O Peak 133 IOPS per drive During peak load FAST Cache serviced over 2,800 write IOPS and 10,000 read IOPS 11
Time to Scan (minutes) I/Os FAST Cache and VMWare: Block Antivirus Scan This test measures the impact of running antivirus scan simultaneously on 150 desktops 80 70 Average Time to Scan 18000 Antivirus Scan - FAST Cache I/O 60 50 16000 14000 12000 40 30 20 10 0 Avg Time - Baseline Avg Time - FAST Cache 10000 8000 6000 4000 2000 0 Individual Disk Throughput FAST Cache Read Hits/s FAST Cache Write Hits/s Average time to scan a desktop decreased from 67 to 15 minutes with a warmed-up FAST Cache (followed several hours of Office work) Peak Host Response time decreased from 382 ms to 11.86 ms 12
FAST Cache and VMWare: NFS on VMware VMDKs Observations: Data when accessed repeatedly from the VMDKs on NFS datastore with FAST cache shows 4x performance improvement. We could see a 4x performance improvement in average throughput as well as response time with FAST cache. Strongly recommended to use FAST Cache for NFS on VMware VMDKs Recommendation Pools OK w/r31 MR1 FAST Cache YES FAST VP NOT TESTED 13
Optimized for Virtualization Industry-leading integration Storage Administrator Manage storage and VM resources in unison Control offload functions and integrated replication Unisphere VAAI* offload Less net I/O More VMs Faster response SAN and NAS connect vcenter Server Integration and VASA** Virtual Server Administrator Manage storage and VM resources in unison Control offload functions and integrated replication * VAAI = VMware vstorage APIs for Array Integration ** VASA = VMware vstorage APIs for Storage Awareness 14
Where Does Integration Happen? circa 2012 ESX Storage Stack VI Client 5.1 Change Snap request SvMotion request VM provisioning cmd Turn thin prov on/off SRM vcenter 5.1 Change VM VSS via VMware Tools vstorage API for Data Protection (VDDK) Vendor-specific vcenter Plug-In Datamover NMP VMFS VMware LVM iscsi/fcoe SW Co-op vstorage API for Multipathing NFS client NFS Coop Network Stack Vendor-specific VAAI block module Vendor Specific vstorage API for SRM View VMware-to-Storage relationships Provision datastores more easily Leverage array features (compress/dedupe, file/filesystem/lun snapshots) APIs & Mgmt vcops Connectors VM object Awareness in array/mgmt tools InyoC hange VASA Module NFS VAAI Module NIC Drivers NFS HBA Drivers FC FCoE iscsi New coolness Storage Array 5.1 Change Vendor-specific VAAI NFS operation support VAAI SCSI cmds Standards-based VAAI SCSI command support 5.1 Change Copyright 2011 EMC Corporation. All rights reserved. 15
Virtualization Management EMC Virtual Storage Integrator plug-in Integrated point of control to simplify and speed VMware storage management tasks One unified storage tool for all Symmetrix, CLARiiON, Celerra, VNX series, and VNXe series VMware vsphere EMC Virtual Storage Integrator Unified storage M A N A G E M E N T 16
VMware Storage Management at a Higher Level vcenter Operations Manager Enterprise Observe. Diagnose. Act. EMC Storage Analytics Cross-domain (end-to-end) view of IT infrastructure Proactive Analytics vs. Static Monitoring Single tool to manage your VMware & EMC Storage environments M A N A G E M E N T 17
vsphere 5 Support* VAAI (VMware API for Array Integration) off loads storage related activities from the ESX server to the VNX system VASA (VMware API for Storage Awareness) provides vsphere with system configurations data to support automated policy based provisioning VMware API Protocol Feature VNX OE VAAI Block HW Accelerated Locking Yes VAAI Block HW Accelerated Zero Yes VAAI Block HW Accelerated Copy Yes VAAI Block Thin Provisioning Yes VAAI Block Thin Provision Stun Yes VAAI Block Space Reclaim Yes VAAI NAS Full Clone Yes VAAI NAS Extended Stats Yes VAAI NAS Space Reservation Yes VAAI NAS Snap of Snap** Yes VASA Block Block Storage API s Yes VASA NAS NAS API s Yes M A N A G E M E N T * Requires VNX OE File V7.0.3x+ or VNX OE Block R31.5+ ** Currently available as Tech Preview in View 5.1 18
Simplify Storage Management EMC Solutions Group Windows Environment EMC Storage Integrator (ESI) for Windows Simplify storage provisioning and mapping Delegate for selfservice SharePoint aware storage provisioning Hyper-V VMWare/XenServer Automate your environment with PowerShell Easy to use MMC Snap-ins for Server/Application Admin M A N A G E M E N T 19
Hyper-V Support - Storage Provisioning EMC Solutions Group Dynamic attach/detach of EMC storage to/from the virtual SCSI controller on the VM View Virtual Machine and their Storage Supports FC and iscsi initiators on the Hyper-V parent Obviates the need for administration on VM or Hyper-V parent for storage provisioning Cluster Shared Volumes Support Leverages Server 2008 R2 hot add feature M A N A G E M E N T 20
EMC VNX VMware Integration D E M O N S T R A T I O N 21
VNX Series Enhancements EMC transforms the midrange with VNX family innovations Flexible RAID configurations Multiple RAID types per pool Automated pool rebalancing VNX Snapshots 22
VNX Series RAID Configurations Improve storage pool efficiency 38% Lower Flash Starting Cost 17% Overall Pool Savings SSD SAS NL-SAS SMALL SETS FOR SSD LARGE SETS FOR NL HDD 4 + 1 RAID 5 8 + 1 RAID 5 14 + 2 RAID 6 23
VNX Series Automated Pool Rebalancing Ensures top performance by eliminating hot spots AUTOMATED REBALANCING SSD D A T A NEW DRIVES FAST VP SAS NL-SAS Storage pool allocation dynamically optimized for highest performance Pool Expansion Rebalancing Redistributes data whenever drives are added Improves pool performance Dynamic Pool Rebalancing Automatically redistributes data within a tier Based on FAST VP policies 24
VNX Snapshots Point-in-time block technology ideal for application development ENHANCED SNAPSHOTS SSD SAS LUN Mon Tues Wed Thur 9:00 AM Dev/ Test 10:00 AM Wed NL-SAS Snaps of snaps Backup Analysis Other Added functionality Snaps of snaps Improved scalability 256 writable snaps per LUN Up to 32,768 per system New use cases Test and development Point-in-time backup Reporting/data repurposing 25
Performance Efficiency Taking Data Delivery to the Next Level VNX enhanced with host-based read caching VFCache FAST Cache & FAST VP VNX5500-F (Flash array) FAST Pools with FAST Cache FAST LUNs SSDs as option 2008 2009 2010 2011 2012 26
VFCache 1.5 - NEW Enhanced Efficiency and Integration Cache deduplication Orchestrated VMware vmotion VMAX Unisphere integration Increased Performance Multiple cards per server Higher capacity cards Use Case Expansion Active/passive cluster support Cisco UCS blade server support 27
Working Set Use Cases Small 80% of the IOPS 20% of the data Write journals, logs, temp files Databases (CRP, ERM), OLTP, email, web, reporting, analytics, file systems VFCache Write-intensive workloads with small working sets Read-intensive workloads with small working sets 100% of the IOPS 100% of the data Backups, disaster recovery sites, temporary data, Oil & Gas data dumps, Satellite Imagery, Air Surveillance Big Data, Genetics Studies Large Write-intensive workloads with large working sets Write Read-intensive workloads with large working sets 50% Read Workload 28
World is changing Existing Architecture Emerging Architecture Apps HW Network Software Defined Network + Copyright 2011 EMC Corporation. All rights reserved. 29
Copyright 2011 EMC Corporation. All rights reserved. 30
Copyright 2011 EMC Corporation. All rights reserved. 31
VNX Series Models Simple. Efficient. Powerful. File System Modules Storage Pool Modules VNX5100 VNX5300 VNX5500 VNX5700 VNX7500 Form factor 4U 4U 7U 4U 7U 5U 8U 5U 8U Number of drives 75 125 250 500 1,000 Drive types 3.5-inch Flash, SAS, NL-SAS and 2.5-inch Flash, SAS I/O slots per X-Blade n/a 3 4 4 5 X-Blades n/a 1 or 2 1, 2, or 3 2, 3, or 4 2 8 Memory n/a 6 GB/Blade 12 GB/Blade 12 GB/Blade 24 GB/Blade 12 GB 36 GB 48 GB 192 GB Protocols n/a NFS, CIFS, MPFS, pnfs Storage processors 2 I/O ports per SP 4 Fibre Channel ports, 2 back-end SAS ports n/a n/a I/O slots per SP n/a 2 2 5 5 Memory 8 GB 16 GB 24 GB 36 GB 48 or 96 GB Protocols Fibre Channel Fibre Channel, Fibre Channel over Ethernet, iscsi 32
Next-Generation Unified Storage Optimized for today s virtualized data IT Plug and play Works on any IP network Up and running quickly Easier than ever Scales large and fast Self-optimizes for performance and capacity efficiency Works on any network Everything is fully automated VNXe3150 VNXe3300 VNX5100 VNX5300 VNX5500 VNX5700 VNX7500 Affordable. Simple. Efficient. Powerful. 33
34
Summary of Use Cases Where FAST technologies are and are not a good fit, for ROI and total performance Pools FAST Cache FAST VP SQL Yes Yes Yes Oracle OLTP Yes Yes Yes Exchange Yes (with SOAP) Neutral Disable BDM Oracle DSS Yes No skew No skew NAS small random I/O Non mission-crit Yes* Low skew NAS large sequential I/O Non mission-crit No skew No skew FAST Cache and FAST VP most effective when data has skew, e.g. OLTP FAST VP adversely impacted by background management activities FAST Cache best suited to small random I/O Copyright 2011 EMC Corporation. All rights reserved. 36
EMC: #1 in Storage for Applications Oracle SAP Exchange VDI Home Directory SharePoint Analytics #1 #1 #1 #1 #1 #1 #1 Source : IDC, September 2011 37