EMC Approach to Data Center Virtualization

Transcription

1 EMC Approach to Data Center Virtualization Horia Constantinescu Technology Consultant Team Lead IDG Bucharest, June 12,

2 Market Leadership 2008 GOLDMAN SACHS IT SPENDING SURVEY Aug-08 Jun-08 EMC 42% 40% IBM 22% 25% Hewlett-Packard 13% 7% Hitachi 9% 8% Dell 7% 9% NetApp 6% 8% EqualLogic/Dell 2% 4% Sun Microsystems 1% 3% Compellent 1% Two reports is a trend 2009 FORRESTER STORAGE CHOICES FOR VIRTUAL SERVER ENVIRONMENTS Which vendor(s) supplied the networked (SAN or NAS) storage used for your virtual server environment? EMC 48% IBM NetApp HP Hitachi Data Sys Dell/EqualLogic Compellent Lefthand Networks 6% 1% 1% 15% 25% 24% 23% (multiple responses accepted) Base: 124 global IT decision-makers currently using x86 server virtualization technology Multiple reports, over multiple years and multiple analysts, is market leadership 2

3 Why EMC is the Leader Shared storage All EMC Platforms (Fibre Channel, iscsi, NAS) Virtual Provisioning, Quality of Service, Virtual LUNs, security, and ease of use Backup and recovery NetWorker integration with VCB Avamar with VMware Consolidated Backup, and Avamar Virtual Edition for VMware Replication Manager for application consistency Replication VMware Site Recovery Manager integrated across EMC replication products Support for application-consistent disaster recovery with VMware Site Recovery Manager Resource management EMC ControlCenter V6.1 support for virtual machine discovery EMC Smarts integration and Smarts Application Discovery Manager support 3

4 Virtualization Adoption Rate The Path to Success Process and Technical Standard Phase Extended Mobility VM First Policy NUMBER OF VMs Pilot Phase POC servers Testing/development Light Use Phase Utility servers High availability Time TIME Heavy Use Phase DISASTER RECOVERY Tier 1 applications Backup built for VM Performance/Quality of Service VM Mobility VDI 4

5 Disaster Recovery is a Top Requirement How important are the following motivations for adopting server virtualization? Very important Important Slightly/somewhat important Not important Doesn t know or does not apply to me Cut hardware costs 43% 39% 12% 6% 1% Improve power and cooling 21% 37% 29% 10% 3% Improve server manageability and flexibility 41% 46% 8% 4% 1% Create a shared IT infrastructure 27% 40% 22% 10% 1% Improve disaster recovery and business continuity 49% 34% 12% 4% 2% Base: 197 server decision-makers at North American and European enterprises that are interested in, are implementing in the next 12 months, or have already implemented server virtualization for x86 servers (percentages may not total 100 because of rounding) Source: Enterprise and SMB Hardware Survey, North America and Europe, Q3 2007; Forrester Research, Inc. 5

6 Defining Virtualization Virtualization is an abstraction technology that provides logical views of physical elements Virtualization simplifies infrastructure by consolidating many virtual entities onto a small number of physical elements Virtualization can reduce cost, complexity and management overhead while improving resource utilization 6

7 EMC s End-to-End Virtual Infrastructure APP OS Virtual Machines APP APP APP OS OS OS APP OS Virtual Host Environments Multiple virtual machines running on a single server VMware ESX, MS Hyper-V Interconnect topology Virtual Paths Multiple virtual paths through a physical network topology EMC PowerPath Virtual Storage Services Virtual Storage Environments Transparent data mobility and migration across multiple tiers and/or storage arrays EMC CLARiiON, Symmetrix, and Invista 7

8 Storage Virtualization Objectives Storage virtualization is the consolidation of multiple tiers of storage within a single pane of management All tiers of storage easily and quickly configured and managed, lowering management effort and cost Relocation of data between tiers and between arrays is accomplished transparently to host applications High resource utilization and capacity efficiency minimizes the amount of storage that must be purchased and managed 8

9 Array-based Virtualization Tier-0 Tier-1 Tier-1 Tier-1 Lower TCO Faster ROI Less power SAN Tier-2 Tier-2 Tier-1 Tier-4 Tier-3 Better performance Easier management High availability Servers Logical application/ user view Virtual Provisioning and LUN Migration within the array Array-based Tiering Simple, Economical, and Easy to Manage Performance and consolidation for Enterprise environments Flexibility within the frame for tiering, cloning, replication and management Ease of use for advanced functionality like virtual provisioning and virtual LUNs Data mobility across tiers while applications remain online Lower operational costs and complexity Leverage maturity and resiliency of array operating environments Utilize scalable processing power of high end arrays EMC supports storage tiering on Symmetrix, CLARiiON and Celerra platforms 9

10 Network-based Storage Virtualization Tier-0 Tier-1 Tier-1 Tier-1 SAN Tier-2 Tier-2 Tier-1 Tier-4 Tier- 3 Servers Logical application/ user view Heterogeneous mobility and management across multiple arrays Heterogeneous Tiering Simplified heterogeneous storage management Ongoing, non-disruptive data mobility Flexible And Economical Across Heterogeneous Storage Enterprise management for multivendor environments Single interface for storage functions like provisioning and volume management Heterogeneous cloning and replication technologies Virtualized end-to-end resource management Data mobility across heterogeneous arrays with no impact to business operations Eliminate planned and unplanned downtime Reduce migration costs Increase ability to meet service levels EMC Invista supports heterogeneous operating systems and storage 10

11 Storage Virtualization Use Cases Host-based Common Use Cases Array-, Host- and Network-based Network-based Change LUN sizes Data center moves Tech refreshes and lease rollovers Consolidation and increased utilization Array tiering Non-disruptive data mobility Virtual provisioning Change volume sizes/ protection Change RAID types Heterogeneous storage functions 11

12 Simplify Management of Virtual Environments Management abstraction enables ease, speed, and automation VMware Infrastructure Quickly provision resources on demand Auto-provisioning Virtual Provisioning DRS VMotion Nondisruptive mobility of applications and data Tier 1 Tier 2 Virtual LUNs HA vstorage VMFS Policy-based load balancing across physical resources PowerPath PowerPath PowerPath vcenter Centralized, automated management, reporting, and control ControlCenter and VMware vcenter Server Plug-in 12

13 Easy, Quick, and Automated Storage Provisioning for Virtual Servers with a Single Action Traditional Mapping and Masking Auto-provisioning Groups New HBA HBA HBA Port A Port B Port C Port D HBA DEV DEV DEV HBA HBA HBA HBA HBA HBA DEV DEV DEV DEV 40 Individual Masking Operations 5 ESX servers x 2 HBAs x 4 storage ports ~160 clicks to complete DEV DEV Includes initial configuration and repeated for every change or add HBA HBA HBA Port A Port B Port C Port D HBA DEV DEV DEV HBA HBA HBA HBA HBA HBA DEV DEV 15 clicks to complete DEV DEV DEV DEV Single Setup to Build and Associate Groups Simplifies initial configurations and all future changes and additions 13

14 Easy, Quick, and Automated Storage Provisioning Auto-provisioning Groups simplifies initial configurations and all future changes and additions Create Initiator Group 2 Add/Remove Initiator 3 Create Port Group 4 Add/Remove Port 5 Create Storage Group 6 Add/Remove Device 14

15 Space-Efficient, Easy-to-Manage Capacity New Enginuity 5874 Symmetrix Virtual Provisioning provides spaceefficient, easy-to-manage capacity on demand Improves storage utilization ESX 1 10 TB ESX 2 10 TB ESX 3 10 TB Reduces storage provisioning complexity and overhead 4 TB 3 TB 3 TB Physical allocation Common Storage Pool New automation to easily grow and reclaim storage Drain physical devices to shrink storage pools Create four-times larger volumes (up to 256 GB) Virtually provision all tiers and RAID levels 15

16 Nondisruptive Mobility Across Storage Tiers Moves Information to the Right Tiers and RAID Types at the Right Time New Enginuity 5874 Flash Any RAID Type V-LUN Fibre Channel Any RAID Type V-LUN SATA Any RAID Type Virtual LUN Technology Executes and monitors migrations across all drive and RAID types No disruption to data protection, replication, or application availability during migration Enables further tiered storage consolidation Optimize back-end layout for performance Continuous operations during migration 16

17 Nondisruptive Mobility Across Storage Tiers Competitors LUN Migrations Symmetrix Virtual LUN Technology 10K FC RAID 1 15K FC RAID 1 10K FC RAID 1 Flash RAID 5 LUN-10 LUN-12 LUN-10 LUN-12 LUN-10 LUN-12 V-LUN LUN-10 LUN-12 LUN-11 LUN-13 LUN-11 LUN-13 LUN-11 LUN-13 LUN-11 LUN-13 SUSPEND Replication BCV/SRDF R2 LUN-10 LUN-12 LUN-10 LUN-12 LUN-11 LUN-13 LUN-11 LUN-13 Remote replication is suspended, and data is unprotected during migration Data is fully protected during entire migration with no impact to local or remote 17

18 Optimize Throughput for Virtualized Environments Native Path Management Minimal Path Management ESX Server ESX Server PowerPath/VE Multipathing Enterprise Path Management ESX Server ESX Server Active channels Standby channels PowerPath PowerPath All channels are active and used to load balance Storage Ports Storage Ports VMware only Limited failover capability Basic load balancing Fully heterogeneous including Microsoft Hyper-V, Linux Proactive failover management Constantly optimizes IO paths based on changes in path loads 18

19 Virtualization Closing Remarks EMC is the only vendor that offers leading products in host environment virtualization, network path virtualization and storage virtualization VMware, PowerPath, Symmetrix, CLARiiON and Invista are the leading names in server virtualization, path management, and storage arrays EMC has more virtualized storage deployed than any other vendor EMC works closely with leading customers to advance the state of the art in data center virtualization excellence and efficiency EMC is investing more than any other vendor in storage virtualization VMware and Microsoft partnerships provide integrated virtualized host solutions PowerPath can enable completely non-disruptive migrations Storage array product roadmap futures are available to customers under NDA in the EMC Executive Briefing Center Network Storage virtualization product roadmap futures are available to customers under NDA in the EMC Executive Briefing Center 19

20 ^

21 EMC Celerra Family 21

22 Why EMC Celerra CELERRA IP Storage Leadership #1 in NAS (IDC, Q4 2008) No-compromise availability Five 9s ( percent) availability, integrated advanced clustering, managed as a single device Advanced functionality at no extra cost Most comprehensive suite of built-in features Comprehensive unified storage NAS, iscsi, Fibre Channel, and patented Celerra Multi-Path File System (MPFS) Scalability leadership Up to eight X-Blades on the front-end, up to four arrays on the back-end; Flash drives Advanced tiering for unified storage File server consolidation, file virtualization, file archiving, network management, policybased management 22

23 Celerra Innovations: Driving Down Costs Tiered Storage Tier data according to business value Increased Capacity Two-times the previous generation (960 drives) Flash Drives Tier 0 storage with up to 30 times more IOPS Unified Storage Cost-effective NAS and iscsi and High-performance Multi- Path File System (MPFS) and Fibre Channel Deduplication File system dedupe with compression reduces capacity requirements by up to 50 % Simplified Setup and Provisioning Celerra Startup Assistant and Celerra Provisioning Wizard Advanced functionality at no extra cost Deduplication, Virtual Provisioning, Snaps, and Automated Volume Manager included at no additional cost Compliance Compliant file-level retention (WORM) for archiving 23

24 Celerra Unified Storage Unified Storage Application Value Proposition FC Ease of Management Archive iscsi Unified Storage Platform Tier A Tier B B2D CIFS/NFS DMX Centera Rainfinity EDL Disaster Recovery Key Benefits Storage/file server consolidation via existing IP skills Extends consolidation benefits to stranded servers Control costs, simplify management, increase utilization, improve backups and increase availability Option to leverage Fibre Channel Ideal for VMware Multi-protocol, SRM, VDI Oracle dnfs, Writable Snaps for testing MS Exchange and SQL VSS, Celerra Replicator for mixed Microsoft workloads, Writable Snaps for testing Windows, Linux/Unix File server consolidation 24

25 Celerra Unified Storage iscsi NAS Fibre Channel Ethernet Ethernet MPFS File Sharing MPFS Fibre Channel iscsi SAN SAN Choice of connectivity Fibre Channel Low cost IP Choice of delivery File-based Block-based Celerra Growth paths NAS to MPFS for throughput iscsi to Fibre Channel for throughput Scale front end and storage independently 25

26 Celerra NS Unified System Architecture Application Servers Exchange Servers Clients Virtual Servers Oracle Servers SAN LAN Celerra Unified Storage Failover X-Blade X-Blade DART CX4 SP Failover CX4 SP FLARE FC IS FC IS Power Supply Power Supply SPS LCC SPS LCC FC drives Flash drives SATA II drives 26

27 Celerra Family The industry-leading IP storage platform Unified Storage Dedicated storage Easy to deploy Simple to manage New New New Gateway Shared storage Add NAS, iscsi to Fibre Channel SAN Highest storage usage Single management New NX4 NS-120 NS-480 NS-960 NS40G NS-G8 Availability Failover Failover Advanced clustering Advanced clustering Failover Number of X-Blades 1 or 2 1 or 2 2 or or Connectivity NAS, iscsi, Fibre Channel NAS, MPFS, iscsi, Fibre Channel NAS, MPFS, iscsi, Fibre Channel NAS, MPFS, iscsi, Fibre Channel Storage CLARiiON CLARiiON CLARiiON CLARiiON Maximum usable IP storage capacity (X-Blade/system) 16 TB/ 32 TB 32 TB/ 64 TB 64 TB/ 192 TB 128 TB/ 740 TB NAS, MPFS, iscsi, Fibre Channel CLARiiON, Symmetrix 64 TB/ 128 TB Advanced clustering NAS, MPFS, iscsi, Fibre Channel CLARiiON, Symmetrix 128 TB/ 896 TB 27

28 Flash Drives for Tier 0 Requirements Response Time 1 15K 10 15K Fibre Fibre Channel Channel drive drives IO per second Flash drives 30 15K Fibre Channel drives 1 Flash drive Faster performance Up to 30 times IOPS and less than 1 millisecond response time More energy efficient 38 percent less per terabyte and 95 percent less per IO Better reliability No moving parts, faster RAID rebuilds First and only midrange storage array to support Flash drives 28

29 Celerra Ease-of-Use Capabilities = No charge Celerra Startup Assistant Celerra Manager Automated Volume Management Installation 15 minutes power-up to production Celerra Virtual Provisioning Intuitive Web-based management Celerra Snapsure Provision file systems in four clicks Celerra Monitoring User A 10 GB Logical application and user view User B 10 GB User C 10 GB Physical allocation 2 GB 4 GB 2 GB Physical consumed storage Built-in thin provisioning Simple snaps At-a-glance system status 29

30 Celerra Built-in Advanced Functionality = No charge Celerra Replicator Production Local Site Remote Site Celerra Data Deduplication File data Automated Storage Tiering Network Network Network 1 TB EFD EFD LAN WAN FS/ FS/ FS/ LUN LUN LUN Snaps Snaps Snaps 10-minute RPO 2-hour RPO Simple business rule RPO File-level Retention Active Inactive Compress & Dedupe Up to 50% ~ 500 GB savings File-level deduplication and compression Celerra Event Enabler SATA FMA Policy Engine Policy-based tiered storage with Rainfinity FMA Multi-path File System User Celerra Antivirus/QM server NAS request IP Applicatio n Servers Fibre Channel or iscsi Write once-read many (WORM) Integration with third-party antivirus and quota management vendors NS SAN Delivery Improved performance and scalability 30

31 Multi-protocol Storage is Critical for VMware VMware Infrastructure Data Center ESX Cluster Simple ESX Cluster VDI ESX Cluster Big I/O APP OS APP OS APP OS APP OS APP OS APP APP APP APP APP APP APP OSAPP OSAPP OSAPP OSAPP OSAPP OSAPP OSAPP OS OS OS OS OS OS OS APP OS APP OS APP OS APP OS AD, Application Servers, E2K7 Desktop VMs SharePoint, DW, DSS Low Cost Deployment iscsi Shared Templates NAS/iSCSI VDI Deployment Fibre Channel SAN Big I/O Deployment Celerra Unified Storage iscsi NAS FC NAS, iscsi and Fibre Channel 31

32 Celerra with VMware for Disaster Recovery Production ESX Servers servers Celerra Celerra Replicator SRM Failback Recovery ESX Servers servers Celerra Makes disaster recovery rapid, reliable, manageable, affordable Celerra and VMware Site Recovery Manager (SRM) Integration Celerra Replicator controlled by VMware SRM Define Celerra and VMware business continuity/disaster recovery workflows for discovery, testing, and failover Celerra specific Virtual Center Plug-in simplifies the fail-back process Benefits Simplifies and automates disaster recovery Make disaster recovery a property of the virtual machine Provides central management of recovery plans from VMware VirtualCenter Turns manual recovery processes into automated recovery plans 32

33 EMC Celerra and Microsoft Compatibility Client, Application, and Management DART operating system compatibility Client integration with Celerra SnapSure Windows 2008 support (SMB2, Hyper-V) Interoperability with future Windows releases Windows logo-certified iscsi Volume Shadow Copy Service (VSS) Provider Microsoft Exchange and SQL Server support Snap and replication integration via EMC Replication Manager Native Microsoft management tools Managed as a Windows server Distributed File System (DFS) support Active Directory integration 33

34 EMC Velocity ISV Program: NAS Specialty Provides the highest levels of support and application availability Joint Customer Support Agreements with escalation procedures Leading NAS application and infrastructure providers in: Data migration Anti-virus and security File retention for compliance Quota management WAN optimization Backup and recovery Policy-based HSM Unified Namespace CAD/CAM/CAE Software development Designed to help you implement NASbased applications more effectively Reduces complexity and risk 34

35 Celerra Services NAS Implementation Services QuickStart, Custom NAS Migration Services Optimized access to information while reducing time and cost EMC Services Ensure operational efficiency Customer Service Accelerate time to production Thousands of professionals, measured by one criterion: your complete satisfaction As you acquire As you grow As you deploy 35

36 EMC Celerra Data Deduplication Increasing Storage Efficiency with File- Level Deduplication and Compression 36

37 Managing Multiple Copies of Data Reality: Pressure to Store More Efficiently Data growth is exploding, primarily due to the growth of unstructured data Having multiple copies of data is desirable Having multiple copies of data is widely considered prudent and responsible However Having an unnecessarily large number of copies of data is wasteful and irresponsible Lowering infrastructure costs is a necessity 37

38 Data Deduplication Increases Storage Efficiency Deliver Maximum Storage Efficiency without Operational Impacts Inefficient File Storage Efficient File Storage Doc1 Doc3 Doc3 Doc1 Doc1 Doc2 Doc2 Doc3 PPT1 PPT1 vs. PPT1 Doc3 Doc2 Doc1 Multiple copies of the same data Uncompressed data Deduplicated data Compressed data Store more data in less space Save money 38

39 Market Dynamics Driving Deduplication How Important is Deduplication? Very important One of the top 10 technology considerations Deduplication 59% #1 reason for growth in networked storage Business expansion/data growth 64% #8 reason for growth in networked storage is data deduplication 10% Data sharing via duplication #1 application suited for deduplication Unstructured files 65% #1 most important deduplication functionality High deduplication effectiveness 40% In use 24% Deploying deduplication Evaluating/in near-long-term plan 55% Not in plan 21% Source: TheInfoPro Wave 11 Storage Study,

40 Primary File System Deduplication Methods Targeted at Traditional File Share Environments (Office Shares/Files, Home Directories, etc.) Technology Typical Savings Resource Footprint File-level deduplication 10 percent Low Fixed-block deduplication 20 percent High Variable-block deduplication 28 percent High Compression percent Medium It s not a discussion of block versus variable block or compression; it s about how much you can decrease your storage needs without impacting operational requirements 40

41 Celerra Deduplication Overview Celerra X-Blade Intelligent data selection Avoids active data Tunable options Size of files Age of files File extension Internal policy engine Runs in the background Throttles to avoid negative impact on client services Leverages EMC technologies Compression engine Deduplication engine ~200 GB Active data Capacity Savings ~500 GB 1 TB Traditional file data Celerra deduplicated file system ~800 GB Inactive or aged data 300 GB Deduplicated and compressed data Deduplicated data Up to 500 GB or 50 percent savings 41

42 Celerra File-Level Data Deduplication Architecture Deduplication process Policy engine scans all production files looking for data that meets certain criteria Last accessed/modified time, minimum/maximum size, file extension Candidates are compressed A hash is generated Duplicated files are removed Stubs point to files in the hidden deduplication store Deduplication is transparent to clients Process runs in the background Files pre and post processing look the same Hidden deduplication store is a working area that is not visible Reads decompress data in memory, not on disk Writes decompress and restore the data on disk Modifying one instance of a file has no impact on other deduplicated instances Celerra Data Deduplication Deduplication-enabled file system File A File A Stub A Stub A File B Stub B File C Stub C Stub File CA Stub B File B`B (active) Active file User visible area Compress and deduplicate file Decompress and retrieve selected file File A File B File C Hidden deduplication store 42

43 Use Case Increased Storage Efficiencies for Primary storage only When there is no secondary storage Secondary or archival storage When your primary storage retention is based on a short time period Or both primary and secondary storage When there is a longer primary storage retention period NAS client File I/O Doc1 Doc3 Doc3 Doc1 PPT1 Doc2 Doc1 Doc2 PPT1 Doc3 PPT1 Doc2 Doc3 Doc1 Archive file Retrieve file Doc1 Doc3 Doc3 Doc1 PPT1 Doc2 Doc2 Doc1 PPT1 Doc3 PPT1 Doc3 Doc2 Doc1 Primary storage Archival storage 43

44 Benefits Based on Key EMC Technologies EMC Avamar, RecoverPoint Active File File A File A File A File A File B File C File B File B File C Up to 50 percent storage savings for unstructured file share datasets Increased primary storage efficiency Up to 50 percent savings Built-in compression Deduplicate files to remove duplicates Intelligent data selection Targets inactive data Unobtrusive processing Background processing with throttling Supports full Celerra functionality Celerra Manager Celerra SnapSure Celerra Replicator Celerra NDMP Volume Backup and traditional NDMP Backup Celerra FileMover Celerra File-Level Retention With Celerra platform backward compatibility Easy to install and manage One-click GUI enablement Hands-off, policy-driven 44

45 Celerra Deduplication Calculator Easy-to-Use Celerra Deduplication Calculator 1. Enter data size 2. Enter growth rate 3. Enter storage cost 4. Click Calculate 5. Discover projected space and cost savings Available on EMC.com Celerra Inactive File-Level Deduplication plus Compression Allows up to 50 percent storage savings for file share datasets Intelligent file selection maintains a low resource overhead 45

46 Why EMC Celerra CELERRA IP Storage Leadership #1 in NAS (IDC, Q4 2008) No-compromise availability Five 9s ( percent) availability, integrated advanced clustering, managed as a single device Advanced functionality at no extra cost Most comprehensive suite of built-in features Comprehensive unified storage NAS, iscsi, Fibre Channel, and patented Celerra Multi-Path File System (MPFS) Scalability leadership Up to eight X-Blades on the front end, up to four arrays on the back end; Flash drives Advanced tiering for unified storage File server consolidation, file virtualization, file archiving, network management, policybased management 46

47 47