EMC Storage Strategy. Madis Pärn Senior System Engineer EMC

Transcription

1 EMC Storage Strategy Madis Pärn Senior System Engineer EMC 1

2 BILLIONS OF USERS MILLIONS OF APPS Mobile Cloud Big Data Social Mobile Devices HUNDREDS OF MILLIONS OF USERS TENS OF THOUSANDS OF APPS LAN/Internet Client/Server PC MILLIONS OF USERS THOUSANDS OF APPS Source: IDC Mainframe, Mini Computer Terminals 2

3 5 Mega Disruptors 3

4 WHAT ARE THE 5 DISRUPTIORS DOING TO ARCHITECTURES? 4

5 Disruption = FUN COOL STUFF = Next-gen Hybrid Arrays 2. + = Next-gen All-Flash Arrays 3. + = Next-gen Sea of Storage = Next-gen Converged models 5. + = Next-gen Data Protection 6. + = Next-gen Automation 5

6 WHY IS THERE SO MUCH VARIATION IN STORAGE DATA PLANES? 6

7 3 architectures, and two sides of a coin. I need transactional storage for compute storage for next-gen apps Efficiency, Simplicity + Scales Down + Unified/multipurpose SAN or (can layer NAS federation on top) Brains Brains Brains Brains OR Architectural variation Simple At SAN All- or tera to NAS Flash petascale Variants NAS/metaobject RAS trumps all Brains Brains Brains Brains AND Presented as Distributed, Objects Simple at exascale (SOAP/Rest) + Non-POSIX Object (can layer POSIX/block) on top RESTful APIs Storage Array Storage Array Type 1 Tends to win best swiss army knife Storage Array Type 2. Tends to win with SPs, mission critical apps, purpose fit Software Gloms server+ DAS OR SAN/NAS shared storage into nontransactional, Object Storage Blob Storage Stack running on a host or compute co-resident = architecturally equivalent Type 3 Tends to win with new apps with low resiliency expectations. 7

8 Workloads and Data Plane Design Centers Performance In Memory DB Non HA DB Video Strea m Tech Apps HPC App Dev VDI Decision Support Transaction Processing VM Infrastructure Lower Service Level Web Content Home Directories Higher Service Level New Cloud Apps Online Archive Video Processing IT Content Mgmt. Backup & Recovery Capacity 8

9 Workloads and Data Plane Design Centers Performance Lower Service Level In Memory DB HW + SW Distributed Server-IO Distributed, Simple at exascale Object New Cloud Apps Non HA DB Video Strea m Simple At tera to petascale NAS/meta-object Online Archive Web Content Low Latency IOps Centric Flash-centric HPC Data services Efficiency, Simplicity + Scales Down Tech + Apps Unified/multipurpose Video Processing App Dev Home Directories IT Capacity VDI Content Mgmt. Decision Support Transaction Processing VM Infrastructure Simple at Petascale NAS Protection-centric Data services Recoverability Availability Serviceability trumps all Backup & Recovery Higher Service Level 9

10 NEXT GENERATION ALL-FLASH ARRAYS 10

11 XtremIO All Flash Array Consistent Performance Multi-controller, Scale-Out Perfectly Balanced Purpose-Built for Flash Inline, Always On Deduplication Always Thin Provisioned Simple Easy Provisioning No Performance Tuning 11

12 XtremIO All-Flash Scale-Out Arrays 10 TB X-BRICKS 11/19/13 Release TB Per Cluster Physical Capacity 20 TB X-BRICKS January 2014 Release TB Per Cluster Physical Capacity UP TO 1,000,000 FULLY RANDOM IOPS Over 250 TB Logical Capacity Thin Provisioning Inline Data Reduction XDP 12

13 IT IS NOT ABOUT FLASH! 13

14 1858: Internal combustion engine invented 1980: Flash memory invented Jean Joseph Étienne Lenoir 1885: First internal combustion vehicle ~2010: REDEFINE First Flash Arrays Gottlieb THE POSSIBLE Daimler & Wilhelm Maybach 1903: The first powered aircraft 2013: Next Generation All-Flash Arrays Orville & Wilbur Wright 14

15 XtremIO Flash-Optimized Data Services INLINE DATA REDUCTION THIN PROVISIONING DATA PROTECTION WRITABLE SNAPSHOTS XDP Never Write Duplicate Data 4KB Allocations Optimal Utilization Flash-Optimized Zero Configuration Instant Copies Full Performance 15

16 Functional IOPS vs. Hero Numbers Measured end-to-end at the host 100% random All flash pages non-zero Array filled to 80% forcing overwrites Any size LUNs, any LBA range Mixed read/write I/O ALL DATA SERVICES ACTIVE! Increasing thread counts Extended time periods 16

17 CONTENT BASED DATA PLACEMENT Scale-out. Inherent balance. Data reduction. XtremIO s Unique Architecture DUAL-STAGE METADATA ENGINE Consistent. Predictable. No garbage collection. XTREMIO DATA PROTECTION Superior capacity, endurance, performance. SHARED IN-MEMORY METADATA Zero impact copy services. 17

18 NEXT GENERATION SEA OF STORAGE 18

19 EMC ScaleIO Software-Defined Distributed Shared Storage Software that creates a server-based SAN from local storage to deliver performance and capacity on demand Creates virtual pool of storage with varying performance tiers Media-agnostic: Leverages any HDDs, SSDs, & PCIe flash cards Server-agnostic: Installed on existing physical & virtual app servers 19

20 ScaleIO Turns DAS Into A Server SAN Convergence of storage and compute Scale-out to thousands of servers Elastic add/remove servers & capacity on-the-fly Performance massive I/O parallelism 20

21 ScaleIO now part of XtremCache Suite Creates Pools Of Server Flash & HDD Leverage Application Servers with local disks Physical Server or Hypervisors Servers (auto) Install lightweight ScaleIO Driver Aggregate total DC server capacity and I/O performance Add (and remove) storage and compute dynamically ScaleIO Agent (tiny footprint) 21

22 Simple Management & Monitoring Automated installation scripts and easy configuration Any IT admin can manage the entire data center stack Call-home and incident reporting Self-regulated data layout, performance optimization, and HW/SW failure recovery no administrative intervention required 22

23 Enterprise Features WRITABLE SNAPSHOTS MULTI-TENANCY MULTI-TIERING QUALITY OF SERVICE Instant Copies Full Performance Segregation of Data Data Encryption PCIe, SSD & HDD Auto Rebalancing Limit IOPS per Application 23

24 Your Bottom Line How ScaleIO Lowers Your TCO 1. Commodity hardware 2. No dedicated storage components (FC network, HBAs, etc.) 3. Reduced power, cooling, and space 4. No forklift upgrades for EOL HW 5. Reduced administrative overhead 6. Pay as you grow linear investments with predictable costs 24

25 NEXT GENERATION HYBRID ARRAYS 25

26 Virtualization Drives Efficiency Storage System Must Automatically Differentiate Between Cost and Latency VIRTUALIZED DATA CENTER 1000 s of Workloads DATA is HIGHLY SKEWED 5% of Data is Doing 95% of the IO Storage System Must Simultaneously Deliver Data at LOWEST LATENCY While Storing it at LOWEST COST At Any Given Time, Only a Small Percentage of Data Is Active 26

27 FLASH-Optimized Hybrid Arrays Automatically Tier Data PERFORMANCE CAPACITY ACTIVE DATA INACTIVE DATA 5% FLASH 95% DISK FAST dynamically and automatically optimizes storage pools based on actual data activity 27

28 The New FLASH-Optimized Hybrid Array The performance of FLASH with the efficiency of tiering Controller Takes full advantage of the low latency of FLASH FLASH-optimized software and data services SSDs HDDs Delivers progressively lower $/IOPS at scale Moves inactive data to NL-HDDs for lowest $/GB 28

29 FLASH Optimized Hybrid: FLASH, Disk, or Tiered ALL DISK 6PB CAPACITY LOWEST $/GB 1M IOPS BLENDED COST LOWEST $/IO ALL FLASH 134K IOPS 600TB 100% NL DISK TIERED (DISK + FLASH) 100% FLASH 29

30 VNX-F All Flash Array Based on the industry-leading, enterprise-proven VNX Low Flash $/GB UP TO 500,000 IOPS SCALES TO 41 TBs 30

31 VNX-CA Improved AVAILABILITY Add storage, nondisruptive migrations, and active/active array access VNX-CA VNX-CA2 (2 storage controllers) Nondisruptive Scaling VNX-CA4 (4 storage controllers) More data MOBILITY Stretching functionality and load-balance across arrays Simple SCALING Simple onboarding; scaling capacity, availability, and performance 31

32 VNXe KittyHawk With Flash FLASH 1 st in an Affordable and Simple Solution Native File and Block Support Support for Flash FAST Suite (FAST Cache & FAST VP) New Intel Processors (Sandy Bridge) Native Fibre Channel & iscsi Protocol MCx IO Stack Unified Snapshots Unisphere Snapshot Scheduling Next Gen Unisphere Management Suite EMC Storage Analytics COMING Q Windows & VMware Integration (VAAI, VASA, ODX, SMB3) 32

33 EMC Strategy: Best Of Breed Storage & Backup XtremSF XtremCache ScaleIO XtremIO VMAX SIMPLE DATA SERVICES Isilon VNX ADVANCED DATA SERVICES Atmos Data Domain, Avamar, & NetWorker 33

34

35 35