XTREMIO S TRANSFORMATIONAL TECHNOLOGY

Transcription

1 1

2 XTREMIO S TRANSFORMATIONAL TECHNOLOGY JOSH GOLDSTEIN, VP MARKETING & PRODUCT MANAGEMENT 2

3 TODAY S TOPIC This session provides an overview of the EMC XtremIO scale-out all-flash array and its design objectives. The architecture will be discussed with the goal of helping the audience understand the unique requirements of building an allflash array, the proper methodology for testing all-flash arrays, and architectural differentiation among flash array features that affect endurance, performance, consistency and copy data management for demanding mixed workload consolidated environments. 3

4 AGENDA XtremIO Background XtremIO Technology Transforming Application Environments Q&A 4

5 XTREMIO BACKGROUND 5

6 >$1B ANNUALIZED Q4 RUN RATE Achieved in One Year Copyright EMC Corporation. All rights reserved. 6

7 XTREMIO: EMC S FASTEST GROWING PRODUCT $1,250 $1,000 $1B $750 $500 $250 $ Years EMC Acquisition Source: 7

8 XtremIO TODAY >1,400 unique customers #1 Market Share 1H 14 >40% of top 100 & top 200 own XtremIO Leader in strategic AFA technology 8

9 #1 IN SSA MARKET SHARE Latest Gartner research published 5/1/15 EMC is #1 with 31.1% share 19.2% share gain over 2013 >10% market share lead Accomplished in the first full year since XtremIO became Generally Available! 9

10 Why has this product been so successful? 10

11 ACCELERATING IMBALANCE WHAT COULD YOU DO WITH BALANCED CPU, NETWORK, IOPS? Any flash array is fast when your reference point is disk 10,000X CPU 1,000X 100x Performance Gap Latency HDD 11

12 SUDDEN IMPACT EPIC HEALTHCARE DB XtremIO Sudden Impact XtremIO Sudden Impact 12

13 SUDDEN IMPACT SQL SERVER Disk Operations vs Latency 13

14 SCALE UP XTREMIO SCALE OUT Controller 16 Controller 15 Controller 14 Passive SAN Flash Flash Flash Active ACTIVE ACTIVE 16 ACTIVE CONTROLLERS Controller 13 Controller 10 Controller 9 Controller 6 Controller 5 Controller 2 Controller 1 Controller 12 Controller 11 Controller 8 Controller 7 Controller 4 Controller 3 150K SCALE IOPS SCALE 2M IOPS 14

15 EXPERTS AGREE ON SCALE-OUT "The bottom line is that scale-out architectures with rich metadata support, consistent latency, advanced snapshot technologies and advanced quality of service are a prerequisite for fourth generation all-flash storage arrays. David Floyer "The most successful vendors will be those that can make a smooth transition from the traditional, dedicated application model to mixed workload consolidation Eric Burgener Phase 3 starts to really require a scale-out system that can provide consistent high performance and low latency George Crump 15

16 Fast isn t enough in the all-flash data center. Agility is key. 16

17 XTREMIO 15 SECOND PROVISIONING 1 2 CREATE VOLUMES CREATE INITIATOR GROUPS 3 MAP VOLUMES 17

18 WHAT PROBLEM ARE YOU SOLVING? = + Use Flash Go Fast (maybe solve economics) Get Smarter THE RIGHT ARCHITECTURE UNLOCKS UNIQUE BUSINESS VALUE 18

19 A DAY IN THE LIFE OF A VIRTUAL DATA CENTER Thousands of VMs = I/O blender Cloning & Provisioning new VMs VMotion Operations 19

20 A TYPICAL APP ENVIRONMENT Multiple Applications Development Copy Production Database Test Multiple & QA Copies copies 20

21 A TYPICAL APP ENVIRONMENT 10TB Database = 20TB of Disk (RAID10) 10TB Test Copies x 5 = 60TB of Disk (RAID5) 10TB Development Copy = 12TB of Disk (RAID5) 92TB of high performance capacity to serve a 10TB application instance! Brute Force Cloning Difficult Updates Complex Limited Copies Limited Data Sets Expensive & Slow 21

22 COMMON THREADS Consolidation creates random performance issues Copying data is common VMs, databases, analytics Workflow complexity creating/managing copies MASSIVE OPPORTUNITY FOR IMPROVEMENT 22

23 2015 IS THE TCO INFLECTION POINT Economic Influences Intelligent Scale-out Flash HDD Consumer Demand Data Services Allowing free Copies of Application Data Flash technology has improved at a faster rate than Moore s Law 23

24 XTREMIO TECHNOLOGY 24

25 XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 25

26 XtremIO Intelligent Content Engine CONTENT ADDRESSING INHERENTLY LOAD BALANCES 16 Active Controllers each with 6.25% of the I/O and data services load Balanced reads/writes across all controllers/ssds 100% Performance with no Setup or Tuning 26

27 XtremIO Intelligent Content Engine INCOMING DATA STREAM 963FE7B CA38C90 134F F7A 963FE7B F3AFBA3 AB45CB A8 RANDOMIZE LOCATIONS FIND MATCHES 27

28 XtremIO Intelligent Content Engine INCOMING DATA STREAM 963FE7B CA38C90 134F F7A 963FE7B F3AFBA3 AB45CB A8 Fingerprint Prefix A B C D E F C X-Brick #1 X-Brick #2 2 6 A E D 3 7 B F 28

29 XtremIO Intelligent Content Engine INCOMING DATA STREAM 963FE7B CA38C90 134F F7A 963FE7B F3AFBA3 AB45CB A C 2 6 A E D 3 7 B F 29

30 XtremIO Intelligent Content Engine Deduplicate INCOMING DATA STREAM 963FE7B C 2 6 A E D 3 7 B F 30

31 XtremIO Balanced Processing Two 40TB X-Bricks. Four controllers. 8 Sockets. 80 Cores. Controller 1 Controller 2 Controller 3 Controller 4 Balanced metadata processing Controller 1 Controller 2 Controller 3 Controller 4 Balanced user data processing 31

32 XtremIO Balanced SSD Capacity 0.16% variation from least filled to most filled SSD 251,600, ,500, ,400, ,300, ,200, ,100,000 KB Used 251,554,448 KB Only 0.16% Variation 251,151,328 KB 251,000, SSD Number Array is 77% full 32

33 XtremIO Balanced SSD Endurance XtremIO cluster active for 277 days under heavy write load 6PB written to array - 242TB per SSD! SSD endurance will never be a concern! 98% life remaining on each SSD completely balanced 33

34 XTREMIO FLASH ENDURANCE 98% 95-97% 99% Remaining <95% Remaining = 0%! We have no arrays with projected endurance of less than 20 years 100% Remaining 15PB written to a single array! XtremIO SSD Endurance Remaining Entire Install Base 34

35 CONSISTENT & PREDICATABLE PERFORMANCE Actual customer workload: OLTP with 8KB Block Size IOPS 70K IOPS for 35TB Flash Array 70K IOPS for 10TB XtremIO Array Latency Latency Spikes System-Level Garbage Collection Impact 2-4.5ms Various latency spikes <1ms = XtremIO Consistent & Predictable (~0.5ms) Latency Worse than HDD Latency Garbage Collection as array fills Always Consistent & Predictable 10TB XtremIO X-Brick 35TB Traditional Flash Array 35

36 Lowest Service Requests of any EMC product Average Support Calls Per XtremIO Array Per Month (for any reason) ~1/10 th typical arrays Nov Dec Jan Feb Mar April May June July Aug Sept Oct Nov Dec Jan Feb Mar 36

37 XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 37

38 XTREMIO DATA SERVICES ALWAYS-ON, INLINE, ZERO PENALTY, FREE ALWAYS-ON THIN PROVISIONING INLINE DEDUPLICATION INLINE COMPRESSION XTREMIO DATA PROTECTION INLINE DATA AT REST ENCRYPTION AGILE WRITEABLE SNAPSHOTS 38

39 WHAT IS METADATA? 39

40 CONVENTIONAL METADATA 1PB Conventional Array 1GB Data Chunk 30MB of metadata Metadata record (~30 bytes) 1PB = 1,000,000 x 1GB chunks of data x 30 byte metadata records = 30MB of metadata 40

41 XTREMIO GRANULAR METADATA 1GB Data Chunk Metadata record (~30 bytes) 1PB Array 3.75TB of metadata!. 8KB Data Chunk (125,000 times more granular) 1PB = 125B x 8KB chunks of data 1PB = 125 billion x 30 byte content-based metadata records = 3.75TB of metadata This requires a different architecture! 41

42 WHY GRANULAR METADATA? Vastly improved space allocation Important for inherent load balancing Important for data reduction effectiveness Critical for effective copy data management 42

43 METADATA DE-STAGING Dual Controller arrays don t have enough memory to hold granular metadata in memory METADATA METADATA METADATA So they de-stage most metadata to the array and retrieve it from flash as needed METADATA INCONSISTENT & UNPREDICATBLE PERFORMANCE METADATA HEAVY OPERATIONS = SLOW 43

44 XTREMIO IN-MEMORY METADATA XtremIO scales-out. Granular metadata is distributed across controllers in a shared memory fabric. PERFORMANCE CONSISTENT & PREDICATABLE AMAZING METADATA HEAVY OPERATIONS USER DATA USER DATA USER DATA USER DATA REMOTE DIRECT MEMORY ACCESS FABRIC 44

45 CONVENTIONAL VM CLONING WITH VAAI X-COPY COMMAND VM VM STORAGE ARRAY Array offloads the host Brute force copy on the array 45

46 XTREMIO IN-MEMORY VM CLONING VM Cloning in seconds! X-COPY / ODX COMMAND IN-MEMORY METADATA BLOCK BLOCK BLOCK BLOCK UNIQUE, COMPRESSED USER DATA ON SSD 46

47 F1000 SOFTWARE COMPANY XTREMIO S IMPACT Regression Testing 1,000s of VMs created each day, test results logged, then VMs discarded Code Check-in Triggers Automated VM Creation 47

48 PRIVATE CLOUD CASE STUDY: VMware HANDS ON LABS 500+ concurrent users, 4,100 VMs Short vapp life High VM churn rate <500us avg latency 100% SLA Direct VM Console interaction Nested Workloads LAB Count: 10,000+ VMs Provisioned over 4 days: 100,

49 XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 49

50 XTREMIO SNAPSHOTS XtremIO is already globally deduplicated XtremIO already has granular metadata XtremIO already holds metadata in memory HUGE OPPORTUNITY TO IMPROVE CONVENTIONAL SNAPSHOTS 50

51 Conventional XtremIO Snapshots: Snaps Efficiency - Granular and Performance Metadata Production Instance Volume Metadata 37.5GB Data Blocks 10TB Dev/Test Instance Snapshot Volume Metadata 37.5GB Complete copy of metadata created Metadata copy can take several seconds, even on flash Severe performance degradation 51

52 Conventional XtremIO Snapshots: Snaps Efficiency Granular and Performance Metadata Dev/Test Workflow Snapshot 16 Writeable Clones for Dev/Test 16 x 37.5GB of Metadata = 600GB! Unsuitable for performance copies Metadata overhead kills the array Forces use of brute force clones 52

53 Metadata XtremIO Snapshots: Bloat 250 Efficiency writeable and Performance snapshots 200TB USABLE DISK ARRAY Snapshot 10TB METADATA (5%) 15TB USABLE METADATA 10TB (66%!) FLASH ARRAY WITH DATA REDUCTION GOOD THING XTREMIO DOESN T WORK THIS WAY! 53

54 A LET S SNAPSHOT SEE HOW IS CREATED IT WORKS INSTANTLY IT ONLY INVOLVES ALLOCATION OF AN EMPTY CONTAINER IN-MEMORY METADATA SSD DATA Production Shared MD MD Snapshot MD 54

55 METADATA MANAGEMENT IS EFFICIENT ALLOWING FOR A LARGE NUMBER OF SNAPSHOTS IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 55

56 METADATA MANAGEMENT IS EFFICIENT NO DUPLICATION OF METADATA Modify Data Block 1 IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 56

57 SNAPSHOT PERFORMANCE IS EQUAL IT S EXACTLY LIKE WRITING DATA TO THE PRODUCTION VOLUME Modify Data Block 4 IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 57

58 XTREMIO SNAPSHOTS PERFORMANCE 100% (read, write and latency as volume) SPACE EFFICIENT IN-MEMORY FLASH OPTIMIZED (no metadata bloat, no space reservation, no moving blocks) (instant creation, immediate deletion, flexible topography) (identical data services, always on, always inline) 58

59 TRANSFORMING APPLICATION ENVIRONMENTS 59

60 A TYPICAL APP ENVIRONMENT 10TB 10TB 10TB 10TB 10TB 10TB 10TB Brute force cloning of 6 copies = 60TB of data Time consuming refreshes / reverts Cost limits scale 60

61 AN XTREMIO APP ENVIRONMENT 5TB INSTANT COPIES ALL SPACE EFFICIENT INSTANT REFRESH KEEPS COPIES CURRENT NEAR ZERO COST INCREASES SCALE 61

62 TRANSFORMATIONAL AGILITY SCALE-OUT PERFORMANCE ALL SLAs INSTANT, FAST, SPACE EFFICIENT INSTANT, FAST, SPACE- EFFICIENT XTREMIO FLASH FOR ENTIRE LIFECYCLE DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 FIN COPY FIN COPY REPORTS MORE BUSINESS PRODUCTIVITY DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 OPS COPY OPS COPY ANALYTICS DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 TEST/DEV COPIES DEV INST 3 DEV INST 3 HIGH PERFORMANCE PRODUCTION SALES COPY SALES COPY ANALYTICS COPIES TRENDS FASTER APPLICATION DEVELOPMENT MORE COPIES? WHY NOT? 62

63 INTRODUCTION TO James Eason Manager, Information Systems Epic Platform Overview 8 Hospitals 75 Clinics 1,400+ Beds 12,500 Employees Live on Epic since 2007; ~ 23 Epic environments Epic (April) Platform: AIX 7.1; EMC Storage 1 st in U.S. Both PRD & Clarity on EMC XtremIO 63

64 XTREMIO AT VIDANT Why? To add storage; improve performance; strategic alignment Due for a storage refresh, i.e. timing Challenges? Aggressive timeline PRD migration completed Dec 2014; Clarity Jan 2015 Before testing, XtremIO support concerns (Powerpath, HA) No MORE Clones!! (Script/process changes) Best Practice: Clarity / Epic PRD separate XtremIO clusters 64

65 XtremIO TODAY - PRD, RPT, SRO/DR & Clarity ms PRD max latency <10 sec PRD average WD length <45min Nightly SUP refresh/backup 2X Faster Nightly Clarity Extracts 2X Faster Daily Reporting 65

66 POWERFUL XTREMIO COPY SERVICES Storage usage Data Reduction! 6.5TB 1 st Copy PRD 30-40GB Additional Copies PRD More to Come 66

67 XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 69

68 SNAPSHOT REFRESH THE POWER OF IN-MEMORY METADATA Refresh Snapshot to latest Production IN-MEMORY METADATA Production MD Shared MD Snapshot MD Copyright 2015 EMC Copyright Corporation All EMC rights Corporation. reserved. All rights reserved. 70

69 SNAPSHOT REFRESH ON DEMAND, FRESH COPIES, SAME PERFORMANCE Create Snapshot on entity we refresh from IN-MEMORY METADATA Production MD Shared MD Snapshot MD Copyright 2015 EMC Copyright Corporation All EMC rights Corporation. reserved. All rights reserved. 71

70 SNAPSHOT REFRESH CURRENT AND UPDATED ANALYTICS FOR ACCURATE DECISION-MAKING Existing snapshot points to newly created Snapshot IN-MEMORY METADATA Production MD Shared MD Snapshot MD Delete or keep the old Snapshot Copyright 2015 EMC Copyright Corporation All EMC rights Corporation. reserved. All rights reserved. 72

71 XTREMIO COPY MANAGEMENT SINGLE-CLICK AUTOMATION ON-DEMAND Provision Databases In Seconds Increase Operational Efficiencies SCHEDULED Unattended Automated Protection Centralized Management EXPIRE Removal Of Databases And Prevention Of Sprawl Recover Storage Capacity Reduce Complexity Increase Agility Alert Notification System Customizable For Databases 73

72 XTREMIO PROBLEMS SOLVED! = + Use Flash Go Fast Solve Economics Get Smarter Be Agile! THE RIGHT ARCHITECTURE UNLOCKS UNIQUE BUSINESS VALUE 75

73 SUMMARY XtremIO is much more than speed It s a platform for improving the way applications and virtual data centers work Intelligent handling of granular content-based metadata is at its core These capabilities deliver unique business value and agility Questions? 76

74