1
XTREMIO S TRANSFORMATIONAL TECHNOLOGY JOSH GOLDSTEIN, VP MARKETING & PRODUCT MANAGEMENT 2
TODAY S TOPIC This session provides an overview of the EMC XtremIO scale-out all-flash array and its design objectives. The architecture will be discussed with the goal of helping the audience understand the unique requirements of building an allflash array, the proper methodology for testing all-flash arrays, and architectural differentiation among flash array features that affect endurance, performance, consistency and copy data management for demanding mixed workload consolidated environments. 3
AGENDA XtremIO Background XtremIO Technology Transforming Application Environments Q&A 4
XTREMIO BACKGROUND 5
>$1B ANNUALIZED Q4 RUN RATE Achieved in One Year Copyright 2015 2014 EMC Corporation. All rights reserved. 6
XTREMIO: EMC S FASTEST GROWING PRODUCT $1,250 $1,000 $1B $750 $500 $250 $0 0 1 2 3 4 5 6 7 8 9 10 11 12 Years EMC Acquisition Source: http://www.xtremio.com/happy-birthday-xtremio 7
XtremIO TODAY >1,400 unique customers #1 Market Share 1H 14 >40% of top 100 & top 200 own XtremIO Leader in strategic AFA technology 8
#1 IN SSA MARKET SHARE Latest Gartner research published 5/1/15 EMC is #1 with 31.1% share 19.2% share gain over 2013 >10% market share lead Accomplished in the first full year since XtremIO became Generally Available! 9
Why has this product been so successful? 10
ACCELERATING IMBALANCE WHAT COULD YOU DO WITH BALANCED CPU, NETWORK, IOPS? Any flash array is fast when your reference point is disk 10,000X CPU 1,000X 100x Performance Gap Latency 2000 2010 2015 2020 HDD 11
SUDDEN IMPACT EPIC HEALTHCARE DB XtremIO Sudden Impact XtremIO Sudden Impact 12
SUDDEN IMPACT SQL SERVER Disk Operations vs Latency 13
SCALE UP XTREMIO SCALE OUT Controller 16 Controller 15 Controller 14 Passive SAN Flash Flash Flash Active ACTIVE ACTIVE 16 ACTIVE CONTROLLERS Controller 13 Controller 10 Controller 9 Controller 6 Controller 5 Controller 2 Controller 1 Controller 12 Controller 11 Controller 8 Controller 7 Controller 4 Controller 3 150K SCALE IOPS SCALE 2M IOPS 14
EXPERTS AGREE ON SCALE-OUT "The bottom line is that scale-out architectures with rich metadata support, consistent latency, advanced snapshot technologies and advanced quality of service are a prerequisite for fourth generation all-flash storage arrays. David Floyer "The most successful vendors will be those that can make a smooth transition from the traditional, dedicated application model to mixed workload consolidation Eric Burgener Phase 3 starts to really require a scale-out system that can provide consistent high performance and low latency George Crump 15
Fast isn t enough in the all-flash data center. Agility is key. 16
XTREMIO 15 SECOND PROVISIONING 1 2 CREATE VOLUMES CREATE INITIATOR GROUPS 3 MAP VOLUMES 17
WHAT PROBLEM ARE YOU SOLVING? = + Use Flash Go Fast (maybe solve economics) Get Smarter THE RIGHT ARCHITECTURE UNLOCKS UNIQUE BUSINESS VALUE 18
A DAY IN THE LIFE OF A VIRTUAL DATA CENTER Thousands of VMs = I/O blender Cloning & Provisioning new VMs VMotion Operations 19
A TYPICAL APP ENVIRONMENT Multiple Applications Development Copy Production Database Test Multiple & QA Copies copies 20
A TYPICAL APP ENVIRONMENT 10TB Database = 20TB of Disk (RAID10) 10TB Test Copies x 5 = 60TB of Disk (RAID5) 10TB Development Copy = 12TB of Disk (RAID5) 92TB of high performance capacity to serve a 10TB application instance! Brute Force Cloning Difficult Updates Complex Limited Copies Limited Data Sets Expensive & Slow 21
COMMON THREADS Consolidation creates random performance issues Copying data is common VMs, databases, analytics Workflow complexity creating/managing copies MASSIVE OPPORTUNITY FOR IMPROVEMENT 22
2015 IS THE TCO INFLECTION POINT Economic Influences Intelligent Scale-out Flash HDD Consumer Demand Data Services Allowing free Copies of Application Data Flash technology has improved at a faster rate than Moore s Law 23
XTREMIO TECHNOLOGY 24
XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 25
XtremIO Intelligent Content Engine CONTENT ADDRESSING INHERENTLY LOAD BALANCES 16 Active Controllers each with 6.25% of the I/O and data services load Balanced reads/writes across all controllers/ssds 100% Performance with no Setup or Tuning 26
XtremIO Intelligent Content Engine INCOMING DATA STREAM 963FE7B CA38C90 134F871 0325F7A 963FE7B F3AFBA3 AB45CB7 20147A8 RANDOMIZE LOCATIONS FIND MATCHES 27
XtremIO Intelligent Content Engine INCOMING DATA STREAM 963FE7B CA38C90 134F871 0325F7A 963FE7B F3AFBA3 AB45CB7 20147A8 Fingerprint Prefix 0 1 2 3 4 5 6 7 8 9 A B C D E F 0 4 8 C X-Brick #1 X-Brick #2 2 6 A E 1 5 9 D 3 7 B F 28
XtremIO Intelligent Content Engine INCOMING DATA STREAM 963FE7B CA38C90 134F871 0325F7A 963FE7B F3AFBA3 AB45CB7 20147A8 0 4 8 C 2 6 A E 1 5 9 D 3 7 B F 29
XtremIO Intelligent Content Engine Deduplicate INCOMING DATA STREAM 963FE7B 0 4 8 C 2 6 A E 1 5 9 D 3 7 B F 30
XtremIO Balanced Processing Two 40TB X-Bricks. Four controllers. 8 Sockets. 80 Cores. Controller 1 Controller 2 Controller 3 Controller 4 Balanced metadata processing Controller 1 Controller 2 Controller 3 Controller 4 Balanced user data processing 31
XtremIO Balanced SSD Capacity 0.16% variation from least filled to most filled SSD 251,600,000 251,500,000 251,400,000 251,300,000 251,200,000 251,100,000 KB Used 251,554,448 KB Only 0.16% Variation 251,151,328 KB 251,000,000 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 SSD Number Array is 77% full 32
XtremIO Balanced SSD Endurance XtremIO cluster active for 277 days under heavy write load 6PB written to array - 242TB per SSD! SSD endurance will never be a concern! 98% life remaining on each SSD completely balanced 33
XTREMIO FLASH ENDURANCE 98% 95-97% 99% Remaining <95% Remaining = 0%! We have no arrays with projected endurance of less than 20 years 100% Remaining 15PB written to a single array! XtremIO SSD Endurance Remaining Entire Install Base 34
CONSISTENT & PREDICATABLE PERFORMANCE Actual customer workload: OLTP with 8KB Block Size IOPS 70K IOPS for 35TB Flash Array 70K IOPS for 10TB XtremIO Array Latency Latency Spikes System-Level Garbage Collection Impact 2-4.5ms Various latency spikes <1ms = XtremIO Consistent & Predictable (~0.5ms) Latency Worse than HDD Latency Garbage Collection as array fills Always Consistent & Predictable 10TB XtremIO X-Brick 35TB Traditional Flash Array 35
Lowest Service Requests of any EMC product 2.00 1.40 1.30 Average Support Calls Per XtremIO Array Per Month (for any reason) 1.20 1.30 1.10 0.94 0.97 0.85 0.70 0.76 0.84 0.62 ~1/10 th typical arrays 0.51 0.48 0.44 0.47 Nov Dec Jan Feb Mar April May June July Aug Sept Oct Nov Dec Jan Feb Mar 36
XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 37
XTREMIO DATA SERVICES ALWAYS-ON, INLINE, ZERO PENALTY, FREE ALWAYS-ON THIN PROVISIONING INLINE DEDUPLICATION INLINE COMPRESSION XTREMIO DATA PROTECTION INLINE DATA AT REST ENCRYPTION AGILE WRITEABLE SNAPSHOTS 38
WHAT IS METADATA? 39
CONVENTIONAL METADATA 1PB Conventional Array 1GB Data Chunk 30MB of metadata Metadata record (~30 bytes) 1PB = 1,000,000 x 1GB chunks of data x 30 byte metadata records = 30MB of metadata 40
XTREMIO GRANULAR METADATA 1GB Data Chunk Metadata record (~30 bytes) 1PB Array 3.75TB of metadata!. 8KB Data Chunk (125,000 times more granular) 1PB = 125B x 8KB chunks of data 1PB = 125 billion x 30 byte content-based metadata records = 3.75TB of metadata This requires a different architecture! 41
WHY GRANULAR METADATA? Vastly improved space allocation Important for inherent load balancing Important for data reduction effectiveness Critical for effective copy data management 42
METADATA DE-STAGING Dual Controller arrays don t have enough memory to hold granular metadata in memory METADATA METADATA METADATA So they de-stage most metadata to the array and retrieve it from flash as needed METADATA INCONSISTENT & UNPREDICATBLE PERFORMANCE METADATA HEAVY OPERATIONS = SLOW 43
XTREMIO IN-MEMORY METADATA XtremIO scales-out. Granular metadata is distributed across controllers in a shared memory fabric. PERFORMANCE CONSISTENT & PREDICATABLE AMAZING METADATA HEAVY OPERATIONS USER DATA USER DATA USER DATA USER DATA REMOTE DIRECT MEMORY ACCESS FABRIC 44
CONVENTIONAL VM CLONING WITH VAAI X-COPY COMMAND VM VM STORAGE ARRAY Array offloads the host Brute force copy on the array 45
XTREMIO IN-MEMORY VM CLONING VM Cloning in seconds! X-COPY / ODX COMMAND IN-MEMORY METADATA BLOCK BLOCK BLOCK BLOCK UNIQUE, COMPRESSED USER DATA ON SSD 46
DEVOPS @ F1000 SOFTWARE COMPANY XTREMIO S IMPACT Regression Testing 1,000s of VMs created each day, test results logged, then VMs discarded Code Check-in Triggers Automated VM Creation 47
PRIVATE CLOUD CASE STUDY: VMware HANDS ON LABS 500+ concurrent users, 4,100 VMs Short vapp life High VM churn rate <500us avg latency 100% SLA Direct VM Console interaction Nested Workloads LAB Count: 10,000+ VMs Provisioned over 4 days: 100,000+ 48
XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 49
XTREMIO SNAPSHOTS XtremIO is already globally deduplicated XtremIO already has granular metadata XtremIO already holds metadata in memory HUGE OPPORTUNITY TO IMPROVE CONVENTIONAL SNAPSHOTS 50
Conventional XtremIO Snapshots: Snaps Efficiency - Granular and Performance Metadata Production Instance Volume Metadata 37.5GB Data Blocks 10TB Dev/Test Instance Snapshot Volume Metadata 37.5GB Complete copy of metadata created Metadata copy can take several seconds, even on flash Severe performance degradation 51
Conventional XtremIO Snapshots: Snaps Efficiency Granular and Performance Metadata Dev/Test Workflow Snapshot 16 Writeable Clones for Dev/Test 16 x 37.5GB of Metadata = 600GB! Unsuitable for performance copies Metadata overhead kills the array Forces use of brute force clones 52
Metadata XtremIO Snapshots: Bloat 250 Efficiency writeable and Performance snapshots 200TB USABLE DISK ARRAY Snapshot 10TB METADATA (5%) 15TB USABLE METADATA 10TB (66%!) FLASH ARRAY WITH DATA REDUCTION GOOD THING XTREMIO DOESN T WORK THIS WAY! 53
A LET S SNAPSHOT SEE HOW IS CREATED IT WORKS INSTANTLY IT ONLY INVOLVES ALLOCATION OF AN EMPTY CONTAINER IN-MEMORY METADATA SSD DATA Production Shared MD MD Snapshot MD 54
METADATA MANAGEMENT IS EFFICIENT ALLOWING FOR A LARGE NUMBER OF SNAPSHOTS IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 55
METADATA MANAGEMENT IS EFFICIENT NO DUPLICATION OF METADATA Modify Data B @ Block 1 IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 56
SNAPSHOT PERFORMANCE IS EQUAL IT S EXACTLY LIKE WRITING DATA TO THE PRODUCTION VOLUME Modify Data D @ Block 4 IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 57
XTREMIO SNAPSHOTS PERFORMANCE 100% (read, write and latency as volume) SPACE EFFICIENT IN-MEMORY FLASH OPTIMIZED (no metadata bloat, no space reservation, no moving blocks) (instant creation, immediate deletion, flexible topography) (identical data services, always on, always inline) 58
TRANSFORMING APPLICATION ENVIRONMENTS 59
A TYPICAL APP ENVIRONMENT 10TB 10TB 10TB 10TB 10TB 10TB 10TB Brute force cloning of 6 copies = 60TB of data Time consuming refreshes / reverts Cost limits scale 60
AN XTREMIO APP ENVIRONMENT 5TB INSTANT COPIES ALL SPACE EFFICIENT INSTANT REFRESH KEEPS COPIES CURRENT NEAR ZERO COST INCREASES SCALE 61
TRANSFORMATIONAL AGILITY SCALE-OUT PERFORMANCE ALL SLAs INSTANT, FAST, SPACE EFFICIENT INSTANT, FAST, SPACE- EFFICIENT XTREMIO FLASH FOR ENTIRE LIFECYCLE DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 FIN COPY FIN COPY REPORTS MORE BUSINESS PRODUCTIVITY DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 OPS COPY OPS COPY ANALYTICS DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 TEST/DEV COPIES DEV INST 3 DEV INST 3 HIGH PERFORMANCE PRODUCTION SALES COPY SALES COPY ANALYTICS COPIES TRENDS FASTER APPLICATION DEVELOPMENT MORE COPIES? WHY NOT? 62
INTRODUCTION TO James Eason Manager, Information Systems Epic Platform Overview 8 Hospitals 75 Clinics 1,400+ Beds 12,500 Employees Live on Epic since 2007; ~ 23 Epic environments Epic 2012 2014 (April) Platform: AIX 7.1; EMC Storage 1 st in U.S. Both PRD & Clarity on EMC XtremIO 63
XTREMIO AT VIDANT Why? To add storage; improve performance; strategic alignment Due for a storage refresh, i.e. timing Challenges? Aggressive timeline PRD migration completed Dec 2014; Clarity Jan 2015 Before testing, XtremIO support concerns (Powerpath, HA) No MORE Clones!! (Script/process changes) Best Practice: Clarity / Epic PRD separate XtremIO clusters 64
XtremIO TODAY - PRD, RPT, SRO/DR & Clarity 0.5 0.8ms PRD max latency <10 sec PRD average WD length <45min Nightly SUP refresh/backup 2X Faster Nightly Clarity Extracts 2X Faster Daily Reporting 65
POWERFUL XTREMIO COPY SERVICES Storage usage Data Reduction! 6.5TB 1 st Copy PRD 30-40GB Additional Copies PRD More to Come 66
XTREMIO DESIGN FUNDAMENTALS SCALE-OUT CONSISTENT & PREDICTABLE INHERENTLY BALANCED COPY DATA MANAGEMENT INSTANT & HIGH PERFORMANCE DATA SERVICES INLINE ALL THE TIME APPLICATION & ECOSYSTEM INTEGRATION & AUTOMATION 69
SNAPSHOT REFRESH THE POWER OF IN-MEMORY METADATA Refresh Snapshot to latest Production IN-MEMORY METADATA Production MD Shared MD Snapshot MD Copyright 2015 EMC Copyright Corporation. 2015 All EMC rights Corporation. reserved. All rights reserved. 70
SNAPSHOT REFRESH ON DEMAND, FRESH COPIES, SAME PERFORMANCE Create Snapshot on entity we refresh from IN-MEMORY METADATA Production MD Shared MD Snapshot MD Copyright 2015 EMC Copyright Corporation. 2015 All EMC rights Corporation. reserved. All rights reserved. 71
SNAPSHOT REFRESH CURRENT AND UPDATED ANALYTICS FOR ACCURATE DECISION-MAKING Existing snapshot points to newly created Snapshot IN-MEMORY METADATA Production MD Shared MD Snapshot MD Delete or keep the old Snapshot Copyright 2015 EMC Copyright Corporation. 2015 All EMC rights Corporation. reserved. All rights reserved. 72
XTREMIO COPY MANAGEMENT SINGLE-CLICK AUTOMATION ON-DEMAND Provision Databases In Seconds Increase Operational Efficiencies SCHEDULED Unattended Automated Protection Centralized Management EXPIRE Removal Of Databases And Prevention Of Sprawl Recover Storage Capacity Reduce Complexity Increase Agility Alert Notification System Customizable For Databases 73
XTREMIO PROBLEMS SOLVED! = + Use Flash Go Fast Solve Economics Get Smarter Be Agile! THE RIGHT ARCHITECTURE UNLOCKS UNIQUE BUSINESS VALUE 75
SUMMARY XtremIO is much more than speed It s a platform for improving the way applications and virtual data centers work Intelligent handling of granular content-based metadata is at its core These capabilities deliver unique business value and agility Questions? 76