ACCELERATING SQL SERVER WITH XTREMIO

Transcription

1 1

2 ACCELERATING SQL SERVER WITH XTREMIO WANDA HE PRINCIPAL SOLUTIONS ARCHITECT EMC XTREMIO KAREN WALLACE DIR. OF ARCHITECTURE CONNECTIONS EDUCATION GORDON LAQUE INFRASTRUCTURE ARCHITECT/DATABASE MANAGER CONNECTIONS EDUCATION 2

3 AGENDA Why XtremIO for SQL Server Customer Case Study: Connections Education Accelerate Your SQL Server Lifecycle Workflows Demo Seeding AlwaysOn Replica with AppSync Common Questions / Considerations 3

4 REDEFINING SQL SERVER WITH XTREMIO PREDICTABLE PERFORMANCE Predictable, consistent sub-millisecond latency Scale over 1 million IOPS Automatic load and ACCELERATE capacity balancing across all X-Bricks INCREDIBLE SIMPLICITY CONSOLIDATE Zero planning required No complex RAID, file layout No caching and tiering COMPLETE EFFICIENCY Instant database copies for reporting without capacity or performance overhead Test, develop on production dataset Compress, encrypt databases without downtime SIMPLIFY 4

5 PERFORMANCE OLTP like workload, 90% read, 10% write, majority 8K random XtremIO dual X-Brick Consolidate 1, 2, 4, and 8 SQL Server DB size: ~1TB each Near linear scalability of IOPS Disk latency measured from Perfmon shows consistent sub-millisecond performance 5

6 XTREMIO STORAGE COMPRESSION 795GB OLTP like database w/ 610GB actual space used Compresses 3% better than SQL native row compression XtremIO + row compression additional 15% savings In-line operation, zero CPU overhead to SQL Server, zero licensing cost 6

7 RAPID DEPLOYMENT W/ Copy Services Methods Deployment Time Data Reduction for Copies Backup / Restore Copy / Attach Copy Services Backup 28 mins 100% Restore 33 mins Copy 29 mins 100% Attach instantaneous Snapshot instantaneous 100% Mount / Attach < 5 seconds Deployed DB size: ~1TB 100% data reduction for database copies w/ all deployment methods In-memory copy services Instant DB copies w/ no extra storage cost Zero cost on host CPU, network 7

8 XTREMIO INTELLIGENT CONTENT ENGINE INCOMING DATA STREAM 963FE7B CA38C90 134F F7A 963FE7B F3AFBA3 AB45CB A8 BALANCED READS/WRITES ACROSS ALL CONTROLLERS/SSDS Copyright 2014 EMC Corporation. All rights reserved. 8

9 XTREMIO INTELLIGENT CONTENT ENGINE INCOMING DATA STREAM 963FE7B CA38C90 134F F7A 963FE7B F3AFBA3 AB45CB A A B C D E F C X-Brick #1 X-Brick #2 2 6 A E D 3 7 B F Copyright 2014 EMC Corporation. All rights reserved. 9

10 XTREMIO INTELLIGENT CONTENT ENGINE INCOMING DATA STREAM 963FE7B CA38C90 134F F7A 963FE7B F3AFBA3 AB45CB A C 2 6 A E D 3 7 B F Copyright 2014 EMC Corporation. All rights reserved. 10

11 XTREMIO INTELLIGENT CONTENT ENGINE Deduplicate INCOMING DATA STREAM 963FE7B C 2 6 A E D 3 7 B F Copyright 2014 EMC Corporation. All rights reserved. 11

12 XTREMIO DATA SERVICES ALWAYS-ON, INLINE, ZERO PENALTY, FREE ALWAYS-ON THIN PROVISIONING INLINE DEDUPLICATION INLINE COMPRESSION XTREMIO DATA PROTECTION INLINE DATA AT REST ENCRYPTION AGILE IN-MEMORY COPY SERVICES 12

13 IN-MEMORY A SNAPSHOT COPY IS CREATED SERVICES INSTANTLY IT ONLY INVOLVES ALLOCATION TO A SMALL CONTAINER IN-MEMORY METADATA SSD DATA Production Shared MD MD Snapshot MD 13

14 METADATA MANAGEMENT IS EFFICIENT Enabling thousands of space efficient copies IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 14

15 METADATA MANAGEMENT IS EFFICIENT THE METADATA IS Shared and in-memory space efficient Modify Data Block 1 IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 15

16 SNAPSHOT PERFORMANCE IS EQUAL IT S EXACTLY LIKE WRITING DATA TO THE PRODUCTION VOLUME Modify Data Block 4 IN-MEMORY METADATA SSD DATA Production MD Shared MD Snapshot MD 16

17 GAME-CHANGING CONSOLIDATION, AGILITY SCALE-OUT IOPS IN ABUNDANCE FREE, FAST DEV/TEST FREE, FAST ANALYTICS XTREMIO FLASH FOR ENTIRE APPLICATION DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 DEV INST 1 FIN COPY FIN COPY REPORTS MORE BUSINESS PRODUCTIVITY DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 DEV INST 2 OPS COPY OPS COPY ANALYTICS DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 DEV INST 3 x TEST/DEV COPIES DEV INST 3 DEV INST 3 DEV INST 3 DEV INST DATABASE INSTANCES HIGH PERFORMANCE PRODUCTION 1 SALES COPY XTREMIO CLUSTER SALES COPY DATAMART COPIES 0 TRENDS FASTER APPLICATION DEVELOPMENT TIMES BRUTE FORCE COPIES Copyright 2014 EMC Corporation. All rights reserved. 17

18 AGENDA Why XtremIO for SQL Server Customer Case Study: Connections Education Accelerate Your SQL Server Lifecycle Workflows Demo Seeding AlwaysOn Replica with AppSync Common Questions / Considerations 18

19 ABOUT CONNECTIONS Connections Academy was created in 2001, offering an online virtual school program for students in grades K-12 Our bespoke web-based Education Management System, Connexus, provides a platform that connects students with their lessons, teachers, learning coaches, and a wide range of other educational resources Developed and supported by a large in-house software development team, Connexus is continually enhanced to improve the learning experience 19

20 CUSTOMER CASE STUDY: CONNECTIONS EDUCATION CHALLENGES We have not budgeted standard SAN disk growth for the upcoming fiscal year, despite planning to deploy AlwaysOn with four replicas. Manage unpredictable data growth and IO requirements due to expanding user base and introduction of new features by a large development team Maintain growing population of non-production SQL Server environments Refresh 5 TB of production data on-demand, daily, and weekly Support production IO workload for dev, tuning, and load testing SOLUTION EMC XtremIO APPLICATIONS ASP.Net SQL Server 2014 Enterprise 20

21 Connections Education Production Environment Application Summary 5 TB Databases 12 Million Daily Page Loads 95,000 Users 85 Web / Application Servers 0.05 Second Average SQL Time XtremIO Performance Summary 5 TB Databases 4,500 Transactions Per Second Primary SQL Instance 80 Core 2.0 TB Secondary SQL Instance 40 Core 512 GB Reporting SQL Instance 40 Core 512 GB 2,900 IOPS 0.77 Millisecond Per Operation XtremIO 20TB Dual Brick System 21

22 Connections Education Non-Production Environment Database Refresh Process Dev Test Staging Load Test Production databases are replicated using a custom log shipping app Data drives are snapped and attached to a utility instance for private data removal Hotfix Dev Hotfix Test Demo BP Test New snaps are created and attached to non-prod servers Snapshot Clean Utility XtremIO Performance Summary 5 TB Databases 15,000 IOPS 0.75 Millisecond Per Operation XtremIO 20TB Dual Brick System Source Log Ship 22

23 SQL SERVER APPLICATION LIFE CYCLE UPGRADE DESIGN / DEVELOP SCALE-OUT REPORTING DBAs DEPLOY MAINTAIN DBAs MONITOR / TUNE 23

24 TEST / DEV Challenges Multiple copies increase storage footprint Starving test/dev I/O Refreshing is a complex process Easily verify that your application/release works well and integrates well with production data XtremIO values Instantaneous space efficient copy services No space or metadata bloat Inherently writable, zero performance impact As many copies as you need on-demand Test on production class storage - reduce risk of code changes Copy refresh enables easy refresh to the latest in production Test & Dev Every environment gets a full DB copy, All data, full IOPs 24

25 CAPACITY PLANNING TRADITIONAL STORAGE Flash 15K HDD High Capacity HDD RAID configurations for data, log, tempdb Number of spindles Separate data, log, and tempdb Separate OLTP and Analytics Right sizing Hot data > Flash Active data > SAS Cold data > SATA Short Stroke 25

26 CAPACITY PLANNING XTREMIO No more complex capacity planning Built-in flash optimized XDP w/ dual parity Predictable, consistency performance for all workloads Automatic load balance across all SSDs Scale on-demand w/ building block approach 26

27 TUNING Improve query performance without development costs Run load tests and workload analysis tools to identify application throughput and bottlenecks Test changes to queries without affecting production performance by testing against a snapshot Query performance is highly affected by IO latency and throughput after migrating to XtremIO, IO stalling was reduced from 100s of milliseconds to less than 1 27

28 DATABASE MAINTENANCE Space efficient instantaneous snapshots to offload resource intensive maintenance tasks (for example, DBCC checkdb, backup) Verify your backups by restoring them without worrying about space consumption Production Dbcc checkdb Backup 28

29 SCALE-OUT REPORTING Provide readable secondary for scale-out without complex application setup Isolate reads to its own memory, CPU, and tempdb database Enable rapid deployment of AlwaysOn Availability Group replica without doubling the storage cost OLTP Production Report Server(s) Production Volume Time 1 Time 2 29

30 UPGRADE Challenges Too many tasks to complete in a small upgrade window Difficult to rollback ROLLBACK TEST XtremIO values Reduce risk of upgrade with the ability to test on replica of production database Instantaneous snapshot provides backup copy in case of needs to rollback VERIFY SQL SERVER UPGRADE PROCESS PATCH BACKUP 30

31 CUSTOMER CASE STUDY: CONNECTIONS EDUCATION RESULTS The disk requirements of our non-prod environments, if we just used spindles, would put us out of the building. We can get away with a single twobrick XtremIO cluster. Easily support 20 active non-production database servers, 18 TB of thin-provisioned volumes, 81 snapshots, 169 TB of snapshots, all consuming only 10 TB of physical disk space Adding new environments is now possible without budgeting for additional space or spindles Jobs and developers no longer cause IO starvation resulting in more thorough testing and fewer hotfixes Automated database refresh using PowerShell and XtremIO CLI Reduced IO latency from 100s of milliseconds per op to <1 No more SQL Server has encountered <n> occurrence(s) of I/O requests taking longer than 15 seconds to complete Leveraged snapshots to offload CPU-intensive reporting workload during peak season Recovered many days that we used to spend budgeting, planning, configuring, and migrating data around the SAN to attempt to meet disk growth and latency demands 31

32 AGENDA Why XtremIO for SQL Server Customer Case Study: Connections Education Accelerate Your SQL Server Lifecycle Workflows Demo Seeding AlwaysOn Replica with AppSync Common Questions / Considerations 32

33 DEMO SEEDING ALWAYSON REPLICA WITH APPSYNC 33

34 AGENDA Why XtremIO for SQL Server Customer Case Study: Connections Education Accelerate Your SQL Server Lifecycle Workflows Demo Seeding AlwaysOn Replica with AppSync Common Questions / Considerations 34

35 RAID & DB FILE LAYOUTS ON XTREMIO TRUE OR FALSE You should configure different RAID for data, log, and tempdb. Answer: False You should seperate data, log, tempdb for best performance. Answer: False You don t need to have multiple data and tempdb files. Answer: False 35

36 STORAGE EFFICIENCY Dedupe Compression Thin Overall Efficiency Single DB No/Row Compress Page Compress DB Copies Multi DBs AlwaysOn Replica Encrypted DB Snapshot Copies 36

37 POINT-IN-TIME RECOVERY WITH COPY SERVICES Is it possible to do point-in-time recovery with copy services? Yes What do you need? Application consistent snapshot Utility that integrates w/ SQL Server Virtual Backup Device Interface (VDI) AppSync Log backups How to perform point-in-time recovery? Leave snapshot in No Recovery mode during mount Restore log backup to desired point-in-time 37

38 APPLICATION vs. CRASH CONSISTENT SNAPSHOT Application Consistent Crash Consistent Data vs. Log Sync Not Sync Pending IOs Wait Ignore Recovery on Mount No Yes Pause SQL IO Yes No Application consistent snapshot Backup AAG replica, Log ship secondary Crash consistent snapshot Repurpose for reporting, test/dev Offload for tuning, database integrity check 38

39 SUMMARY XtremIO is much more than speed XtremIO refines simplicity and efficiency for DBAs managing SQL Server workloads Call to action Simplify your SQL Server landscape, consolidate with confidence Create free test/dev and reporting space Offload your resource intensive tuning, maintenance tasks from production 39

40 WHAT S NEXT? XtremIO Solution Demo Deep Dive on XtremIO and Microsoft Solutions Custom Sizing & TCO Analysis Reference Architectures More Information: Reference Architectures & Solution Guides All-Flash Array Testing Guide & Best Practices Architecture & Product White Papers, Demo s and Educational Videos Customer Case Studies 40

41 More Xtremio Sessions For Customer Stories and Product & Solution Best Practices Transformational Workload Sessions ID Title Day ctdtt.63 ctdtt.64 ctdtt.65 ctdtt.66 ctdtt.67 ctdtt.70 ctdtt.71 ctdtt.72 ctdtt.73 solutionst T.07 XtremIO For Microsoft Workloads Enterprise Hybrid Cloud & Database-as-a- Service Best Practices Accelerating SQL Server With XtremIO Best Practices For Running Virtualized Workloads On XtremIO XtremIO: Transforming Your Workloads, Enabling The Agile Data Center SAS Analytics: Transformed w/ XtremIO & Isilon Transforming Agile Software DevOps With XtremIO Splunk Analytics: Transformed With XtremIO, Isilon & Avamar Transforming End-User Computing With XtremIO: DaaS & New Use Cases For Graphics No Storage Tuning & Complete Operational Simplicity for Oracle Databases Tue, 4:30pm Thu, 8:30am Tue, 12pm Thu, 10am Mon, 8:30am Mon, 12pm Mon, 4:30pm Wed, 4:30pm Mon, 3pm Wed, 8:30am Tue, 3pm Thu, 11:30am Tue, 8:30am Thu, 10am Tue, 12pm Wed, 3pm Mon, 4:30pm Tue, 8:30am Mon, 8:30am Wed, 4:30pm Product Sessions ID Title Day ctdtt.60 What's New With XtremIO For 2015 ctdtt.62 ctdtt.68 ctdtt.69 ctdtt.96 ctdtt.97 CDTT.74 bof.12 Business Continuity For XtremIO XtremIO In The Wild: Insights, Data Reduction, Performance & Operational Best Practices XtremIO Native Replication with RecoverPoint Transformational Technology Inside XtremIO Analysts' View On All-Flash Array Trends, Adoption & Market Leadership OpenStack Enablement with EMC Top 10 Tips & Tricks to Rock Your XtremIO World Wed, 12pm Tue, 4:30pm Mon, 3pm Thu, 1pm Tue, 3pm Wed, 3pm Mon, 8:30am Thu, 11:30am Mon, 1:30pm Wed, 8:30am Mon, 1:30pm Thu, 8:30am Mon, 1:30pm Thu, 4:30pm Tue, 1:30pm bof.39 Evaluating All-Flash Arrays Wed, 1:30pm solutionst T.01 XtremIO for SAP - Game changer for SAP landscapes (Customer Panel) Mon, 12pm Thu, 11:30am 41

42