Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie?

Transcription

1 Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie? Systems Engineer Sven Willholz

2 Performance Growth Performance Gap Performance Gap Challenge Server Huge gap between CPU and storage Relatively small differences between HDD types HDD Storage Latency impacts applications Time 2

3 Market Opportunity: Enterprise Solid State Storage WW Enterprise SSD Revenue in $millions Verdoppelung bis Heute CY2011 CY2012 CY2013 CY2014 CY2015 CY2016 Source: IDC: Worldwide Solid State Storage Forecast Update, Dec 2012, Doc #

4 NetApp Flash Portfolio Historie Server Flash Accel Application Acceleration Storage Controller Flash Cache HDD Acceleration VST Drives SSDs for NetApp Arrays Flash Pool SSD/HDD Caching Array EF540 All-Flash Array 4

5 Flash Technology in Storage Server Flash All Flash Array Hybrid Array Traditional Storage Cache storage Fastest access Lowest capacity Persistent storage Submillisecond access Larger capacity Intelligent caching Submillisecond access for cached data Leverages HDD for capacity Persistent storage Slowest access Scalable, cost-effective capacity Performance (Latency) Requirements Capacity Requirements 5

6 NetApp Flash Portfolio Server Flash All Flash Array Hybrid Array Traditional Storage Cache storage Fastest access Lowest capacity Persistent storage Submillisecond access Larger capacity Intelligent caching Submillisecond access for cached data Leverages HDD for capacity Persistent storage Slowest access Scalable, cost-effective capacity Complete Portfolio of Offerings for Any Workload Flash Accel Server Caching Partners EF540 FlashRay Flash Cache Flash Pool Flash Aggregates SSD Cache Fas/V-Series E-Series 6

7 Flash Cache 7

8 NetApp Flash Cache Optimize Performance and Reduce Costs Flash Cache improves average latency for random reads Increase I/O throughput of disk-bound storage systems without adding more disk drives Reduce costs by using fewer, larger disk drives Effective for file services, databases, messaging, and virtual infrastructure Predict your results before buying for an existing storage system 8

9 Reduce Latency with Flash Cache 9

10 Synergy of Flash Cache and Deduplication Reducing the Duration of Boot Storms in a Virtual Infrastructure Virtual Machine Reads During a Boot Storm VM 1 VM 2 VM 3 VM 4 Deduplicated Volume of VM Boot Images Storage Controller with Flash Cache VM 5 Once a master block is cached then all virtual block duplicates will be read at cache speed. VM n 10

11 VST Results: Flash Cache File Services Example Before: FAS6210 HA Pair with 144TB 240 SAS 600GB 10K RPM Disks Cost/efficiency impact Entire workload moved from SAS to SATA (OLTP workload) 34.1% lower cost per TB 40.2% lower $/IOPS 40.5% less power After: Flexibility impact 16.7% more storage capacity 28.5% more IOPS FAS6210 HA Pair with 168TB 168 1TB 7.2K RPM SATA Disks 1 TB Flash Cache 18.5% improvement in average response time 11

12 Flash Cache Summary PCIe Card, wirkt auf Controller-Ebene Random Read Beschleunigung für Fileservices, Server/Desktop Virtualisierung, DB s, 4kB Block Granularität MS Exchange und SharePoint Ohne zusätzliche Konfiguration wirksam Kann für einzelne Volumes ein- oder ausgeschaltet werden Storage Efficiency transparent (i.e. Dedup aware) 12

13 Flash Pool 13

14 NetApp Flash Pool Shared Storage Virtual Storage Tiering Server level Flash Accel Fusion-io (resell) Dedicated Storage Hybrid Arrays (Persistent or cache) E-series Controller level Flash Cache Array level (hybrid) Flash Pool (Data cache) Flash Aggregates (Persistent) FAS All Flash Arrays (Persistent) EF540 FlashRay 14

15 Flash Pool Data ONTAP Requirements Software requirements Clustered Data ONTAP or Data ONTAP operating in 7-Mode HDD based 64-bit aggregate Aggregate state must be healthy (can t be FAILED, offline or in a foreign state) Can be a RAID-DP, RAID 4 or SyncMirror aggregate No license is required it s free! NetApp Confidential - Limited Use 15

16 Flash Pool Read Caching 1. The first read request goes to HDD block is brought into memory and sent to the requestor. 2. Read is evicted from memory if it matches the insertion policy (random read), it is copied into the SSD cache. 3. Any additional requests for the same block are serviced from the SSD cache the block is copied back into system memory and sent to the requestor. 2 memory CP 1 SSD Block in HDD = actual block Block in memory = copy of actual block Block in SSD cache = copy of actual block 3 HDD NetApp Confidential - Limited Use 16

17 Flash Pool Overwrite Caching 1. First random write is sent to HDD in a CP. All sequential writes are sent to HDD. 2. An overwrite of the same random block arrives in memory if it matches the insertion policy (small block random overwrite), it is sent to the SSD cache in a CP. 3. Actual block resides in SSD (block in HDD is invalid) will eventually be de-staged to HDD when evicted from the SSD cache. 2 memory NVRAM CP CP Block in HDD = actual block Block in memory = actual block Block in SSD cache = actual block 3 1 SSD HDD NetApp Confidential - Limited Use 17

18 VST Results: Flash Pool OLTP Example Before: FAS6210 HA Pair with 144 TB 240 SAS 600-GB 10K RPM Disks Cost/efficiency impact Entire workload moved from SAS to SATA (OLTP workload) 46.3% lower cost per TB 18% lower $/IOPS 26.5% less power After: Flexibility impact 50% more storage capacity Similar IOPS (± 2%) FAS6210 HA pair with 216 TB 216 1TB 7.2K RPM SATA Disks GB SSDs Significant improvement in average response time 18

19 Flash Pool Summary SSD RAID Group, wirkt auf Aggregate-Ebene Beschleunigt Random Reads für DB s, Server/Desktop Virtualisierung, 4kB Block Granularität Beschleunigt Random Overwirtes (<16KB Blocks) für spezielle DB Workloads (OLTP) Ohne zusätzliche Konfiguration wirksam Kann für einzelne Volumes ein- oder ausgeschaltet werden Read und Write Policie s auf Volume Ebene Storage Efficiency transparent Cached Data bleiben nach Takeover/Giveback HOT 19

20 Flash Accel 20

21 NetApp Server Cache Approach Flash Accel Server Caching Partner Alliance NetApp server caching software Software only, uses supported PCI-e or SSD hardware Turns server flash into cache for Data ONTAP Free download for customers, fully supported by NGS HW program validated partner HW for use with Flash Accel SW program validates partner SW compatibility with ONTAP Provides support for broad array of server cache use Fusion-io Resale Program Resell of hardware and software products Enables complete server caching solution purchase from single source * 21

22 Flash Accel Architecture 3 Key Components Flash Accel Windows Agent (OS Driver and Web Service) Flash Accel ESX Host Agent Flash Accel Virtual Management Appliance and VSC Plug-in Available in VSC

23 Flash Accel: Snapshot Coherency Storage Operation Flash Accel Operation Take snapshot Store metadata of cache state at point-in-time along with snapshot in ONTAP (SnapDrive Integration) Restore snapshot Offline - Unmount device and disconnect from VM Online via SnapDrive Read metadata stored with snapshot Compare snapshot state metadata with current cache state metadata Invalidate changed blocks between the two states and rollback cache to snapshot state 23

24 Flash Accel Summary Block-orientierter write-through cache Coherent mit backing store Persistent (and durable) across reboots/crashes 24

25 All Flash Array 25

26 NetApp EF540 Flash Array Designed for performance-driven applications with submillisecond latency requirements 26

27 Product Overview 2U/24-drive system 800GB SSDs Dual-active controllers (8) 8Gb FC host interfaces 24GB battery-backed cache SANtricity software Two configuration options: 12 drives (9.6TB) 24 drives (19.2TB) Over 300,000 IOPS Submillisecond latency Up to 6 GB/s throughput Options: Additional connectivity: 8Gb FC, 6Gb SAS, 10Gb iscsi, 40Gb IB Advanced data protection: Snapshot technology, volume copy, synchronous mirroring, and asynchronous mirroring 27

28 FlashRay with Mars OS Entirely new all-flash array offering New hardware architecture (FlashRay) and new software (Mars OS) Designed from the ground up to maximize the benefits of flash Differentiated with classic NetApp value Seamless scalability Built-in efficiencies Enterprise-class capabilities Rich set of data management features Worldwide support NetApp Confidential 28

29 NetApp FlashRay Performance Write-optimized High IOPS Consistent latency Storage Efficiency Global inline dedupe Inline compression Enterprise-class Capabilities High availability Snapshots/clones Replication Multi-protocol App integration Scalability Scale-out architecture with auto balancing Multi-tenancy and QoS NetApp Confidential Internal Use Only 29

30 Summary FlashRay and Mars OS architecture optimized for flash Sustained high performance Consistent low latency Enterprise service levels How can we help you optimize your data center with flash? NetApp Confidential 30

31 31