The Data Placement Challenge



Similar documents
Lab Evaluation of NetApp Hybrid Array with Flash Pool Technology

Flash Accel, Flash Cache, Flash Pool, Flash Ray Was? Wann? Wie?

New Cluster-Ready FAS3200 Models

Deploying Flash in the Enterprise Choices to Optimize Performance and Cost

Introducing NetApp FAS2500 series. Marek Stopka Senior System Engineer ALEF Distribution CZ s.r.o.

SSDs: Practical Ways to Accelerate Virtual Servers

SSDs: Practical Ways to Accelerate Virtual Servers

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

WHITE PAPER 1

Integrating SSDs into Virtual Servers

MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products

Automated Data-Aware Tiering

Increasing Storage Performance

Using Synology SSD Technology to Enhance System Performance Synology Inc.

A Close Look at PCI Express SSDs. Shirish Jamthe Director of System Engineering Virident Systems, Inc. August 2011

Using Synology SSD Technology to Enhance System Performance. Based on DSM 5.2

89 Fifth Avenue, 7th Floor. New York, NY White Paper. HP 3PAR Adaptive Flash Cache: A Competitive Comparison

Application-Focused Flash Acceleration

Flash Memory Technology in Enterprise Storage

FAS6200 Cluster Delivers Exceptional Block I/O Performance with Low Latency

NEXT GENERATION EMC: LEAD YOUR STORAGE TRANSFORMATION. Copyright 2013 EMC Corporation. All rights reserved.

W H I T E P A P E R D e l i v e r i n g C u s t o m e r V a l u e w i t h E n t e r p r i s e F l a s h D e p l o y m e n t s

WHITE PAPER. Drobo TM Hybrid Storage TM

Accelerating Applications and File Systems with Solid State Storage. Jacob Farmer, Cambridge Computer

Solid State Architectures in the Modern Data Center

The IntelliMagic White Paper: Storage Performance Analysis for an IBM Storwize V7000

EMC VFCACHE ACCELERATES ORACLE

Accelerating Server Storage Performance on Lenovo ThinkServer

Seeking Fast, Durable Data Management: A Database System and Persistent Storage Benchmark

How To Get A Memory Memory Device From A Flash Flash To A Memory Card (Iomemory) For A Microsoft Flash Memory Card From A Microsable Memory Card For A Flash (Ios) For An Iomemories Memory

NetApp FAS Hybrid Array Flash Efficiency. Silverton Consulting, Inc. StorInt Briefing

All-Flash Storage Solution for SAP HANA:

Comparison of Hybrid Flash Storage System Performance

OCZ s NVMe SSDs provide Lower Latency and Faster, more Consistent Performance

Data Center Storage Solutions

Flash for Databases. September 22, 2015 Peter Zaitsev Percona

Analyzing Big Data with Splunk A Cost Effective Storage Architecture and Solution

Leveraging EMC Fully Automated Storage Tiering (FAST) and FAST Cache for SQL Server Enterprise Deployments

Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software

How To Scale Myroster With Flash Memory From Hgst On A Flash Flash Flash Memory On A Slave Server

MaxDeploy Hyper- Converged Reference Architecture Solution Brief

Essentials Guide CONSIDERATIONS FOR SELECTING ALL-FLASH STORAGE ARRAYS

EMC XtremSF: Delivering Next Generation Storage Performance for SQL Server

WHITE PAPER Addressing Enterprise Computing Storage Performance Gaps with Enterprise Flash Drives

Driving Big Data with OCZ Enterprise SSDs

Solid State Technology What s New?

WITH A FUSION POWERED SQL SERVER 2014 IN-MEMORY OLTP DATABASE

Flash Use Cases Traditional Infrastructure vs Hyperscale

Accelerating Real Time Big Data Applications. PRESENTATION TITLE GOES HERE Bob Hansen

Scaling from Datacenter to Client

Using Synology SSD Technology to Enhance System Performance Synology Inc.

Intel RAID SSD Cache Controller RCS25ZB040

Boost Database Performance with the Cisco UCS Storage Accelerator

Can Flash help you ride the Big Data Wave? Steve Fingerhut Vice President, Marketing Enterprise Storage Solutions Corporation

Data Center Solutions

200 flash-related. petabytes of. flash shipped. patents. NetApp flash leadership. Metrics through October, 2015

Flash Performance in Storage Systems. Bill Moore Chief Engineer, Storage Systems Sun Microsystems

VMware Software-Defined Storage & Virtual SAN 5.5.1

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010

Hyperscale Use Cases for Scaling Out with Flash. David Olszewski

Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance

ioscale: The Holy Grail for Hyperscale

Memory Channel Storage ( M C S ) Demystified. Jerome McFarland

White Paper. Educational. Measuring Storage Performance

EMC FLASH STRATEGY. Flash Everywhere - XtremIO. Massimo Marchetti. Channel Business Units Specialty Sales EMC massimo.marchetti@emc.

FUJITSU Storage ETERNUS DX200 S3 Performance. Silverton Consulting, Inc. StorInt Briefing

Flash 101. Violin Memory Switzerland. Violin Memory Inc. Proprietary 1

FlashSoft Software from SanDisk : Accelerating Virtual Infrastructures

The Technologies & Architectures. President, Demartek

Reduce Latency and Increase Application Performance Up to 44x with Adaptec maxcache 3.0 SSD Read and Write Caching Solutions

Deploying Affordable, High Performance Hybrid Flash Storage for Clustered SQL Server

White. Paper. NetApp s Solid State Hierarchy. With a Focus on Flash Cache. September, 2009

The Economics of Intelligent Hybrid Storage. An Enmotus White Paper Sep 2014

10th TF-Storage Meeting

AIX NFS Client Performance Improvements for Databases on NAS

Supreme Court of Italy Improves Oracle Database Performance and I/O Access to Court Proceedings with OCZ s PCIe-based Virtualized Solution

FlexArray Virtualization

Lab Validation Report

Big Fast Data Hadoop acceleration with Flash. June 2013

LEVERAGING FLASH MEMORY in ENTERPRISE STORAGE. Matt Kixmoeller, Pure Storage

Evaluation Report: Supporting Microsoft Exchange on the Lenovo S3200 Hybrid Array

EMC XtremSF: Delivering Next Generation Performance for Oracle Database

Violin Memory Arrays With IBM System Storage SAN Volume Control

Accelerating Database Applications on Linux Servers

Introduction to NetApp Infinite Volume

Answering the Requirements of Flash-Based SSDs in the Virtualized Data Center

Measuring Interface Latencies for SAS, Fibre Channel and iscsi

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

THE SUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9

VMware Software-Defined Storage Vision

SOLID STATE DRIVES AND PARALLEL STORAGE

Data Center Solutions

PrimaryIO Application Performance Acceleration Date: July 2015 Author: Tony Palmer, Senior Lab Analyst

EqualLogic PS Series Load Balancers and Tiering, a Look Under the Covers. Keith Swindell Dell Storage Product Planning Manager

Flash at the price of disk Redefining the Economics of Storage. Kris Van Haverbeke Enterprise Marketing Manager Dell Belux

SOLUTION BRIEF. Resolving the VDI Storage Challenge

Flash Pool Design and Implementation Guide

Amadeus SAS Specialists Prove Fusion iomemory a Superior Analysis Accelerator

Solution Brief Network Design Considerations to Enable the Benefits of Flash Storage

SQL Server Virtualization

Transcription:

The Data Placement Challenge Entire Dataset Applications Active Data Lowest $/IOP Highest throughput Lowest latency 10-20% Right Place Right Cost Right Time 100% 2 2

What s Driving the AST Discussion? Performance Less Complexity Reduce Cost Scale performance on demand Simplify management Lower cost of ownership Maximum efficiency Co-existence of hot and cold data Hard to predict what s hot and what s not Focus on lowest $/IOPS for tier 1 applications Server virtualization driving throughput requirements 3

Moving data for Storage Tiering is by definition, inherently inefficient 4

Performance Gap Challenge Performance Growth Server Flash Huge gap between CPU and Storage Relatively small differences between HDD types Right Place Right Cost Right Time SAS/FC SATA Flash is a game changer Time

NetApp s Criteria for Effective Tiering Real-Time Efficient Transparent Data $ Serve data when it s hot Use high-cost media efficiently Separate performance and capacity scaling Keep it simple 6

Storage Tiering Approaches Typical Storage Tiering NetApp Virtual Storage Tier SSD Main Memory Data migration FC or SAS Flash Cache Block caching SATA SATA FC or SAS Data movement: Uses controller and drive IO Is not real-time Each tier requires capacity headroom No data migration Blocks cached dynamically Storage efficiency space savings reduce effective storage cost 7

Virtual Storage Tiering Virtual Storage Tier Data-driven Real-time Self-managing Array Flash Server Flash HDD Storage Intelligently place hot data on the highest performing media in real time Efficient Use of Flash Simple to install Self Managing Non Disruptive Operations Caching vs. Data Migration Minimal HDD I/O s Highly Granular Real Time Responsiveness

NetApp Flash Pool Overview Flash Pool provides a persistent, aggregate-level read/write cache A Flash Pool consists of: 1 or more RAID group of one type of HDD PLUS a RAID group of SSDs Features common with Flash Cache: 4KB granularity, real-time, fully-automated Integrated with Data ONTAP capabilities Additional Flash Pool benefits Consistent performance during controller failover and takeover events Cached data continues to be available Random overwrite data is cached Avoids writes to and reads from disk 9

Flash Pool Performance Results File Services Workload $ / GB optimized Before: FAS6210 pair with 144TB After: FAS6210 pair with 168TB Capacity 240 x SAS 600GB 10K RPM Disks 168 x 1TB 7.2K RPM SATA Disks 12 x 100G SSDs on each node Cost/Efficiency Benefit Entire workload moved from SAS to SATA 16% more storage capacity Performance Benefit 6% Higher IOPS 14% lower response time 34% lower cost 48% lower cost per TB 40% less power 10

Flash Pool Performance Results OLTP Workload $ / GB optimized Before: FAS6210 pair with 144TB After: FAS6210 pair with 216TB Capacity 240 x SAS 600GB 10K RPM Disks 216 x 1TB 7.2K RPM SATA Disks 12 x 100G SSDs on each node Cost/Efficiency Benefit Entire workload moved from SAS to SATA 47% more capacity 23% lower cost Performance Benefit Similar IOPS (± 2%) Significantly improved response times 50% lower cost per TB 26% less power 11

Flash Pool Performance Results OLTP Workload $ / GB optimized Before: FAS6210 pair with 144TB After: FAS6210 pair with 648TB Capacity 240 x SAS 600GB 10K RPM Disks 216 x 3TB 7.2K RPM SATA Disks 12 x 100G SSDs on each node Cost/Efficiency Benefit Entire workload moved from SAS to SATA 342% more capacity for 42% higher cost Performance Benefit Similar IOPS (± 2%) Significantly improved response times 67% lower cost per TB 24% less power 12

Flash Pool Performance Results File Services Workload $ / IOP optimized Before: FAS6210 pair with 92K IOPS After: FAS6210 pair with 111.7K IOPS 240 x SAS 600GB 10K RPM SAS Disks 96 x 600GB 10K RPM SAS Disks 12 x 100G SSDs on each node Cost/Efficiency Benefit 60% fewer HDDs 37% lower cost 48% lower $/IOPS Performance Benefit 21% higher throughput 26% lower response time 49% less power 13

Flash Pool Performance Results OLTP Workload $ / IOP optimized Before: FAS6210 pair with 106K IOPS After: FAS6210 pair with 112K IOPS 240 x SAS 600GB 10K RPM SAS Disks 96 x 600GB 10K RPM SAS Disks 12 x 100G SSDs on each node Cost/Efficiency Benefit Reduced spindle count 37% lower cost 40% lower $/IOPS Performance Benefit 5% higher throughput Significantly improved response time 49% less power 14

Flash Pool Software & Hardware Support Data ONTAP 8.1.1 7-Mode and Cluster-Mode No license 64-bit aggregates only Platform Support FAS/V 62x0; FAS/V60x0 FAS/V 3270, 3240; FAS/V 3170, 3160 FAS2240, FAS2220 V-Series Flash Pools with NetApp SSD + HDD only Shelf configurations Mixed SSD + SATA shelves 15

Server Flash as Cache Flash emerging in server as IOPS tier Significant performance benefits, but relatively costly However, flash alone is just fast DAS (Direct Attached Storage) No sharing across servers No high availability, data protection, disaster recovery Management complexity Ideal: Server flash as a cache for network storage Flash to improve performance, network storage to protect and manage data Optimal $/GB and $/IOPS Target use cases Application specific IOPS acceleration, OLTP, Virtualized OLTP, VM Density

Introducing NetApp Flash Accel Improved App and Server Performance Reduces latency up to 90% Increases server throughput up to 80% Reduces demand on backend storage Leverage shared storage for reliability and centralized management Bring server flash under management of ONTAP Flexible Deployment Software only, compatible server PCI-e flash or SSD drive Flash Accel is a free license Downloaded via NOW download page. Sustainable High Performance Intelligent data coherency: block-level invalidation rather than flush entire cache Persistent and durable cache across VM / server reboots Optimized Metrics: $ / IOPS and $ / GB

Fusion-io Bare Metal Cache Solution 18

Fusion-io Solution Components iomemory Virtual Storage Layer (VSL) Block interface for iomemory (driver) iomemory device iodrive2 Hardware PCIe device providing flash capacity directcache software Software that transforms iomemory into a block based cache device iosphere GUI for iomemory management, alerting, and performance monitoring 19

Fusion-io iomemory VSL & iodrive2 Enterprise reliability from MLC flash Simplified data path from CPU to flash = lower latency and increased data integrity Lower CPU and RAM utilization Flash endurance-extending capabilities 20

Summary Extending VST End-to-End Server Level Flash on the Server SSD on the Server Flash Accel (Server Cache) Server flash offloads IOPS Data ONTAP manages data Operational simplicity Optimal $/IOPS & $/GB Controller Level Flash-based caching storage acceleration Flash Cache Disk Level SATA: Big, Slow, cheap FC/SAS: Small, Fast, $$$ SSD: Fastest, $$$$$ Flash Pool

Any questions?

Johnny Dahlberg Technical Partner Manager djohnny@netapp.com 0733-140 139 24