Comparison of Drive Technologies for High-Titan aggregate Performance



Similar documents
Best Practices for Optimizing SQL Server Database Performance with the LSI WarpDrive Acceleration Card

RAID Performance Analysis

WHITE PAPER FUJITSU PRIMERGY SERVER BASICS OF DISK I/O PERFORMANCE

Accelerating Server Storage Performance on Lenovo ThinkServer

White Paper. Educational. Measuring Storage Performance

Chapter Introduction. Storage and Other I/O Topics. p. 570( 頁 585) Fig I/O devices can be characterized by. I/O bus connections

Distribution One Server Requirements

Disks and RAID. Profs. Bracy and Van Renesse. based on slides by Prof. Sirer

OBJECTIVE ANALYSIS WHITE PAPER MATCH FLASH. TO THE PROCESSOR Why Multithreading Requires Parallelized Flash ATCHING

Secondary Storage. Any modern computer system will incorporate (at least) two levels of storage: magnetic disk/optical devices/tape systems

White paper. QNAP Turbo NAS with SSD Cache

WITH A FUSION POWERED SQL SERVER 2014 IN-MEMORY OLTP DATABASE

Fusionstor NAS Enterprise Server and Microsoft Windows Storage Server 2003 competitive performance comparison

Performance Beyond PCI Express: Moving Storage to The Memory Bus A Technical Whitepaper

Input / Ouput devices. I/O Chapter 8. Goals & Constraints. Measures of Performance. Anatomy of a Disk Drive. Introduction - 8.1

Measuring Interface Latencies for SAS, Fibre Channel and iscsi

Seeking Fast, Durable Data Management: A Database System and Persistent Storage Benchmark

Outline. CS 245: Database System Principles. Notes 02: Hardware. Hardware DBMS Data Storage

How To Scale Myroster With Flash Memory From Hgst On A Flash Flash Flash Memory On A Slave Server

Benchmarking Cassandra on Violin

RAID. RAID 0 No redundancy ( AID?) Just stripe data over multiple disks But it does improve performance. Chapter 6 Storage and Other I/O Topics 29

Solid State Drive Architecture

Solid State Technology What s New?

How To Improve Write Speed On An Nand Flash Memory Flash Drive

COS 318: Operating Systems. Storage Devices. Kai Li Computer Science Department Princeton University. (

Price/performance Modern Memory Hierarchy

DIABLO TECHNOLOGIES MEMORY CHANNEL STORAGE AND VMWARE VIRTUAL SAN : VDI ACCELERATION

Optimizing SQL Server Storage Performance with the PowerEdge R720

Amadeus SAS Specialists Prove Fusion iomemory a Superior Analysis Accelerator

Quiz for Chapter 6 Storage and Other I/O Topics 3.10

Improve Business Productivity and User Experience with a SanDisk Powered SQL Server 2014 In-Memory OLTP Database

Sistemas Operativos: Input/Output Disks

White Paper Open-E NAS Enterprise and Microsoft Windows Storage Server 2003 competitive performance comparison

Flash s Role in Big Data, Past Present, and Future OBJECTIVE ANALYSIS. Jim Handy

Deep Dive: Maximizing EC2 & EBS Performance

Using Synology SSD Technology to Enhance System Performance Synology Inc.

Mass Storage Structure

Chapter 10: Mass-Storage Systems

Real-Time Storage Tiering for Real-World Workloads

The Data Placement Challenge

Lab Evaluation of NetApp Hybrid Array with Flash Pool Technology

Boost Database Performance with the Cisco UCS Storage Accelerator

Lecture 36: Chapter 6

SSD Old System vs HDD New

WHITE PAPER Addressing Enterprise Computing Storage Performance Gaps with Enterprise Flash Drives

WHITE PAPER Optimizing Virtual Platform Disk Performance

CPS104 Computer Organization and Programming Lecture 18: Input-Output. Robert Wagner

Communicating with devices

Impact of Flash Memory on Video-on-Demand Storage: Analysis of Tradeoffs

Optimizing LTO Backup Performance

LSI MegaRAID CacheCade Performance Evaluation in a Web Server Environment

HP Z Turbo Drive PCIe SSD

COS 318: Operating Systems. Storage Devices. Kai Li and Andy Bavier Computer Science Department Princeton University

A Close Look at PCI Express SSDs. Shirish Jamthe Director of System Engineering Virident Systems, Inc. August 2011

HP Smart Array Controllers and basic RAID performance factors

NAND Flash Architecture and Specification Trends

Big Picture. IC220 Set #11: Storage and I/O I/O. Outline. Important but neglected

How A V3 Appliance Employs Superior VDI Architecture to Reduce Latency and Increase Performance

1 Storage Devices Summary

Using Synology SSD Technology to Enhance System Performance Synology Inc.

SOLID STATE DRIVES AND PARALLEL STORAGE

Introduction to I/O and Disk Management

OCZ s NVMe SSDs provide Lower Latency and Faster, more Consistent Performance

Analysis of VDI Storage Performance During Bootstorm

File System & Device Drive. Overview of Mass Storage Structure. Moving head Disk Mechanism. HDD Pictures 11/13/2014. CS341: Operating System

Memory-Centric Database Acceleration

Intel Xeon Processor 5560 (Nehalem EP)

September 25, Maya Gokhale Georgia Institute of Technology

Flash Memory Technology in Enterprise Storage

LEVERAGING FLASH MEMORY in ENTERPRISE STORAGE. Matt Kixmoeller, Pure Storage

Q & A From Hitachi Data Systems WebTech Presentation:

Technologies Supporting Evolution of SSDs

Intel Solid- State Drive Data Center P3700 Series NVMe Hybrid Storage Performance

Using Synology SSD Technology to Enhance System Performance. Based on DSM 5.2

EMC XTREMIO EXECUTIVE OVERVIEW

Best Practices for Deploying Citrix XenDesktop on NexentaStor Open Storage

AMAZON S3 AND EC2 PERFORMANCE REPORT

Storing Data: Disks and Files

Everything you need to know about flash storage performance

NEXSAN NST STORAGE FOR THE VIRTUAL DESKTOP

Xangati Storage Solution Brief. Optimizing Virtual Infrastructure Storage Systems with Xangati

technology brief RAID Levels March 1997 Introduction Characteristics of RAID Levels

The Use of Flash in Large-Scale Storage Systems.

Chapter 12: Mass-Storage Systems

SLIDE 1 Previous Next Exit

WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression

PowerVault MD1200/MD1220 Storage Solution Guide for Applications

RAID Implementation for StorSimple Storage Management Appliance

Optimizing Solid State Storage With

How To Write On A Flash Memory Flash Memory (Mlc) On A Solid State Drive (Samsung)

Data Storage - I: Memory Hierarchies & Disks

White Paper Fujitsu PRIMERGY Servers RAID Controller Performance 2013

Evaluation Report: Database Acceleration with HP 3PAR StoreServ 7450 All-flash Storage

Systems Infrastructure for Data Science. Web Science Group Uni Freiburg WS 2014/15

Understanding endurance and performance characteristics of HP solid state drives

Cloud Optimized Performance: I/O-Intensive Workloads Using Flash-Based Storage

Microsoft Exchange Server 2003 Deployment Considerations

USB Flash Drives as an Energy Efficient Storage Alternative

Caching Mechanisms for Mobile and IOT Devices

RAMCloud and the Low- Latency Datacenter. John Ousterhout Stanford University

Transcription:

Comparison of Drive Technologies for High-Transaction Databases August 2007 By Solid Data Systems, Inc. Contents: Abstract 1 Comparison of Drive Technologies 1 2 When Speed Counts 3 Appendix 4 5

ABSTRACT Database transactions are by nature random and usually come with small block sizes. Cost and performance tradeoffs between hard drives, flash-based Solid-State Disks (SSDs), and DRAM-based SSDs are worth investigating. In this paper, we discuss considerations in choosing the right technology and provide one viewpoint on performance comparison using industry-standard benchmarks and handy graphical guides for estimating read and write Database performance improvements. High-transaction databases are typically comprised of small records (i.e., 4 or 8 Kbytes) that are often accessed randomly. Because the records are brief when compared to the time required to reach the data location, mechanical disk drives are paced by their ability to locate and retrieve information on the disks (i.e., disk access time). Disk access time becomes the dominant reason for slow database application performance, often causing the CPU to wait for disk I/O to complete. The problem is compounded by ever-increasing disk drive capacities because, as companies take advantage of larger drives, they are accessing fewer spindles for the same amount of data. With a 50 GB drive, less than 0.004% of the drive is accessible each second when randomly accessed for database-sized records. Striping information over multiple drives can increase the amount of data that is accessed, but transaction integrity requirements of the database often conflict with broad, simultaneous access. Solid State Disks (SSDs) are an excellent solution to the problem, and provide various levels of performance based on the underlying memory technology. COMPARING DRIVE TECHNOLOGIES Hard Disks Table 1 indicates the random performance that can be expected from a single rotating disk. When block sizes are 4 or 8 kb the typical database size these disks can read and write data at only 1 to 2 MBps. This is because the seek time (the time required for the heads to move mechanically from track to track), plus the rotational latency (the time for the block of interest to rotate under the read/write head), is 5 to 10 milliseconds for modern disk drives. Note as well that if the block is as large as 128K, then the rotating disk performance improves. Thus, rotating disks work well when reading or writing large files, but are limited when used for database-sized blocks. Needless to say, rotating disks are very economical for their capacity, but limited in performance. RANDOM READ BENCHMARK Table 1 RANDOM WRITE BENCHMARK Size Read IO/s Read MB/s Size Write IO/s Write MB/s 512B 185 0.09 10.4 512B 290 0.14 6.7 1K 185 0.18 10.5 1K 290 0.29 6.5 2K 182 0.37 10.5 2K 283 0.57 6.9 4K 175 0.70 10.8 4K 280 1.12 6.3 8K 176 1.41 10.9 8K 284 2.27 6.2 16K 172 2.75 11.0 16K 264 4.23 6.3 32K 170 5.44 11.0 32K 237 7.58 6.6 64K 152 9.76 11.0 64K 211 13.51 6,5 128K 132 16.96 11.2 128K 183 23.48 8.0 1 2007 Solid Data Systems, Inc. All rights reserved.

Flash-Based SSDs Because they have no moving parts, flash-based SSDs are a popular option in ruggedized applications or under high g load as in airborne applications. On reads, their performance falls between a conventional rotating drive and a DRAM-based SSD. On writes, however, they are generally the slowest of any disk technology at any block size. Performance figures are shown in Table 2. RANDOM READ BENCHMARK RANDOM WRITE BENCHMARK Size Read IO/s Read MB/s Size Write IO/s Write MB/s 512B 1315 0.66 1.4 512B 22 0.01 92.5 1K 1217 1.22 1.5 1K 22 0.02 91.7 2K 1206 2.41 1.5 2K 21 0.04 92.3 4K 1075 4.30 1.7 4K 21 0.09 94.5 8K 906 7.26 2.0 8K 21 0.17 92.5 16K 666 10.66 2.8 16K 21 0.34 93.7 32K 447 14.33 4.2 32K 21 0.68 102.1 64K 322 20.62 5.9 64K 19 1.23 106.7 128K 204 26.16 9.5 128K 18 2.37 113.2 Table 2 DRAM-Based SSDs As shown in Table 3, DRAM-based SSDs are the performance champions for database use, producing very high quantities of reads and writes per second and very low service times. Often, large databases may be performance limited by a few hot files or a heavily used temporary sort area. Placing just these files on DRAM-based SSDs can provide substantial overall performance gains, sometimes as much as an order of magnitude. Note as well that as the block size increases, the benefit over conventional rotating drive diminishes. Thus, DRAM-based SSDs are typically used to improve random small block performance. They are the most expensive of all drives due to the use of internal uninterruptible power supplies and hard drive backup. However, DRAM-based SSDs are still a reasonable solution in many cases because only a small percentage of the database must be stored on them. RANDOM READ BENCHMARK Table 3 RANDOM WRITE BENCHMARK Size Read IO/s Read MB/s Size Write IO/s Write MB/s 512B 7388 3.69 0.2 512B 7238 3.62 0.2 1K 6794 6.79 0.2 1K 6015 6.01 0.2 2K 5752 11.50 0.2 2K 5353 10.71 0.3 4K 4091 16.36 0.4 4K 4184 16.74 0.4 8K 2959 23.68 0.6 8K 2875 23.00 0.6 16K 1771 28.35 1.0 16K 1773 28.37 1.0 32K 999 31.98 1.8 32K 1004 32.14 1.8 64K 531 34.01 3.5 64K 540 34.57 3.5 128K 277 35.47 6.9 128K 281 36.08 6.8 2007 Solid Data Systems, Inc. All rights reserved. 2

WHEN SPEED COUNTS While less expensive than DRAM-based SSDs at an equivalent capacity, hard drives or flash-based SSDs may not deliver enough overall performance in some applications. The leading choice for overall performance in transactional real-time database environments is DRAM-based SSD. ABOUT THE AUTHOR Wade Tuma is the founder and CEO of Solid Data Systems, and is a technical visionary in the SSD industry. Prior to launching Solid Data Systems, Wade was the founder, president, and CEO of Compower Corporation. He has more than three decades of experience including significant work in very high-speed digital logic, radio frequency, video, and color-generation systems for National Semiconductor, Atari, and Apple. He earned a BS degree in Electrical Engineering from Cleveland State University. To learn more, contact Wade at wtuma@soliddata.com or visit www.soliddata.com. 3 2007 Solid Data Systems, Inc. All rights reserved.

APPENDIX The following tables provide a graphical comparison of the three drive technologies for reads and writes. READS I/O's per Second for Random READ Benchmarks 8000 I/O's (sec) 6000 4000 2000 0 Size (Bytes) Times for Random READ Benchmark Time (ms) 12.0 10.0 8.0 6.0 4.0 2.0 0.0 Size (Bytes) Throughput for Random READ Benchmark MB (sec) 40.00 30.00 20.00 10.00 0.00 Size (Bytes) 2007 Solid Data Systems, Inc. All rights reserved. 4

APPENDIX (CONT D) WRITES I/O's per Second for Random WRITE Benchmarks Solid Data DRAM -Based SCSI SSD 3.5" Flash-Based SCSI SSD Hard Disk Drive I/O's (sec) 8000 7000 6000 5000 4000 3000 2000 10 0 0 0 Size (Bytes) Times for Random WRITE Benchmark Time (ms) 120.0 100.0 80.0 60.0 40.0 20.0 0.0 Size (Bytes) Throughput for Random WRITE Benchmark 40.00 MB (sec) 30.00 20.00 10.00 0.00 Size (Bytes) 5 2007 Solid Data Systems, Inc. All rights reserved.