Timing of a Disk I/O Transfer



Similar documents
I/O Management. General Computer Architecture. Goals for I/O. Levels of I/O. Naming. I/O Management. COMP755 Advanced Operating Systems 1

Chapter 11 I/O Management and Disk Scheduling

Chapter 11 I/O Management and Disk Scheduling

Disks and RAID. Profs. Bracy and Van Renesse. based on slides by Prof. Sirer

File System & Device Drive. Overview of Mass Storage Structure. Moving head Disk Mechanism. HDD Pictures 11/13/2014. CS341: Operating System

Devices and Device Controllers

Introduction Disks RAID Tertiary storage. Mass Storage. CMSC 412, University of Maryland. Guest lecturer: David Hovemeyer.

Sistemas Operativos: Input/Output Disks

Linux Block I/O Scheduling. Aaron Carroll December 22, 2007

Storing Data: Disks and Files

RAID. Contents. Definition and Use of the Different RAID Levels. The different RAID levels: Definition Cost / Efficiency Reliability Performance

Chapter 10: Mass-Storage Systems

Data Storage - II: Efficient Usage & Errors

COS 318: Operating Systems. Storage Devices. Kai Li Computer Science Department Princeton University. (

Lecture 36: Chapter 6

COS 318: Operating Systems. Storage Devices. Kai Li and Andy Bavier Computer Science Department Princeton University

Secondary Storage. Any modern computer system will incorporate (at least) two levels of storage: magnetic disk/optical devices/tape systems

How To Write A Disk Array

Database Management Systems

Operating System Concepts. Operating System 資 訊 工 程 學 系 袁 賢 銘 老 師

Chapter 12: Mass-Storage Systems

Copyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 13-1

Operating Systems. Virtual Memory

Chapter 13 Disk Storage, Basic File Structures, and Hashing.

Chapter 13. Disk Storage, Basic File Structures, and Hashing

Introduction to I/O and Disk Management

Physical Data Organization

COSC 6374 Parallel Computation. Parallel I/O (I) I/O basics. Concept of a clusters

Storage and File Systems. Chester Rebeiro IIT Madras

Chapter 2 Data Storage

Systems Infrastructure for Data Science. Web Science Group Uni Freiburg WS 2014/15

UNIX File Management (continued)

Operating Systems OBJECTIVES 7.1 DEFINITION. Chapter 7. Note:

Chapter 13. Chapter Outline. Disk Storage, Basic File Structures, and Hashing

Operating Systems, 6 th ed. Test Bank Chapter 7

WHITE PAPER FUJITSU PRIMERGY SERVER BASICS OF DISK I/O PERFORMANCE

Chapter 12: Secondary-Storage Structure

4.2: Multimedia File Systems Traditional File Systems. Multimedia File Systems. Multimedia File Systems. Disk Scheduling

Definition of RAID Levels

An Introduction to RAID. Giovanni Stracquadanio

OPERATING SYSTEM - VIRTUAL MEMORY

Filing Systems. Filing Systems

CS 464/564 Introduction to Database Management System Instructor: Abdullah Mueen

File Management. File Management

HARD DRIVE CHARACTERISTICS REFRESHER

RAID HARDWARE. On board SATA RAID controller. RAID drive caddy (hot swappable) SATA RAID controller card. Anne Watson 1

Price/performance Modern Memory Hierarchy

Redpaper. Performance Metrics in TotalStorage Productivity Center Performance Reports. Introduction. Mary Lovelace

Why disk arrays? CPUs improving faster than disks

Storage and File Structure

Operating Systems CSE 410, Spring File Management. Stephen Wagner Michigan State University

Storing Data: Disks and Files. Disks and Files. Why Not Store Everything in Main Memory? Chapter 7

PERFORMANCE TUNING ORACLE RAC ON LINUX

Lecture 18: Reliable Storage

CPU Scheduling. Basic Concepts. Basic Concepts (2) Basic Concepts Scheduling Criteria Scheduling Algorithms Batch systems Interactive systems

CS420: Operating Systems

1 File Management. 1.1 Naming. COMP 242 Class Notes Section 6: File Management

Input / Ouput devices. I/O Chapter 8. Goals & Constraints. Measures of Performance. Anatomy of a Disk Drive. Introduction - 8.1

Operating Systems. RAID Redundant Array of Independent Disks. Submitted by Ankur Niyogi 2003EE20367

SAN Conceptual and Design Basics

Distribution One Server Requirements

Quiz 4 Solutions EECS 211: FUNDAMENTALS OF COMPUTER PROGRAMMING II. 1 Q u i z 4 S o l u t i o n s

NetApp Software. SANtricity Storage Manager Concepts for Version NetApp, Inc. 495 East Java Drive Sunnyvale, CA U.S.

HP Smart Array Controllers and basic RAID performance factors

Striped Set, Advantages and Disadvantages of Using RAID

Chapter 12 File Management

Lecture 16: Storage Devices

CS 6290 I/O and Storage. Milos Prvulovic

RAID Overview

File Management. Chapter 12

High Performance Tier Implementation Guideline

Best Practices for Deploying SSDs in a Microsoft SQL Server 2008 OLTP Environment with Dell EqualLogic PS-Series Arrays

technology brief RAID Levels March 1997 Introduction Characteristics of RAID Levels

Q & A From Hitachi Data Systems WebTech Presentation:

Network Attached Storage. Jinfeng Yang Oct/19/2015

6. Storage and File Structures

Chapter 6 External Memory. Dr. Mohamed H. Al-Meer

IncidentMonitor Server Specification Datasheet

Filesystems Performance in GNU/Linux Multi-Disk Data Storage

Best practices for operational excellence (SharePoint Server 2010)

CS 153 Design of Operating Systems Spring 2015

RAID 6 with HP Advanced Data Guarding technology:

File Management. Chapter 12

What is RAID? data reliability with performance

Outline. Principles of Database Management Systems. Memory Hierarchy: Capacities and access times. CPU vs. Disk Speed

Dell SAS RAID Storage Manager. User s Guide. support.dell.com

Comp 204: Computer Systems and Their Implementation. Lecture 12: Scheduling Algorithms cont d

TELE 301 Lecture 7: Linux/Unix file

Performance and scalability of a large OLTP workload

Chapter 2: Computer-System Structures. Computer System Operation Storage Structure Storage Hierarchy Hardware Protection General System Architecture

ELEC 377. Operating Systems. Week 1 Class 3

1 Storage Devices Summary

Why disk arrays? CPUs speeds increase faster than disks. - Time won t really help workloads where disk in bottleneck

File System Reliability (part 2)

Using Synology SSD Technology to Enhance System Performance Synology Inc.

CSE 120 Principles of Operating Systems

Transcription:

Disk Performance Parameters To read or write, the disk head must be positioned at the desired track and at the beginning of the desired sector Seek time Time it takes to position the head at the desired track Rotational delay or rotational latency Time its takes for the beginning of the sector to reach the head 1 Timing of a Disk I/O Transfer 2

Disk Performance Parameters Access time Sum of seek time and rotational delay The time it takes to get in position to read or write Data transfer occurs as the sector moves under the head 3 Disk Scheduling Policies Seek time is the reason for differences in performance For a single disk there will be a number of I/O requests If requests are selected randomly, we will poor performance 4

Disk Scheduling Policies First-in, first-out (FIFO) Process request sequentially Fair to all processes Approaches random scheduling in performance if there are many processes 5 Disk Scheduling Policies Priority Goal is not to optimize disk use but to meet other objectives Short batch jobs may have higher priority Provide good interactive response time 6

Disk Scheduling Policies Last-in, first-out Good for transaction processing systems The device is given to the most recent user so there should be little arm movement Possibility of starvation since a job may never regain the head of the line 7 Disk Scheduling Policies Shortest Service Time First Select the disk I/O request that requires the least movement of the disk arm from its current position Always choose the minimum Seek time 8

Disk Scheduling Policies SCAN Arm moves in one direction only, satisfying all outstanding requests until it reaches the last track in that direction Direction is reversed 9 Disk Scheduling Policies C-SCAN Restricts scanning to one direction only When the last track has been visited in one direction, the arm is returned to the opposite end of the disk and the scan begins again 10

Disk Scheduling Policies N-step-SCAN Segments the disk request queue into subqueues of length N Subqueues are processed one at a time, using SCAN New requests added to other queue when queue is processed FSCAN Two queues One queue is empty for new requests 11 Disk Scheduling Algorithms 12

RAID Redundant Array of Independent Disks Set of physical disk drives viewed by the operating system as a single logical drive Data are distributed across the physical drives of an array Redundant disk capacity is used to store parity information 13 RAID 0 (non-redundant) 14

RAID 1 (mirrored) 15 RAID 2 (redundancy through Hamming code) 16

RAID 3 (bit-interleaved parity) 17 RAID 4 (block-level parity) 18

RAID 5 (block-level distributed parity) 19 RAID 6 (dual redundancy) 20

RAID 10 RAID 10 is sometimes also called RAID 1+0 source: http://www.illinoisdataservices.com/raid-10-data-recovery.html 2013 A.W. Krings 21 RAID 0+1 2013 A.W. Krings source: http://www.illinoisdataservices.com/raid-10-data-recovery.html 22

Disk Cache Buffer in main memory for disk sectors Contains a copy of some of the sectors on the disk 21 Least Recently Used The block that has been in the cache the longest with no reference to it is replaced The cache consists of a stack of blocks Most recently referenced block is on the top of the stack When a block is referenced or brought into the cache, it is placed on the top of the stack 22

Least Recently Used The block on the bottom of the stack is removed when a new block is brought in Blocks don t actually move around in main memory A stack of pointers is used 23 Least Frequently Used The block that has experienced the fewest references is replaced A counter is associated with each block Counter is incremented each time block accessed Block with smallest count is selected for replacement Some blocks may be referenced many times in a short period of time and the reference count is misleading 24

25 26

27 Each individual device is associated with a special file Two types of I/O Buffered Unbuffered UNIX SCR4 I/O 28

Hash Table Buffer Cache Free list pointers hash pointers Device#, Block# Free List Pointer Figure 11.13 UNIX Buffer Cache Organization 29 Linux I/O Elevator scheduler Maintains a single queue for disk read and write requests Keeps list of requests sorted by block number Drive moves in a single direction to satisfy each request 30

Linux I/O Deadline scheduler Uses three queues Incoming requests Read requests go to the tail of a FIFO queue Write requests go to the tail of a FIFO queue Each request has an expiration time defaults for requests: 0.5s for read 5s for write 31 Linux I/O 1. Put requests in sorted queue *and* FIFO remove request from both Qs when processed Schedule from sorted Q and check expiration date of FIFO entry. if date has expired, schedule from FIFO until caught up 32

Linux I/O Anticipatory I/O scheduler Delay a short period of time after satisfying a read request to see if a new nearby request can be made 33 Windows I/O Basic I/O modules Cache manager File system drivers Network drivers Hardware device drivers 34

Windows I/O 35