Chapter 11: File System Implementation!
|
|
|
- Brittany Walton
- 7 years ago
- Views:
Transcription
1 The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again. Chapter 11: File System Implementation!
2 Chapter 11: File System Implementation! File-System Structure" File-System Implementation " Directory Implementation" Allocation Methods" Free-Space Management " Efficiency and Performance" Recovery" Log-Structured File Systems" NFS" Example: WAFL File System" 11.2! Silberschatz, Galvin and Gagne 2005!
3 Objectives! To describe the details of implementing local file systems and directory structures" To describe the implementation of remote file systems" To discuss block allocation and free-block algorithms and trade-offs" 11.3! Silberschatz, Galvin and Gagne 2005!
4 User program & Kernel interface in Linux! Note: This picture is excerpted from Write a Linux Hardware Device Driver, Andrew O Shauqhnessy, 11.4! Silberschatz, Galvin Unix and world Gagne 2005!
5 File-System Structure! File structure" Logical storage unit" Collection of related information" File system resides on secondary storage (disks or SSD)" File system organized into layers" File control block storage structure consisting of information about a file" 11.5! Silberschatz, Galvin and Gagne 2005!
6 Layered File System! 11.6! Silberschatz, Galvin and Gagne 2005!
7 A Typical File Control Block! 11.7! Silberschatz, Galvin and Gagne 2005!
8 In-Memory File System Structures! 11.8! Silberschatz, Galvin and Gagne 2005!
9 Virtual File Systems! Virtual File Systems (VFS) provide an object-oriented way of implementing file systems." VFS allows the same system call interface (the API) to be used for different types of file systems." The API is to the VFS interface, rather than any specific type of file system." Basic operations are open, close, read & write" 11.9! Silberschatz, Galvin and Gagne 2005!
10 Schematic View of Virtual File System! 11.10! Silberschatz, Galvin and Gagne 2005!
11 VFS & Device Driver interface! Note: This picture is excerpted from Write a Linux Hardware Device Driver, Andrew O Shauqhnessy, Unix world 11.11! Silberschatz, Galvin and Gagne 2005!
12 VSF & Major number! principal interface between a device driver and Linux kernel " " 11.12! Silberschatz, Galvin and Gagne 2005!
13 Directory Implementation! Linear list of file names with pointer to the data blocks." simple to program" time-consuming to execute " Hash Table linear list with hash data structure." decreases directory search time" collisions situations where two file names hash to the same location" fixed size" 11.13! Silberschatz, Galvin and Gagne 2005!
14 Allocation Methods! An allocation method refers to how disk blocks are allocated for files:" Contiguous allocation! Linked allocation! Indexed allocation! 11.14! Silberschatz, Galvin and Gagne 2005!
15 Contiguous Allocation! Each file occupies a set of contiguous blocks on the disk" Simple only starting location (block #) and length (number of blocks) are required " Random access " Wasteful of space (dynamic storage-allocation problem) " Files cannot grow" 11.15! Silberschatz, Galvin and Gagne 2005!
16 Contiguous Allocation! Mapping from logical to physical" LA/512" Q" R" Block to be accessed = Q + starting address Displacement into block = R 11.16! Silberschatz, Galvin and Gagne 2005!
17 Contiguous Allocation of Disk Space! 11.17! Silberschatz, Galvin and Gagne 2005!
18 Extent-Based Systems! Many newer file systems (I.e. Veritas File System) use a modified contiguous allocation scheme" Extent-based file systems allocate disk blocks in extents" An extent is a contiguous block of disks" Extents are allocated for file allocation" A file consists of one or more extents." 11.18! Silberschatz, Galvin and Gagne 2005!
19 Linked Allocation! Each file is a linked list of disk blocks: blocks may be scattered anywhere on the disk." block =" pointer" 11.19! Silberschatz, Galvin and Gagne 2005!
20 Linked Allocation (Cont.)! Simple need only starting address" Free-space management system no waste of space " No random access" Mapping" LA/511" Q" R" Block to be accessed is the Qth block in the linked chain of blocks representing the file." Displacement into block = R + 1" File-allocation table (FAT) disk-space allocation used by MS-DOS and OS/2." 11.20! Silberschatz, Galvin and Gagne 2005!
21 Linked Allocation! 11.21! Silberschatz, Galvin and Gagne 2005!
22 File-Allocation Table! 11.22! Silberschatz, Galvin and Gagne 2005!
23 Indexed Allocation! Brings all pointers together into the index block." Logical view." index table" 11.23! Silberschatz, Galvin and Gagne 2005!
24 Example of Indexed Allocation! 11.24! Silberschatz, Galvin and Gagne 2005!
25 Indexed Allocation (Cont.)! Need index table" Random access" Dynamic access without external fragmentation, but have overhead of index block." Mapping from logical to physical in a file and block size of 512 words. We need only 1 block for index table." LA/512" Q" R" Q = displacement into index table" R = displacement into block" 11.25! Silberschatz, Galvin and Gagne 2005!
26 Indexed Allocation Mapping (Cont.)!!" outer-index" index table" file" 11.26! Silberschatz, Galvin and Gagne 2005!
27 Summary! Contiguous Allocation" Each file occupies a set of contiguous blocks on the disk" Simple " Random access" Wasteful of space (dynamic storage-allocation problem)" Files cannot grow" Linked Allocation" Simple need only starting address" Free-space management system no waste of space " No random access" Indexed Allocation" Need index table" Random access" Dynamic access without external fragmentation, but have overhead of index block." 11.27! Silberschatz, Galvin and Gagne 2005!
28 Combined Scheme: UNIX/Linux (4K bytes per block)! 11.28! Silberschatz, Galvin and Gagne 2005!
29 Free-Space Management! Bit vector (n blocks)" 0" 1" 2" n-1" " "#$" bit[i] =" 0 block[i] free" 1 block[i] occupied" Block number calculation" (number of bits per word) *" (number of 0-value words) +" offset of first 1 bit" 11.29! Silberschatz, Galvin and Gagne 2005!
30 Free-Space Management (Cont.)! Bit map requires extra space" Example:" " "block size = 2 12 bytes" " "disk size = 2 30 bytes (1 gigabyte)" " "n = 2 30 /2 12 = 2 18 bits (or 32K bytes)" Easy to get contiguous files " Linked list (free list)" Cannot get contiguous space easily" No waste of space" Grouping " Counting" 11.30! Silberschatz, Galvin and Gagne 2005!
31 Free-Space Management (Cont.)! Need to protect:" Pointer to free list" Bit map"! Must be kept on disk"! Copy in memory and disk may differ"! Cannot allow for block[i] to have a situation where bit[i] = 1 in memory and bit[i] = 0 on disk" Solution:"! Set bit[i] = 1 in disk"! Allocate block[i]"! Set bit[i] = 1 in memory" 11.31! Silberschatz, Galvin and Gagne 2005!
32 Directory Implementation! Linear list of file names with pointer to the data blocks" simple to program" time-consuming to execute" Hash Table linear list with hash data structure" decreases directory search time" collisions situations where two file names hash to the same location" fixed size" 11.32! Silberschatz, Galvin and Gagne 2005!
33 Linked Free Space List on Disk! 11.33! Silberschatz, Galvin and Gagne 2005!
34 Efficiency and Performance! Efficiency dependent on:" disk allocation and directory algorithms" types of data kept in file s directory entry " Performance" disk cache separate section of main memory for frequently used blocks" free-behind and read-ahead techniques to optimize sequential access" improve PC performance by dedicating section of memory as virtual disk, or RAM disk" 11.34! Silberschatz, Galvin and Gagne 2005!
35 Page Cache! A page cache caches pages rather than disk blocks using virtual memory techniques" Memory-mapped I/O uses a page cache" Routine I/O through the file system uses the buffer (disk) cache" This leads to the following figure" 11.35! Silberschatz, Galvin and Gagne 2005!
36 I/O Without a Unified Buffer Cache! 11.36! Silberschatz, Galvin and Gagne 2005!
37 Unified Buffer Cache! A unified buffer cache uses the same page cache to cache both memory-mapped pages and ordinary file system I/O" 11.37! Silberschatz, Galvin and Gagne 2005!
38 I/O Using a Unified Buffer Cache! 11.38! Silberschatz, Galvin and Gagne 2005!
39 Recovery! Consistency checking compares data in directory structure with data blocks on disk, and tries to fix inconsistencies " Use system programs to back up data from disk to another storage device (floppy disk, magnetic tape, other magnetic disk, optical) " Network storage & Disaster Recovery site" " Recover lost file or disk by restoring data from backup" 11.39! Silberschatz, Galvin and Gagne 2005!
40 Log Structured File Systems! Log structured (or journaling) file systems record each update to the file system as a transaction" All transactions are written to a log" A transaction is considered committed once it is written to the log" However, the file system may not yet be updated" The transactions in the log are asynchronously written to the file system" When the file system is modified, the transaction is removed from the log" If the file system crashes, all remaining transactions in the log must still be performed" 11.40! Silberschatz, Galvin and Gagne 2005!
41 Stop here Apr 25! 11.41! Silberschatz, Galvin and Gagne 2005!
42 The Sun Network File System (NFS)! An implementation and a specification of a software system for accessing remote files across LANs (or WANs) " The implementation is part of the Solaris and SunOS operating systems running on Sun workstations using an unreliable datagram protocol (UDP/IP protocol and Ethernet" 11.42! Silberschatz, Galvin and Gagne 2005!
43 NFS (Cont.)! Interconnected workstations viewed as a set of independent machines with independent file systems, which allows sharing among these file systems in a transparent manner" A remote directory is mounted over a local file system directory"! The mounted directory looks like an integral subtree of the local file system, replacing the subtree descending from the local directory" Specification of the remote directory for the mount operation is nontransparent; the host name of the remote directory has to be provided"! Files in the remote directory can then be accessed in a transparent manner" Subject to access-rights accreditation, potentially any file system (or directory within a file system), can be mounted remotely on top of any local directory" 11.43! Silberschatz, Galvin and Gagne 2005!
44 NFS (Cont.)! NFS is designed to operate in a heterogeneous environment of different machines, operating systems, and network architectures; the NFS specifications independent of these media" " This independence is achieved through the use of RPC primitives built on top of an External Data Representation (XDR) protocol used between two implementation-independent interfaces " The NFS specification distinguishes between the services provided by a mount mechanism and the actual remote-file-access services " 11.44! Silberschatz, Galvin and Gagne 2005!
45 Three Independent File Systems! 11.45! Silberschatz, Galvin and Gagne 2005!
46 Mounting in NFS! Mounts" Cascading mounts" 11.46! Silberschatz, Galvin and Gagne 2005!
47 NFS Mount Protocol! Establishes initial logical connection between server and client" Mount operation includes name of remote directory to be mounted and name of server machine storing it" Mount request is mapped to corresponding RPC and forwarded to mount server running on server machine " Export list specifies local file systems that server exports for mounting, along with names of machines that are permitted to mount them " Following a mount request that conforms to its export list, the server returns a file handle a key for further accesses" File handle a file-system identifier, and an inode number to identify the mounted directory within the exported file system" The mount operation changes only the user s view and does not affect the server side " 11.47! Silberschatz, Galvin and Gagne 2005!
48 NFS Protocol! Provides a set of remote procedure calls for remote file operations. The procedures support the following operations:" searching for a file within a directory " reading a set of directory entries " manipulating links and directories " accessing file attributes" reading and writing files" NFS servers are stateless; each request has to provide a full set of arguments "(NFS V4 is just coming available very different, stateful)" Modified data must be committed to the server s disk before results are returned to the client (lose advantages of caching)" The NFS protocol does not provide concurrency-control mechanisms" 11.48! Silberschatz, Galvin and Gagne 2005!
49 Three Major Layers of NFS Architecture! UNIX file-system interface (based on the open, read, write, and close calls, and file descriptors) " Virtual File System (VFS) layer distinguishes local files from remote ones, and local files are further distinguished according to their file-system types" The VFS activates file-system-specific operations to handle local requests according to their file-system types " Calls the NFS protocol procedures for remote requests " NFS service layer bottom layer of the architecture" Implements the NFS protocol" 11.49! Silberschatz, Galvin and Gagne 2005!
50 Schematic View of NFS Architecture! 11.50! Silberschatz, Galvin and Gagne 2005!
51 NFS Path-Name Translation! Performed by breaking the path into component names and performing a separate NFS lookup call for every pair of component name and directory vnode " To make lookup faster, a directory name lookup cache on the client s side holds the vnodes for remote directory names" 11.51! Silberschatz, Galvin and Gagne 2005!
52 NFS Remote Operations! Nearly one-to-one correspondence between regular UNIX system calls and the NFS protocol RPCs (except opening and closing files)" NFS adheres to the remote-service paradigm, but employs buffering and caching techniques for the sake of performance " File-blocks cache when a file is opened, the kernel checks with the remote server whether to fetch or revalidate the cached attributes" Cached file blocks are used only if the corresponding cached attributes are up to date" File-attribute cache the attribute cache is updated whenever new attributes arrive from the server" Clients do not free delayed-write blocks until the server confirms that the data have been written to disk" 11.52! Silberschatz, Galvin and Gagne 2005!
53 Example: WAFL File System! Used on Network Appliance Filers distributed file system appliances" Write-anywhere file layout " Serves up NFS, CIFS, http, ftp" Random I/O optimized, write optimized" NVRAM for write caching" Similar to Berkeley Fast File System, with extensive modifications" 11.53! Silberschatz, Galvin and Gagne 2005!
54 The WAFL File Layout! 11.54! Silberschatz, Galvin and Gagne 2005!
55 Snapshots in WAFL! 11.55! Silberschatz, Galvin and Gagne 2005!
56 11.02! 11.56! Silberschatz, Galvin and Gagne 2005!
57 The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again. End of Chapter 11!
Chapter 11: File System Implementation. Operating System Concepts with Java 8 th Edition
Chapter 11: File System Implementation 11.1 Silberschatz, Galvin and Gagne 2009 Chapter 11: File System Implementation File-System Structure File-System Implementation Directory Implementation Allocation
Chapter 11: File System Implementation. Chapter 11: File System Implementation. Objectives. File-System Structure
Chapter 11: File System Implementation Chapter 11: File System Implementation File-System Structure File-System Implementation Directory Implementation Allocation Methods Free-Space Management Efficiency
Chapter 11: File System Implementation. Operating System Concepts 8 th Edition
Chapter 11: File System Implementation Operating System Concepts 8 th Edition Silberschatz, Galvin and Gagne 2009 Chapter 11: File System Implementation File-System Structure File-System Implementation
Two Parts. Filesystem Interface. Filesystem design. Interface the user sees. Implementing the interface
File Management Two Parts Filesystem Interface Interface the user sees Organization of the files as seen by the user Operations defined on files Properties that can be read/modified Filesystem design Implementing
File System Management
Lecture 7: Storage Management File System Management Contents Non volatile memory Tape, HDD, SSD Files & File System Interface Directories & their Organization File System Implementation Disk Space Allocation
File-System Implementation
File-System Implementation 11 CHAPTER In this chapter we discuss various methods for storing information on secondary storage. The basic issues are device directory, free space management, and space allocation
We mean.network File System
We mean.network File System Introduction: Remote File-systems When networking became widely available users wanting to share files had to log in across the net to a central machine This central machine
OPERATING SYSTEMS FILE SYSTEMS
OPERATING SYSTEMS FILE SYSTEMS Jerry Breecher 10: File Systems 1 FILE SYSTEMS This material covers Silberschatz Chapters 10 and 11. File System Interface The user level (more visible) portion of the file
CHAPTER 17: File Management
CHAPTER 17: File Management The Architecture of Computer Hardware, Systems Software & Networking: An Information Technology Approach 4th Edition, Irv Englander John Wiley and Sons 2010 PowerPoint slides
Network File System (NFS) Pradipta De pradipta.de@sunykorea.ac.kr
Network File System (NFS) Pradipta De pradipta.de@sunykorea.ac.kr Today s Topic Network File System Type of Distributed file system NFS protocol NFS cache consistency issue CSE506: Ext Filesystem 2 NFS
Operating Systems CSE 410, Spring 2004. File Management. Stephen Wagner Michigan State University
Operating Systems CSE 410, Spring 2004 File Management Stephen Wagner Michigan State University File Management File management system has traditionally been considered part of the operating system. Applications
Network Attached Storage. Jinfeng Yang Oct/19/2015
Network Attached Storage Jinfeng Yang Oct/19/2015 Outline Part A 1. What is the Network Attached Storage (NAS)? 2. What are the applications of NAS? 3. The benefits of NAS. 4. NAS s performance (Reliability
CHAPTER 16: DISTRIBUTED-SYSTEM STRUCTURES. Network-Operating Systems. Distributed-Operating Systems. Remote Services. Robustness.
CHAPTER 16: DISTRIBUTED-SYSTEM STRUCTURES Network-Operating Systems Distributed-Operating Systems Remote Services Robustness Design Issues Operating System Concepts, Addison-Wesley 1994 Silberschatz &
Chapter 13 File and Database Systems
Chapter 13 File and Database Systems Outline 13.1 Introduction 13.2 Data Hierarchy 13.3 Files 13.4 File Systems 13.4.1 Directories 13.4. Metadata 13.4. Mounting 13.5 File Organization 13.6 File Allocation
Chapter 13 File and Database Systems
Chapter 13 File and Database Systems Outline 13.1 Introduction 13.2 Data Hierarchy 13.3 Files 13.4 File Systems 13.4.1 Directories 13.4. Metadata 13.4. Mounting 13.5 File Organization 13.6 File Allocation
COS 318: Operating Systems. File Layout and Directories. Topics. File System Components. Steps to Open A File
Topics COS 318: Operating Systems File Layout and Directories File system structure Disk allocation and i-nodes Directory and link implementations Physical layout for performance 2 File System Components
Chapter 12 File Management
Operating Systems: Internals and Design Principles, 6/E William Stallings Chapter 12 File Management Dave Bremer Otago Polytechnic, N.Z. 2008, Prentice Hall Roadmap Overview File organisation and Access
Chapter 12 File Management. Roadmap
Operating Systems: Internals and Design Principles, 6/E William Stallings Chapter 12 File Management Dave Bremer Otago Polytechnic, N.Z. 2008, Prentice Hall Overview Roadmap File organisation and Access
ECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective
ECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective Part II: Data Center Software Architecture: Topic 1: Distributed File Systems Finding a needle in Haystack: Facebook
File Management Chapters 10, 11, 12
File Management Chapters 10, 11, 12 Requirements For long-term storage: possible to store large amount of info. info must survive termination of processes multiple processes must be able to access concurrently
Part III Storage Management. Chapter 11: File System Implementation
Part III Storage Management Chapter 11: File System Implementation 1 Layered File System 2 Overview: 1/4 A file system has on-disk and in-memory information. A disk may contain the following for implementing
09'Linux Plumbers Conference
09'Linux Plumbers Conference Data de duplication Mingming Cao IBM Linux Technology Center cmm@us.ibm.com 2009 09 25 Current storage challenges Our world is facing data explosion. Data is growing in a amazing
File Management. Chapter 12
Chapter 12 File Management File is the basic element of most of the applications, since the input to an application, as well as its output, is usually a file. They also typically outlive the execution
Operating system Dr. Shroouq J.
3 OPERATING SYSTEM STRUCTURES An operating system provides the environment within which programs are executed. The design of a new operating system is a major task. The goals of the system must be well
Chapter 10 Case Study 1: LINUX
MODERN OPERATING SYSTEMS Third Edition ANDREW S. TANENBAUM Chapter 10 Case Study 1: LINUX History of UNIX and Linux UNICS PDP-11 UNIX Portable UNIX Berkeley UNIX Standard UNIX MINIX Linux UNIX/Linux Goals
Chapter 11 Distributed File Systems. Distributed File Systems
Chapter 11 Distributed File Systems Introduction Case studies NFS Coda 1 Distributed File Systems A distributed file system enables clients to access files stored on one or more remote file servers A file
Chapter 6, The Operating System Machine Level
Chapter 6, The Operating System Machine Level 6.1 Virtual Memory 6.2 Virtual I/O Instructions 6.3 Virtual Instructions For Parallel Processing 6.4 Example Operating Systems 6.5 Summary Virtual Memory General
Computer Science 4302 Operating Systems. Student Learning Outcomes
Computer Science 4302 Operating Systems Student Learning Outcomes 1. The student will learn what operating systems are, what they do, and how they are designed and constructed. The student will be introduced
Chapter 3: Operating-System Structures. System Components Operating System Services System Calls System Programs System Structure Virtual Machines
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines Operating System Concepts 3.1 Common System Components
Chapter 3 Operating-System Structures
Contents 1. Introduction 2. Computer-System Structures 3. Operating-System Structures 4. Processes 5. Threads 6. CPU Scheduling 7. Process Synchronization 8. Deadlocks 9. Memory Management 10. Virtual
Chapter 12 File Management
Operating Systems: Internals and Design Principles Chapter 12 File Management Eighth Edition By William Stallings Files Data collections created by users The File System is one of the most important parts
The Linux Virtual Filesystem
Lecture Overview Linux filesystem Linux virtual filesystem (VFS) overview Common file model Superblock, inode, file, dentry Object-oriented Ext2 filesystem Disk data structures Superblock, block group,
Storage and File Structure
Storage and File Structure Chapter 10: Storage and File Structure Overview of Physical Storage Media Magnetic Disks RAID Tertiary Storage Storage Access File Organization Organization of Records in Files
6. Storage and File Structures
ECS-165A WQ 11 110 6. Storage and File Structures Goals Understand the basic concepts underlying different storage media, buffer management, files structures, and organization of records in files. Contents
Lesson Objectives. To provide a grand tour of the major operating systems components To provide coverage of basic computer system organization
Lesson Objectives To provide a grand tour of the major operating systems components To provide coverage of basic computer system organization AE3B33OSD Lesson 1 / Page 2 What is an Operating System? A
Chapter 14: Recovery System
Chapter 14: Recovery System Chapter 14: Recovery System Failure Classification Storage Structure Recovery and Atomicity Log-Based Recovery Remote Backup Systems Failure Classification Transaction failure
A Deduplication File System & Course Review
A Deduplication File System & Course Review Kai Li 12/13/12 Topics A Deduplication File System Review 12/13/12 2 Traditional Data Center Storage Hierarchy Clients Network Server SAN Storage Remote mirror
FAT32 vs. NTFS Jason Capriotti CS384, Section 1 Winter 1999-2000 Dr. Barnicki January 28, 2000
FAT32 vs. NTFS Jason Capriotti CS384, Section 1 Winter 1999-2000 Dr. Barnicki January 28, 2000 Table of Contents List of Figures... iv Introduction...1 The Physical Disk...1 File System Basics...3 File
Windows OS File Systems
Windows OS File Systems MS-DOS and Windows 95/98/NT/2000/XP allow use of FAT-16 or FAT-32. Windows NT/2000/XP uses NTFS (NT File System) File Allocation Table (FAT) Not used so much, but look at as a contrast
Storage and File Systems. Chester Rebeiro IIT Madras
Storage and File Systems Chester Rebeiro IIT Madras 1 Two views of a file system system calls protection rwx attributes Application View Look & Feel File system Hardware view 2 Magnetic Disks Chester Rebeiro
COS 318: Operating Systems
COS 318: Operating Systems File Performance and Reliability Andy Bavier Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall10/cos318/ Topics File buffer cache
Operating System Components
Lecture Overview Operating system software introduction OS components OS services OS structure Operating Systems - April 24, 2001 Operating System Components Process management Memory management Secondary
Distributed File Systems. Chapter 10
Distributed File Systems Chapter 10 Distributed File System a) A distributed file system is a file system that resides on different machines, but offers an integrated view of data stored on remote disks.
Memory Management Outline. Background Swapping Contiguous Memory Allocation Paging Segmentation Segmented Paging
Memory Management Outline Background Swapping Contiguous Memory Allocation Paging Segmentation Segmented Paging 1 Background Memory is a large array of bytes memory and registers are only storage CPU can
Topics in Computer System Performance and Reliability: Storage Systems!
CSC 2233: Topics in Computer System Performance and Reliability: Storage Systems! Note: some of the slides in today s lecture are borrowed from a course taught by Greg Ganger and Garth Gibson at Carnegie
Physical Data Organization
Physical Data Organization Database design using logical model of the database - appropriate level for users to focus on - user independence from implementation details Performance - other major factor
File Systems Management and Examples
File Systems Management and Examples Today! Efficiency, performance, recovery! Examples Next! Distributed systems Disk space management! Once decided to store a file as sequence of blocks What s the size
CS 377: Operating Systems. Outline. A review of what you ve learned, and how it applies to a real operating system. Lecture 25 - Linux Case Study
CS 377: Operating Systems Lecture 25 - Linux Case Study Guest Lecturer: Tim Wood Outline Linux History Design Principles System Overview Process Scheduling Memory Management File Systems A review of what
Lecture 18: Reliable Storage
CS 422/522 Design & Implementation of Operating Systems Lecture 18: Reliable Storage Zhong Shao Dept. of Computer Science Yale University Acknowledgement: some slides are taken from previous versions of
IBM Tivoli Storage Manager Version 7.1.4. Introduction to Data Protection Solutions IBM
IBM Tivoli Storage Manager Version 7.1.4 Introduction to Data Protection Solutions IBM IBM Tivoli Storage Manager Version 7.1.4 Introduction to Data Protection Solutions IBM Note: Before you use this
File Management. Chapter 12
File Management Chapter 12 File Management File management system is considered part of the operating system Input to applications is by means of a file Output is saved in a file for long-term storage
Chapter 16: Recovery System
Chapter 16: Recovery System Failure Classification Failure Classification Transaction failure : Logical errors: transaction cannot complete due to some internal error condition System errors: the database
Filing Systems. Filing Systems
Filing Systems At the outset we identified long-term storage as desirable characteristic of an OS. EG: On-line storage for an MIS. Convenience of not having to re-write programs. Sharing of data in an
Disk Space Management Methods
Volume 1, Issue 1, June 2013 International Journal of Advance Research in Computer Science and Management Studies Research Paper Available online at: www.ijarcsms.com Disk Space Management Methods Ramakrishna
Outline: Operating Systems
Outline: Operating Systems What is an OS OS Functions Multitasking Virtual Memory File Systems Window systems PC Operating System Wars: Windows vs. Linux 1 Operating System provides a way to boot (start)
COSC 6374 Parallel Computation. Parallel I/O (I) I/O basics. Concept of a clusters
COSC 6374 Parallel I/O (I) I/O basics Fall 2012 Concept of a clusters Processor 1 local disks Compute node message passing network administrative network Memory Processor 2 Network card 1 Network card
Symantec NetBackup OpenStorage Solutions Guide for Disk
Symantec NetBackup OpenStorage Solutions Guide for Disk UNIX, Windows, Linux Release 7.6 Symantec NetBackup OpenStorage Solutions Guide for Disk The software described in this book is furnished under a
COSC 6374 Parallel Computation. Parallel I/O (I) I/O basics. Concept of a clusters
COSC 6374 Parallel Computation Parallel I/O (I) I/O basics Spring 2008 Concept of a clusters Processor 1 local disks Compute node message passing network administrative network Memory Processor 2 Network
Understanding Disk Storage in Tivoli Storage Manager
Understanding Disk Storage in Tivoli Storage Manager Dave Cannon Tivoli Storage Manager Architect Oxford University TSM Symposium September 2005 Disclaimer Unless otherwise noted, functions and behavior
Record Storage and Primary File Organization
Record Storage and Primary File Organization 1 C H A P T E R 4 Contents Introduction Secondary Storage Devices Buffering of Blocks Placing File Records on Disk Operations on Files Files of Unordered Records
Chapter 13 Disk Storage, Basic File Structures, and Hashing.
Chapter 13 Disk Storage, Basic File Structures, and Hashing. Copyright 2004 Pearson Education, Inc. Chapter Outline Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files
Original-page small file oriented EXT3 file storage system
Original-page small file oriented EXT3 file storage system Zhang Weizhe, Hui He, Zhang Qizhen School of Computer Science and Technology, Harbin Institute of Technology, Harbin E-mail: wzzhang@hit.edu.cn
Devices and Device Controllers
I/O 1 Devices and Device Controllers network interface graphics adapter secondary storage (disks, tape) and storage controllers serial (e.g., mouse, keyboard) sound co-processors... I/O 2 Bus Architecture
Chapter 11 I/O Management and Disk Scheduling
Operating Systems: Internals and Design Principles, 6/E William Stallings Chapter 11 I/O Management and Disk Scheduling Dave Bremer Otago Polytechnic, NZ 2008, Prentice Hall I/O Devices Roadmap Organization
1 Organization of Operating Systems
COMP 730 (242) Class Notes Section 10: Organization of Operating Systems 1 Organization of Operating Systems We have studied in detail the organization of Xinu. Naturally, this organization is far from
Trends in Enterprise Backup Deduplication
Trends in Enterprise Backup Deduplication Shankar Balasubramanian Architect, EMC 1 Outline Protection Storage Deduplication Basics CPU-centric Deduplication: SISL (Stream-Informed Segment Layout) Data
1 File Management. 1.1 Naming. COMP 242 Class Notes Section 6: File Management
COMP 242 Class Notes Section 6: File Management 1 File Management We shall now examine how an operating system provides file management. We shall define a file to be a collection of permanent data with
NFS File Sharing. Peter Lo. CP582 Peter Lo 2003 1
NFS File Sharing Peter Lo CP582 Peter Lo 2003 1 NFS File Sharing Summary Distinguish between: File transfer Entire file is copied to new location FTP Copy command File sharing Multiple users can access
Operating Systems. Design and Implementation. Andrew S. Tanenbaum Melanie Rieback Arno Bakker. Vrije Universiteit Amsterdam
Operating Systems Design and Implementation Andrew S. Tanenbaum Melanie Rieback Arno Bakker Vrije Universiteit Amsterdam Operating Systems - Winter 2012 Outline Introduction What is an OS? Concepts Processes
Outline. Operating Systems Design and Implementation. Chap 1 - Overview. What is an OS? 28/10/2014. Introduction
Operating Systems Design and Implementation Andrew S. Tanenbaum Melanie Rieback Arno Bakker Outline Introduction What is an OS? Concepts Processes and Threads Memory Management File Systems Vrije Universiteit
Chapter 13. Disk Storage, Basic File Structures, and Hashing
Chapter 13 Disk Storage, Basic File Structures, and Hashing Chapter Outline Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files Hashed Files Dynamic and Extendible Hashing
THE BCS PROFESSIONAL EXAMINATIONS BCS Level 6 Professional Graduate Diploma in IT. April 2009 EXAMINERS' REPORT. Network Information Systems
THE BCS PROFESSIONAL EXAMINATIONS BCS Level 6 Professional Graduate Diploma in IT April 2009 EXAMINERS' REPORT Network Information Systems General Comments Last year examiners report a good pass rate with
Objectives of Lecture. Network Architecture. Protocols. Contents
Objectives of Lecture Network Architecture Show how network architecture can be understood using a layered approach. Introduce the OSI seven layer reference model. Introduce the concepts of internetworking
Client/Server Computing Distributed Processing, Client/Server, and Clusters
Client/Server Computing Distributed Processing, Client/Server, and Clusters Chapter 13 Client machines are generally single-user PCs or workstations that provide a highly userfriendly interface to the
CS 3530 Operating Systems. L02 OS Intro Part 1 Dr. Ken Hoganson
CS 3530 Operating Systems L02 OS Intro Part 1 Dr. Ken Hoganson Chapter 1 Basic Concepts of Operating Systems Computer Systems A computer system consists of two basic types of components: Hardware components,
Disaster Recovery Checklist Disaster Recovery Plan for <System One>
Disaster Recovery Plan for SYSTEM OVERVIEW PRODUCTION SERVER HOT SITE SERVER APPLICATIONS (Use bold for Hot Site) ASSOCIATED SERVERS KEY CONTACTS Hardware Vendor System Owners Database Owner
Last Class: OS and Computer Architecture. Last Class: OS and Computer Architecture
Last Class: OS and Computer Architecture System bus Network card CPU, memory, I/O devices, network card, system bus Lecture 3, page 1 Last Class: OS and Computer Architecture OS Service Protection Interrupts
Copyright 2007 Ramez Elmasri and Shamkant B. Navathe. Slide 13-1
Slide 13-1 Chapter 13 Disk Storage, Basic File Structures, and Hashing Chapter Outline Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files Hashed Files Dynamic and Extendible
June 2009. Blade.org 2009 ALL RIGHTS RESERVED
Contributions for this vendor neutral technology paper have been provided by Blade.org members including NetApp, BLADE Network Technologies, and Double-Take Software. June 2009 Blade.org 2009 ALL RIGHTS
Availability Digest. www.availabilitydigest.com. Data Deduplication February 2011
the Availability Digest Data Deduplication February 2011 What is Data Deduplication? Data deduplication is a technology that can reduce disk storage-capacity requirements and replication bandwidth requirements
Review from last time. CS 537 Lecture 3 OS Structure. OS structure. What you should learn from this lecture
Review from last time CS 537 Lecture 3 OS Structure What HW structures are used by the OS? What is a system call? Michael Swift Remzi Arpaci-Dussea, Michael Swift 1 Remzi Arpaci-Dussea, Michael Swift 2
Chapter 17: Distributed Systems
Chapter 17: Distributed Systems Chapter 17: Distributed Systems Advantages of Distributed Systems Types of Network-Based Operating Systems Network Structure Communication Structure Communication Protocols
Chapter 12: Secondary-Storage Structure
Chapter 12: Secondary-Storage Structure Chapter 12: Secondary-Storage Structure Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space Management RAID
One Solution for Real-Time Data protection, Disaster Recovery & Migration
One Solution for Real-Time Data protection, Disaster Recovery & Migration Built-in standby virtualisation server Backs up every 15 minutes up to 12 servers On and Off-site Backup User initialed file, folder
CS 416: Opera-ng Systems Design
Question 1 Explain the major difference between a file system that supports journaling (e.g., Linux ext4) versus a log-structured file system (e.g., YAFFS2). Operating Systems 2015 Exam 3 Review Paul Krzyzanowski
Distributed File Systems
Distributed File Systems 1 Topics Introduction File Service Architecture DFS: Case Studies Case Study: Sun NFS Case Study: Hadoop HDFS 2 Introduction File system were originally developed for centralized
Linux Kernel Architecture
Linux Kernel Architecture Amir Hossein Payberah payberah@yahoo.com Contents What is Kernel? Kernel Architecture Overview User Space Kernel Space Kernel Functional Overview File System Process Management
File System & Device Drive. Overview of Mass Storage Structure. Moving head Disk Mechanism. HDD Pictures 11/13/2014. CS341: Operating System
CS341: Operating System Lect 36: 1 st Nov 2014 Dr. A. Sahu Dept of Comp. Sc. & Engg. Indian Institute of Technology Guwahati File System & Device Drive Mass Storage Disk Structure Disk Arm Scheduling RAID
<Insert Picture Here> Managing Storage in Private Clouds with Oracle Cloud File System OOW 2011 presentation
Managing Storage in Private Clouds with Oracle Cloud File System OOW 2011 presentation What We ll Cover Today Managing data growth Private Cloud definitions Oracle Cloud Storage architecture
Operating System Structures
Operating System Structures Meelis ROOS mroos@ut.ee Institute of Computer Science Tartu University fall 2009 Literature A. S. Tanenbaum. Modern Operating Systems. 2nd ed. Prentice Hall. 2001. G. Nutt.
Distributed Systems. REK s adaptation of Prof. Claypool s adaptation of Tanenbaum s Distributed Systems Chapter 1
Distributed Systems REK s adaptation of Prof. Claypool s adaptation of Tanenbaum s Distributed Systems Chapter 1 1 The Rise of Distributed Systems! Computer hardware prices are falling and power increasing.!
Chapter 3: Operating-System Structures. Common System Components
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System Design and Implementation System Generation 3.1
Amoeba Distributed Operating System
Amoeba Distributed Operating System Matt Ramsay Tim Kiegel Heath Memmer CS470 Case Study Paper 4/19/02 Amoeba Introduction The Amoeba operating system began as a research project at Vrije Universiteit
Network Programming TDC 561
Network Programming TDC 561 Lecture # 1 Dr. Ehab S. Al-Shaer School of Computer Science & Telecommunication DePaul University Chicago, IL 1 Network Programming Goals of this Course: Studying, evaluating
CROSS PLATFORM AUTOMATIC FILE REPLICATION AND SERVER TO SERVER FILE SYNCHRONIZATION
1 E N D U R A D A T A EDpCloud: A File Synchronization, Data Replication and Wide Area Data Distribution Solution CROSS PLATFORM AUTOMATIC FILE REPLICATION AND SERVER TO SERVER FILE SYNCHRONIZATION 2 Resilient
How to Choose your Red Hat Enterprise Linux Filesystem
How to Choose your Red Hat Enterprise Linux Filesystem EXECUTIVE SUMMARY Choosing the Red Hat Enterprise Linux filesystem that is appropriate for your application is often a non-trivial decision due to
1. Introduction to the UNIX File System: logical vision
Unix File System 1. Introduction to the UNIX File System: logical vision Silberschatz, Galvin and Gagne 2005 Operating System Concepts 7 th Edition, Feb 6, 2005 Logical structure in each FS (System V):
OPERATING SYSTEMS STRUCTURES
S Jerry Breecher 2: OS Structures 1 Structures What Is In This Chapter? System Components System Calls How Components Fit Together Virtual Machine 2: OS Structures 2 SYSTEM COMPONENTS These are the pieces