Data Storage Technologies

Transcription

1 STUDY GUIDE Data Storage Technologies Ramūnas MARKAUSKAS Vilnius University 2012

2 Data Storage Technologies Study Guide Cycle: 1 st level Study program: Information Technologies Course unit code: ITDST Awarding institution: Department of Computer Science II, Faculty of Mathematics and Informatics Preparation of the study guide was supported by the project Increasing Internationality in Study Programs of the Department of Computer Science II, project number VP1 2.2 ŠMM-07-K , funded by The European Social Fund Agency and the Government of Lithuania. Studijų vadovo medžiagos rengimą rėmė projektas Kompiuterijos katedros studijų programų tarptautiškumo didinimas, projekto kodas VP1 2.2 ŠMM-07-K , finansuojamas iš Europos socialinio fondo ir Lietuvos valstybės biudžeto lėšų. Ramūnas Markauskas, 2012 Vilnius University, 2012

3 Contents Abstract... 4 Assessment strategy... 4 Content of the course... 4 Literature... 6 Exam test... 6 Project cases... 7 Problem solving... 9 Laboratory work Installation and Configuration of Virtual Data Storage (VDS)... 9

4 Abstract This course is intended for students who wish / need to understand the different type of storage technologies, their architectures and the technological trends. While the information provided in this course is essential for IT system administrators and key knowledge for data storage administrators, but it can also be used in one s everyday life dealing with personal storage. The course is delivered by the means of inclusive lectures, task solving in class and individually, individual analysis of literature, presentation, project work, case analysis, data interpretation and consulting. Assessment strategy Assessment of the course consists of: 1. Exam test for maximum of 4 points (5 open questions, 0.4 points each and 10 multiplechoice questions, 0.2 points each), assessment criteria are based on the correctness of the answer. Deadline: during exam session; 2. Project presentation / defence for maximum of 3 points. Project is done in a groups of two students, assessment criteria are based on logical reasoning, technical requirements conformity (up to 80%); level of presentation and oratory (up to 10%); style of presentation (up to 10%). Deadline: till 14 th lecture; 3. Class / homework presentation /defence for maximum of 3 points (5 problems, 0.6 points each), assessment criteria are based on one s ability to explain logics of the solution (up to 40%) and connection between variables and parameters of technical equipment (up to 40%); right arithmetic operations (up to 20%). Deadline: till 9 th lecture; 4. Additionally, to earn extra 3 points, one can present / defend a laboratory work Installation and Configuration of Virtual Data Storage. Assessment criteria are based on the fact of installation of virtual data storage (explanation up to 10%), configuration of Back-End components (fact up to 15%, explanation up to 15%), configuration of Front-End components and access (fact up to 20%, explanation up to 20%), demonstration of access (up to 20%). Deadline: till the end of the course. Content of the course 1. Introduction to Storage technologies [1: chapter 1] a. Information Storage b. Evolution of storage technology and architecture c. Key challenges d. Information Lifecycle 2. Storage system environment [1: chapter 2] a. Components of storage system b. Disk drive components c. Disk drive performance d. Fundamental laws for drive performance e. Logic components of the host 3. Data protection (RAID) [1: chapter 3] a. Implementation of RAID b. RAID array components c. RAID levels Page 4 of 9

5 d. RAID comparison e. RAID impact on disk performance 4. Intelligent storage systems [1: chapter 4] a. Components b. Intelligent storage array 5. DAS and SCSI [1: chapter 5] a. Types of DAS b. DAS benefits and limits c. Disk drives interfaces d. Introduction to parallel SCSI e. SCSI command model 6. NAS [1: chapter 7] a. General purpose servers versus NAS devices b. Benefits of NAS c. NAS File I/O d. Components of NAS e. NAS implementations f. NAS file sharing protocols (NFS, CIFS) g. NAS I/O operations h. NAS performance and availability 7. SAN [1: chapter 6] a. Overview of Fiber Channel b. SAN and its evolution c. Components of SAN d. FC connectivity e. FC ports f. FC architecture g. Zoning h. FC login types i. FC topologies 8. IP SAN [1: chapter 8] a. Components of iscsi b. iscsi host connectivity c. iscsi protocol stack d. iscsi names and sessions e. iscsi error handling and security f. FCIP 9. CAS [1: chapter 9] a. Fixed content and archives b. Types of archives c. Benefits of CAS d. CAS architecture e. Object storage and retrieval in CAS f. CAS examples 10. Storage, server virtualization, real world examples [1: chapter 10] a. Forms of virtualization b. SNIA virtualization taxonomy c. Storage virtualization configurations d. Virtualization challenges Page 5 of 9

6 e. Types of storage virtualization 11. Business continuity, Backup and recovery [1: chapter 11, 12] a. Backup purpose b. Backup considerations c. Granularity d. Recovery considerations e. Backup methods and process f. Backup and restore operations g. Topologies h. Backup in NAS i. Backup technologies 12. Local and remote replication [1: chapter 13, 14] 13. Storage security and management [1: chapter 15, 16] a. Storage security framework b. Risk triad c. Storage security domains d. Security implementations e. Monitoring infrastructure f. Management activities g. Management challenges Literature Required [1] EMC education services, Information Storage and Management: Storing, Managing, and Protecting Digital Information. John Wiley & Sons, Optional EMC education services, Information Storage and Management: Storing, Managing, and Protecting Digital Information in Classic, Virtualized, and Cloud Environments, 2nd ed. John Wiley & Sons, G. Schulz, Cloud and Virtual Data Storage Networking. Taylor & Francis, M. Gupta, Storage Area Network Fundamentals. Cisco Press, Exam test Example of an open question How many milliseconds does it take for an HDD of RPM to do a full round? Please, give the full solution. (Answer may be found in lecture #2) Example of multiple choice question What is the minimal amount of controllers for a storage array of type AA (active - active)? (Answer may be found in lecture #4) [A] 1 [B] 2 [C] 3 [D] 4 Page 6 of 9

7 Project cases Each group of two students should choose one project case and inform the lecturer by about group members and their choice. The same case may be chosen not more than by two groups and the solutions between groups should be totally different. Detailed case interpretation will be done during laboratory work. Projects should be presented / defended in a presentational form. The presentation should consist of: 1. Introduction: presentation of current situation; 2. Architectural solution: presentation of proposed system s architecture, requirements for the environment; 3. Proposal: presentation of real world hardware with specification and prices to fulfill the requirements. Intensive use of schemas and graphics is desirable. 1 st case Select and present data storage equipment for MS Exchange 2010 environment with the following parameters / requirements: 1. boxes count: 4000; 2. Average size of a box: 2 GB; 3. Expected growth of boxes count: 1% per year; 4. Expected growth of boxes size: 50% per year; 5. Part of intensively used boxes: 30%; 6. RPO: 24 hours; 7. RTO: 1 hour; 8. Period: 3 years. 2 nd case Select and present data storage equipment for server of your choice with the following parameters / requirements: 1. boxes count: 500; 2. Average size of a box: 1 GB; 3. Expected growth of boxes count: 5% per year; 4. Expected growth of boxes size: 120% per year; 5. Part of intensively used boxes: 80%; 6. RPO: 5 min; 7. RTO: 0 min; 8. Period: 5 years. 3 rd case Select and present data storage equipment for an application with the following parameters / requirements: 1. IOPS: 450,000; 2. Block size: 4 KB; 3. Distribution of read / write operations: 80 / 20; 4. RPO: 0 hours; 5. RTO: 0 hour; 6. Records should be kept online at least for 3 years and may be destroyed after 10 years; 7. Period: 10 years. 4 th case Current equipment: one AA type SAN device with nine 15,000 RPM disks, connected over FCP and configured in RAID 5 mode (two RAID groups with four disks in each; one disk used as Hot Spare). Requirements: Page 7 of 9

8 1. IOPS: 250,000; 2. Block size: 4 MB; 3. Distribution of read / write operations: 40 / 60; 4. RPO: 0 hours; 5. RTO: 0 hour; 6. Records should be kept online at least for 3 years and may be destroyed after 10 years; 7. Period: 10 years. 5 th case Select and present data storage equipment for application with the following parameters / requirements: 1. IOPS: 50,000; 2. Block size: 16 KB; 3. Distribution of read / write operations: 90 / 10; 4. Database size: 20 TB; 5. Expected growth of database: 15% per year; 6. RPO: 0 hours; 7. RTO: 24 hour; 8. Records should be kept online at least for 5 years and may be destroyed after 25 years. 6 th case Current equipment: one AA type SAN device with 128 GB SSD connected over FCP and configured in RAID 5 mode (two RAID groups with six disks in each; one disk used as Hot Spare). Requirements: 1. IOPS: 100,000; 2. Block size: 1 MB; 3. Distribution of read / write operations: 90 / 10; 4. Database size: 600 GB; 5. Expected growth of database: 100% per year; 6. RPO: 0 hours; 7. RTO: 24 hour; 8. Data distribution by creation date: a. Recent year 80.0%; b. 1 to 3 years 15.0%; c. 3 to 10 years 5.0%; d. Over 10 years 0.0%. 9. Records should be kept online at least for 3 years and may be destroyed after 15 years. 7 th case Current equipment: one AA type SAN device with 256 GB SSD connected over FCP and configured in RAID 1 mode (six RAID groups with two disks in each; one disk used as Hot Spare). Requirements: 1. IOPS: 150,000; 2. Block size: 1 MB; 3. Distribution of read / write operations: 85 / 15; 4. Database size: 1 TB; 5. Expected growth of database: 120% per year; 6. RPO: 0 hours; 7. RTO: 24 hour; 8. Data distribution by creation date: a. Recent year 60.0%; b. 1 to 3 years 25.0%; Page 8 of 9

9 c. 3 to 10 years 10.0%; d. Over 10 years 5.0%. 9. Records should be kept online at least for 5 years and may be destroyed after 20 years. Problem solving Each problem should be solved in a written form and defended. 1 st problem Application operates with blocks of size 64 KB and has 1,000 intensive users, who generate 2 IOPS each, and also 2,000 regular users, who generate 1 IOPS each. Each intensive user uses up to 400 GB and regular up to 75 GB of storage space. Distribution of read / write operations is respectively 2/1. Management processes create additional 20% IOPS flow. Calculate IOPS requirements for RAID of type 1, 5 and 6. 2 nd problem The manufacturer gives the following parameters of hard disk drive: rotation speed 15,000 RPM; external data transfer rate 3 Gbps; internal data transfer rate 120 MBps; average seek time 3 ms, capacity 2TB Calculate the IOPS capability of this disk if 64 KB data blocks are used. 3 rd problem The manufacturer gives the following parameters of solid state drive: external data transfer rate 6 Gbps; internal data transfer rate 400 MBps; average seek time 0.1 ms, capacity 256 GB Calculate the IOPS capability of this disk if 4 KB data blocks are used. 4 th problem Calculate, how many disk from the 2 nd problem will be needed to fulfill the requirements for the application from the 1 st problem with all mentioned RAID types. 5 th problem Calculate, how many disk from the 3 rd problem will be needed to fulfill the requirements for the application from the 1 st problem with all mentioned RAID types. Laboratory work Installation and Configuration of Virtual Data Storage (VDS) Goal To get to know the technological principles of data storage, configuration abilities, protocols in use; To practically try the process of data storage installation / configuration by using VDS. Work flow 1. Get to know candidates for VDS installation (FreeNAS, NAS4Free, ); 2. Decide, which one you ll be working with; 3. Prepare virtual machine in an environment of your own which fulfill requirements for your chosen VDS; 4. Create additional 3 to 5 virtual disks of possible smallest size for information storage; 5. Install virtual machine and complete basic configuration tasks (user accounts, network configuration, ); 6. Create RAID array of selected level; 7. Configure VDS to be accessed over CIFS and iscsi; 8. Access VDS over CIFS and iscsi; 9. Imitate disaster by removing one disk from a RAID array and give comment on a situation. Page 9 of 9