Storage Networking Concepts -- Foundations - NEW Mastering Storage Networking for the Storage Professional

Transcription

1 Storage Networking Concepts -- Foundations - NEW 2016 Mastering Storage Networking for the Storage Professional Course materials in preparation for the new SNCF 110 SNIA Certification Exam and much much more! Accessing, Managing, Securing Your Distributed Stored Data Assets Including Cloud Storage, Flash and other Options SNC-F v Edition

2 This page is intentionally left BLANK.

3 NOTICE FMJO, LLC dba Infinity I/O All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means electronic, mechanical, photocopying, scanning or otherwise without written permission of Infinity I/O. This is Storage Networking- Concepts Foundations Version 7 Limit of Liability/Disclaimer of Warranty. Use of this book constitutes consent to the following conditions: This book is supplied AS IS for informational purposes only, without warranty of any kind, expressed or implied. Infinity I/O shall not be liable for any loss of profit or other commercial damages, including but not limited to special, indirect or other damages. Infinity I/O reserves the right to make changes to this book at any time, without notice, and assumes no responsibility for its use. IMPORTANT PLEASE READ Digital Rights Management. When you purchase this electronic study guide Infinity I/O will grant you a 2 system licence. This will enable you to access the emanual on a desktop PC and also a laptop remember the authentication works for the first time when you are online If you want to view the emanual offline as a download to your laptop, you would have had to have previously viewed it online with that laptop to authenticate the system.

4 Forward Storage Networking has been in use for over twenty years in enterprise data centers. Mastery of the field has become essential for large organizations and especially those applying Enterprise Architecture and Management for organizational expanded benefit. The Storage Networking Industry Association sponsors vendor neutral education through its Education Committee. These activities support industry recognized certification programs. This updated version (V7) incorporates new storage networking concepts since the last update. As well, it incorporates the new topics on the S SNIA Certification Exam. Specifically new topics on Cloud Based Storage, NVMe, and Distributed Management are now included. The purpose of this publication is to train Storage Professionals to be able to master the concepts and is prepared to provid professional services to their employer or client. It covers but is NOT just a checklist for passing the new S Certification Exam. Prerequisites: A copy of the 2015 SNIA Dictionary: A working knowledge of enterprise level computer systems. A BS in Information or Computer Science or equivalent experience is highly recommended or 12 months hands-on storage systems related experience. See Appendix B for a brief listing of expected experimental skills. With special thanks for development of the new course to Sam Samuel and Ronald Hendriks. The professional organizations, ANSI T11 and SNIA, have been very central to the development of this Storage Networking technology. Your comments and suggestions on this material are most welcome edf@infinityio.com. Edward M. Frymoyer Editor FMJO, LLC dba Infinity I/O January 2016

5 SNIA Certification Program

6 SNIA Certification Program The SNIA Vendor Neutral Certification process is explained on the SNIA website:

7 Storage Networking Concepts - Foundation Storage Networking Concepts Foundation

8 IStorage Networking Concepts - Foundation Storage Networking Concepts Foundation Introduction Objectives The objective of this programmed elearning Course is to provide the Storage Networking professional with a vendor neutral deep understanding and competency in Storage Networking. The course is intended to outfit the student with the expertise to provide value to their employer or client in their enterprise level storage systems. Storage Networking contains Systems Level topics including management, optimization of systems and disaster recovery including protocols, techniques, and components. This is much more than simply a teaching to the test document. Todays storage systems encompass every increasing oceans of data, often in a cloud that is physical somewhere. The goal is to train the professional in Accessing, Managing, and Securing your distributed stored data assets for the benefit of the organization or enterprise. The course is arranged in a logical manner to enhance total storage networking topic mastery. The course prepares the student to be able to pass new S SNIA foundations level exam plus gain a thorough understanding that will enable enhanced professional business level results for their enterprise employer or client. This course has been tested and improved continuously for over 15 years and many thousands of students. These objectives can occur in multiple sections of the course. For the convenience of the reader, the mapping of the exam objectives covered section by section are noted in the page(s) following the title page of each section. This is a vendor neutral descriptive and theory systems level course. Any operational systems level Storage Networking installation will involve a large set of vendor related equipment. For those with the requisite equipment, a list of suggested independently run hands-on exercises are covered in Appendix C, both self run and step by step exercises are included. I- 8

9 Contents The teaching methodology is to group the topics logically from a systems perspective section by section. The major items covered are listed each section, followed by a sub-section grouping. Pre-tests, Section Tests and Post Tests - As a result of these broader objectives, this elearning course provides tests section by section. If the reader wishes, they can use the section tests (separate document) as a pretest to provide some indication of areas on which they need to focus. A comprehensive set of questions is covered by the Post Tests of Appendix D. These questions also contain an extensive set of real life storage networking examples at the systems level. Index The Table of Contents is a brief Index. A more through index can be found using the Find Command -- CNTRL F on a PC or CMD F on a Mac. Any topic of Storage Networking covered in this document can be discovered this way. This employs the more useful thorough features of Adobe Reader in searching. Mapping to specific exam topics is shown in Appendix A. Glossary - Please see the reference document 2015 SNIA Dictionary referenced as a pre-requisite for a very thorough glossary of terms. This is especially pertinent in that the topic is Storage Networking. I- 9

10 Contents Storage Networking Concepts Foundation Table of Contents CONTENTS Page Introduction to Storage Networking. 1-1 o What is Storage Networking About? 1-2 o Evolution or Revolution? 1-6 o Business Needs o The New Data Center o Storage Consolidation 1-23 o Storage Networking Applications Storage Networking Architectures 2-1 o Direct-Attached Storage (DAS). 2-2 o Network-Attached Storage (NAS). 2-6 o Storage Area Network (SAN) 2-10 o Comparing Solutions o Storage Transport Protocols o Network Metrics 2-37 Storage Components o Disk Physical Characteristics. 3-2 o Tape Physical Characteristics 3-15 o Optical Media o Solid State Disks (SSDs) 3-41 Data Storage Techniques o De-duplication I- 10

11 Contents CONTENTS Page I/O Interfaces 5-1 o Overview o Parallel ATA. 5-5 o Serial ATA 5-10 o Parallel SCSI 5-12 o Serial Attached SCSI o Non-Volatile Memory Express (NVMe) o Interface Comparisons Host Architectures o Moving Data 6-2 o Bus Metrics. 6-9 o Fibre Channel HBA Feature Sets 6-16 o Converged Network Adapter o Fibre Channel HBA Multipathing o iscsi Host Implementations 6-30 o File Systems and File System Protocols 6-41 o Support Matrices 6-49 o Host Virtualization o Server Clustering RAID and Subsystem Architectures. 7-1 o Subsystem Architectures 7-2 o RAID Configurations 7-12 o Configuring Logical Units 7-30 o Assigning Hosts to Storage 7-34 NAS Concepts 8-1 o NAS Concepts 8-2 o NAS Architecture 8-9 o NAS Protocols 8-15 o NAS Backup Issues I- 11

12 Contents CONTENTS Page FC Components 9-1 o Fibre Channel Terminology. 9-2 o Infrastructure Devices FC Protocol and Ethernet Architecture o Fibre Channel Layered Model o ULP Mapping o Ethernet Primer o FCoE Fibre Channel over Ethernet Cables and Connectors o Media Types 11-2 o Connectors o Transceivers FC SAN Topologies 12-1 o Point-to-Point o Arbitrated Loop 12-5 o Switched Fabric Fabric Services 13-1 o Fabric Services 13-2 o Zoning o LUN Masking and Mapping I- 12

13 Contents CONTENTS Page FC SAN Extension over IP 14-1 o FCIP Concepts 14-2 o ifcp Concepts 14-6 o FCIP and ifcp Comparison o IP Transport Architectures FC SAN Extension over Optical o SONET/SDH Concepts o DWDM Concepts 15-5 o CWDM o WAN Design Metrics Storage Resource Management o Storage Resource Management o Information Lifecycle Management o Archiving and Compliance o Tiers of Storage o ILM Enabling Technologies o SRM Applications o Usage Management o Automating Storage Management o Content Addressed Storage iscsi Protocol Architecture o The iscsi Standard 17-2 o iscsi Applications o The iscsi Protocol I- 13

14 Contents CONTENTS Page Storage Virtualization 18-1 o Defining Storage Virtualization 18-2 o Storage Virtualization Architectures o Subsystem-Based Virtualization o Host-Based Virtualization o Network-Based Virtualization o SAN Virtualization Data Protection o Terminology 19-2 o Backup o Tape Virtualization o When is Tape Not Enough? o Snapshots o Split Mirrors o Remote Mirroring o Access Controls o Encrypting Data Distributed Storage o The Cloud o Object Based Storage o Software Defined Storage o Grid Storage o Cloud Storage Management Troubleshooting o LAN Troubleshooting Insights 21-2 o SAN Troubleshooting Insights I- 14

15 Contents CONTENTS Page SAN Monitoring and Reporting o Monitoring and Reporting Methodology 22-2 o Capacity Planning I- 15

16 Contents Appendix A CompTIA Storage + Exam Objectives.A-1 to 16 Appendix B Basic Skill Sets expected of person taking this course B-1 Appendix C Suggested Hands-On Exercises..C1 IOmeter Exercise 1 6 Appendix D Comprehensive Post Test D-1 Answer Sheet.D-40 Review Pre Test and Section Questions and Answers See separate document: IIO_SNC- F_v601Review_Question_Answers I- 16

17 Introduction to Storage Networking 1-1 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

18 Introduction to Storage Networking In this module we are going to look at some of the drivers that have taken us on the path to implement storage area networks and network attached storage architectures. We will look at the evolution of both the business drivers, and the technology advances, and how they help craft the different solutions available. Some of this will be a history lesson, but it is always important to see how things have come to be, as it helps us to understand why architectures have developed to the way they are today. 1-2 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

19 Introduction to Storage Networking Effective storage networking solutions focus on information: Not just storing information, but also accessing that information reliably and securely Not just high-speed interconnects, but flexible, extensible, and highly scalable infrastructures Not just securing information, but effectively managing information resources to derive value 1-3 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

20 Introduction to Storage Networking The Storage Networking Industry Association (SNIA) is a non-profit trade association dedicated to "ensuring that storage networks become complete and trusted solutions across the IT community by: Sponsoring technical work groups Co-producing the Storage Networking World conference series Maintaining a vendor-neutral Technology Centre in Colorado Springs Promoting activities that expand the breadth and quality of the storage networking market SNIAs definition of a SAN addresses information storage, information interconnects, and information logistics. 1-4 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

21 Introduction to Storage Networking To make a SAN which is actually useful, you need an integrated set of elements that includes: Device management tools to manage the hardware infrastructure SAN system management tools to manage higher-level functionality such as storage allocation and data security, and to integrate SAN management functions into the broader enterprise resource management schema Like a jigsaw puzzle, the separate pieces must fit together. Unlike a puzzle, however, a SAN has significant overlap between the parts. 1-5 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

22 Introduction to Storage Networking 1-6 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

23 Introduction to Storage Networking Comparing the proprietary mainframe model to an open systems model shows that: Mainframe systems consist of monolithic components that can be difficult to scale and limit flexibility. The system uses proprietary technologies that were designed by the same vendor. These proprietary technologies can be relatively easy to manage because the management tools do not have to contend with distributed, open systems, but ease of management comes at the cost of scalability and flexibility. 1-7 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

24 Introduction to Storage Networking The advent of the departmental computing model scattered computing and storage resources across the enterprise: The open-systems approach does provide more flexibility in terms of faster and more flexible deployment options, and it avoids vendor lock. However, this model still suffers from scalability issues, in terms of both computing power and storage, because it relies on smaller, distributed, heterogeneous components. 1-8 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

25 Introduction to Storage Networking 1-9 The system architectures enabled by SANs start to resemble the mainframe architecture: Storage virtualization can create a unified storage pool, just like mainframe storage cabinets. Tightly integrated server clusters and blade architectures integrate microcomputer CPUs into a unified computing resource. The user sees a single system image of both servers and storage. The basic conceptual model of a computing system has not changed, but the implementation of that model has evolved: Monolithic systems simplify system management but have limited flexibility. Today s SAN-enabled computing architectures consist of smaller, easily re-deployable components that can be used as building blocks to create highly scalable systems. This provides much more flexibility for the IT organization, but integrating and managing multi-vendor environments creates new challenges. Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

26 Introduction to Storage Networking Data storage requirements: Exponentially increasing since the first business-critical application hit the market Rapid growth of the Internet has added fuel to the fire messages sent daily 1995: 400,000, : 9,700,000, : 35,000,000,000 is just the tip of the iceberg: Digital audio and video require massive amounts of storage space. Some customer relationship management (CRM) applications record every click that a user makes on a website. But storage networking is not just about providing more space for data it is about leveraging the value of that data Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

27 Introduction to Storage Networking In the past, the storage paradigm focused on data: Businesses accumulated and warehoused data. Data was viewed as a competitive asset; businesses guarded it. Data was stored in isolated, independent systems Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

28 Introduction to Storage Networking Today, the new paradigm focuses on information: The focus has shifted from storing the data to using the information that the data contains. Businesses have realized that the ability to share information is more of a competitive asset than the ability to hoard it. By 2000, a Partners link had appeared on the home pages of nearly all corporate websites. Businesses require accessible, open systems in order to effectively share information Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

29 Introduction to Storage Networking 1-13 Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O

30 Introduction to Storage Networking Businesses must be able to easily adapt to the dynamic global marketplace: They must be prepared to respond to rapid growth. They must be able to add capacity with very short planning windows and minimal disruption to operations. Capacity is not the only scalability issue; application performance must also be able to scale Storage Networking Concepts Foundation FMJO, LLC dba Infinity I/O