Networking. Cloud and Virtual. Data Storage. Greg Schulz. Your journey. effective information services. to efficient and.

Transcription

1 Cloud and Virtual Data Storage Networking Your journey to efficient and effective information services Greg Schulz CRC Press Taylor & Francis Group Boca Raton London New York CRC Press is an imprint of the Taylor & Francis Group, an informs business AN AU E R B AC H BOOK

2 Contents Preface xv Acknowledgments About the Author xix xxi Chapter 1 Industry Trends and Perspectives: From Issues and Challenges to Opportunities 1 In This Chapter Getting Started The Importance of Data and Storage The Business End of IT Data Storage Impact Addressing Business and IT Issues What Is Driving Data Growth and Information Reliance Business Issues and IT Challenges Business and IT Opportunities Traditional Information Services Delivery/Model Information Factories Opportunity for Cloud, Virtualization, and Data Storage Networking IT Clouds and Virtualization: Not If, Rather When, Where, Why, and How Private Cloud: Coexistence vs. Competing with Legacy IT Common Cloud, Virtualization, and Storage Networking Questions 14 v

3 vi Cloud and Virtual Data Storage Networking 1.7 Cloud, Virtualization, and Storage Networking: Bringing It Together (for Now) Chapter Summary 18 Chapter 2 Cloud, Virtualization, and Data Storage Networking Fundamentals 21 In This Chapter Getting Started Server and Storage I/O Fundamentals Server and I/O Architectures Storage Hierarchy From Bits to Bytes Disk Storage Fundamentals Initiators and Targets How Data Is Written to and Read from a Storage Device Storage Sharing vs. Data Sharing Different Types of Storage: Not All Data Storage Is the Same I/O Connectivity and Networking Fundamentals IT Clouds Virtualization: Servers, Storage, and Networking Virtualization and Storage Services Data and Storage Access Direct Attached Storage (DAS) Networked Storage: Network Attached Storage (NAS) Networked Storage: Storage Area Network (SAN) Networked Storage: Public and Private Clouds Common Questions Chapter Summary 48 Chapter 3 Infrastructure Resource Management 49 In This Chapter Managing Data Infrastructures for Cloud and Virtual Environments Introduction to Infrastructure Resource Management Understanding IT Resources Managing IT Resources 58

4 Contents vii 3.5 Service Offerings, Categories, and Technology Alignment Gaining Situational Awareness and Control From SRM to E2E SRA Search and ediscovery Performance and Capacity Planning Data Movement and Migration Chapter Summary 71 Chapter 4 Data and Storage Networking Security 73 In This Chapter Being Secure Without Being Scared Eliminating Blind Spots, Gaps in Coverage, or "Dark Territories" Security Threat Risks and Challenges Taking Action to Secure Your Resources Physical Security Logical Security Multitenancy Deciphering Encryption Securing Networks Securing Storage Removable Media Security Virtual Servers, Physical Servers, and Desktops Securing Clouds Disposing of Digital Assets and Technology Security Checklist Common Security-Related Questions Chapter Summary 89 Chapter 5 Data Protection: Backup/Restore and Business Continuance/Disaster Recovery 91 In This Chapter Getting Started Data Protection Challenges and Opportunities Protect, Preserve, and Serve Information Services Basic Information Reliability-Availability- Serviceability (RAS) High Availability and Business Continuance Disaster Recovery 98

5 viii Cloud and Virtual Data Storage Networking Data Protection vs. Preservation (Backup vs. Archive) SLO and SLAs: How Much Availability Do You Need vs. Want RTO and RPO: Balancing Data Availability vs. Time and Budgets Reconciling and Assessing RTO and RPO Requirements Tiered Data Protection Common-Sense Data Protection Virtual, Physical, and Cloud Data Protection Tools and Technologies Virtual and Physical Machine Movement Enabling High Availability Snapshots and Continuous Data Protection Backup and Recovery Data Replication (Local, Remote, and Cloud) Data Protection Management Modernizing Data Protection and Backup Expanding from DR to BC, Shifting from Cost Overhead to Profit Center Using Virtualization and Clouds to Enhance Data Protection Data Protection Checklist Common HA-, BC-, and DR-Related Questions Chapter Summary 128 Chapter 6 Metrics and Measurements for Situational Awareness 129 In This Chapter Getting Started Making Sense of Metrics and Measurements Different Metrics for Different Audiences Key Performance Indicators Averages, Rates, and Ratios Compound Metrics Measuring IT Resources and Services Delivery Performance, Availability, Capacity, Energy, and Economics (PACE) 138

6 Contents ix 6.6 Where to Get Metrics Accounting and Chargeback Benchmarks and Simulation Comparisons Common Metrics-Related Questions Chapter Summary 150 Chapter 7 Data Footprint Reduction: Enabling Cost-Effective Data Demand Growth 151 In This Chapter Getting Started What Is Driving Expanding Data Footprints Changing Data Access and Lifecycles What Is Your Data Footprint Impact? Business Benefits of Data Footprint Reduction The Expanding Scope and Focus of Data Footprint Reduction Reducing Your Data Footprint Not All Data or Applications Are the Same DFR Techniques Metrics and Measurements What to Look for in a DFR Technology Solution Best Practices Common DFR Questions Chapter Summary 164 Chapter 8 Enabling Data Footprint Reduction: Storage Capacity Optimization 167 In This Chapter DFR Techniques Archiving Tools and Targets Compression and Compaction Compression Implementation Real-Time and On-the-Fly Compression Postprocessing and Deferred Compression Consolidation and Storage Tiering Data De-duplication Dedupe Fundamentals How and Where Dedupe Is Implemented 181

7 x Cloud and Virtual Data Storage Networking Dedupe Locations (Hardware, Software, Appliance, Source, and Target) Global vs. Local Dedupe DFR and RAID Configurations Space-Saving Snapshots Thin Provisioning Common DFR Questions Chapter Summary 189 Chapter 9 Storage Services and Systems 191 In This Chapter Getting Started Tiered Storage Storage Reliability, Availability, and Serviceability (RAS) Aligning Storage Technology and Media to Application Needs Hard Disk Drives Hybrid Hard Disk Drives Removable Hard Disk Drives Solid-State Devices Magnetic Tape Different Storage Media Are Better Together Storage Services and Functionalities Redundant Components RAID and Data Availability Enhancing Data Availability and Protection Automated Storage Tiering and Data Movement Performance Optimization Unified, Multiprotocol, and Function Storage Intelligent Power Management and "Green" Storage Management Tools Storage System Architectures Servers as Storage, Storage as Servers Clustered and Grid Storage Cloud Storage Storage Virtualization and Virtual Storage Volume Mangers and Global Name Spaces 226

8 Contents xi Virtualization and Storage Services Storage Virtualization Locations Common Storage Questions Chapter Summary 230 Chapter 10 Server Virtualization 233 In This Chapter Getting Started Virtual Servers Inside Virtual Servers and Virtual Machines Virtual Desktop Infrastructure Cloud and Virtual Servers Can and Should All Servers or Desktops Be Virtualized? Virtualization Beyond Consolidation: Enabling IT Agility Common Virtualization Questions Chapter Summary 248 Chapter 11 Connectivity: Networking with Your Servers and Storage 249 In This Chapter Getting Started Networking Challenges I/O and Networking Bits and Bytes, Decoding Encoding I/O and Networking Fundamentals Server (Physical, Virtual and Cloud) Topics Peripheral Component Interconnect (PCI) Adapters, NICs, and CNAs I/O and Networking Devices Converged and Unified Networking PCI-SIG I/O Virtualization Converged Networks Local Networking (DAS, SANs, and LANs) The Role of Networking with Storage Ethernet (802.1) Fibre Channel (FC) Fibre over Ethernet (FCoE) InfiniBand (IBA) iscsi (Internet SCSI) 272

9 xii Cloud and Virtual Data Storage Networking Serial Attached SCSI (SAS) The Best Protocol for Block Storage Enabling Distance (MANs and WANs) Bandwidth and Protocol Optimization Cloud, Visualization, and Management Topics Accessing Cloud Storage and Services Virtual I/O and I/O Virtualization (IOV) N_Port ID Virtualization (NPIV) Configuring for Reliability, Availability, and Serviceability (RAS) Flat Networks Configuration and Topologies Cabling: Tools and Management Common Networking Questions Chapter Summary 287 Chapter 12 Cloud and Solution Packages 289 In This Chapter Getting Started Clarifying Cloud Confusion: What Does Your Cloud Need to Do laas, PaaS, SaaS, and AaaS Accessing Clouds Public Cloud Services Private Clouds Stacks and Solutions PODs and Modular Data Center Components Vendor Lock-in: The Good, the Bad, and the Ugly Evaluating Cloud Servers and Solutions Common Cloud Questions Chapter Summary 304 Chapter 13 Management and Tools 305 In This Chapter Getting Started Software and Management Tools Management Tool Interfaces End-to-End Management 310

10 Contents xiii 13.5 Licensing Topics The Evolving Role of Management Tools Hard vs. Soft Products The Other IT Resources: People, Processes, and Policies Common Management-Related Questions Chapter Summary 318 Chapter 14 Applying What You Have Learned 321 In This Chapter Getting Started Don't Be Afraid, but Look Before You Leap Addressing Issues and Challenges While Enabling Opportunities What's Your Vision, Strategy, and Plan? What to Consider When Evaluating Technologies, Techniques, and Services Common Cloud, Virtualization and Data Storage Networking Questions Chapter Summary 329 Chapter 15 Wrap-up, What's Next, and Book Summary 331 In This Chapter Wrapping up This Part of the Journey Where Have We Been, Where Are We Going: From Efficiency to Effectiveness What to Do Next Futures, Trends, Perspectives, and Predictions Chapter and Book Summary 338 Appendix 341 Glossary 343 Index 357