The IBM Storage System N series

Transcription

1 Draft Document for Review December 6, :59 am SG The IBM Storage System N series Fundamentals of Data ONTAP Snapshot Explained IBM Network Attached Storage (NAS) Alex Osuna Bruce Clarke Kurt Kiefer Dirk Peitzmann ibm.com/redbooks

2

3 Draft Document for Review December 6, :59 am 7129edno.fm International Technical Support Organization The IBM TotalStorage Network Attached Storage N Series September 2005 SG

4 7129edno.fm Draft Document for Review December 6, :59 am Note: Before using this information and the product it supports, read the information in Notices on page xxvii. First Edition (November 2005) This edition applies to the System Storage N series products as of publication release date. This document created or updated on December 6, Copyright International Business Machines Corporation All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

5 Draft Document for Review December 6, :59 am 7129TOC.fm Contents Figures xi Tables xix Examples xxi Preface xxiii The team that wrote this redbook xxiii Become a published author xxv Comments welcome xxv Notices xxvii Trademarks xxviii Part 1. Introduction to System Storage IBM N Series Chapter 1. Introduction to System Storage N Series System Storage N-series Hardware Introduction TotalStorage N EXP Common components The N3700 product highlights are as follows N Application Software Overview Software Included in Base System Optional Software Storage Architecture Overview Direct Attached Storage (DAS) Network Attached Storage (NAS) Storage Area Network NAS Gateway LAN Basics Local Area Networks File systems and I/O Network file system protocols Understanding I/O Network Attached Storage (NAS) File servers Designated Network Attached Storage NAS uses File I/O NAS benefits Other NAS considerations Total cost of ownership Industry standards Part 2. N series Systems Concepts Chapter 2. Introduction to Data ONTAP DATA ONTAP is a light weight microkernel The Data ONTAP approach Copyright IBM Corp All rights reserved. iii

6 7129TOC.fm Draft Document for Review December 6, :59 am 2.3 Benefits of Data ONTAP Data ONTAP architecture Data ONTAP startup Chapter 3. Write Anywhere File Layout(WAFL) Introduction WAFL Implementation Overview Meta-Data Lives in Files Tree of Blocks File System Consistency and Non-Volatile RAM Avoiding file system consistency checking Consistency Points and NVRAM Understanding NVLOG forwarding High Performance NAS processing Write Allocation Conclusion Chapter 4. N Series Data Protection with RAID DP Introduction What Is the Need for RAID-DP? The Effect of Modern Larger Disk Sizes on RAID Protection Schemes with Single-Parity RAID Using Larger Disks RAID-DP Data Protection How RAID-DP Works RAID-DP with Double Parity How RAID-DP Works RAID4 Horizontal Row Parity Adding RAID-DP Double-Parity Stripes RAID-DP Reconstruction RAID-DP Operation Summary RAID-DP Overview Protection Levels with RAID-DP Larger versus smaller RAID groups Advantages of large RAID groups Advantages of small RAID groups Hot spare disks Disk failure with a hot spare disk Chapter 5. SnapShots Introduction To Snapshots High level Snapshot process Understanding Snapshots in detail Snapshot Data Structures And Algorithms The Block-Map File Creating a Snapshot Chapter 6. Recovery with SnapRestore Overview Key Features Examples: SnapRestore for Databases SnapRestore for Databases Example About SnapRestore iv The IBM TotalStorage Network Attached Storage N Series

7 Draft Document for Review December 6, :59 am 7129TOC.fm How SnapRestore Works What SnapRestore Reverts Applications of SnapRestore SnapRestore in detail Part 3. Software Technical Description Chapter 7. Introduction to FLEXVOL Improved Performance FlexVol Improves Utilization Capacity Guarantees in FlexVol Flexible Capacity Planning Chapter 8. A Thorough Introduction to FlexClone Volumes Introduction How FlexClone Volumes Work Practical Applications of FlexClone Technology FlexClone Performance FlexClone Summary Chapter 9. An Introduction to FlexCache Volumes Introduction What Are FlexCache Volumes? Benefits of FlexCache Volumes Where Can FlexCache Volumes Be Used? Acceleration of Compute Farms Software Distribution to Remote Locations How Do FlexCache Volumes Work? Caching Granularity Cache Consistency Attribute Cache Time outs Delegation Write Operation Proxy Cache Hits and Misses Space Management File Locking Conclusion Chapter 10. Data Permanence with SnapLock Features Two forms of SnapLock Licensing SnapLock Connectivity How SnapLock works WORM and SnapLock Replicating SnapLock volumes How easy is it to use SnapLock High Availability Summary Chapter 11. ENABLING RAPID RECOVERY WITH SNAPVAULT Benefits How does SnapVault Work What Gets Backed Up and When Contents v

8 7129TOC.fm Draft Document for Review December 6, :59 am Incremental Updates Scheduling/Retention Policy Snapshot Copies SnapVault Detail Disaster Recovery with SnapVault Protecting Backup Data with SnapMirror Comparing SnapMirror and SnapVault Remote Solution Example Chapter 12. LockVault explained LockVault uses Benefits SnapVault, SnapLock and LockVault working together Files transferred log files Retention capabilities Chapter 13. Overview of SnapDrive The Benefits of SnapDrive SnapDrive for Windows Software Components Windows Device Manager Dynamic File System Expansion Volumes, RAID Groups, and Virtual Disks SnapManager for Microsoft Exchange SnapDrive for Unix How SnapDrive for UNIX works SnapDrive for UNIX and logical volumes Flexible Networked Storage Summary Chapter 14. SnapMirror Introduction to SnapMirror SnapMirror Defined The Three Modes of SnapMirror Asynchronous Mode Synchronous Mode Semi-Synchronous Mode SnapMirror Applications Implications for Synchronous and Asynchronous SnapMirror Volume Capacity and SnapMirror Guarantees in a SnapMirror Deployment SNAP Mirror Detail Isolate testing from production Cascading Mirrors Cascading Replication Example Disaster Recovery Understanding the Performance Impact of Synchronous and Semi-synchronous Modes CPU Impact in Synchronous and Semi-synchronous Modes Network Bandwidth Considerations System Performance on the Secondary Storage Device System Workload on the Secondary Storage Device Application of SyncMirror Modes vi The IBM TotalStorage Network Attached Storage N Series

9 Draft Document for Review December 6, :59 am 7129TOC.fm Chapter 15. SyncMirror Advantages of SyncMirror Assuring reliable enterprise data availability with SyncMirror Business Continuance with SyncMirror Part 4. Filer Access Methods Chapter 16. Cluster Failover Sample level 2 n.n chapter heading (Head 1) new page Sample level 2 n.n chapter heading (Head 2) Sample level 3 n.n.n chapter heading (Head 3) Chapter 17. MULTIPROTOCOL DATA ACCESS: NFS, CIFS, AND HTTP File System Permissions UNIX File Permissions (UFS) NTFS File Permissions NTFS Access Modes File Service for Heterogeneous Environments with NFS and CIFS NFS CIFS (SMB) NFS vs. CIFS Mixing NFS and CIFS Part 5. Initial installation and setup Chapter 18. Single-node setup Planning the Implementation Planning Worksheets System Storage N Series disk handling basics Hardware setup Before you begin Tools and equipment The N3700 A10: Filerhead Installation and initial configuration N3700 Initial Setup Web Logon to the Filer Chapter 19. Cluster Setup Planning the implementation Planning Worksheets Disk ownership Hardware setup Before you begin Tools and equipment The N3700 Model A20: - Filerhead Initial configuration N3700 Initial setup Web logon to the Filer Chapter 20. Subsequent Setup Subsequent configuration Documenting a plan Administration Methods Timezone settings Date settings Contents vii

10 7129TOC.fm Draft Document for Review December 6, :59 am Verification of the installation Changing CIFS s settings Part 6. Client Side Attachment Chapter 1. Client attachment AIX Clients Check IP connection between client and N series filer Listing available NFS shares Mounting a Volume Part 1. N series Filer administration Chapter 2. N series Filer Administration Administration Methods Starting, stopping and reboot of the N series system Starting the N series system Stopping the N series system Rebooting the system Checking the Data ONTAP software version Updating Data ONTAP software Storage Management Replacing a disk Adding new disks Aggregates N series Volumes Qtrees Shares Cluster Management Checking cluster status Takeover Giveback Managing snapshots Part 2. Sizing Part 3. Appendices Chapter 3. Pre-installation Planning Primary issues affecting planning Performance and throughput Capacity planning Effects of Optional features Future expansion Application considerations Backup and Recovery Resiliency to Failure Summary Appendix A. Setup Worksheets and Cabling Diagrams Planing and Implementation Worksheets Single node configuration Initial Setup Worksheet Single Node Configuration (N A10) Cluster configuration Initial Setup Worksheet Cluster Configuration (N A20) viii The IBM TotalStorage Network Attached Storage N Series

11 Draft Document for Review December 6, :59 am 7129TOC.fm Disk Ownership Worksheet Matching parameters in clustered environments Cabling Cabling the N3700 Model A10 to EXP600s Cabling the N3700 Model A20 to EXP600s Appendix B. LAN Basics Local Area Networks Open Systems Interconnection (OSI) model Device driver and hardware layer Internet Protocol layer The transport layer Application layer Protocol suites Appendix C. Additional material Locating the Web material Using the Web material System requirements for downloading the Web material How to use the Web material Abbreviations and acronyms Related publications IBM Redbooks Other publications Online resources How to get IBM Redbooks Help from IBM Index Contents ix

12 7129TOC.fm Draft Document for Review December 6, :59 am x The IBM TotalStorage Network Attached Storage N Series

13 Draft Document for Review December 6, :59 am 7129LOF.fm Figures 0-1 From Top, Dirk Peitzmann, Alex Osuna, From Bottom, Bruce Clarke, Kirk Kiefer. xxiv 1-1 N CPU Tray module front view CPU tray module showing Battery backup for memory Bottom of CPU tray module showing Compact Flash card External ports on CPU tray module Schematic of Arbitrated loop vs. Switch hub External ports on ESH2 module Rear view of N Fault codes for power supply N Network Attached Storage NAS gateway The role of NAS in your storage network NAS devices use File I/O Features and Benefits Data ONTAP commands Base Software with Data ONTAP Additional Software included in Data ONTAP Data ONTAP architecture Boot Sequence WAFL overhead WAFL advantages WAFL Helps Maximize Raid performance WAFL: Write Anywhere File Layout The WAFL file system is a tree of blocks with the root inode, which describes the inode file, at the top, and meta-data files and regular files underneath A more detailed view of WAFL's tree of blocks Write Requests High performance: NVRAM aware OS = WAFL NVRAM operation N3700 node Minimal seeks and no hotspot RAID-DP Raid-DP horizontal row parity approach Adding Raid-DP double parity stripes The rest of the data added for each block and corresponding row and diagonal parity stripes created Double Disk Failure data having been recovered onto an available hot spare disk reconstructing the single missing horizontal block from row parity recreating the missing diagonal block in the gray diagonal stripe recreating the one missing horizontal block in the first column Recreation of data in C stripe recreation of the missing horizontal block from row parity, RAID-DP can continues in the current chain on the D stripe, Copyright IBM Corp All rights reserved. xi

14 7129LOF.fm Draft Document for Review December 6, :59 am all data recreated with RAID-DP RAID-DP initial factory setup Raid-DP protection SnapShot Features Step Step Step Step WAFL creates a Snapshot by duplicating the root inode that describes the inode file. WAFL avoids changing blocks in a Snapshot by writing new data to new locations on disk To write a block to a new location, the pointers in the block's ancestors must be updated, which requires them to be written to new locations as well The life cycle of a block-map file entry Software testing scenario Testing with SnapRestore First Snap Second Snap SnapShot Subsequent SnapShots Reversion to Snap Comparison of Reversion to Snap 3 Time State 4 and Active File System at Time State Flexible Volumes An aggregate consists of a pool of many disks from which space is allocated to volumes Performance Advantages Productivity enhancement Think of a FlexClone volume as a transparent writable layer in front of a Snapshot FlexClone basics FlexClone Operation WAFL creates a Snapshot copy by duplicating the root. WAFL avoids changing blocks in a Snapshot copy by writing new data to new locations on disk FlexCache Caching Model FlexVol, FlexCache Remote Office usage of FlexCache Accelerating compute farms: read off loading using FlexCache Software distribution to remote offices: reduce latency using FlexCache Sparse Files SnapLock Creation Displaying regular and SnapLock Volumes Basic SnapVault Backup Flow Diagram SnapVault Solutions Traditional Backup Remote Office Solution Disk Backup Unify Backup and Compliance Compliance drives and requirements Compliance offerings Remote capabilities Unstructured data SnapLock and LockVault compared xii The IBM TotalStorage Network Attached Storage N Series

15 Draft Document for Review December 6, :59 am 7129LOF.fm 13-1 Computer management SnapDrive Microsoft Disk Manager Disk Expansion Dynamic Expansion Unix SnapDrives N series LUNS Baseline creation Single Path SnapMirror Data Replication for Warm backup/offload SnapMirror Detail SnapMirror Internals Consistent SnapMirror Snap C consistency Isolate Testing from Production Cascading Mirrors Cascading Replication Example Disaster Recovery Example Synchronous Mirroring Clustered SyncMirror single storage system sync mirror between volume X s Tiers of Disaster Recovery SyncMirror Business Continuity with SyncMirror Network Attached Storage and SAN protocols Multiprotocol N series Filer Sample configuration with four labeled shelves Drive addressing and bay numbers Sample Device ID identification SES disks Aggregates - Example RAID-DP and RAID N3700 Model A10 back side N3700 CPU Module Setting the Shelf ID Setting the 1Gb/2Gb switch Connect console cable Connecting Ethernet, Console Cable, and Fibre Channel terminator No EXP600 attached EXP 600 attached Connecting EXP600 shelves Connecting additional EXP600 shelves Initial Setup: Host and network definitions Initial Setup: WINS, CIFS and Filer settings Initial setup: Active Directory, Domain Controller or Workgroup settings CLI Output: Sysconfig -d System Storage N series Web logon System Storage N series Web interface Starting the Setup Wizard Setup Wizard: Basic settings Setup Wizard: , Location and Administrative Host Setup Wizard - DNS, NIS, Gateway settings Setup Wizard - IP configuration, MAC addresses Setup Wizard - Protocol configuration (W2000) Figures xiii

16 7129LOF.fm Draft Document for Review December 6, :59 am Setup Wizard: Confirmation Setup Wizard -Status Message Example disk ownership Node A and Node B FilerView: Manage Disks N3700 Model A20 back panel N3700 CPU module Setting the Shelf ID Setting the 1Gb/2Gb switch Connecting Ethernet, console cables and Fibre Channel terminator No EXP600 attached EXP600 attached Connecting EXP600 shelves connecting additional EXP600 shelves Initial Setup: Host and network definitions Initial Setup: WINS, CIFS and user authentication settings Initial Setup: Active Directory, Domain Controller, and Workgroup settings Command line output: sysconfig -r Command line: cf enable Command line: cf status Command line: cf monitor Cluster status after takeover Cluster status after giveback System Storage N series Web logon System Storage N series Web Interface Starting the Setup Wizard Setup Wizard - basic settings Setup Wizard - , Location and Admin Host Setup Wizard - DNS, NIS, Gateway settings Setup Wizard - IP configuration, MAC addresses Setup Wizard - Protocol configuration (W2000) Setup Wizard = Confirmation Setup Wizard -Status Message N series Web administration access FilerView administration window DataFabric Manager Telnet connection SSH connection FilerView Use Command Line option The help and? commands The man command Mapping the administration share Edit files via mapped administration share Sample /etc/rc file Change the timezone using the command line interface Change timezone using FilerView Set date and time with FilerView Ping command from a Windows system: responds Ping command from a Linux system: no response Ifconfig command Exportfs command Matching parameters in clustered environments Cifs setup AIX volume xiv The IBM TotalStorage Network Attached Storage N Series

17 Draft Document for Review December 6, :59 am 7129LOF.fm 1-2 ping ip_address ping hostname Section of our /etc/hosts file The showmount command Showmount -a lists all mounted volumes for a specific Filer Create mount point and list directory info Mount remote file system Verify mount on the client Show remote mounts of a particular Filer Smitty mountfs Message File system successfully mounted smitty mount Smitty mount List all mounted volumes via smitty The help and? commands The man command Boot screen: Press CTRL-C for special boot menu Boot menu List open CIFS sessions Cifs terminate -t Cifs terminate command for a single workstation Shutdown messages on cifs clients Cifs restart Check, if cifs is running on the Filer Halt with command line interface (serial console) Startup the filer at the CFE prompt Halt with FilerView GUI Confirmation on halting the filer with FilerView CIFS shutdown messages Reboot with command line interface Reboot with FilerView FilerView reboot Confirmation and Alert messages check Data ONTAP version FilerView About Data ONTAP Window Finding failed disks Raid.timeout setting Sysconfig -r locate the disk Disk fail without -i option Disk failure messages Sysconfig -r shows disk v0.41 as new data disk aggregate Sysconfig -r shows Broken Disks (failed disks) Locate spare disks wit sysconfig -r FilerView: List spare disk Removing a spare disk Disk drive release mechanism Remove disk drive from bay Insert Disk FilerView: Add Aggregates Create Aggregates Wizard: Add Aggregate Create Aggregates Wizard: Aggregate Name and RAID level Create Aggregates Wizard: Size of Raid Groups Create Aggregates Wizard: Disk Selection Create Aggregates Wizard: Disks to Add Figures xv

18 7129LOF.fm Draft Document for Review December 6, :59 am 2-40 Create Aggregates Wizard: Commit changes Create Aggregates Wizard: Aggregate successfully created Aggregates Manage: New created Aggregate Aggregates Manage: Details of new created Aggregate Disks zeroing The aggr create command Aggr status command: lists existing Aggregates Create an Aggregate Aggr status command: lists new Aggregate and existing Aggregates Sysconfig -r lists raid groups and disks for all Aggregates Aggr status lists RAID types for existing Aggregates Change raidtype with aggr options command Raid reconstruction in progress Aggregate status concerning disks and current tasks Raidtype changed: verification with aggr status command Verify number of disks after changing the raid type List Aggregates Set Aggregate offline List status: offline Aggregate aggr_itso Destroy Aggregate Verify Aggregates after destroying FilerView: Offline an Aggregate Offline Aggregate confirmation FilerView: aggregate changed to offline state FilerView: Destroy Aggregate Destroy Aggregate: Warning Message FilerView: aggregate destroyed successfully Information on volumes (vol status command) The df command provides file system information Vol create options Vol lang command List all volumes Verify Aggregates Create a new volume via command line interface Create a new volume via command line interface with -l option Show new volume FilerView: add volumes Add Volume Wizard Popup Add Volumes Wizard: Flexible or Traditional Volumes Add Volumes Wizard: Choose name and language for new volume Add VOlumes Wizard: choose Aggregate, size, and space guarantee Add VOlumes Wizard: Commit changes to Filer Add VOlumes Wizard: Volume successfully added Add VOlumes Wizard: New volume in Volumes-> Manage vol container command List status before off-lining the volume Offline the volume before destroying Vol status shows the offline volume Destroy a volume Exported volumes cf status and cf monitor FilerView: Cluster Manage cf status: check status xvi The IBM TotalStorage Network Attached Storage N Series

19 Draft Document for Review December 6, :59 am 7129LOF.fm 2-93 cf takeover command cf status: verification if takeover completed Cluster takeover initiated by FilerView FilerView: Cluster status cf giveback cf status: check for successful giveback FilerView: Initiate Giveback FilerView: Status after Refresh Cabling N3700 Model A10 to EXP shelves Cabling N3700 Model A20 to EXP600 shelves Bus topology Ring topology Star topology Comparing the Internet protocol suite with the OSI reference model Layering and Encapsulation Figures xvii

20 7129LOF.fm Draft Document for Review December 6, :59 am xviii The IBM TotalStorage Network Attached Storage N Series