Isilon OneFS. Version 7.2. OneFS Migration Tools Guide



Similar documents
Isilon OneFS. Version OneFS Migration Tools Guide

EMC ViPR Controller. Version 2.4. User Interface Virtual Data Center Configuration Guide REV 01 DRAFT

Isilon OneFS. Version Built-In Migration Tools Guide

Using Windows Administrative Tools on VNX

How To Use Insightiq

EMC ViPR Controller Add-in for Microsoft System Center Virtual Machine Manager

EMC PERSPECTIVE: THE POWER OF WINDOWS SERVER 2012 AND EMC INFRASTRUCTURE FOR MICROSOFT PRIVATE CLOUD ENVIRONMENTS

EMC ISILON AND ELEMENTAL SERVER

Installing Management Applications on VNX for File

Understanding EMC Avamar with EMC Data Protection Advisor

AUTOMATED DATA RETENTION WITH EMC ISILON SMARTLOCK

Dell Enterprise Reporter 2.5. Configuration Manager User Guide

Acronis Storage Gateway

IDENTITIES, ACCESS TOKENS, AND THE ISILON ONEFS USER MAPPING SERVICE

EMC ViPR Controller. Service Catalog Reference Guide. Version 2.3 XXX-XXX-XXX 01

EMC ISILON OneFS OPERATING SYSTEM Powering scale-out storage for the new world of Big Data in the enterprise

EMC ViPR Controller. ViPR Controller REST API Virtual Data Center Configuration Guide. Version

Replicating VNXe3100/VNXe3150/VNXe3300 CIFS/NFS Shared Folders to VNX Technical Notes P/N h REV A01 Date June, 2011

How To Configure Vnx (Vnx) On A Windows-Only Computer (Windows) With A Windows 2.5 (Windows 2.2) (Windows 3.5) (Vnet) (Win

EMC Celerra Version 5.6 Technical Primer: Control Station Password Complexity Policy Technology Concepts and Business Considerations

EMC Celerra Network Server

EMC NetWorker Snapshot Management for NAS Devices

How To Protect Data On Network Attached Storage (Nas) From Disaster

SMB FILE MIGRATION TO EMC ISILON

VIDEO SURVEILLANCE WITH SURVEILLUS VMS AND EMC ISILON STORAGE ARRAYS

Physical Security EMC Storage with ISS SecurOS

IBM TSM DISASTER RECOVERY BEST PRACTICES WITH EMC DATA DOMAIN DEDUPLICATION STORAGE

EMC DiskXtender File System Manager for UNIX/Linux Release 3.5

Isilon OneFS. Version 7.2. Backup and recovery guide

EMC Data Protection Search

BRIDGING EMC ISILON NAS ON IP TO INFINIBAND NETWORKS WITH MELLANOX SWITCHX

FILE ARCHIVAL USING SYMANTEC ENTERPRISE VAULT WITH EMC ISILON

How To Secure An Rsa Authentication Agent

The safer, easier way to help you pass any IT exams. Exam : E Backup Recovery - Avamar Expert Exam for Implementation Engineers.

Integrated Grid Solutions. and Greenplum

Veeam Cloud Connect. Version 8.0. Administrator Guide

HADOOP SOLUTION USING EMC ISILON AND CLOUDERA ENTERPRISE Efficient, Flexible In-Place Hadoop Analytics

FILE ARCHIVING FROM EMC CELERRA TO DATA DOMAIN WITH EMC FILE MANAGEMENT APPLIANCE

EMC Data Domain Management Center

SECURE, ENTERPRISE FILE SYNC AND SHARE WITH EMC SYNCPLICITY UTILIZING EMC ISILON, EMC ATMOS, AND EMC VNX

EMC AVAMAR INTEGRATION GUIDE AND DATA DOMAIN 6.0 P/N REV A02

Domain Management with EMC Unisphere for VNX

NDMP Configuration Guide for Symantec NetBackup

EMC SOLUTION FOR SPLUNK

EMC NetWorker. Security Configuration Guide. Version 8.2 SP REV 02

Configuring Celerra for Security Information Management with Network Intelligence s envision

EMC Avamar 7.0 and EMC Data Domain System

Testing and Restoring the Nasuni Filer in a Disaster Recovery Scenario

EMC NetWorker Module for Microsoft Applications Release 2.3. Application Guide P/N REV A02

CONFIGURATION GUIDELINES: EMC STORAGE FOR PHYSICAL SECURITY

Introduction to NetApp Infinite Volume

Understanding EMC Avamar with EMC Data Protection Advisor

English ETERNUS CS800 S3. Backup Exec OST Guide

Actifio Big Data Director. Virtual Data Pipeline for Unstructured Data

Deploying Silver Peak VXOA with EMC Isilon SyncIQ. February

Enterprise Reporter Report Library

Get Success in Passing Your Certification Exam at first attempt!

EMC NetWorker VSS Client for Microsoft Windows Server 2003 First Edition

CA ARCserve Backup for Windows

EMC VNXe Series. Configuring Hosts to Access CIFS File Systems. Version 3.1 P/N REV. 03

Backup Solutions for the Celerra File Server

EMC ISILON SCALE-OUT STORAGE PRODUCT FAMILY

AX4 5 Series Software Overview

Syncplicity On-Premise Storage Connector

FILE SYSTEM AUDITING WITH EMC ISILON AND EMC COMMON EVENT ENABLER

EMC VNX Series: Introduction to SMB 3.0 Support

BrightStor ARCserve Backup for Windows

EMC ISILON X-SERIES. Specifications. EMC Isilon X200. EMC Isilon X210. EMC Isilon X410 ARCHITECTURE

Strong Authentication for Microsoft SharePoint

EMC NetWorker. EMC Data Domain Boost Integration Guide. Version REV 05

RSA Authentication Manager 7.1 to 8.1 Migration Guide: Upgrading RSA SecurID Appliance 3.0 On Existing Hardware

EMC ViPR Controller. User Interface Virtual Data Center Configuration Guide. Version REV 01

Symantec NetBackup OpenStorage Solutions Guide for Disk

NetApp Storage System Plug-In for Oracle Enterprise Manager 12c Installation and Administration Guide

Setting Up a Unisphere Management Station for the VNX Series P/N Revision A01 January 5, 2010

EMC Backup and Recovery for Microsoft SQL Server 2008 Enabled by EMC Celerra Unified Storage

Isilon IQ Network Configuration Guide

RSA Security Analytics. S4 Broker Setup Guide

Dell InTrust Preparing for Auditing Microsoft SQL Server

IBM Tivoli Storage Manager

EMC Integrated Infrastructure for VMware

Testing and Restoring the Nasuni Filer in a Disaster Recovery Scenario

PATROL Console Server and RTserver Getting Started

FILE ARCHIVING FROM NETAPP TO EMC DATA DOMAIN WITH EMC FILE MANAGEMENT APPLIANCE

ONEFS MULTIPROTOCOL SECURITY UNTANGLED

BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything

OPTIMIZING PRIMARY STORAGE THROUGH FILE ARCHIVING WITH EMC CLOUD TIERING APPLIANCE

BEST PRACTICES FOR INTEGRATING TELESTREAM VANTAGE WITH EMC ISILON ONEFS

BlackShield ID Agent for Remote Web Workplace

VMware vsphere Data Protection Advanced 5.5

BrightStor ARCserve Backup for Windows

CA ARCserve Backup for Windows

EMC VNX Series. Configuring and Managing CIFS on VNX. Version VNX1, VNX2 P/N REV. 03

Technical Notes. EMC NetWorker Performing Backup and Recovery of SharePoint Server by using NetWorker Module for Microsoft SQL VDI Solution

EMC ISILON NL-SERIES. Specifications. EMC Isilon NL400. EMC Isilon NL410 ARCHITECTURE

Big data management with IBM General Parallel File System

CA ARCserve Backup for Windows

RSA Security Analytics Netflow Collection Configuration Guide

Transcription:

Isilon OneFS Version 7.2 OneFS Migration Tools Guide

Copyright 2014 EMC Corporation. All rights reserved. Published in USA. Published November, 2014 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC², EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other countries. All other trademarks used herein are the property of their respective owners. For the most up-to-date regulatory document for your product line, go to EMC Online Support (https://support.emc.com). EMC Corporation Hopkinton, Massachusetts 01748-9103 1-508-435-1000 In North America 1-866-464-7381 www.emc.com 2 OneFS 7.2 OneFS Migration Tools Guide

CONTENTS Chapter 1 Introduction to this guide 5 About this guide...6 Isilon scale-out NAS overview...6 Where to go for support...6 Chapter 2 OneFS data migration 7 OneFS migration tools... 8 Advantages and limitations of OneFS migration tools... 8 Related concepts and documents...8 Chapter 3 Data migration planning 11 Migration workflow...12 NetApp system requirements... 12 VNX system requirements... 13 Estimating time requirements for migration...13 Data migration considerations... 14 NFS data migration considerations...14 Chapter 4 Data migration preparation 17 Network preparation... 18 Cluster preparation... 18 Prepare the NetApp storage system...18 Chapter 5 Data migration testing 19 Test a migration from a NetApp storage system... 20 Test a migration from a VNX...21 Chapter 6 Performing a data migration 23 Migrate data from a NetApp storage system... 24 Migrate data from a VNX...24 Cut over to an Isilon cluster... 25 Managing failed migrations...25 Migration logs... 25 Set the migration log level...25 Restart a NetApp migration... 26 Restart a VNX migration...26 Chapter 7 Migration commands 29 isi_vol_copy... 30 isi_vol_copy_vnx...31 OneFS 7.2 OneFS Migration Tools Guide 3

CONTENTS 4 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 1 Introduction to this guide This section contains the following topics: About this guide...6 Isilon scale-out NAS overview...6 Where to go for support...6 Introduction to this guide 5

Introduction to this guide About this guide Isilon scale-out NAS overview This guide describes how to migrate data from NetApp filers and EMC VNXs to EMC Isilon clusters through the isi_vol_copy and isi_vol_copy_vnx tools. We value your feedback. Please send any comments or suggestions about this guide to docfeedback@isilon.com. The EMC Isilon scale-out NAS storage platform combines modular hardware with unified software to harness unstructured data. Powered by the distributed OneFS operating system, an EMC Isilon cluster delivers a scalable pool of storage with a global namespace. The platform's unified software provides centralized web-based and command-line administration to manage the following features: A symmetrical cluster that runs a distributed file system Scale-out nodes that add capacity and performance Storage options that manage files, block data, and tiering Flexible data protection and high availability Software modules that control costs and optimize resources Where to go for support You can contact EMC Isilon Technical Support for any questions about EMC Isilon products. Online Support Telephone Support Help with online support Live Chat Create a Service Request United States: 800-782-4362 (1-800-SVC-4EMC) Canada: 800-543-4782 Worldwide: +1-508-497-7901 For local phone numbers in your country, see EMC Customer Support Centers. For questions specific to EMC Online Support registration or access, email support@emc.com. 6 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 2 OneFS data migration This section contains the following topics: OneFS migration tools... 8 Advantages and limitations of OneFS migration tools... 8 Related concepts and documents...8 OneFS data migration 7

OneFS data migration OneFS migration tools You can migrate data onto Isilon clusters through data-migration tools that are built into OneFS. You can migrate data from NetApp storage systems through the isi_vol_copy tool and you can migrate data from EMC VNXs through the isi_vol_copy_vnx tool. OneFS migration tools transfer data over the Network Data Management Protocol (NDMP). The tools leverage snapshot technology on the source devices to ensure that a point-intime image of the file system is transferred to the Isilon cluster. Leveraging snapshot technology also allows directories that are currently being migrated to remain available to clients on the source device. OneFS migration tools migrate files and directories, including NFS permissions for NFS versions 3 and 4, Windows ACLs, Windows Properties and Alternate Data Streams. However, the tools do not migrate system configuration settings, such as SMB shares, local user accounts, or quotas. OneFS migration tools migrate all data contained in a specified volume or directory. You cannot exclude any directories or files within a volume or directory from being migrated. Advantages and limitations of OneFS migration tools You should consider the advantages and limitations of OneFS migration tools before deciding to migrate data with these tools. Other migration tools that are not built into OneFS might be the best option for your migration. For most data migrations from NetApp storage systems or VNXs, it is recommended that you migrate data with the OneFS migration tools, isi_vol_copy and isi_vol_copy_vnx. These tools can often be more efficient than host-based tools, such as EMCopy and Robocopy, because the performance of host-based tools performance is dependent on the network connectivity of the host, while the performance OneFS migration tools depends only on the network connection between the source device and the Isilon cluster. However, you might consider migrating data with a hostbased tool if one or more of the following conditions apply to your migration: The source device and Isilon cluster are on separate networks. Security restrictions prevent the source device and Isilon cluster from communicating directly. OneFS migration tools are available only for specific versions of OneFS, NetApp ONTAP, and the VNX Operating Environment. If you are migrating data from operating systems that OneFS migration tools do not support, you might need to migrate data with other tools. For more information, see NetApp system requirements and VNX system requirements. Related concepts and documents It is recommended that you be familiar with the following concepts related to Isilon data migration before performing a migration. Isilon identity management. For more information, see EMC Isilon Multiprotocol Data Access with a Unified Security Model and Identities, Access Tokens, and the Isilon OneFS User Mapping Service. 8 OneFS 7.2 OneFS Migration Tools Guide

OneFS data migration Isilon administration. For more information, see the OneFS Web Administration Guide and OneFS CLI Administration Guide. VNX identity management. For more information, see the VNX Open Systems Configuration Guide. VNX administration. For more information, see the OneFS Web Administration Guide and OneFS CLI Administration Guide. NetApp identity management and administration. For more information, see the NetApp website. SMB file migration. For more information, see SMB File Migration to EMC Isilon. NFS file migration. For more information, see NFS File Migration to an EMC Isilon Cluster Related concepts and documents 9

OneFS data migration 10 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 3 Data migration planning This section contains the following topics: Migration workflow...12 NetApp system requirements... 12 VNX system requirements...13 Estimating time requirements for migration...13 Data migration considerations... 14 Data migration planning 11

Data migration planning Migration workflow It is recommended that you follow the migration workflow to ensure that data is migrated successfully. Each migration should pass through the following stages: Preparation The preparation stage includes determining what data will be migrated from the source device and defining where data will be migrated to on the Isilon cluster. This stage also includes configuring settings to maximize the performance and reliability of data migration. Testing The testing stage includes selecting a smaller, representative data set, migrating data to the Isilon cluster, and recording performance statistics. This allows you to verify that your network settings support transfer between the source device and the Isilon cluster and estimate how much time the migration process will take. Migration Initial data transfer The initial data transfer stage includes migrating all data from a directory on the source device to the Isilon cluster. This process can take a very long time to complete, depending on the amount of data being transferred. Incremental data transfers The incremental data transfer stage includes migrating any changes that occur to the data after the initial data transfer. This ensures that a minimal amount of data need be transferred at the time of the cutover. Final data transfer and cutover The final data transfer and cutover stage includes prohibiting clients from accessing data on the source device, migrating changes to the data one more time, and redirecting clients to access their data on the Isilon cluster. NetApp system requirements You can migrate data from a NetApp storage system to an Isilon cluster with the isi_vol_copy tool only if your environment meets the following system requirements. The NetApp storage system and the Isilon cluster must be connected by either a WAN or a LAN. It is recommended that you perform migrations through a LAN. The NetApp storage system must be running NetApp ONTAP 7.x. NDMP must be enabled on the NetApp storage system. You are not required to enable the NDMP daemon on the Isilon cluster. An NDMP user account and password must be configured and enabled on the NetApp storage system. 12 OneFS 7.2 OneFS Migration Tools Guide

Data migration planning VNX system requirements You can migrate data from an EMC VNX to an Isilon cluster with the isi_vol_copy_vnx tool only if your environment meets the following system requirements. The VNX and the Isilon cluster must be connected either by a WAN or a LAN. It is recommended that you perform migrations through a LAN. The VNX must be running either VNX Operating Environment 7.x or Celerra DART 5.6.0 or later. On the Isilon cluster, at least one access zone must be configured to use the same authentication providers as the VNX. An NDMP user must be configured on the VNX Data Mover. Estimating time requirements for migration It is recommended that you estimate the amount of time that will be required for you to complete a data migration. The total amount of data being migrated is not the only factor that determines time requirements. The size and number of files being transferred can also greatly influence the performance of a data migration. Smaller files require more overhead, and thus migrating smaller files takes more time that migrating larger files. The following time-estimation results were obtained during Isilon migration testing: File size range GB / Hour 0 KB - 1 KB 0.414 1 KB - 8 KB 3.019 8 KB - 16 KB 9.678 16 KB - 32 KB 17.720 32 KB - 64 KB 30.899 64 KB - 124 KB 45.319 128 KB - 384 KB 69.231 384 KB - 1 MB 78.693 1 MB - 10 MB 81.733 10 MB - 100 MB 85.207 Over 100 MB 85.300 The results from the preceding table were obtained under the following conditions: Data was migrated from an EMC VNX to an Isilon cluster through the isi_vol_copy_vnx tool. The Isilon cluster was running OneFS 7.0.2. The VNX was running VNX Operating Environment 7.0. It was a stand-alone migration. VNX system requirements 13

Data migration planning Data was migrated through a single NDMP stream. Data was migrated over a low latency (less than 100 microseconds) Gigabit Ethernet network. All network bandwidth was allocated to migration. The VNX and Isilon cluster were not under heavy load. Data migration considerations NFS data migration considerations As you prepare to migrate data to an Isilon cluster, keep in mind the following considerations. Local users and groups are not migrated to the Isilon cluster, so if a local user or group owns a file, the file might not have an owner on the target cluster. Migration does not take into a account deduplication. Files are migrated as if they were not deduplicated. However, once files are transferred to the Isilon cluster, you can deduplicate the data again with the SmartDedupe software module. If the path of a symbolic link changes during migration, the symbolic link will break and you will need to rebuild the symbolic link. Export paths, share paths, and hostnames might change after a migration. If a firewall exists between your Isilon cluster and either the NetApp storage system or the EMC VNX, the firewall might block incoming data packets. To ensure that data migrations are successful, it is recommended that you configure your firewall to perform a stateful inspection of incoming data packets, rather than disable your firewall. For information about configuring a stateful inspection, see your firewall documentation. It is recommended that you do not back up files or directories on source VNXs during the migration process. If you back up data that is being migrated on a VNX at any point during the process, the data will not be backed up correctly. The migration process begins when the initial migration is started and ends when the cutover stage is complete. To migrate data faster, you can run multiple migrations in parallel. However, it is recommended that you run no more than four simultaneous migrations per node in the cluster. The names of all directories and files must contain only UTF-8 characters. OneFS migration tools do not migrate attributes that are specific to NetApp ONTAP, VNX Operating Environment, or Celerra DART. The following considerations are applicable only if you are migrating NFS data to an Isilon cluster. If you are migrating data from multiple source devices, and the source devices are not configured with a common source of authentication, you may introduce duplicate User IDs (UIDs) on the Isilon cluster. If two users share a UID, and files owned by the users are migrated to the cluster, both users will have the same access to each other's files when the files are migrated to the cluster. To work around this issue, you can change the UID for one of the users; however, if you do this, you must also remember to change the permissions of all files that the user has access to reflect the changes. Isilon clusters do not support extended proprietary file attributes. 14 OneFS 7.2 OneFS Migration Tools Guide

Data migration planning Isilon clusters do not support the compressed or encrypted file attributes. The isi_vol_copy_vnx tool does not migrate file creation times. NFS data migration considerations 15

Data migration planning 16 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 4 Data migration preparation This section contains the following topics: Network preparation...18 Cluster preparation... 18 Prepare the NetApp storage system...18 Data migration preparation 17

Data migration preparation Network preparation Cluster preparation It is recommended that you optimize the network infrastructure and connectivity between the source device and the Isilon cluster. It is recommended that you maximize network bandwidth between the source device and the Isilon cluster by connecting the two systems over 10Gb/s ethernet cables and setting MTU at 9000 bytes, if possible. It is also recommended that you perform migrations over isolated networks so migrations do not compete with clients for network bandwidth. Limit network traffic on the network to ensure maximum throughput. Before you migrate data to an Isilon cluster, you must prepare the cluster in the following ways. Create a directory that will serve as the target of all migration operations. Migrating data to a dedicated directory will minimize the impact of the migration on the rest of the cluster. After the migration is complete, you can move data to more appropriate locations throughout the filesystem. Create equivalent exports and shares on the Isilon cluster, and set up SmartPools policies to govern these exports. Do not migrate data directly to the exported directories. If local users exist on the source device, create equivalent accounts on the Isilon cluster. Ensure that data will not be replicated with the SyncIQ tool at the same time that data is migrated to the Isilon cluster. This might require you to modify replication-policy schedules. Disable all SmartQuotas quotas. Do not re-enable quotas until the migration is completed. Prepare the NetApp storage system If you plan to migrate data from a NetApp storage system to an Isilon cluster, you must prepare the NetApp storage system before you begin migrating data. Procedure 1. Ensure that the NetApp storage system is configured to tranfer data through NDMP v4. a. Verify the NDMP version by running the following command: ndmp version b. Optional: Set the NDMP version to v4 by running the following command. ndmpd version 4 2. Enable the challenge authentication method by running the following command: options ndmpd.authtype challenge 18 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 5 Data migration testing This section contains the following topics: Test a migration from a NetApp storage system... 20 Test a migration from a VNX...21 Data migration testing 19

Data migration testing Test a migration from a NetApp storage system It is recommended that you test migration from a NetApp storage system before you begin your migration. Procedure 1. Identify directories on the NetApp storage system that contain small, representative samples of the data that will be migrated. 2. Create a directory on the Isilon cluster that will contain the data migrated during the test. 3. Initiate the full migration for each test directory on the source NetApp storage system by running the isi_vol_copy command. The following command migrates data to /ifs/data/netapp_migration/test: isi_vol_copy netapp.ip.address:/vol/volume_name/media \ /ifs/data/netapp_migration/test -sa user-name: -full The system displays output similar to the following example: The transfer is complete. Elapsed time: 5 hours, 1 minutes, 22 seconds. 4. Record the amount of time taken to transfer the data for each directory. 5. Verify that data and permissions were transferred to the cluster correctly. 6. Continue migrating data for the next week, recording the amount of time required for each between incremental migrations and the amount of time taken to complete the incremental migrations. The following command incrementally migrates data to /ifs/data/ netapp_migration/test: isi_vol_copy netapp.ip.address:/vol/volume_name/media \ /ifs/data/netapp_migration/test -sa user-name: -incr 7. Record the amount of data transferred to the test directories. The following command displays the amount of data contained in /ifs/data/ netapp_migration/test: du -hs /ifs/data/netapp_migration/test 8. Record the number of files transferred to the test directories. The following command displays the number of files contained in /ifs/data/ netapp_migration/test: ls -lr /ifs/data/netapp_migration/test egrep -c '^-' 9. Optional: Compile the results of your test in a table and evaluate potential migration time requirements. The following table is an example of an evaluation table: Size (GB) Number of files Initial migration Final migration Time between incremental migrations Test 1 606 1,199,463 3:39:19 0:21:04 24:00:00 20 OneFS 7.2 OneFS Migration Tools Guide

Data migration testing Size (GB) Number of files Initial migration Final migration Time between incremental migrations Test 2 351 3,476,712 5:46:03 1:35:32 24:00:00 Test 3 1,815 6,016,284 13:26:28 1:42:09 24:00:00 Test 4 1,679 6,011,737 14:10:14 1:51:04 24:00:00 Test a migration from a VNX It is recommended that you test migration from a VNX before you begin your migration. Procedure 1. Identify directories on the VNX that contain small, representative samples of the data that will be migrated. 2. Create a directory on the Isilon cluster that will contain the data migrated during the test. 3. Initiate the full migration for each test directory on the source VNX storage system by running the isi_vol_copy_vnx command. The following command migrates data to /ifs/data/vnx_migration/test: isi_vol_copy_vnx vnx.ip.address:/directory/media \ /ifs/data/vnx_migration/test -sa user-name: -full The system displays output similar to the following example: The transfer is complete. Elapsed time: 5 hours, 1 minutes, 22 seconds. 4. Record the amount of time taken to transfer the data for each directory. 5. Verify that data and permissions were transferred to the cluster correctly. 6. Continue migrating data for the next week, recording the amount of time between incremental migrations and the amount of time taken to complete the incremental migrations. The following command incrementally migrates data to /ifs/data/ vnx_migration/test: isi_vol_copy_vnx vnx.ip.address:/directory/media \ /ifs/data/vnx_migration/test -sa user-name: -incr 7. Record the amount of data transferred to the test directories. The following command displays the amount of data contained in /ifs/data/ vnx_migration/test: du -hs /ifs/data/vnx_migration/test 8. Record the number of files transferred to the test directories. The following command displays the amount of data contained in /ifs/data/ vnx_migration/test: ls -lr /ifs/data/vnx_migration/test egrep -c '^-' Test a migration from a VNX 21

Data migration testing 9. Optional: Compile the results of your test in a table and evaluate potential migration time requirements. The following table is an example of an evaluation table: Size (GB) Number of files Initial migration Final migration Time between incremental migrations Test 1 606 1,199,463 3:39:19 0:21:04 24:00:00 Test 2 351 3,476,712 5:46:03 1:35:32 24:00:00 Test 3 1,815 6,016,284 13:26:28 1:42:09 24:00:00 Test 4 1,679 6,011,737 14:10:14 1:51:04 24:00:00 22 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 6 Performing a data migration This section contains the following topics: Migrate data from a NetApp storage system... 24 Migrate data from a VNX...24 Cut over to an Isilon cluster... 25 Managing failed migrations...25 Performing a data migration 23

Performing a data migration Migrate data from a NetApp storage system You can migrate data from a NetApp storage system to an Isilon cluster through the isi_vol_copy tool. It is recommended that you divide your data migrations into chunks and repeat this procedure for each chunk that you want migrate. Procedure 1. Initiate the full migration by running the isi_vol_copy command: The following command migrates data from a NetApp storage system to /ifs/data/ netapp_migration/: isi_vol_copy netapp.ip.address:/vol/volume_name/media \ /ifs/data/netapp_migration/ -sa user-name: -full The system displays output similar to the following: The transfer is complete. Elapsed time: 5 hours, 1 minutes, 22 seconds. 2. Verify that data and permissions were transferred to the cluster correctly. 3. Continue performing scheduled, incremental data transfers until you are ready to transfer clients to the Isilon cluster. The following command incrementally migrates data from a NetApp storage system to /ifs/data/netapp_migration/: isi_vol_copy netapp.ip.address:/vol/volume_name/media \ /ifs/data/netapp_migration/ -sa user-name: -incr Migrate data from a VNX You can migrate data from a VNX to an Isilon cluster through the isi_vol_copy_vnx tool. It is recommended that you divide your data migrations into chunks and repeat this procedure for each chunk that you want migrate. Procedure 1. Initiate the full migration by running the isi_vol_copy_vnx command: The following command migrates data from a VNX system to /ifs/data/ vnx_migration/test: isi_vol_copy_vnx vnx.ip.address:/directory/media \ /ifs/data/vnx_migration/test -sa user-name: -full The system displays output similar to the following: The transfer is complete. Elapsed time: 5 hours, 1 minutes, 22 seconds. 2. Verify that data and permissions were transferred to the cluster correctly. 3. Continue performing scheduled, incremental data transfers until you are ready to transfer clients to the Isilon cluster. 24 OneFS 7.2 OneFS Migration Tools Guide

Performing a data migration The following command incrementally migrates data from a VNX storage system to /ifs/data/vnx_migration/test: isi_vol_copy_vnx vnx.ip.address:/directory/media \ /ifs/data/vnx_migration/test -sa user-name: -incr Cut over to an Isilon cluster After data has been successfully migrated to an Isilon cluster, you can perform a cut over to allow clients to access their data on the Isilon cluster. Procedure 1. Restrict access to the source device or set the data on the source device to read-only. 2. Initiate the final incremental data transfer by running either the isi_vol_copy or isi_vol_copy_vnx command with the -incr option. The following command incrementally migrates data from a NetApp storage system to /ifs/data/netapp_migration/: isi_vol_copy netapp.ip.address:/vol/volume_name/media \ /ifs/data/netapp_migration/ -sa user-name: -incr 3. Transfer files to their final locations on the Isilon cluster. 4. Validate that the data is ready to be accessed by clients. 5. Update the client connections and name resolution protocols. 6. Redirect clients to the Isilon cluster. Managing failed migrations Migration logs Set the migration log level If a migration fails, you can view migration logs to determine what caused the failure. You can also restart migrations to begin migrating data again; migrations do not automatically restart after a failure. When you migrate data through a OneFS migration tool, OneFS generates a migration log. If a migration fails, you can view the migration log to identify the cause of the failure. These logs are separate from the output of the migration tools; the migration-tool output is not stored after the migration completes. OneFS retains 10 migration log files at a time. When OneFS detects that the cluster contains more than 10 migration log files, OneFS deletes the oldest log file. OneFS stores migration logs on the node that the migrations were started from; to access a log, you must be connected to the node that contains the log. The default location of migration logs related to the isi_vol_copy tool is /var/log/isi_vol_copy.log. The default location of migration logs related to the isi_vol_copy_vnx tool is /var/log/isi_vol_copy_vnx.log. If problems arise during migration, you might want to increase the migration log level to help you troubleshoot. Increasing the migration log level increases the amount of data stored in the migration logs. If you choose to increase the log level for a migration command, always ensure that you set the log level back to the default setting after you have completed your Cut over to an Isilon cluster 25

Performing a data migration troubleshooting. Increased log levels can negatively impact migration performance and should not be used unless you are investigating a problem. Procedure Restart a NetApp migration Restart a VNX migration 1. Set the migration log level by runing the isi_ilog command with the --level and --syslog_threshold options. The following command sets the log level for isi_vol_copy to debug: isi_ilog -a isi_vol_copy --level debug --syslog_threshold debug 2. After you have completed your investigation, reset the log settings by running the isi_ilog command with the --default option. The following command resets the log settings for isi_vol_copy_vnx: isi_ilog -a isi_vol_copy_vnx --default If a data migration from a NetApp storage system fails, you can restart the migration from the point at which the migration failed. Procedure 1. Restart the migration by running the isi_vol_copy command with the exact same parameters that you specified to begin the migration. For example, if you ran the following command to begin an incremental migration, and the migration failed, you would need to run the same command again to restart the migration: isi_vol_copy netapp.ip.address:/vol/volume_name/media \ /ifs/data/netapp_migration/ -sa user-name: -incr The system displays output similar to the following: The transfer is complete. Elapsed time: 1 hours, 2 minutes, 35 seconds. If a data migration from a VNX fails, you can restart the migration. To restart a VNX migration, you must run a full migration, even if the migration that failed was an incremental migration. Procedure 1. Delete the directory on the Isilon cluster that data was being migrated to. The following command deletes /ifs/data/vnx_migration: rm -Rf /ifs/data/vnx_migration 2. Recreate the migration directory on the cluster. The following command creates /ifs/data/vnx_migration: mkdir /ifs/data/vnx_migration 3. Restart the migration by running the isi_vol_copy_vnx command with the -full option. 26 OneFS 7.2 OneFS Migration Tools Guide

Performing a data migration The following command restarts the migration of /ifs/data/ netapp_migration/: isi_vol_copy_vnx vnx.ip.address:/directory/media \ /ifs/data/vnx_migration/ -sa user-name: -full Restart a VNX migration 27

Performing a data migration 28 OneFS 7.2 OneFS Migration Tools Guide

CHAPTER 7 Migration commands This section includes the following topics: isi_vol_copy... 30 isi_vol_copy_vnx...31 Migration commands 29

Migration commands isi_vol_copy Migrates data from a NetApp storage device. Syntax isi_vol_copy {<src_filer>:<src_dir> <dest_dir> {-full -incr} [-sa <username>:[<password>]] [-sport <port>] [-dport <port>] [-dhost <host>] [-maxino <integer>] -list [-detail] -contexts <server> [-sa <username>:[<password>]] -cleanup <server> [-sa <username>:[<password>]]} Options <src_filer> Specifies the IP address or domain name of the NetApp storage device. <src_dir> Specifies the absolute path of the directory on the NetApp storage device to migrate. <dest_dir> -full -incr Specifies the absolute path of the directory on the cluster to migrate data to. Migrates all data from the source to the target directory. Migrates only data that has been modified since the last migration was run. -sa <username>:[<password>] Specifies the username and password of a user on the NetApp storage device. If the <username> specified is not the name of the root account, specify <password> as the NDMP password of the user. To view the NDMP password of a user, run the ndmpd password command on the NetApp storage device. It is recommended that you do not specify a password through this option. Instead, specify only a username. If you specify a password as part of the command, the password will be visible to all other users logged in to the cluster. If you do not specify a password, and one is required, you will be prompted for the password. If you enter a password at the prompt, the password will not be visible to other users on the cluster. -sport <port> Specifies the NDMP port that OneFS will connect to on the NetApp storage device. The default value is 0, which causes OneFS to connect to the default NDMP port configured on the NetApp storage device. -dport Specifies the NDMP port on the Isilon cluster that OneFS will coordinate the data migration through. The default value is ANY, which causes OneFS to connect through any available port. 30 OneFS 7.2 OneFS Migration Tools Guide

Migration commands -dhost <host> Specifies the name or IP address of the interface on the Isilon cluster that OneFS will coordinate the data migration through. This can be useful if the cluster has multiple network interfaces and the majority of the data must be transferred through a link other than the outgoing NDMP control interface. -maxino <integer> Specifies the maximum number of files that can be created on the NetApp volume. This option can be useful if the NDMP stream incorrectly reports the maximum number of files, which can cause the migration to fail. Manually specifying the correct maximum number of files prevents this issue. -list Displays the current status of all migration sessions. -detail Displays more detailed information about migration sessions. -contexts <server> Displays information about interrupted migration sessions that can be restarted. This information is retrieved from the NetApp storage device. Specify <server> as an IP address of the NetApp storage device. -cleanup <server> Deletes information about non-restartable migration sessions on both the Isilon cluster and the NetApp storage device. Specify <server> as an IP address of the NetApp storage device. isi_vol_copy_vnx Migrates data from a VNX storage device. Syntax isi_vol_copy_vnx <src_filer>:<src_dir> <dest_dir> {-full -incr} [-sa <username>:[<password>]] [-sport <port>] [-dport <port>] [-dhost <host>] Options <src_filer> Specifies the IP address or domain name of the VNX. <src_dir> Specifies the absolute path of the directory on the VNX that is being migrated to the cluster. <dest_dir> -full -incr Specifies the absolute path of the directory that data is being migrated to. Migrates all data from the source to the target directory. Migrates only data that has been modified since the last migration was run. isi_vol_copy_vnx 31

Migration commands -sa <username>:[<password>] Specifies the username and password of a user on the VNX. It is recommended that you do not specify a password through this option. Instead specify only a username. If you specify a password as part of the command, the password will be visible to all other users logged in to the cluster. If you do not specify a password and one is required, you will be prompted for the password. If you enter a password at the prompt, the password will not be visible to other users on the cluster. -sport <port> Specifies the NDMP port that OneFS will connect to on the VNX. The default value is 0, which causes OneFS to connect to the default NDMP port configured on the VNX. -dport <port> Specifies the NDMP port on the Isilon cluster that OneFS will coordinate the data migration through. The default value is ANY, which causes OneFS to connect through any available port. -dhost <host> Specifies the name or IP address of the interface on the Isilon cluster that OneFS will coordinate the data migration through. This can be useful if the cluster has multiple network interfaces and the majority of the data must be transferred through a link other than the outgoing NDMP control interface. 32 OneFS 7.2 OneFS Migration Tools Guide