Egnyte Storage Sync For NetApp Installation Guide Introduction... 2 Architecture... 2 Key Features... 3 Access Files From Anywhere With Any Device... 3 Easily Share Files Between Offices and Business Partners... 3 File Sharing Across Multiple Offices... 3 Full Admin Control... 3 Network Bandwidth Optimization... 3 Performance Optimization... 3 Installation... 3 NetApp Storage pre-installation requirements and configuration... 4 Storage Sync pre-installation requirements... 4 NetApp System Configuration and Settings... 4 Storage Sync pre-installation requirements... 5 Storage and RAM Considerations... 5 Configure NetApp Volumes and folders for Sync... 5 Group Management in AD... 7 Storage Sync Installation and Configuration... 7 Install Storage Sync Virtual Machine... 7 Starting NetApp Sync VM... 9 Configure NetApp Sync VM and Join to your Domain... Error! Bookmark not defined. Join your Egnyte Domain to AD... 13 Map NetApp Volumes and Folders to Storage Sync... 14 Page 1
Introduction Egnyte NetApp Sync enhances your NetApp FAS Series and E-Series storage solutions with online file sharing and remote access. By integrating with NetApp storage systems, Egnyte combines high performance file servicing with anywhere access and collaboration file capabilities. Files on NetApp Volumes can be read and written from anywhere with any device anytime. Employees can share their files across multiple offices with their colleagues and business partners. While the user accesses share and private files directly through the NetApp NAS system, Egnyte for NetApp Sync solution, synchronizes and provides access to the shared files in the Cloud. Storage Sync is a thin enablement layer that communicates with local NetApp storage systems using the NetApp ONTAP API s (through Fpolicy module). Storage Sync replicates data between local storage and the cloud. It is uniquely architected to allow direct CIFS access to the NetApp share without intermediation by Egnyte. There is no proprietary file system or access protocol required by Egnyte. Direct access to NetApp ensures high performance file serving in your office, preserving the value of your investment. Files on the NetApp local Volume are automatically synchronized with Egnyte Cloud File Server, providing users with flexible remote file access or fast local network access This document will cover Egnyte Sync for NetApp solution architecture, key capabilities and step-by-step installation and configuration. This document assumes the user is familiar with VMware ESXi platform and with Active Directory Domain Controller. Architecture Egnyte Storage Sync for NetApp is a Virtual Appliance for VMware ESXi platform integrated with NetApp FAS Series and E-Series Storage System using NetApp Fpolicy API. With Event Sync Engine as a foundation, NetApp Sync provides synchronization solution for share and private folders and files stored in the NetApp system with the Cloud. The local data is stored in CIFS shares NetApp Volume, while Egnyte Storage Sync is registered engine with the NetApp to retrieve file change events using Fpolicy API The event changes are kept in Storage Sync and upon pre-configured synchronization policy, the data will automatically be synchronized with the Cloud. Storage Sync is ESXi OVA file capable of running on VMware ESXi 4.1, 5.0 and 5.1 hosts. Storage Sync requires two VMware virtual disks (vmdk). The first Virtual Disk contains the core applications; log files and synchronization engine to be used for the application Operational System and for database, logs and system configuration files. The second Virtual Disk contains data synchronized to the cloud and exported locally via CIFS. Folders /egnyte/shared and /egnyte/private are smb mounted points to CIFS shares on the NetApp System. The virtual disks can reside on any storage that is mountable by VMware host, including direct attached, iscsi, Fiber Channel or NFS Volume. Page 2
Key Features Storage Sync for NetApp includes the following key capabilities for NetApp users: Access Files From Anywhere With Any Device Users can access their files directly on the NetApp Volume and through Egnyte Cloud File Server. Egnyte bi-directionally synchronizes the two to insure uninterrupted access to the latest file versions. Easily Share Files Between Offices and Business Partners Egnyte lets you set up a central access point for sharing files within teams, across multiple offices and with business partners. You can exercise complete control over file access using granular access permissions and audit reports. File Sharing Across Multiple Offices Egnyte can be deployed on multiple NetApp storage devices across any number of offices to allow collaboration under one central access point. This helps employees of distributed offices seamlessly work together as if they are in one location and eliminates the need to set up and maintain complex VPN and FTP networks. Full Admin Control Admin level user has full control to access and monitor file usage with real-time audit reports. User permissions and authentication are synced locally and in the cloud, ensuring that only the right users have access to the files. Network Bandwidth Optimization By cloud enabling your local NetApp storage, NetApp Sync optimizes the network bandwidth used by storage. Administrators can configure which files are synchronized, and the synchronization frequency. When the network becomes saturated, or fails, users still have access to their files on your local NetApp storage. Performance Optimization Using deep integration between NetApp ONTAP and Egnyte Software, local files and folders are accessible directly from the NetApp storage Volume without the need of extra hops between the user and the files. This integration assures no performance reduction during sync time. Installation This section covers the following topics: NetApp Storage System pre-installation requirements and configuration Storage Sync pre-installation requirements Step-by-step Storage Sync installation Map NetApp Volumes and Folders to Storage Sync and run first sync Page 3
NetApp Storage pre-installation requirements and configuration Prior installation, please verify you have access to the following: 1. NetApp login credentials. An admin account on the NetApp is required (usually this account will be root ). You will need the root user in order to attach and configure shares, as well as to create Fpolicy records in the NetApp Storage System 2. NetApp Storage System IP address 3. You can ping your NetApp system and able connect it via telnet or ssh from your machine Storage Sync pre-installation requirements Storage Sync installation requires several configuration changes in the NetApp system. These changes must be done under root credentials. Using your NetApp root credentials, run the followings: 1. Login to the NetApp Command Line Interface (thru telnet or ssh) to perform the pre-configuration checks described below. 2. Egnyte Storage Sync for NetApp uses users permissions defined in Active Directory Domain Controller. Therefore, the NetApp is required to be joined to an Active Directory domain. To verify the NetApp uses AD, open a command line for your NetApp and run the following command Netapp-ny> cifs domaininfo NetApp System Configuration and Settings 1. Run command options <parameter> to verify the following NetApp system parameters are configured with the below values: a. httpd.admin.enable on b. httpd.admin.ssl.enable on c. httpd.enable on d. fpolicy.enable on e. cifs.client.dup-detection off f. cifs.max_mpx 253 In case one or more options are not set correctly, run the following command to set the parameter: options <option>=<value> For example: options httpd.admin.enable=on Page 4
2. Run command Qtree to verify the security style is set to ntfs. Note that if the security style is not set to ntfs, the Cloud permissions set will fail. Storage Sync pre-installation requirements After verifying all NetApp System parameters are set, its time to prepare the NetApp volumes to be sync and configure the AD users and group to be share data using Egnyte Cloud. Storage and RAM Considerations There is a total storage maximum of 6 TB per Storage Sync instance; storage can be allocated in increments of 2 TB up to this 6 TB limit. We recommend deploying multiple Storage Sync VMs if you need to access more than 6 TB of storage at a specific office location. When deploying Storage Sync for NetApp, we recommend to allocate at least 4GB RAM for Storage Sync VM Configure NetApp Volumes and folders for Sync 1. To sync NetApp Volume with the Cloud, the volume to be sync is required to be online. To verify the volume is available for use by Storage Sync, do the following: a. Telnet or ssh to NetApp system with root credential b. Run command vol status c. In case there is no existing volume or all volumes are not in online state, please create one and make it online. 2. Ideally, the shares volume will be empty to prevent long initial sync with the Cloud. If the volume is not empty, please contact Egnyte Technical Support to help you identify the best practice for first full sync. To verify the volume is empty of shares on the NetApp: Page 5
a. Login with ssh or telnet as NetApp-Root b. Run the command cifs shares If any shares exist on the volume, you ll see the shares listed as folders under the volume as shown in the below image If shares exist, ALL shares on a volume should be attached to the Egnyte Storage Sync during the installation process. Using NetApp Fpolicy API, Storage Sync generates file/folder events for volume to be sync with the Cloud. Hence the Storage Sync will receive notifications for every file/folder in each change event. Note: to prevent unnecessary workloads during sync process between NetApp volume and the Cloud, we require that all users, which are not defined in the Cloud, will use a separate shares folders from the users, which are defined in the Cloud. 3. Egnyte Storage Sync uses the Domain Admin Account to read and update files and folder for shared folders and files: Page 6
a. Empty share folders permissions will automatically be set to RWD by the domain admin. b. When copying data from another share into a share folder managed by NetApp Sync, make sure that the Domain Admin account has full permissions to every element on the Egnyte share. Group Management in AD Since users data will be stored in the NetApp share, the NetApp will perform permissions enforcement. For this to work, the NetApp must know about Egnyte users and groups. When using AD, users are exported to the Cloud using Egnyte AD Kit. Groups are not always exported in this manner. In addition, Egnyte allows a subset of group members to access each Storage Sync Appliance, which means you are required to create custom, tailored replica groups in AD per appliance. Egnyte Storage Sync will create these tailored replica groups in AD using the domain admin account. Hence it is important that the domain admin account have write access to the Group Organizational Unit (OU) in the AD domain server. Storage Sync can be configured to create groups under a custom OU in AD. This allows AD administrators to provide the domain admin account with write-access to only a part of the OU structure. When using Egnyte AD Kit to create security groups, the custom OU that is used by Egnyte should not be linked under any OU that is part of the search path for the AD Kit to prevent duplication tailored replica groups cycles. Follow the below steps to create AD Custom OU a. Create custom OU in your AD b. Move existing groups in AD to new custom OU if needed c. Telnet or ssh to Egnyte Sync d. Create a file called /usr/local/etc/egnyte/group_ou_name.txt e. Open the file and add the line GROUP_OU_NAME=your_group_name No restart is required the custom OU settings will take effect immediately. Storage Sync Installation and Configuration Install Storage Sync Virtual Machine Follow the below steps in order to install Egnyte Storage Sync for NetApp: 1. Connect to your ESXi host via VMware VI client, and deploy Egnyte Storage Sync from the downloaded OVA template. Page 7
Once the virtual machine (VM) has been deployed successfully, an addition hard drive will automatically be added to NetApp Sync VM. The second hard disk will act as the storage device for your NetApp Sync. The hard disk type must be at least 32GB SCSI device. To add more then 2 Virtual Disks, go to step #2 If you don t want to add additional Virtual disk, skip to "Starting NetApp Sync VM" 2. Click on Edit virtual machine settings and follow the steps below. 3. Click Add to add Hard Disk Page 8
4. After the additional hard disk is added, click on Power on the Virtual Machine to start NetApp Sync. Starting NetApp Sync VM 1. As the VM starts up, it will recognize all Virtual Disks, and create a file system on it. You can observe the progress of the VM on the console. 2. If your host network does not have DHCP enabled, the VM may fail to get an IP address dynamically. In this case, you will need to assign it static IP address. 3. Once Storage Sync has started up, click the Console tab. You will be presented with a console, from where you can log into your Storage Sync Page 9
4. In the Console tab, you will be presented with IP address to launch Egnyte Storage Sync. Joining Your NetApp Shares to Egnyte 1. Once an IP address is obtained for NetApp Sync Virtual Appliance, log into any browser using http://ipaddress:8806 You will be presented with a login page to enter the default credentials below. username: root password: egnyteelc 2. If you are an existing Egnyte user, select Yes and skip to #4. Page 10
3. If you do not have an Egnyte account, click No. 4. Complete the free trial registration to get your Egnyte account started. 5. Read the instructions and click Configure Storage Sync. You will receive a notification for an untrusted connection. Continue after selecting I understand the risks. Page 11
6. Next step is to configure your NetApp Sync VM. You will be presented with a login page to enter the credentials below. username: root password: egnyteelc 7. Verify the System Information settings and select a time-zone that corresponds with the location of your NetApp storage device. Page 12
Join your Egnyte Domain to AD NetApp requires that all engines which use Fpolicy API be joined to the Active Directory domain with a machine account. Hence, Storage Sync must use Active Directory when joining to the NetApp. To configure your NetApp Sync to perform user authentication against an existing Active Directory (AD) domain, please perform the following actions. 1. From the Network Tab, configure your NetApp Sync to have a static IP address, and set the primary DNS server of the VM to the IP address of your AD Domain Controller (DC). Also, set the hostname of the VM to conform to the domain you will be joining. 2. Click on Configure Enterprise Local Cloud tab and click on the button under Actions. If prompted to leave the page, click on Leave this page. Page 13
3. Enter the Egnyte Cloud File Server username, password, and domain. You will need to enter the Egnyte administrator credentials. If your browser pops up an alert to authenticate as the VM administrator, enter username: root password: egnyteelc. This is to ensure that only the administrator may access the sync settings page. Map NetApp Volumes and Folders to Storage Sync Once Storage Sync is installed, connected your Egnyte Cloud Domain and joined to same AD as your NetApp system is connected, the next step will be configure your AD Page 14
credential and your NetApp volume to the Cloud through Storage Sync. As described in the Architecture section, Egnyte Storage Sync listens to NetApp Fpolicy Event Notifications. The sync engine updates the Cloud with every changes and vise versa. You must specify a mapping from the NetApp share on a volume to a Cloud Folder. The NetApp volume must be created before we attach to the NetApp. Otherwise, the attach will fail with an error. If the NetApp share doesn t exist on the specified volume, the NetApp Sync will create the share for the user. After the NetApp share has been created (or its existence has been validated), NetApp Sync will automatically create an smbmount link to the NetApp. This link will be used to push and pull files on the NetApp share as part of the sync. If the Cloud Folder doesn t exist, NetApp Sync will create this folder AFTER the cloud credentials are entered. 1. Join to Active Directory domain. The admin needs to enter NetBios Domain Name, Domain name (FQDN), Domain Controller, Administrator credentials. The admin can also select multiple OU (organization units) or select a Security Group to filter AD users. 2. Assign your NetApp box IP and credential to select your the NetApp volumes and folders to your Cloud Domain. Page 15
3. Then map the NetApp Volume(s) and folder(s) that you wish to synchronize to your cloud folders. You must select at least one folder to continue. Note that Storage Sync can only be mapped to a single volume. For this reason, shares in different volumes will be grayed out once you select a share. To sync these shares, deploy another Storage Sync instance and repeat the steps above. Page 16
This share grayed-out because it is in a separate volume 4. Map the users on the VM to the users in your CFS domain. If the Local Usernames in the Virtual Machine matches the Cloud Username, then the system will auto-map the users. You can also manually map the Local Username to Cloud Username by selecting the row of local user and entering the cloud username. 5. Select the folders and subfolders you wish to synchronize. Make sure you click Save when you re done. Page 17
6. Start the initial synchronization. The initial synchronization pulls down folders and files from your Egnyte Cloud File Server, and sets permissions on them accordingly. Admins can choose to first modify synchronization settings, changing the synchronization mode to sync with a given frequency (e.g., every 15 minutes) or at a scheduled time of the day. Accessing the Network Share Once the initial synchronization has completed, your users can now access the network share from the VM. For PC users: open My Computer, and click on menu item Tools > Map Network Drive. The folder name to be used is: \\NetAppIP\ShareName Page 18
For Mac users: open Finder, and click on menu item Go > Connect To Server. The location to be used is: smb://netappip/sharename You will be presented with an authentication window to access the share. Enter either your AD credentials or Egnyte username and password and click OK. You can now access your files from the cloud or your local directory! Page 19