Mellanox WinOF for Windows 8 Quick Start Guide

Transcription

1 Mellanox WinOF for Windows 8 Quick Start Guide Rev 1.0

2 NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT(S) ) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS-IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. Mellanox Technologies 350 Oakmead Parkway Suite 100 Sunnyvale, CA U.S.A. Tel: (408) Fax: (408) Mellanox Technologies, Ltd. Beit Mellanox PO Box 586 Yokneam Israel Tel: +972 (0) ; +972 (0) Fax: +972 (0) Copyright Mellanox Technologies. All rights reserved. Mellanox, Mellanox Logo, BridgeX, ConnectX, CORE-Direct, InfiniBridge, InfiniHost, InfiniScale, PhyX, SwitchX, Virtual Protocol Interconnect and Voltaire are registered trademarks of Mellanox Technologies, Ltd. FabricIT, MLNX-OS, Unbreakable-Link, UFM and Unified Fabric Manager are trademarks of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners. Mellanox WinOF for Windows 8 Quick Start Guide 2 Mellanox Technologies Document Number:

3 Table of Contents Table of Contents About this Manual Chapter 1 Overview Requirements Chapter 2 Installation Process Chapter 3 Port Configuration Port Configuration Port Protocol Configuration Chapter 4 SM Configuration OpenSM Activation Mellanox Technologies 3

4 About this Manual Scope This document describes how to install and test Windows 8 on a single host machine with Mellanox hardware installed. Mellanox Technologies 4

5 1 Overview Windows 8 contains Mellanox driver for Ethernet, IPoIB, and IB. However some of the IB components such as performance tools, open SM and UI are not included in box. Windows Server 8 File Servers (SMB2) support the use of an InfiniBand card providing the ability to function at high performance, very low latency while using minimal CPU utilization. For application server workloads like SQL or Hyper-V, this allows a remote file server that performs much like local storage. The main advantages of this solution are: Minimal CPU utilization for remote file storage processing Low Latency Fiber Channel equivalent solution at a lower cost 1.1 Requirements To use SMB2 direct (over InfiniBand) you need a Mellanox adapter card (NIC) that supports both InifiniBand Ethernet. The NIC can work over InfiniBand or RoCE (RDMA over Converged Ethernet). The NIC should contain firmware v or higher. If the NIC does not contain the above firmware, then SMB over RDMA will fail and the default NIC (usually 1Gbe Ethernet) will be used instead. This installation package contains the missing components that are not integrated in Windows 8. It allows installation of OpenSM, tools, SDK and User Interface (UI). In addition, the installation package burns the latest firmware allowing you to benefit from the new SMB functionality. Mellanox Technologies 5

6 2 Installation Process Step 1 Double click the.exe and follow the wizard s instructions to install Windows 8 Beta package. Step 2. Click Next in the Welcome screen. Mellanox Technologies 6

7 Step 3. Select the I accept the terms in the license agreement radio button and click Next. Step 4. Click Next to install to this folder, or click Change to install a different folder. If the firmware version is up to date regardless of the used device (OEM, Mellanox or both), please see Section Step 5. and on. Otherwise, the screens bellow will be displayed if a firmware upgrade is required. Mellanox Technologies 7

8 If you are using a Mellanox device which requires a firmware upgrade, the following window will be displayed: If you are using an OEM device which requires a firmware upgrade, the following window will be displayed: Mellanox Technologies 8

9 If you are using both a Mellanox and an OEM device that require a firmware upgrade, the following window will be displayed: Regardless of the device used, upon choosing Next follow step 5 and on. Step 5. Choose the desired Setup type (Complete / Custom). If you choose the Complete setup type, follow Step a and on (page 8). If you choose the Custom setup type, follow step 5 and on (page 8) Mellanox Technologies 9

10 Step a. To install the package components, click Install. Step b. To complete the installation, click Finish. Mellanox Technologies 10

11 Step 6. If you choose the Custom setup type, follow Step a and on, on page 10 Step a. Select the desired program feature. Documentation: contains the User Manual and Installation Guide (it is not included in this package). OpenSM - installs windows SM that is required to mange the subnet. In general, the SM is used from the managed switch. You can download the SM for test purpose Performances tools - install the performance tools that are used to measure the IB performance in user environment. Analyze tools - installs the tools that can be used to diagnosing and analyzing the IB environment SDK - contains the libraries and DLLs for developing IB application over IBALok Mellanox Technologies 11

12 Step b. Click Install to start the installation. Step c. To complete the installation, click Finish. Mellanox Technologies 12

13 3 Port Configuration 3.1 Port Configuration After MLNX_VPI installation, it is possible to modify the network protocol that runs on each port of VPI adapter cards. Each port can be set to run as InfiniBand, Ethernet or Auto Sensing. The UI is visible only after installing Mellanox package. The UI is not part of the in-box drivers Port Protocol Configuration Step 1 Display the Device Manager and expand Network adapters. Step 2. Right-click on the Mellanox ConnectX VPI network adapter and left-click Properties. Select the Port Protocol tab from the Properties sheet. The "Port Protocol" tab is displayed only if the NIC is a VPI (IB and ETH). The figure below is an example of the displayed Port Protocol sheet for a dual port VPI (IB and ETH) adapter card. Step 3. In this step, you can perform the following functions: Mellanox Technologies 13

14 Port1 / Port2 - Choose the desired port protocol for the available port(s). If you choose IB or ETH, both ends of the connection must be of the same type (IB or ETH). ROCE - Enable InfiniBand application over Ethernet by checking the RoCE checkbox. RoCE can be selected on the second port (Port2) only if Port 1 is set as either IB or Ethernet with RoCE enabled. ND - Installing Network Direct (ND) by checking the Active ND checkbox IB must be always set as Port 1. If you choose ETH as your Port 1, then Port2 can be only ETH. Mellanox Technologies 14

15 4 SM Configuration OpenSM is an InfiniBand compliant Subnet Manager (SM). It is provided as a fixed flow executable called opensm, accompanied by a testing application called osmtest. OpenSM implements an InfiniBand compliant SM according to the InfiniBand Architecture Specification chapters: Management Model (13), Subnet Management (14), and Subnet Administration (15). OpenSM v is an InfiniBand Subnet Manager. For Mellanox WinOF VPI to operate, OpenSM must be running on at least one host machine in the InfiniBand cluster. Please use the embedded OpenSM in the WinOF package for testing purpose and small cluster. Otherwise, we recommend using OpenSM from FabricIT EFM or UFM. OpenSM can either run as a Windows service which starts automatically during boot or can be started manually from the following directory: <installation_directory>\tools. To start OpenSM automatically, please perform the following: 1. Right click on "My computer" and select Manage 2. Go to "Services and Applications" and select Services 3. Right click "OpenSM" and select Properties 4. Change "Startup type" to Automatic 5. Change service to start mode OpenSM as a service will use the first port which is not in "down" state. To run OpenSM manually, enter on the command line: opensm.exe For additional run options, enter: opensm.exe -h Notes For long term running, please avoid using the '-v' (verbosity) option to avoid exceeding disk quota. Running OpenSM on multiple servers may lead to incorrect OpenSM behavior. Please do not run more than a single instance of OpenSM in the subnet. IBDiagnet cannot run on the same IB port that OpenSM is running on. Mellanox Technologies 15

16 4.1 OpenSM Activation OpenSM is a service required by managed networks in InfiniBand environments, and must be activated in one of the machines running on the subnet, otherwise the interface link will not come up. If the cards are connected to a managed network, there is no need to run OpenSM. Only one OpenSM should run per subnet. In Ethernet interfaces, running OpenSM is not required. OpenSM is embedded in the MLNX_VPI for Windows package and installed as a disabled Windows service. To enable it, after installing the WinOF package, enter at the command line: > sc start opensm For further information, please refer to the OpenSM - Subnet Manager chapter in the User Manual. Mellanox Technologies 16

17 Appendix A: RoCE Remote Direct Memory Access (RDMA) is the remote memory management capability that allows server to server data movement directly between application memory without any CPU involvement. RDMA over Ethernet (RoCE) is a mechanism to provide this efficient data transfer with very low latencies on loss-less Ethernet networks. With advances in data center convergence over reliable Ethernet, ConnectX -2/ConnectX -3 EN with RoCE uses the proven and efficient RDMA transport to provide the platform for deploying RDMA technology in mainstream data center application at 10GigE and 40GigE link-speed. ConnectX -2/ConnectX -3 EN with its hardware offload support takes advantage of this efficient RDMA transport (InfiniBand) services over Ethernet to deliver ultra low latency for performance-critical and transaction intensive applications such as financial, data base, storage, and content delivery networks. Mellanox Technologies 17

18 Appendix B: Supported Device IDs Windows 8 is able to burn firmware for the following devices: 0x1003 0x6732 0x673c 0x6750 0x676e Mellanox Technologies 18