POWER8 Tyan Palmetto Setup for CAPI Ghadir Gholami 08/26/2015
Introduction This document provides a basic procedure to setup the Tyan POWER8 box in order to make the system CAPI ready. It shows: 1- How to set up the Baseboard Management Controller (BMC) for network access 2- How to check if the current BMC firmware is CAPI compatible 3- How to download and install the BMC firmware to enable CAPI 4- How to download and install the PNOR & BMC firmware to enable CAPI 5- How to install/update the Operating System to a CAPI enabled version Some CAPI related online resources are also referenced at the end of this document. BMC Initial Setup There are 3 methods in setting up BMC network access. Two of these methods connect to the BMC through the Serial Port, see section Connect to Serial Port to enable BMC network access. The third method, which is the easiest and simplest one (e.g. is highly recommended), is to use DHCP server for network connection. If you are DHCP connected, obtain your assigned IP address then you can skip this section and go directly to the Connect to BMC through the network section. Connect to Serial Port to enable BMC network access Network access to the BMC is not automatically setup, the first step is to connect to the Tyan controller via the Serial Port to setup & enable network access. This can be done via 2 methods of connection. One is via the host serial connection which is the serial connection above the VGA port, labelled HOST in the picture below. Method 1: Use the HOST serial connection: 1. Connect to host serial connection, e.g. connector above the VGA port (labelled HOST on picture above). 2. Using putty, IPMITool or a similar tool, use the settings (See section 5.3 of AST2050_Manual_v101.pdf): a. Serial Port Number: COM 1 b. Serial Port Mode: 38400, 8, n, 1 3. Log in with Username sysadmin (Password: superuser) 4. Turn the system on 5. Once at Petitboot menu exit the shell script and use the following commands to set BMC IP: a. ipmitool lan set 1 ipsrc static b. ipmitool lan set 1 ipaddr x.x.x.x
c. ipmitool lan set 1 netmask 255.255.255.0 d. ipmitool lan set 1 defgw ipaddr x.x.x.x This should complete the setup of the BMC for network access at address X.X.X.X. Method 2: For this method of firmware update, it is required that serial cable assembly part number PLATE9M16LP from Tyan be installed in the slot labelled BMC in the above picture. Please contact Tyan for information. Use the BMC serial connection: 1. For stability, it is recommended that the system be turned off 2. Connect terminal to the Serial Port at the back of the system (connector further to the right) 3. Using Putty, IPMITool or a similar tool, use the settings (See section 5.3 of AST2050_Manual_v101.pdf): a. Serial Port Number: COM 1 b. Serial Port Mode: 38400, 8, n, 1 4. Log in with Username sysadmin (Password: superuser) 5. Set the IP address of the BMC with your preferred local network settings: a. ifconfig eth0 X.X.X.X netmask 255.255.255.0 up b. route ad default gw X.X.X.1 This should complete the setup of the BMC for network access at address X.X.X.X. Connect to BMC through the network From a web browser, IP address X.X.X.X is now accessible: 1. Browse to http://x.x.x.x 2. Log in as Username admin (Password: admin) a. Please ignore the JAVA error messages b. If BMC code is later than April 2015, please log in as Username ADMIN (Password: admin)
Complete network settings from within web access Skip this section if you are using DHCP 1. Once logged in, the BMC interface looks, like this: 2. Select the Configuration tab and click on the Network menu:
3. On the next screen: o Make sure that your IP parameters are correct o Uncheck DHCP o Check IPV4 tick box o Uncheck IPV6 & VLAN tick boxes o Save before going to the next step Check BMC Firmware For CAPI to work on the Tyan Palmetto platform, both the OS and the BMC firmware must be CAPI compatible. All BMC firmware created after the 6th April 2015 are CAPI compatible. You can check the firmware date on the login screen of the BMC interface: 1. Log in with the web interface as described in Connect to BMC through the network 2. Check the Firmware Build Time on the Dashboard
Download BMC Firmware Update The minimum requirement for CAPI to be enable on the Tyan POWER8 Palmetto platform is firmware created on 04/06/2015 or later. If you have firmware level which is prior to April, then start with Step A then go to Step B. If the firmware level is after April, then go to Step B. It is highly recommended that the system be in off state while performing the firmware update The latest BMC firmware is available from Nallatech. Contact Nallatech directly to obtain the firmware, you will need both the.ima and.hpm files. Updating BMC Firmware only with IMA file STEP A: To update the Firmware, use the BMC network console: 1. Log in with the web interface as described in Method 2: 2. 3. For this method of firmware update, it is required that serial cable assembly part number PLATE9M16LP from Tyan be installed in the slot labelled BMC in the above picture. Please contact Tyan for information. Use the BMC serial connection: 6. For stability, it is recommended that the system be turned off 7. Connect terminal to the Serial Port at the back of the system (connector further to the right) 8. Using Putty, IPMITool or a similar tool, use the settings (See section 5.3 of AST2050_Manual_v101.pdf): a. Serial Port Number: COM 1 b. Serial Port Mode: 38400, 8, n, 1 9. Log in with Username sysadmin (Password: superuser) 10. Set the IP address of the BMC with your preferred local network settings: a. ifconfig eth0 X.X.X.X netmask 255.255.255.0 up b. route ad default gw X.X.X.1 This should complete the setup of the BMC for network access at address X.X.X.X. 4. Connect to BMC through the network 5. Select the Firmware Update tab and click on the Firmware Update menu: 6. On the next screen, select AMI :
7. Press the Continue button 8. On the next screen, make sure the Preserve all Configuration tick box is not checked 9. Then, click on the Enter Update Mode button: 10. Then you get the following confirmation prompt, click the OK button: 11. On the next screen, press the Browse button 12. Select the previously downloaded.ima version of the firmware image 13. Click the Upload button
14. On the next page, check the Full Flash tick box 15. Then confirm by clicking on the Proceed button 16. Once the Firmware update is complete, the system will reset WARNING: Please note that at this point of the firmware update, the BMC IP is lost. You will have to reconnect the serial port and set the BMC IPM again. Updating both PNOR & BMC Firmware with HPM file STEP B: To update the Firmware, use the BMC network console: 1. Log in with the web interface as described in Method 2: 2. 3. For this method of firmware update, it is required that serial cable assembly part number PLATE9M16LP from Tyan be installed in the slot labelled BMC in the above picture. Please contact Tyan for information. Use the BMC serial connection: 11. For stability, it is recommended that the system be turned off 12. Connect terminal to the Serial Port at the back of the system (connector further to the right) 13. Using Putty, IPMITool or a similar tool, use the settings (See section 5.3 of AST2050_Manual_v101.pdf): a. Serial Port Number: COM 1 b. Serial Port Mode: 38400, 8, n, 1 14. Log in with Username sysadmin (Password: superuser) 15. Set the IP address of the BMC with your preferred local network settings: a. ifconfig eth0 X.X.X.X netmask 255.255.255.0 up b. route ad default gw X.X.X.1 This should complete the setup of the BMC for network access at address X.X.X.X. 4. Connect to BMC through the network 5. Select the Firmware Update tab and click on the Firmware Update menu:
6. On the next screen, select HPM & press the Continue button 7. On the next screen, press Continue again 8. On the next screen, press the Browse button:
9. Select the previously downloaded.hpm firmware image 10. Click the OK button 11. On the next page, check the Update All tick box 12. Then confirm by clicking on the Proceed button 13. Once the Firmware update is complete, the system will reset WARNING: Please note that at this point of the firmware update, the BMC IP is lost. You will have to reconnect the serial port and set the BMC IPM again.
OS update For CAPI to work on the Tyan Palmetto platform, both the OS and the BMC firmware must be CAPI compatible. All Ubuntu ppc64le versions greater than 14.10 are CAPI compatible (Updating to 15.04 is recommended). 1. Using a LINUX box which has IPMI tool installed, obtain an IMPI console using following command ipmitool -H x.x.x.x -I lanplus -U admin -P admin sol activate 2. Then Power ON the system, from BMC browser or directly by pressing the power button on the server itself 3. After a few minutes Petitboot will appear on your IPMI console, select System Configuration first 4. Set up you network parameters using the TAB key and then select OK
5. Afterwards from Petitboot type n to enter the setup menu 6. At this menu choose path and using the following URLS for the path a. Kernel: http://ports.ubuntu.com/ubuntu-ports/dists/utopic-updates/main/installerppc64el/current/images/netboot/ubuntu-installer/ppc64el/vmlinux b. Initrd: http://ports.ubuntu.com/ubuntu-ports/dists/utopic-updates/main/installerppc64el/current/images/netboot/ubuntu-installer/ppc64el/initrd.gz 7. Then select OK
8. Then you will return to Petitboot, select user item 1 9. From here on follow the instructions on the following pages as your preference making sure that you set all network parameters for your system Once the installation is over, please upgrade the OS to Ubuntu LE 15.04 CAPI Resources It is highly recommend using Ubuntu ppc64le version 15.04 or greater. http://www.ubuntu.com/download/server/power8 Download the.tgz file and follow the instructions on the following URL, for flashing your AFU: https://www.ibm.com/developerworks/community/forums/html/topic?id=f3bfb166-7bf8-44a2-b2dd- 7e3b2a288a5f&ps=25 In case you don't have root access the following URL is a workaround: https://www.ibm.com/developerworks/community/forums/html/topic?id=4c5ef939-26e8-4e26-97f9- de3a88398b67&ps=25 Clone the libcxl files from Github using the following command: git clone https://github.com/ibm-capi/libcxl.git Nallatech CAPI Developer Kit http://www.nallatech.com/solutions/openpower-capi-developer-kit-for-power-8/ Tyan Palmetto Manual: http://tyan.com/manuals/ast2050_manual_v101.pdf Tyan Palmetto OpenPOWER Platform: http://www.tyan.com/campaign/openpower/index.html