Aster Express Getting Started Guide

Transcription

1 Aster Express Getting Started Guide Release Number 6.00 Product ID: B K April 2014

2 The product or products described in this book are licensed products of Teradata Corporation or its affiliates. Teradata, Active Data Warehousing, Active Enterprise Intelligence, Applications-Within, Aprimo Marketing Studio, Aster, BYNET, Claraview, DecisionCast, Gridscale, MyCommerce, SQL-MapReduce, Teradata Decision Experts, "Teradata Labs" logo, Teradata ServiceConnect, Teradata Source Experts, WebAnalyst, and Xkoto are trademarks or registered trademarks of Teradata Corporation or its affiliates in the United States and other countries. Adaptec and SCSISelect are trademarks or registered trademarks of Adaptec, Inc. AMD Opteron and Opteron are trademarks of Advanced Micro Devices, Inc. Apache, Apache Hadoop, Hadoop, and the yellow elephant logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. Apple, Mac, and OS X all are registered trademarks of Apple Inc. Axeda is a registered trademark of Axeda Corporation. Axeda Agents, Axeda Applications, Axeda Policy Manager, Axeda Enterprise, Axeda Access, Axeda Software Management, Axeda Service, Axeda ServiceLink, and Firewall-Friendly are trademarks and Maximum Results and Maximum Support are servicemarks of Axeda Corporation. Data Domain, EMC, PowerPath, SRDF, and Symmetrix are registered trademarks of EMC Corporation. GoldenGate is a trademark of Oracle. Hewlett-Packard and HP are registered trademarks of Hewlett-Packard Company. Hortonworks, the Hortonworks logo and other Hortonworks trademarks are trademarks of Hortonworks Inc. in the United States and other countries. Intel, Pentium, and XEON are registered trademarks of Intel Corporation. IBM, CICS, RACF, Tivoli, and z/os are registered trademarks of International Business Machines Corporation. Linux is a registered trademark of Linus Torvalds. LSI is a registered trademark of LSI Corporation. Microsoft, Active Directory, Windows, Windows NT, and Windows Server are registered trademarks of Microsoft Corporation in the United States and other countries. NetVault is a trademark or registered trademark of Dell Inc. in the United States and/or other countries. Novell and SUSE are registered trademarks of Novell, Inc., in the United States and other countries. Oracle, Java, and Solaris are registered trademarks of Oracle and/or its affiliates. QLogic and SANbox are trademarks or registered trademarks of QLogic Corporation. Quantum and the Quantum logo are trademarks of Quantum Corporation, registered in the U.S.A. and other countries. Red Hat is a trademark of Red Hat, Inc., registered in the U.S. and other countries. Used under license. SAS and SAS/C are trademarks or registered trademarks of SAS Institute Inc. SPARC is a registered trademark of SPARC International, Inc. Symantec, NetBackup, and VERITAS are trademarks or registered trademarks of Symantec Corporation or its affiliates in the United States and other countries. Unicode is a registered trademark of Unicode, Inc. in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product and company names mentioned herein may be the trademarks of their respective owners. THE INFORMATION CONTAINED IN THIS DOCUMENT IS PROVIDED ON AN "AS-IS" BASIS, WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF IMPLIED WARRANTIES, SO THE ABOVE EXCLUSION MAY NOT APPLY TO YOU. IN NO EVENT WILL TERADATA CORPORATION BE LIABLE FOR ANY INDIRECT, DIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING LOST PROFITS OR LOST SAVINGS, EVEN IF EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. The information contained in this document may contain references or cross-references to features, functions, products, or services that are not announced or available in your country. Such references do not imply that Teradata Corporation intends to announce such features, functions, products, or services in your country. Please consult your local Teradata Corporation representative for those features, functions, products, or services available in your country. Information contained in this document may contain technical inaccuracies or typographical errors. Information may be changed or updated without notice. Teradata Corporation may also make improvements or changes in the products or services described in this information at any time without notice. To maintain the quality of our products and services, we would like your comments on the accuracy, clarity, organization, and value of this document. Please teradata-books@lists.teradata.com. Any comments or materials (collectively referred to as "Feedback") sent to Teradata Corporation will be deemed non-confidential. Teradata Corporation will have no obligation of any kind with respect to Feedback and will be free to use, reproduce, disclose, exhibit, display, transform, create derivative works of, and distribute the Feedback and derivative works thereof without limitation on a royalty-free basis. Further, Teradata Corporation will be free to use any ideas, concepts, know-how, or techniques contained in such Feedback for any purpose whatsoever, including developing, manufacturing, or marketing products or services incorporating Feedback.

3 Copyright by Teradata. All Rights Reserved. Aster Express Getting Started Guide 3

4 Summary Summary Aster Express comprises two virtual machines (a Queen Node and a Worker Node) that run 64-bit SUSE Linux Enterprise Server (SLES), and 20 GBs of pre-configured disk space. Use the following step-by-step guide to get started: 1 Download Aster Express 2 Install Aster Express 3 Set Up Aster Express 4 Start the Aster Management Console (AMC) 5 Activate the Cluster 6 Shut Down the Worker and Queen VMs 7 Troubleshooting 8 Additional Information Download Aster Express Prerequisites Hardware requirements (minimum): 4 GB memory (Teradata recommends 8 GB memory) 20 GB free disk space Software requirements: OS: Microsoft Windows XP, Windows Vista, or Windows 7* * Aster Express requires a 64-bit capable CPU. A 32-bit operating system such as Windows XP can run as the host platform for the VMs, but the CPU needs to support a 64-bit Linux environment within the image. 7-Zip: Extract (or uncompress) the Aster Express package using 7-Zip, available from: VMware Player: Download and install the latest (free) version of the VMware Player from: player/6_0. Virtual Network Editor: VMware Player 6.0 does not come pre-bundled with the necessary executable file vmnetcfg.exe to run the Virtual Network Editor. The section below, Setting up the Teradata Connector and SQL-H to Connect to Hadoop, provides the necessary information to acquire this executable file and to configure the virtual network so that it is correctly bridged to the host computer. Note: This is only required if you want to connect Aster VMs to Teradata or SQL-H connectors. Aster Express Getting Started Guide 4

5 Install Aster Express Table 1-1: MD5 Checksums Downloads from Slow Internet Connections: When downloading from a slow Internet connection, we recommend installing a download manager. If your download crashes, the download manager will allow you to restart the download where it left off rather than starting over. You can get a download manager from: Aster Express Download Files Select one of these options for downloading the required files to your system: For faster speed networks, download this one larger file: AsterExpress60.7z (2.02 GB) For slower speed networks, download these three smaller files: AsterExpress60.7z.001 (650MB) AsterExpress60.7z.002 (650MB) AsterExpress60.7z.003 (650MB) AsterExpress60.7z.004 (128MB) MD5 Checksum Check the integrity of the download using the table below to check the file sizes and validate the MD5 Checksums. Packages Version Initial Disk Space Download Size MD5 Checksum AsterExpress60.7z GB 2,179,342,336 bytes 0372ff44103d08a03cf0877d627719b0 AsterExpress60.7z MB 681,574,400 bytes 21df8d00b3805d285b760e8ac07ff622 AsterExpress60.7z MB 681,574,400 bytes a1dbb9061a15c8e7fe9322c01912ffd2 AsterExpress60.7z MB 681,574,400 bytes f071b3cb0aead38dd205eb802ca49cc5 AsterExpress60.7z MB 134,619,136 bytes c45241c2db430f97d7f12ab3c141d479 Install Aster Express 1 Navigate to the AsterExpress60.7z or AsterExpress60.7z.001 image file on your system. 2 Right-click on the AsterExpress60.7z or AsterExpress60.7z.001 image file and select 7-Zip > Extract Files... 3 In Extract to type C:\ Aster Express Getting Started Guide 5

6 Set Up Aster Express 4 This directory structure will be extracted: C:\Aster 6.0\Virtual Images\Aster\Aster Queen The Aster Queen directory contains the Queen node image. The Queen node is the entry point for connecting to the Aster cluster. C:\Aster 6.0\Virtual Images\Aster\Aster Worker The Aster Worker directory contains the Worker node image. The Worker node is responsible for storing data, doing locally-optimized query planning, and executing queries. C:\Aster 6.0\Virtual Images\Aster\Aster Resources The Aster Resources directory contains this documentation: Aster Express User Guide, Aster Analytics Foundation User Guide, Aster Development Environment User Guide, Aster Developer Guide, Aster Lens User Guide, and Aster Client Guide. Set Up Aster Express 1 Configure your virtual network using one of the following methods: Navigate to the Control Panel and select Network. Go to the Start Menu and right-click My Network Places. Windows 7 users: Navigate to the Control Panel and right-click Network and Sharing Center. Or Navigate to the Control Panel, under Network and Internet select View network status and tasks. The network configuration window opens. Aster Express Getting Started Guide 6

7 Set Up Aster Express 2 Click the VMware Network Adapter VMnet8 to set the IP Address. The VMware Network Adapter VMnet8 status window opens. 3 Click Properties. The VMware Network Adapter VMnet8 Properties window opens. Aster Express Getting Started Guide 7

8 Set Up Aster Express 4 Select Internet Protocol Version 4 (TCP/IPv4) and select Properties. The Internet Protocol Version 4 (TCP/IPv4) Properties window opens. 5 Set the IP address to: Set the Subnet mask to: Click OK, and click the Close button on the two subsequent windows to close the VMware Network Adapter VMnet8 configuration windows. 8 Start VMware Player. 9 To start the Aster virtual images, navigate to the VMware Player Welcome Page and choose Open a Virtual Machine. 10 Navigate to the Aster Queen folder in your file directory and select the Aster Queen file. 11 Double-click this file or choose the Open option. The Aster 6.00 Queen window opens. 12 Click Play virtual machine. The VMware Player dialog box opens. 13 IMPORTANT: Select the 'I copied it' button and click OK. Aster Express Getting Started Guide 8

9 Start the Aster Management Console (AMC) The Queen virtual machine is now up and running. NOTE: Please see the Troubleshooting section for more information regarding the Linux login prompt. 14 To get the Worker virtual machine up and running, open another instance of the VMware Player. 15 Repeat steps 9 through 13 in this section, but this time, navigate to the Aster Worker Node options instead of the Aster Queen Node options. The Worker and Queen virtual machines are now running and the cluster can now be configured through the Aster Management Console. Start the Aster Management Console (AMC) The Aster Management Console (AMC) allows you to add Worker nodes to the cluster and monitor all activity and system resources. 1 To log in to the AMC, enter the following URL: 2 You may ignore any website security certificate warnings and continue to the website. 3 Enter the Username: db_superuser and Password: db_superuser and click Login. Aster Express Getting Started Guide 9

10 Activate the Cluster 4 The AMC Dashboard opens. 5 Check the status of the nodes by navigating to Admin>Cluster Management. 6 The Queen and Worker nodes are now visible under the Nodes tab. Activate the Cluster 1 To activate the Aster cluster, navigate to Admin>Cluster Management in the AMC. 2 Verify that the Worker node Status is Prepared before continuing to Step 3. 3 Click the Activate Cluster button. Aster Express Getting Started Guide 10

11 Activate the Cluster 4 During this process the Activate Cluster button is dim. Upon completion the status will show as Active in the AMC Dashboard screen. Congratulations! Your Aster Express cluster is up and running and ready to start analyzing Big Data! Aster Express Getting Started Guide 11

12 Shut Down the Worker and Queen VMs Shut Down the Worker and Queen VMs IMPORTANT: You must shut down the Worker image first. 1 To close the first virtual image, select the Aster Worker (not the Queen) image. 2 Navigate to the Player dropdown menu, continue to the Power > Suspend sub-menus, and click Suspend. The Suspend action preserves the state of the virtual machine, returns it to the library in the Suspended state, and restores it when you access the virtual machine at a later time. Please refer to the VMware Player website for more information. 3 Click Yes in the VMware Player dialog box to confirm that you want to suspend the Worker virtual machine. 4 The VMware Player welcome page is displayed after the suspend operation is complete. 5 Navigate to the Aster Queen image instead of the Aster Worker image, and repeat steps 1 through 4 in this section. Now, the Worker and Queen virtual images are both Suspended. 6 Click Player > Exit to exit each VMware Player. Aster Express Getting Started Guide 12

13 Troubleshooting Troubleshooting 1 For questions regarding your CPU Compatibility, please refer to the following websites for compatibility details: VMware Workstation Processor Check Utility PDF Windows CPU Checking Tool 2 Trouble Connecting to the Queen Node: Check that you are not also connected to a VPN. The VPN may override your local network and prevent you from connecting to the Queen Node. 3 Linux Login: It is not necessary to log into the virtual machines directly. But if you wish to log in to Linux on the VMs, use Username: aster and Password: aster for both the Queen and Worker Nodes. 4 Network errors: The Queen and Worker VMs are connected using two network interfaces: eth1 connected via NAT. This connects the VMs so they can communicate with each other. eth2 connected via a bridge connection, which is configured to request a DHCP address on the bridged network. This is intended to provide a way to connect to Teradata or Hadoop clusters using an Ethernet network. If your VM host is not connected to an Ethernet network, you will see the error Interface could not be set up for eth2 when the VMs start up. This is normal and can be ignored. Aster Express Getting Started Guide 13

14 Additional Information Additional Information For additional information, read the Aster Express Online Tutorials or us at Setting up the Teradata Connector and SQL-H to Connect to Hadoop The Teradata Connector requires that Aster Express and Teradata have access to each other over a network via a bridged connection. Additionally, SQL-H requires that Aster Express and Hadoop have access to each other over a network. First, follow steps 1 through 12 (in this section) to begin the set-up for both the Teradata Connector and the SQL-H connection to Hadoop nodes. Note: This is only required if you want to connect Aster VMs to Teradata or SQL-H connectors. Second, follow the final steps in each remaining sub-section to complete the configuration process. To establish these bridged connections: 1 Download the (free) trial version of VMware Workstation from: 2 Open a Command Prompt window and run the following: VMware-workstation-full exe /e.\vmware_extract. The folder vmware_extract is the destination directory where you want to extract the contents of the installer. 3 Navigate to the vmware_extract folder and use 7-zip to open the core.cab file and extract the contents. 4 Copy vmnetcfg.exe to the directory where you installed the VMware Player. 5 Open vmnetcfg.exe file to display the Virtual Network Editor configuration screen. 6 Select the VMnet0 in the top part of the screen. 7 Select the Bridged (connect VMs directly to the external network) radio button option in the VMnet Information section. 8 From the drop-down menu, select Intel(R) 82579LM Gigabit Network Connection or the network connection you will use to connect the VM host to Teradata or Hadoop. Aster Express Getting Started Guide 14

15 Additional Information 9 Click Apply, then click OK. 10 Connect the physical machine on which the Aster Express VMs are installed (the host machine) to an Ethernet network. 11 Verify that you can reach the IP address of the Teradata database over the Ethernet network from the host machine. 12 The Aster Express VMs are accessible over the network via their eth2 IP addresses. To find out the eth2 IP address of each VM: a b c Log in to Linux on the Aster Queen with Username: aster and Password: aster. Perform ifconfig -a on the Aster Queen to find out its eth2 IP address. Make a note of it. Repeat these steps on the Aster Worker to obtain its eth2 IP address. Complete the network configuration for the Teradata Connector: 1 Log on to the Teradata database machine and ping both the Aster Queen and the Aster Worker VMs using their eth2 IP addresses to ensure they are reachable. 2 Follow the instructions in the Aster Express User Guide for connecting to the Teradata Connector. Complete the network configuration for SQL-H to connect to Hadoop nodes: 1 Connect the physical machine on which the Aster Express VMs are installed (the host machine) to an Ethernet network. 2 Verify that you can reach the IP address of the HCatalog machine over the Ethernet network from the host machine. SQL-H connects to Hadoop through HCatalog. Aster Express Getting Started Guide 15

16 Additional Information 3 Log on to the Hadoop nodes and ping both the Aster Queen and the Aster Worker VMs using their eth2 IP addresses to ensure they are reachable. 4 Follow the instructions in the Aster Express User Guide for configuring SQL-H. Aster Express Getting Started Guide 16