Toad for Apache Hadoop 1.1.0

Transcription

1 Toad for Apache Hadoop January 23, 2015 These release notes provide information about the Toad for Apache Hadoop release. About New features Enhancements Known issues System requirements Product licensing Globalization About Dell About Toad for Apache Hadoop provides you with an intuitive Windows based interface that allows you to interact with and manage your Hadoop ecosystems regardless of your skill level. With Toad for Apache Hadoop you can: Easily connect to your Cloudera Distribution Hadoop as well as to Cloudera QuickStart VM. Transfer your data from relational database to Hive. Use the HiveQL Editor to execute queries against your data stored in Hive. Store query results for further analysis. Organize and download/upload files and folders stored on HDFS. Toad for Apache Hadoop now brings the functionality and ease of use of the Toad Relational Database Management family to NoSQL databases! is a major release, with new features and functionality. See New features and Enhancements. New features BETA has gone through numerous changes since the last BETA version This chapter will present you with the major changes and differences between the last and the current. 1

2 Perspectives system The application is now divided into Perspectives - Hive, HDFS, Jobs and Transfer. It is also possible to connect to your ecosystem even when not all of the perspectives are configured. Note that you can only work with configured perspectives. The previous version of Toad for Apache Hadoop grouped everything into one tree in Data Explorer window. Working with multiple perspectives at once wasn't as easy as it could be, since having many items in one perspective would force users to scroll too much. In current version users switch between perspectives and each perspective has the same amount of space and its own UI elements (Table viewers in Hive, File viewers in HDFS...). UI redesign All stored ecosystems and ecosystems actions can be now found under Ecosystem button on Main Toolbar available across all perspectives. 2

3 Active ecosystem is now configured by clicking the Services button on Main Toolbar. An icon next to the button indicates status of active perspective. Connections have been moved to Preferences (Ecosystem button on Main Toolbar Configure Ecosystems Connections). Cloudera QuickStart VM support Cloudera QuickStart VM ecosystems can be quickly added using a special Detection Method. 3

4 The QuickStart VM is a great way to get started with Hadoop and the current version of Toad for Apache Hadoop makes this even easier. The auto-configuration method sets up everything automatically and requires only little user interaction. Multiple instances support You can now open multiple instances of Toad for Apache Hadoop. Each instance can be connected to one Hadoop ecosystem only, two instances cannot be connected to the same ecosystem. Previous version was designed so it would be possible to manage multiple Hadoop ecosystems from one instance of Toad for Apache Hadoop. However, working with more than one ecosystem often lead to confusion, since all items from all ecosystems were located in one tree. In this version, each instance of application can manage exactly one ecosystem, which results in clean and productive user interface. Multiple transfer support It is now possible to transfer more than one table at once. 4

5 Ecosystem windows state persist See also: The state of opened windows (editors, viewers...) is now saved when you deactivate an ecosystem and restored when you activate it again. Enhancements Known Issues Enhancements The following is a list of enhancements implemented in. Add new Ecosystem wizard Hive is now automatically detected when adding a new ecosystem using Cloudera Manager or Servlet. Jobs tracking All information about running, completed and failed jobs is now available in the Jobs perspective, including logs. Hive Table Viewer Additional tab added to Table Viewer - Metadata. Data sample is no longer limited to 1000 rows. Additional rows of data are loaded gradually and their number is not limited. Hive/HDFS/Transfer explorer You can now work with multiple items at once (delete/open). Transfer Overwriting tables in target using transfer is now possible (a warning dialog is displayed). Known issues The following is a list of issues, including those attributed to third-party products, known to exist at the time of release. Issue ID Description 1620 Hive Metastore does not support Binary data type (CDH5) Delimiting characters in tables are escaped by backslashes when transferred to Hive. When the data is selected using a query, the backslashes are shown, which should not happen Hive is not able to run queries against tables starting with an underscore character (e.g. "_Table"). 5

6 System requirements Before installing, ensure that your system meets the following minimum hardware and software requirements. Hardware requirements Requirement Processor Memory Hard disk space Details Pentuim IV/x86-64 Minimum 1024 MB Minimum 400 MB Software requirements Requirement Operating system Details Microsoft Windows 7 (64-bit) Other operating systems are currently being tested. Database and Hadoop distributions support Distribution/Database Oracle Details 10g, 11g R1, 11g R2, 12c Cloudera Distribution Hadoop 4.7, 5.1, 5.2, 5.3 Cloudera QuickStart VM 4.7, 5.1, 5.2, 5.3 Product licensing BETA does not require licensing. The installation of BETA expires 365 days after first launch. Globalization This section contains information about installing and operating this product in non-english configurations, such as those needed by customers outside of North America. This section does not replace the materials about supported platforms and configurations found elsewhere in the product documentation. 6

7 This release is Unicode-enabled and supports any character set. In this release, all product components should be configured to use the same or compatible character encodings and should be installed to use the same locale and regional options. This release is targeted to support operations in the following regions: North America, Western Europe and Latin America, Central and Eastern Europe, Far-East Asia, Japan. About Dell Dell listens to customers and delivers worldwide innovative technology, business solutions and services they trust and value. For more information, visit Contacting Dell Technical support: Online support Product questions and sales: (800) Third-party contributions This product contains the third-party components listed below. For third-party license information, go to Source code for components marked with an asterisk (*) is available at Component ANTLR 3.4 License BSD-style license Copyright (c) , Terence Parr Apache Commons Cli 1.2 Apache 2.0 Apache Commons Codec 1.9 Apache 2.0 Apache Commons Collections 3.2 Apache 2.0 Apache Commons Configuration 1.6 Apache 2.0 Apache Commons Dbcp 1.4 Apache 2.0 Apache Commons Httpclient 3.1 Apache 2.0 Apache Commons IO 2.1 Apache 2.0 Apache Commons Lang 2.5 Apache 2.0 Apache Commons Logging 1.1 Apache 2.0 Apache Commons Pool Apache 2.0 7

8 Component License Apache HttpComponents HttpClient Apache 2.0 Apache HttpComponents HttpCore 4.3 Apache 2.0 Apache POI 3.10 Apache 2.0 Apache XMLBeans 2.6 Apache 2.0 Avro 1.7 Apache 2.0 Bouncy Castle 1.47 BouncyCastle 1 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Derby Apache 2.0 Eclipse RCP Eclipse Public License 1.0 guava-libraries Apache 2.0 Hadoop Apache 2.0 Hadoop CDH4 Apache 2.0 Hadoop CDH5 Apache 2.0 Hive 0.11 Apache 2.0 Hive 0.13 Apache 2.0 Hive CDH Apache 2.0 Hive CDH Apache 2.0 Jackson Apache 2.0 Jackson Apache 2.0 Jackson Apache 2.0 Java Jersey 1.18 Java Binary Code License Common Development and Distribution (CDDL) 1.1 JDO 2.3 Apache 2.0 JDO 3.0 Apache 2.0 JLine BSD 3-Clause License N/A json-simple 1.1 Apache 2.0 libfb Apache 2.0 Log4j 1.2 Apache 2.0 8

9 Component MySQL Connector/J 5.1 ojdbc 11 License MySQL OTN Development and Distribution Lici 01/24/09 01/24/09 PostgreSQL JDBC BSD - PostgreSQL 1.0 Copyright PostgreSQL Global Development Group. All rights reserved. Protobuf 2.4 Protobuf 2.5 slf4j - Simple Logging Facade for Java 1.7 BSD 3-Clause License BSD 3-Clause License slf4j license N/A Sqoop 1.3 Apache 2.0 Sqoop Apache 2.0 Sqoop Apache 2.0 Sqoop CDH Apache 2.0 Sqoop CDH Apache 2.0 SSHBlackbox Client 10 Secure Black Box 5 virtualbox-sdk 4.3 LGPL (GNU Lesser General Public License) 2.1 Copyright (C) Oracle Corporation 9

10 2015 Dell Inc. ALL RIGHTS RESERVED. This guide contains proprietary information protected by copyright. The software described in this guide is furnished under a software license or nondisclosure agreement. This software may be used or copied only in accordance with the terms of the applicable agreement. No part of this guide may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for any purpose other than the purchaser s personal use without the written permission of Dell Inc. The information in this document is provided in connection with Dell products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Dell products. EXCEPT AS SET FORTH IN THE TERMS AND CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, DELL ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL DELL BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF DELL HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Dell makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and product descriptions at any time without notice. Dell does not make any commitment to update the information contained in this document. If you have any questions regarding your potential use of this material, contact: Dell Inc. Attn: LEGAL Dept 5 Polaris Way Aliso Viejo, CA Refer to our Web site (software.dell.com) for regional and international office information. Trademarks Dell, the Dell logo, Toad, T.O.A.D., Toad World and any other marks contained in this document here are trademarks of Dell Inc. and/or its affiliates. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell disclaims any proprietary interest in the marks and names of others. Legend CAUTION: A CAUTION icon indicates potential damage to hardware or loss of data if instructions are not followed. WARNING: A WARNING icon indicates a potential for property damage, personal injury, or death. IMPORTANT NOTE, NOTE, TIP, MOBILE, or VIDEO: An information icon indicates supporting information. 10