Toad for Apache Hadoop 1.2.0

Transcription

1 Toad for Apache Hadoop September 16, 2015 These release notes provide information about the Toad for Apache Hadoop release. About New features Enhancements Known issues System requirements Product licensing Globalization About Dell About Toad for Apache Hadoop provides you with an intuitive Windows based interface that allows you to interact with and manage your Hadoop ecosystems regardless of your skill level. With Toad for Apache Hadoop you can: Easily connect to your Cloudera Distribution Hadoop as well as to Cloudera QuickStart VM Transfer your data from relational database to Hive Use HiveQL Editor to execute queries against your data stored in Hive Store query results for further analysis Organize and download/upload files and folders stored on HDFS Create Hive tables from local files or files stored on HDFS (CSV, TSV) Analyze your Hadoop Applications using Logs and Charts perspectives Toad for Apache Hadoop now brings the functionality and ease of use of the Toad Relational Database Management family to NoSQL databases! 1

2 New features Charts Perspective A new perspective has been added - Charts. Charts perspective visualizes queued/running/finished Applications, allowing users to analyze their performance and resource allocation over time to further optimize their MapReduce tasks. The perspective also categorizes Applications by User, Final Status and Type. Editor Session View The new View displays properties and JARs used for a specific Editor session (an Editor window). It is possible to change filter specific Properties and change their values. 2

3 Show Sqoop Command Sqoop command can be now displayed for any item in Transfer Definition by right-clicking it and selecting Show Sqoop Command. See also: Enhancements Known Issues 3

4 Enhancements The following is a list of enhancements implemented in. Logs perspective - tracking filter When users select Application/Job/Task and move up/down a level, the items in the level will be filtered to only display those linked to the originally selected item. Complex data type table transfer Tables containing one or more complex data types (e.g. ARRAY, MAP, STRUCT, UNIONTYPE...) can be now transferred by omitting the complex data type columns. HDFS file Blocks information Information about the number of Blocks a file is divided into as well as the Blocks Availability can be now found in File Properties. 4

5 Known issues The following is a list of issues, including those attributed to third-party products, known to exist at the time of release. Description Issue ID When a file is copied on HDFS, its Replication Factor is forcibly set to Tables with UNIONTYPE columns cannot be displayed when using Hive version older than DROP on table doesn't delete data stored in HDFS in case the table was created by another user Hive is not able to run queries against tables starting with an underscore character (e.g. "_ Table"). (CDH5) Delimiting characters in tables are escaped by backslashes when transferred to Hive. When the data is selected using a query, the backslashes are shown, which should not happen. Tables cannot be dropped under certain circumstances - DROP TABLE *tablename* will return an error when ANALAYZE TABLE *tablename* has been previously executed. (Workaround: Use DROP TABLE *schemaname*.*tablename* to drop such tables) Importing tables with custom types throws an error. 367 Import fails if table name contains non UTF-8 characters. 313 Kerberos session timeouts after approximately 8 hours, which may, for example, result in failed transfer. Hive JDBC drivers are currently backwards incompatible (e.g. JDBC drivers for CDH 5.3 cannot be used with CDH 5.2 or 5.1). 98 N/A Workaround: Until the issue is resolved Toad for Apache Hadoop will be bundled with properly working JDBC drivers for the last 3 versions of Cloudera Distribution Hadoop. System requirements Before installing, ensure that your system meets the following minimum hardware and software requirements. Hardware requirements Table 1: Hardware requirements Requirement Processor Memory Hard disk space Details Pentium IV/x86-64 Minimum 1024 MB Minimum 1,5 GB 5

6 Software requirements Table 2: Software requirements Requirement Operating system Details Microsoft Windows 7 (64-bit) Other operating systems are currently being tested. NOTE: To ensure full functionality, Toad for Apache Hadoop requires Microsoft Visual C SP1 Redistributable Package (x64) to be installed. Database and Hadoop distributions support Distribution/Database Oracle Details 10g, 11g R1, 11g R2, 12c Cloudera Distribution Hadoop 4.7, 5.1, 5.2, 5.3, 5.4 Cloudera QuickStart VM 4.7, 5.3, 5.4 VirtualBox 5.0 and higher NOTE: Metastore support has been discontinued since Toad for Apache Hadoop Product licensing BETA does not require licensing. The installation of BETA expires 365 days after first launch. Globalization This section contains information about installing and operating this product in non-english configurations, such as those needed by customers outside of North America. This section does not replace the materials about supported platforms and configurations found elsewhere in the product documentation. This release is Unicode-enabled and supports any character set. In this release, all product components should be configured to use the same or compatible character encodings and should be installed to use the same locale and regional options. This release is targeted to support operations in the following regions: North America, Western Europe and Latin America, Central and Eastern Europe, Far-East Asia, Japan. 6

7 About Dell Dell listens to customers and delivers worldwide innovative technology, business solutions and services they trust and value. For more information, visit Contacting Dell Technical support: Online support Product questions and sales: (800) Third-party contributions This product contains the third-party components listed below. For third-party license information, go to Source code for components marked with an asterisk (*) is available at Component ANTLR 3.4 License BSD-style license Copyright (c) , Terence Parr Apache Commons Cli 1.2 Apache 2.0 Apache Commons Codec 1.9 Apache 2.0 Apache Commons Collections 3.2 Apache 2.0 Apache Commons Configuration 1.6 Apache 2.0 Apache Commons Dbcp 1.4 Apache 2.0 Apache Commons Httpclient 3.1 Apache 2.0 Apache Commons IO 2.1 Apache 2.0 Apache Commons Lang 2.5 Apache 2.0 Apache Commons Logging 1.1 Apache 2.0 Apache Commons Pool Apache 2.0 Apache HttpComponents HttpClient Apache 2.0 Apache HttpComponents HttpCore 4.3 Apache 2.0 Apache POI 3.10 Apache 2.0 Apache XMLBeans 2.6 Apache 2.0 7

8 Component License Avro 1.7 Apache 2.0 Bouncy Castle 1.47 BouncyCastle 1 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Datanucleus Apache 2.0 Derby Apache 2.0 Eclipse RCP Eclipse Public License 1.0 guava-libraries Apache 2.0 Hadoop Apache 2.0 Hadoop CDH4 Apache 2.0 Hadoop CDH5 Apache 2.0 Hive 0.11 Apache 2.0 Hive 0.13 Apache 2.0 Hive CDH Apache 2.0 Hive CDH Apache 2.0 Jackson Apache 2.0 Jackson Apache 2.0 Jackson Apache 2.0 Java Jersey 1.18 Java Binary Code License Common Development and Distribution (CDDL) 1.1 JDO 2.3 Apache 2.0 JDO 3.0 Apache 2.0 JLine BSD 3-Clause License N/A json-simple 1.1 Apache 2.0 libfb Apache 2.0 Log4j 1.2 Apache 2.0 MySQL Connector/J 5.1 ojdbc 11 MySQL OTN Development and Distribution Lici 01/24/09 01/24/09 PostgreSQL JDBC BSD - PostgreSQL 1.0 8

9 Component License Copyright PostgreSQL Global Development Group. All rights reserved. Protobuf 2.4 Protobuf 2.5 slf4j - Simple Logging Facade for Java 1.7 BSD 3-Clause License BSD 3-Clause License slf4j license N/A Sqoop 1.3 Apache 2.0 Sqoop Apache 2.0 Sqoop Apache 2.0 Sqoop CDH Apache 2.0 Sqoop CDH Apache 2.0 SSHBlackbox Client 10 Secure Black Box 5 virtualbox-sdk 4.3 LGPL (GNU Lesser General Public License) 2.1 Copyright (C) Oracle Corporation 9

10 2015 Dell Inc. ALL RIGHTS RESERVED. This guide contains proprietary information protected by copyright. The software described in this guide is furnished under a software license or nondisclosure agreement. This software may be used or copied only in accordance with the terms of the applicable agreement. No part of this guide may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for any purpose other than the purchaser s personal use without the written permission of Dell Inc. The information in this document is provided in connection with Dell products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Dell products. EXCEPT AS SET FORTH IN THE TERMS AND CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, DELL ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL DELL BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF DELL HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Dell makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and product descriptions at any time without notice. Dell does not make any commitment to update the information contained in this document. If you have any questions regarding your potential use of this material, contact: Dell Inc. Attn: LEGAL Dept 5 Polaris Way Aliso Viejo, CA Refer to our Web site (software.dell.com) for regional and international office information. Trademarks Dell, the Dell logo, Toad, T.O.A.D., Toad World and any other marks contained in this document here are trademarks of Dell Inc. and/or its affiliates. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell disclaims any proprietary interest in the marks and names of others. Legend CAUTION: A CAUTION icon indicates potential damage to hardware or loss of data if instructions are not followed. WARNING: A WARNING icon indicates a potential for property damage, personal injury, or death. IMPORTANT NOTE, NOTE, TIP, MOBILE, or VIDEO: An information icon indicates supporting information. 10