# Extend Table Lens for High-Dimensional Data Visualization and Classification Mining

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Extend Table Lens for High-Dimensional Data Visualization and Classification Mining CPSC 533c, Information Visualization Course Project, Term Fengdong Du University of British Columbia Abstract: Data mining and information visualization apply different techniques to solve the same problem of extracting useful information hidden in large amount of data. In this project, we focus on classification problem and developed an integrated information visualization environment, which plugs in classification rule-mining methods and extends the Table Lens techniques to handle high-dimensional data. This environment allows user to easily view the details of particular data tuples and in the meantime maintains an overview of the entire dataset. In this environment, users can flexibly choose interested subsets of data or subsets of attributes and interactively perform classification mining. 1. Introduction: 1.1 Classification Problem: Given a set of training data, the classification problem is to generate a set of rules that can classify data tuples with high accuracy. Each training data tuple has a set of attributes. And one of them is called the class attribute and indicates which class the data tuple belongs to. An example of such kind of train dataset is shown in table 1. Outlook Temperature Humidity Windy Play_tennis sunny hot High false n overcast hot High false y rain cool Normal true n sunny cool Normal false y Table 1 Among several classification methods proposed over the years, ID3 decision tree algorithm is one of the most popular approaches because it not only presents good prediction accuracy but also provides the reasoning of classification. The possible classification rules produced from this training dataset using ID3 decision tree algorithm are shown in table 2.

2 Rule 1: Outlook = overcast Play_tennis = yes Rule 2: Outlook = rain Play_tennis = no Rule 3: Outlook = sunny and Temperature = hot Play_tennis = no Rule 4: Outlook = sunny and Temperature = cool Play_tennis = yes Table 2 One critical problem with the ID3 algorithm is that it needs to scan and split the training sample space multiple times until the entire tree is pure on class labels or all non-class attributes are exhausted. During the mining process, the splitting occurs for all remaining attribute lists because we don t know which attribute will be chosen to construct the rule after the splitting. And unfortunately, many of the attributes in the splitting are actually irrelevant to the final classification rules. As an example, the Humidity attribute and Windy attribute in the above train data example do not appear in any of the final rules and therefore are irrelevant to classification. However, these two attribute lists are split as well in the mining process together with those relevant attribute lists. For high-dimensional large training dataset, this problem becomes even worse because of the I/O cost. One approach to solve this problem is to rely on the domain knowledge about the target dataset and remove some attributes that are believed irrelevant. Obviously, the reliability of domain knowledge highly affects the final classification rules. 1.2 Table Lens Techniques: Table Lens is an information visualization technique for visualizing large relational dataset. The main advantage of this technique is focus+context. Namely, users can view the details of an arbitrary data tuple and also keep displaying the overall view of the entire dataset. Focus changing and the consequent graphical re-presentation of the information structure are achieved through dynamic interactions and graphical distortions. Users can also change the graphical layout of the data tuples by sorting them according to a particular attribute. These techniques successfully support data exploration process and allow data analysts to visually detect the underlying relationship, e.g. correlation, association, among various attributes. On the other hand, the original Table Lens technique is not capable of handling highdimensional data. Given a relatively small screen size and datasets of high dimensionality (i.e. more than one hundred attributes), even though the Table Lens applies fisheye view kind of techniques and distorts the graphical representation in horizontal direction, it cannot accommodate the whole attributes in one screen view. Another weakness of Table Lens, and also perhaps for all other data exploration approaches that rely on visual detection of data patterns, is that it is difficult to discover complicated patterns, e.g. the relationship between an attribute and the combination of several other attributes. And in addition, it is also not clear on the certainty of the patterns visually found by data analysts. Here, the key problem is that visual detection is the only tool in these kinds of systems. And obviously, visual detection is less powerful and less accurate than well-developed data mining methods.

3 1.3 Relationship Between Table Lens and Classification Mining: The Table Lens technique works on relational datasets. The graphical representation it produced is a distorted table. Each row of this table represents a data tuple and each column represents an attribute. In other words, this technique produces graphical mappings for relational data tables or also called cases-by-variable table [1]. The classification mining methods take relational training dataset as input and tell users sort of dependency relationship between non-class attributes and class attribute. Namely, if some non-class attribute variables are bounded with particular values, the class attribute variable is bounded with particular class labels. And because the Table Lens technique produces graphical mapping of relational tables, the dependency relationship exists in the visual encoding of these relational tables. The Table Lens technique provides interactive layout controls on the target dataset. The most important tool is to sort the data tuples by a particular attribute. This will allow users to directly detect some simple dependency relationship among attributes. As a concrete example, the sample data shown in table 1 has the following visual representation using Table Lens technique. The simple classification rules listed in table 2 can be visually detected directly from this graphical representation. Figure 1 For complicated patterns, even though the dependency relationship still exists in the Table Lens encoding, users may not be able to detect it visually because of the lack of corresponding graphical layout controls. In this case, classification-mining methods can be plugged in the Table Lens environment to build a more powerful information extraction tool. 1.4 Extension of Table Lens: Motivated by the above observations, we try to extend the Table Lens technique in two aspects in this project. First, we design a visual encoding for high dimensionality and therefore completely present the overall context of the high dimensional data within one screen space. We allow users to easily move one interested attribute from the context view to the detailed view, and therefore be able to see the details of this attribute. Second, we plug classification-mining methods into the integrated Table Lens visualization environment and solve the classification rule-mining problem in an interactive and exploratory process. In this environment, domain data analysts can first examine the overall context of the entire dataset and very likely obtain some idea on the potential patterns by viewing the overall context. This step will enrich the prior domain knowledge regarding the target dataset. Then, on basis of the prior knowledge, domain analysts can easily define a subset of interested data or subset of interested attributes and conduct classification mining. Since the mining process will only focus on the interested subset of data, we can successfully avoid many unnecessary computations and also significantly improve the goodness of output classification rules.

4 2. Related Work To our best knowledge, the most directly related work to this project is Ankerst [2] [3]. Ankerst [2] [3] proposed a visual classification approach based on decision tree classifier. It maps each attribute value to a colored pixel, shows different attribute lists in the different areas of the screen, and yields a global view of large amount of data. The common idea between Ankerst [2] [3] and this project is to enable human involvement in the mining process. On the other hand, Ankerst [2] [3] relies on users to perceive the data pattern and control the mining process, e.g. choosing the best attributes to split the sample space; while this project focuses on high-dimensional data, presents the complete global view and detailed view simultaneously to enrich the prior knowledge of domain analysts, and then allow domain analysts to easily choose a subset of relevant attributes perceived from the context view and conduct classification mining. Another difference between Ankerst [2] [3] and this project is that in Ankerst [2] [3], attribute lists are visualized separately and independently; while in this project, we apply Table Lens as the visual encoding technique and preserve the unity of data tuples. Rather than focusing on a particular data-mining task, Kreuseler [4] considers data mining and information visualization as a general integrated problem and proposed a framework for Visual Data Mining. The framework suggests an informationpreprocessing step before performing the actual visualization. Various preprocessing and visualization techniques are discussed for different data exploration tasks. Spenke [5] is an interactive user interface to view cases-by-variable tables. Compared to Table Lens, it has a query mechanism to support simple queries. On the other hand, it is dedicated for relatively small spreadsheet dataset and does not produce perceptible visual representation for large amount of data. Therefore, it can be logically categorized as a user interface project rather than an information visualization work. 3. Table Lens/Classification Mining Integrated Environment 3.1 High Dimensionality Encoding: The original Table Lens technique applies color and position redundant encoding in the context view. This requires a minimum table cell space to achieve good perception. For high-dimensional data, this redundant encoding cannot fit all attributes in one single view. On the other hand, we usually want to maintain a complete and perceptible context view and avoid scrolling over many screen displays. The fundamental task we want to complete in the context view is to show the distribution of the domain values of a particular attribute, given the target dataset is presented in some graphical pattern, e.g. sorted by another attribute. Therefore, the main purpose of visual encoding is to distinguish the different domain values. Here, color encoding could be sufficient to achieve this purpose and redundant encoding seems do not give us more expressive power. As a concrete example, let s consider the sample data set in section 1.1. Assume the dataset has the pattern: if outlook is overcast then playtennis is yes.

5 Let s also assume outlook=overcast is encoded as a blue bar and playtennis=yes is encoded as a yellow bar. In this case, when we sort the data tuples by outlook attribute, we can see the correspondence between the blue bars in outlook column and yellow bars in the playtennis column. Color encoding is sufficiently effective to show the correlation between these two attributes. In this project, we only use color encoding in the context view and therefore are able to accommodate as many as several hundreds attributes into one single context view. The geometric representation of an attribute value is a rectangle bar. When we fit high-dimensionality data into the global context view, the rectangle bars become colored pixels. 3.2 Focus Versus Context Views To extend the Table Lens technique for handling large amount of high-dimensionality data, we divide the entire screen space into two parts. The right part is used to show the overall context view and the left part is used to show the detailed view. And the size of these two views can be adjusted by users. The layout of these two views is shown in figure 2. Figure 2 In the detailed view, we apply same visual encoding techniques used in the original Table Lens. Users can click a column head button and sort the entire dataset in ascending order or descending order of attribute values in this column. Then, the consequent overall

6 context view will automatically update. Users can also bring an attribute from the context view to the detailed view. This is done by first clicking an attribute in the context view, and then moving the mouse to a column in the detailed view and clicking the column head button. These interaction operations allow users to focus on an arbitrary attribute and see the details easily. Moreover, domain analysts can examine how the overall context view changes after sorting a particular attribute and very likely get better idea regarding the relationships of different attributes. This prior knowledge could be very important in classification mining. 3.3 Defining Interested Regions for Classification Mining: Another useful interaction provided in the integrated environment is that users can define their interested regions in the context view and then perform classification mining on a particular region or the union of a set of regions. Because we eliminate the irrelevant attributes before the mining process, this approach successfully avoids the problem we described in section 1. As a consequence of defining the interested regions, we also restrict the classification rules that are output from our integrated environment to be interested rules. In other words, our integrated visualization environment can play the similar role of pruning uninterested rules in those non-visual data mining systems. And furthermore, in our integrated environment, domain analysts can obtain multiple sets of classification rules by defining different interested regions depending on their perceptions. On the contrary, non-visual classification mining systems do not have this kind of flexibility. Domain analysts do not have many controls on the mining process and the final output rules. Figure 3

7 3.4 A Classification Mining Scenario: In figure 3, we present a typical scenario of classification mining in our integrated visual data-mining environment. The dataset we chose here is a DNA sequence dataset that has 181 attributes including a class attribute that has three domain values. We fit 800 tuples in both the context view and the detailed view. When we sort the class attribute, we can see the pattern in the context view from the 80 th attribute to the 105 th attribute. Then we drag a rectangle area in the context view and define this interested region to perform classification rule mining. We click the classification menu item under the edit menu. Very quickly, we can see the mining error rate 0.0% in the bottom status bar. On the other hand, the running time performance of our implementation of the tradition decision tree algorithm is uncompetitive to this interactive visual classification-mining environment. And the prediction error rates of these two approaches on the same test dataset are almost same. 4. Implementation and Results: This project is implemented in Java using standard Swing and AWT package. Graphics and Graphics2D are used to display all graphics components. To improve the graphics computation performance, all geometric shapes take integer parameters to define their sizes and positions. In the overall context view, because we allow user to adjust the width of the view, the number of available pixels is not necessarily dividable by the total number of attributes. To solve this problem, we make compensation for every pixel loss. The minimum width of the visual encoding of an attribute is 1 pixel. If the context view cannot accommodate all attributes with this minimum encoding width, only part of the attributes are displayed. In this case, users have to adjust the view size to obtain a complete display. Users can move the mouse to the right most attribute column showed in the context view, the corresponding attribute index and name will be displayed in the status bar. Our current version of implementation works for the datasets with purely categorical attribute values. Because we use color encoding in the overall context view, to better perceive the graphical representation of the dataset, we restrict the maximum domain size of all attributes being 11. In many data mining applications, we typically have relatively small number of discrete values for categorical attributes. For numerical attributes or categorical attributes with large domain cardinality, we can partition the domain into small number of buckets and encode the different buckets. In practice, binary partition has been showed good accuracy using decision tree algorithm. Therefore, our encoding restriction is particularly suitable in classification mining and does not pose obstacle of using our integrated visual mining environment for more general cases. 5. Summary: In this project, we extend the Table Lens techniques to handle high-dimensional datasets. Having observed that Table Lens produces graphical mapping of relational dataset and also encodes many hidden patterns existing in the dataset, we suggest using Table Lens as the visualization tool for classification mining problem. By plug-in classification mining methods, users can obtain more certainty and accuracy in addition to visual perceptions.

8 And many complex patterns that cannot be visually detected in the original Table Lens technique can now be discovered as classification mining problem. On the other hand, the extended Table Lens visualization tool can be used as an important step before performing the classification mining computations. In this step, domain analysts can perceive the overall context and details of the target dataset very flexibly, and therefore enrich their prior knowledge. On basis of the prior knowledge, domain analysts have more controls on the mining process and therefore can get interested results very quickly. We provide interactive tools in this Table Lens/Classification Mining integrated environment to facilitate both the pattern perception and classification mining control. Reference: [1] R. Rao and S. Card, The Table Lens: Merging Graphical and Symbolical Representations in an Interactive Focus+Context Visualization for Tabular Information, Proc. Conf. Human Factors in Computing System, Apr [2] M. Ankerst, C. Elsen, Ester M., Kriegel H.-P.: Visual Classification: An Interactive Approach to Decision Tree Construction, Proc. 5th Int. Conf. on Knowledge Discovery and Data Mining (KDD 99), San Diego, CA, 1999, pp [3] M. Ankerst, Visual Data Mining with Pixel-Oriented Visualization Techniques, Proc. Workshop Visual Data Mining, 2001 [4] M. Kreuseler, H. Schumann, A Flexible Approach for Visual Data Mining, IEEE Transactions on Visualization and Computer Graphics. Vol. 8, No. 1, January-March [5] M. Spenke, C. Beilken, and T. Berlage, FOCUS: The Interactive Table for Product Comparison and Selection, Proc. Ninth Ann. ACM Symp. User Interface Software and Technology, 1996 [6] M. Sarkar and M. Brown, Graphical Fisheye Views, Comm. ACM, vol. 37, no. 12, pp , Dec. 1994

9 Snapshot 1: Showing detailed attribute values Snapshot 2: Correspondence between the Detailed View and Context View

10 Snapshot 3: Bringing an Attribute from the Context View to Detailed View Snapshot 4: Define Interested Classification Mining Regions

### Visual Data Mining with Pixel-oriented Visualization Techniques

Visual Data Mining with Pixel-oriented Visualization Techniques Mihael Ankerst The Boeing Company P.O. Box 3707 MC 7L-70, Seattle, WA 98124 mihael.ankerst@boeing.com Abstract Pixel-oriented visualization

### TOWARDS SIMPLE, EASY TO UNDERSTAND, AN INTERACTIVE DECISION TREE ALGORITHM

TOWARDS SIMPLE, EASY TO UNDERSTAND, AN INTERACTIVE DECISION TREE ALGORITHM Thanh-Nghi Do College of Information Technology, Cantho University 1 Ly Tu Trong Street, Ninh Kieu District Cantho City, Vietnam

### Visual Mining of E-Customer Behavior Using Pixel Bar Charts

Visual Mining of E-Customer Behavior Using Pixel Bar Charts Ming C. Hao, Julian Ladisch*, Umeshwar Dayal, Meichun Hsu, Adrian Krug Hewlett Packard Research Laboratories, Palo Alto, CA. (ming_hao, dayal)@hpl.hp.com;

### Introduction to Machine Learning Connectionist and Statistical Language Processing

Introduction to Machine Learning Connectionist and Statistical Language Processing Frank Keller keller@coli.uni-sb.de Computerlinguistik Universität des Saarlandes Introduction to Machine Learning p.1/22

### Interactive Exploration of Decision Tree Results

Interactive Exploration of Decision Tree Results 1 IRISA Campus de Beaulieu F35042 Rennes Cedex, France (email: pnguyenk,amorin@irisa.fr) 2 INRIA Futurs L.R.I., University Paris-Sud F91405 ORSAY Cedex,

### Visualization Techniques in Data Mining

Tecniche di Apprendimento Automatico per Applicazioni di Data Mining Visualization Techniques in Data Mining Prof. Pier Luca Lanzi Laurea in Ingegneria Informatica Politecnico di Milano Polo di Milano

### Subject. Dataset. Induction of a decision tree using SIPINA. Data importation

Subject Interactive induction of decision trees with SIPINA. Various functionalities of SIPINA are not documented. In this tutorial, we show how to explore nodes of a decision tree, in order to obtain

### Learning from Data: Decision Trees

Learning from Data: Decision Trees Amos Storkey, School of Informatics University of Edinburgh Semester 1, 2004 LfD 2004 Decision Tree Learning - Overview Decision tree representation ID3 learning algorithm

### Overview. Introduction to Machine Learning. Definition of Learning. A Sample Data Set. Connectionist and Statistical Language Processing

Overview Introduction to Machine Learning Connectionist and Statistical Language Processing Frank Keller keller@coli.uni-sb.de Computerlinguistik Universität des Saarlandes definition of learning sample

### Social Media Mining. Data Mining Essentials

Introduction Data production rate has been increased dramatically (Big Data) and we are able store much more data than before E.g., purchase data, social media data, mobile phone data Businesses and customers

### Microsoft Excel Tutorial

Microsoft Excel Tutorial Contents Starting MS Excel... 2 The MS Excel Window... 3 Title Bar...3 Office Button...4 Saving Your Work... 4 For the first time... 4 While you work... 4 Backing up your work...

### Merging Labels, Letters, and Envelopes Word 2013

Merging Labels, Letters, and Envelopes Word 2013 Merging... 1 Types of Merges... 1 The Merging Process... 2 Labels - A Page of the Same... 2 Labels - A Blank Page... 3 Creating Custom Labels... 3 Merged

### Data Mining: Foundation, Techniques and Applications

Data Mining: Foundation, Techniques and Applications Lesson 1b :A Quick Overview of Data Mining Li Cuiping( 李 翠 平 ) School of Information Renmin University of China Anthony Tung( 鄧 锦 浩 ) School of Computing

### Creating Reports in Access 2010

Creating Reports in Access 2010 Table of Contents INTRODUCTION TO REPORTS... 2 PARTS OF A REPORT... 3 UNDERSTAND CONTROLS... 3 CREATE A SIMPLE REPORT... 4 STEP 1: CHOOSE A RECORD SOURCE... 4 Different

### Data Mining with Weka

Data Mining with Weka Class 1 Lesson 1 Introduction Ian H. Witten Department of Computer Science University of Waikato New Zealand weka.waikato.ac.nz Data Mining with Weka a practical course on how to

### The Scientific Data Mining Process

Chapter 4 The Scientific Data Mining Process When I use a word, Humpty Dumpty said, in rather a scornful tone, it means just what I choose it to mean neither more nor less. Lewis Carroll [87, p. 214] In

### Knowledge Discovery and Data Mining

Knowledge Discovery and Data Mining Unit # 6 Sajjad Haider Fall 2014 1 Evaluating the Accuracy of a Classifier Holdout, random subsampling, crossvalidation, and the bootstrap are common techniques for

### Integration of Cluster Analysis and Visualization Techniques for Visual Data Analysis

Integration of Cluster Analysis and Visualization Techniques for Visual Data Analysis M. Kreuseler, T. Nocke, H. Schumann, Institute of Computer Graphics University of Rostock, D-18059 Rostock, Germany

### Clustering & Visualization

Chapter 5 Clustering & Visualization Clustering in high-dimensional databases is an important problem and there are a number of different clustering paradigms which are applicable to high-dimensional data.

### Customer Classification And Prediction Based On Data Mining Technique

Customer Classification And Prediction Based On Data Mining Technique Ms. Neethu Baby 1, Mrs. Priyanka L.T 2 1 M.E CSE, Sri Shakthi Institute of Engineering and Technology, Coimbatore 2 Assistant Professor

### Chapter 10 Improving Decision Making and Managing Knowledge

1 Chapter 10 Improving Decision Making and Managing Knowledge LEARNING TRACK 1: BUILDING AND USING PIVOT TABLES Spreadsheet software is useful for helping managers detect and understand patterns in data.

### MARiO: Multi Attribute Routing in Open Street Map

MARiO: Multi Attribute Routing in Open Street Map Franz Graf Matthias Renz Hans-Peter Kriegel Matthias Schubert Institute for Informatics, Ludwig-Maximilians-Universität München, Oettingenstr. 67, D-80538

### Word 2007 Layout Tools

Word 2007 Layout Tools Contents Section Breaks and Chapters... 1 Section breaks to vary the header or footer... 2 Same header or footer across section boundaries... 2 Page Setup... 3 Change or set page

### Excel Lesson 1: Microsoft Excel Basics

Excel Lesson 1: Microsoft Excel Basics 1. Active cell: The cell in the worksheet in which you can type data. 2. Active worksheet: The worksheet that is displayed in the work area. 3. Adjacent range: All

### Visualization methods for patent data

Visualization methods for patent data Treparel 2013 Dr. Anton Heijs (CTO & Founder) Delft, The Netherlands Introduction Treparel can provide advanced visualizations for patent data. This document describes

### SUPERVISED CLASSIFICATION USING ARCGIS 10

SUPERVISED CLASSIFICATION USING ARCGIS 10 Image classification refers to the task of extracting information classes from a multiband raster image. The resulting raster from image classification can be

### A Web-based Interactive Data Visualization System for Outlier Subspace Analysis

A Web-based Interactive Data Visualization System for Outlier Subspace Analysis Dong Liu, Qigang Gao Computer Science Dalhousie University Halifax, NS, B3H 1W5 Canada dongl@cs.dal.ca qggao@cs.dal.ca Hai

### Intellect Platform - The Workflow Engine Basic HelpDesk Troubleticket System - A102

Intellect Platform - The Workflow Engine Basic HelpDesk Troubleticket System - A102 Interneer, Inc. Updated on 2/22/2012 Created by Erika Keresztyen Fahey 2 Workflow - A102 - Basic HelpDesk Ticketing System

### HOW TO... Use Excel. Overview

Page 1 of 9 Overview Excel is a spreadsheet application in the Microsoft Office suite. Excel can be used to create and format workbooks in order to analyze data, write formulas, calculations, and charts

### Working with Excel Tables, PivotTables, and PivotCharts

Excel Tutorial 5 Working with Excel Tables, PivotTables, and PivotCharts Objectives Explore a structured range of data Freeze rows and columns Plan and create an Excel table Rename and format an Excel

### How to Build a Classification Model in CART: A Tutorial

: A Tutorial This tutorial will teach you everything you need to know to build your first classification model using CART (Classification and Regression Trees). CART is the ultimate classification tree

### QuickBooks Fixed Asset Manager. User s Guide for Tax Year 20

QuickBooks Fixed Asset Manager User s Guide for Tax Year 20 20 Intuit Inc. All rights reserved. Intuit, the Intuit logo, QuickBooks, QuickBooks Pro, and QuickZoom, among others, are registered trademarks

### Big Data: Rethinking Text Visualization

Big Data: Rethinking Text Visualization Dr. Anton Heijs anton.heijs@treparel.com Treparel April 8, 2013 Abstract In this white paper we discuss text visualization approaches and how these are important

### Handout: Access 2010: Creating Forms

Access 2010: Creating Forms Table of Contents INTRODUCTION TO FORMS... 4 CREATE A FORM BY USING THE FORM TOOL... 4 CREATE A SPLIT FORM BY USING THE SPLIT FORM TOOL... 4 CREATE A FORM THAT DISPLAYS MULTIPLE

### Data Visualization. Prepared by Francisco Olivera, Ph.D., Srikanth Koka Department of Civil Engineering Texas A&M University February 2004

Data Visualization Prepared by Francisco Olivera, Ph.D., Srikanth Koka Department of Civil Engineering Texas A&M University February 2004 Contents Brief Overview of ArcMap Goals of the Exercise Computer

### Building a table in the SAS Web Report Studio

Building a table in the SAS Web Report Studio This section provides an example on how to run a query within the SAS Cube environment. The query will create a table of clients by Indigenous status, age

### MS Excel Tips and Tricks

Contents Sorting Data (primary sort)... 3 Sorting Data (primary and secondary sort)... 4 Filtering Data... 7 Fitting a Worksheet to a Page Width or Number of Pages... 11 Using Page Break Preview to Move

### Horizontal Aggregations in SQL to Prepare Data Sets for Data Mining Analysis

IOSR Journal of Computer Engineering (IOSRJCE) ISSN: 2278-0661, ISBN: 2278-8727 Volume 6, Issue 5 (Nov. - Dec. 2012), PP 36-41 Horizontal Aggregations in SQL to Prepare Data Sets for Data Mining Analysis

### Implementation of Data Mining Techniques to Perform Market Analysis

Implementation of Data Mining Techniques to Perform Market Analysis B.Sabitha 1, N.G.Bhuvaneswari Amma 2, G.Annapoorani 3, P.Balasubramanian 4 PG Scholar, Indian Institute of Information Technology, Srirangam,

### Knowledge Discovery and Data Mining. Structured vs. Non-Structured Data

Knowledge Discovery and Data Mining Unit # 2 1 Structured vs. Non-Structured Data Most business databases contain structured data consisting of well-defined fields with numeric or alphanumeric values.

### Visual Analytics of Large Multi-Dimensional Data Using Variable Binned Scatter Plots

Visual Analytics of Large Multi-Dimensional Data Using Variable Binned Scatter Plots Ming C. Hao, Umeshwar Dayal, Ratnesh K. Sharma Hewlett Packard Laboratories, Palo Alto, CA Daniel A. Keim, Halldór Janetzko

### International Journal of Computer Science Trends and Technology (IJCST) Volume 2 Issue 3, May-Jun 2014

RESEARCH ARTICLE OPEN ACCESS A Survey of Data Mining: Concepts with Applications and its Future Scope Dr. Zubair Khan 1, Ashish Kumar 2, Sunny Kumar 3 M.Tech Research Scholar 2. Department of Computer

### Data Mining and Knowledge Discovery in Databases (KDD) State of the Art. Prof. Dr. T. Nouri Computer Science Department FHNW Switzerland

Data Mining and Knowledge Discovery in Databases (KDD) State of the Art Prof. Dr. T. Nouri Computer Science Department FHNW Switzerland 1 Conference overview 1. Overview of KDD and data mining 2. Data

### Data Mining of Web Access Logs

Data Mining of Web Access Logs A minor thesis submitted in partial fulfilment of the requirements for the degree of Master of Applied Science in Information Technology Anand S. Lalani School of Computer

### Data Mining Algorithms Part 1. Dejan Sarka

Data Mining Algorithms Part 1 Dejan Sarka Join the conversation on Twitter: @DevWeek #DW2015 Instructor Bio Dejan Sarka (dsarka@solidq.com) 30 years of experience SQL Server MVP, MCT, 13 books 7+ courses

### NCSS Statistical Software

Chapter 148 Introduction Bar charts are used to visually compare values to each other. This chapter gives a brief overview and examples of simple 3D bar charts and two-factor 3D bar charts. Below is an

### CHAPTER 3 DATA MINING AND CLUSTERING

CHAPTER 3 DATA MINING AND CLUSTERING 3.1 Introduction Nowadays, large quantities of data are being accumulated. The amount of data collected is said to be almost doubled every 9 months. Seeking knowledge

### AMPLIO VQA A Web Based Visual Query Analysis System for Micro Grid Energy Mix Planning

International Workshop on Visual Analytics (2012) K. Matkovic and G. Santucci (Editors) AMPLIO VQA A Web Based Visual Query Analysis System for Micro Grid Energy Mix Planning A. Stoffel 1 and L. Zhang

### Product Documentation SAP Business ByDesign Analytics

Product Documentation PUBLIC Analytics Table Of Contents 1 Analytics.... 5 2 Business Background... 6 2.1 Overview of Analytics... 6 2.2 Overview of Reports in SAP Business ByDesign... 9 2.3 Reports View...

### Abstract. Introduction

CODATA Prague Workshop Information Visualization, Presentation, and Design 29-31 March 2004 Abstract Goals of Analysis for Visualization and Visual Data Mining Tasks Thomas Nocke and Heidrun Schumann University

### This chapter reviews On-line Analytical Processing (OLAP) in Section 2.1 and data cubes in Section 2.2.

OLAP and Data Cubes This chapter reviews On-line Analytical Processing (OLAP) in Section 2.1 and data cubes in Section 2.2. 2.1 OLAP Coined by Codd et. a1 [18] in 1993, OLAP stands for On-Line Analytical

### OCR Cambridge Nationals in ICT

OCR Cambridge Nationals in ICT Unit R003 Handling Data Using Spreadsheets Microsoft Excel 2010 OCR Cambridge Nationals in ICT Introduction CiA Training Ltd 2013 iii Introduction OCR Cambridge Nationals

### PaintingClass: Interactive Construction, Visualization and Exploration of Decision Trees

PaintingClass: Interactive Construction, Visualization and Exploration of Decision Trees Soon Tee Teoh Department of Computer Science University of California, Davis teoh@cs.ucdavis.edu Kwan-Liu Ma Department

### Data Mining. Practical Machine Learning Tools and Techniques. Classification, association, clustering, numeric prediction

Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 2 of Data Mining by I. H. Witten and E. Frank Input: Concepts, instances, attributes Terminology What s a concept? Classification,

### Robust Outlier Detection Technique in Data Mining: A Univariate Approach

Robust Outlier Detection Technique in Data Mining: A Univariate Approach Singh Vijendra and Pathak Shivani Faculty of Engineering and Technology Mody Institute of Technology and Science Lakshmangarh, Sikar,

Basic Data Analysis Using JMP in Windows Table of Contents: I. Getting Started with JMP II. Entering Data in JMP III. Saving JMP Data file IV. Opening an Existing Data File V. Transforming and Manipulating

### Knowledge-based systems and the need for learning

Knowledge-based systems and the need for learning The implementation of a knowledge-based system can be quite difficult. Furthermore, the process of reasoning with that knowledge can be quite slow. This

### Asset Track Getting Started Guide. An Introduction to Asset Track

Asset Track Getting Started Guide An Introduction to Asset Track Contents Introducing Asset Track... 3 Overview... 3 A Quick Start... 6 Quick Start Option 1... 6 Getting to Configuration... 7 Changing

### Attribute Data Input and Management

Attribute Data Input and Management Attribute data describe the characteristics of the map feature. Attribute data are stored in tables Each row of a table represents a map feature. Each column represents

### Analysis Tools in Geochemistry for ArcGIS

Analysis Tools in Geochemistry for ArcGIS The database that is used to store all of the geographic information in Geochemistry for ArcGIS is Esri s file Geodatabase (fgdb). This is a collection of tables

### How to Create Custom Name Badge Inserts with a Mail Merge in Microsoft Word 2010

Many people know that you can use the Mail Merge feature in Microsoft Word 2010 to easily create mailing labels, but did you know you can use it to quickly create custom name badge inserts? Here, you will

### Worksheets: Part 2. Class Length: 2 Hours. Objectives:

Worksheets: Part 2 Class Description: This class is an introductory course to the worksheet program, Microsoft Excel. You will learn how to create, edit, and format worksheets. The class will also look

### Decision Trees (Sections )

Decision Trees (Sections 8.1-8.4) Non-metric methods CART (Classification & regression Trees) Number of splits Query selection & node impurity Multiway splits When to stop splitting? Pruning Assignment

### Decision-Tree Learning

Decision-Tree Learning Introduction ID3 Attribute selection Entropy, Information, Information Gain Gain Ratio C4.5 Decision Trees TDIDT: Top-Down Induction of Decision Trees Numeric Values Missing Values

### Spreadsheet View and Basic Statistics Concepts

Spreadsheet View and Basic Statistics Concepts GeoGebra 3.2 Workshop Handout 9 Judith and Markus Hohenwarter www.geogebra.org Table of Contents 1. Introduction to GeoGebra s Spreadsheet View 2 2. Record

### Excel-PivotTables and Charts

Excel-PivotTables and Charts rschmid February 23, 2010 0 What is a PivotTable? A. Description B. Structure C. Ribbon Creating a PivotTable Report A. Prepare Data Worksheet B. Create a basic PivotTable

### Easy Data Discovery with Smart Data Transitions

Thought Leadership Easy Data Discovery with Smart Data Transitions Data Animations and Transitions What does your data communicate? Can you see the correlations and insights hiding in your data? Visual

### International Journal of Scientific & Engineering Research, Volume 4, Issue 5, May ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 5, May-213 737 Letter Recognition Data Using Neural Network Hussein Salim Qasim Abstract The letters dataset from the UCI repository

### Dr. Antony Selvadoss Thanamani, Head & Associate Professor, Department of Computer Science, NGM College, Pollachi, India.

Enhanced Approach on Web Page Classification Using Machine Learning Technique S.Gowri Shanthi Research Scholar, Department of Computer Science, NGM College, Pollachi, India. Dr. Antony Selvadoss Thanamani,

### Dataset Preparation and Indexing for Data Mining Analysis Using Horizontal Aggregations

Dataset Preparation and Indexing for Data Mining Analysis Using Horizontal Aggregations Binomol George, Ambily Balaram Abstract To analyze data efficiently, data mining systems are widely using datasets

### Excel Using Pivot Tables

Overview A PivotTable report is an interactive table that allows you to quickly group and summarise information from a data source. You can rearrange (or pivot) the table to display different perspectives

### Title Page. Cooperative Classification: A Visualization-Based Approach of Combining the Strengths of the User and the Computer

Title Page Cooperative Classification: A Visualization-Based Approach of Combining the Strengths of the User and the Computer Contact Information Martin Ester, Institute for Computer Science, University

### Using the ALV Grid in SAP Reports

Using the ALV Grid in SAP Reports After a report has been generated, there are many options available for customizing the data within the ALV grid. The sections below give more information for using the

### Data Mining Practical Machine Learning Tools and Techniques

Data ining Practical achine Learning Tools and Techniques Slides for Chapter 2 of Data ining by I. H. Witten and E. rank Outline Terminology What s a concept Classification, association, clustering, numeric

### Excel Lesson 1 Excel Basics

Excel Lesson 1 Excel Basics Microsoft Office 2007: Introductory t 1 Objectives Define the terms spreadsheet and worksheet. Identify the parts of a worksheet. Open an existing workbook. Save a workbook.

### Microsoft Office Excel 2013

Microsoft Office Excel 2013 Navigating the Excel Interface The Components of the Excel 2013 Interface Component Quick Access Toolbar The ribbon Ribbon tabs Task pane Formula Bar Status bar Description

### Data Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining

Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan, Steinbach, Kumar Tan,Steinbach, Kumar Introduction to Data Mining 8/05/2005 1 What is data exploration? A preliminary

### Cluster Description Formats, Problems and Algorithms

Cluster Description Formats, Problems and Algorithms Byron J. Gao Martin Ester School of Computing Science, Simon Fraser University, Canada, V5A 1S6 bgao@cs.sfu.ca ester@cs.sfu.ca Abstract Clustering is

### Excel Charts and Graphs 2013

Excel Charts and Graphs 2013 Copyright 2014, Software Application Training, West Chester University. A member of the Pennsylvania State Systems of Higher Education. No portion of this document may be reproduced

### A Two-Step Method for Clustering Mixed Categroical and Numeric Data

Tamkang Journal of Science and Engineering, Vol. 13, No. 1, pp. 11 19 (2010) 11 A Two-Step Method for Clustering Mixed Categroical and Numeric Data Ming-Yi Shih*, Jar-Wen Jheng and Lien-Fu Lai Department

### Automatic Web Page Classification

Automatic Web Page Classification Yasser Ganjisaffar 84802416 yganjisa@uci.edu 1 Introduction To facilitate user browsing of Web, some websites such as Yahoo! (http://dir.yahoo.com) and Open Directory

### Drawing a histogram using Excel

Drawing a histogram using Excel STEP 1: Examine the data to decide how many class intervals you need and what the class boundaries should be. (In an assignment you may be told what class boundaries to

### STATISTICA. Financial Institutions. Case Study: Credit Scoring. and

Financial Institutions and STATISTICA Case Study: Credit Scoring STATISTICA Solutions for Business Intelligence, Data Mining, Quality Control, and Web-based Analytics Table of Contents INTRODUCTION: WHAT

### Classification and Prediction

Classification and Prediction Slides for Data Mining: Concepts and Techniques Chapter 7 Jiawei Han and Micheline Kamber Intelligent Database Systems Research Lab School of Computing Science Simon Fraser

### Horizontal Aggregations In SQL To Generate Data Sets For Data Mining Analysis In An Optimized Manner

24 Horizontal Aggregations In SQL To Generate Data Sets For Data Mining Analysis In An Optimized Manner Rekha S. Nyaykhor M. Tech, Dept. Of CSE, Priyadarshini Bhagwati College of Engineering, Nagpur, India

### Converting Dimensions to Measures & Changing Data Types

1 Converting Dimensions to Measures & Changing Data Types When it connects to a data source, Tableau takes a best guess at the type of data contained in each column of your database. Tableau assigns a

### Excel Database Management

How to use AutoFill Whether you just want to copy the same value down or need to get a series of numbers or text values, fill handle in Excel is the feature to help. It's an irreplaceable part of the AutoFill

### Microsoft Excel 2010 Part 3: Advanced Excel

CALIFORNIA STATE UNIVERSITY, LOS ANGELES INFORMATION TECHNOLOGY SERVICES Microsoft Excel 2010 Part 3: Advanced Excel Winter 2015, Version 1.0 Table of Contents Introduction...2 Sorting Data...2 Sorting

### Excel 2007 - Using Pivot Tables

Overview A PivotTable report is an interactive table that allows you to quickly group and summarise information from a data source. You can rearrange (or pivot) the table to display different perspectives

### Metadata Import Plugin User manual

Metadata Import Plugin User manual User manual for Metadata Import Plugin 1.0 Windows, Mac OS X and Linux August 30, 2013 This software is for research purposes only. CLC bio Silkeborgvej 2 Prismet DK-8000

### Training Exercise for Microsoft Excel- Version 2007 PIVOT TABLES

Training Exercise for Microsoft Excel- Version 2007 PIVOT TABLES Prepared by Brenda Hartley, Omeresa Student Services (Some screen shots and content have been borrowed from documentation for DASL retreat

### Statgraphics Getting started

Statgraphics Getting started The aim of this exercise is to introduce you to some of the basic features of the Statgraphics software. Starting Statgraphics 1. Log in to your PC, using the usual procedure

### Introduction to ArcView 3.2a

Introduction to ArcView 3.2a Training Center U.S. Geological Survey Center for Earth Resources Observation and Science (EROS) Sioux Falls, South Dakota, USA Introduction to ArcView 3.2a Introduction to

### Creating PivotTables in Excel 2010

Creating PivotTables in Excel 2010 Table of Contents OVERVIEW OF PIVOTTABLE AND PIVOTCHART REPORTS... 4 WHAT IS A PIVOTTABLE REPORT?... 4 Ways to work with a PivotTable report... 5 WHAT IS A PIVOTCHART

### Make Your Numbers Count Killer Charts in Three Easy Steps

Make Your Numbers Count Killer Charts in Three Easy Steps 9909 Mira Mesa Blvd. San Diego, CA 92131 Phone: 858-225-3374 Toll Free: 800-817-4271 Fax: 858-225-3390 www.smartdraw.com Making Numbers Come to

### Data Mining Practical Machine Learning Tools and Techniques

Some Core Learning Representations Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter of Data Mining by I. H. Witten and E. Frank Decision trees Learning Rules Association rules

### Variable Binned Scatter Plots

Variable Binned Scatter Plots Ming C. Hao, Umeshwar Dayal, Ratnesh K. Sharma Hewlett Packard Laboratories, Palo Alto, CA Daniel A. Keim, Halldór Janetzko University of Konstanz, Germany ABSTRACT The scatter