Data Mining in Direct Marketing with Purchasing Decisions Data.

Size: px
Start display at page:

Download "Data Mining in Direct Marketing with Purchasing Decisions Data."

Transcription

1 Data Mining in Direct Marketing with Purchasing Decisions Data. Randy Collica Sr. Business Analyst Database Mgmt. & Compaq Computer Corp. Database Mgmt. &

2 Overview! Business Problem to Solve.! Data Layout and Brief Definitions.! Data Preparation Methods.! Purchasing Decisions Model Building. " Three different models were built. " Final model uses data cleansing ensemble methods. " Comparison of data cleansing with typical ensemble methods.! Summary.! References and Q & A.! Acknowledgements. 2 Database Mgmt. &

3 Business Problem to Solve.! The problem of telemarketing or telesales calling a potential customer site only to find out that the business makes their purchasing decisions at the parent or headquarters office only!! Time has been wasted calling the wrong site and the caller either has to find out the parent site or skip over to the next business to call.! If the telemarketer already knew what site to call ahead of time, much time and dollars would be saved as well as increasing the opportunity rate 3 Database Mgmt. &

4 Business Problem to Solve.! A similar issue arises for direct mail campaigns. A direct mailer is sent to a site, however, that site does not make the final call on IT purchasing decisions.! Another example is when analyzing customer or prospect data for segmentation analysis. The local vs. parent decision levels is a very important component in segmentation. 4 Database Mgmt. &

5 Data Assay and Brief Definitions.! The data set being modeled contained about 170,000 records.! Other demographic data was appended from syndicated sources e.g. Dun & Bradstreet.! The data partition was set to 70% training and 30% for validation.! Definition of a business site in the original data set prior to demographic appending is slightly different from the Dun & Bradstreet definition of a business site. 5 Database Mgmt. &

6 Data Preparation Methods.! The data preparation methods were done in five basic stages. " First, data was extracted and needed to be cross referenced in order to facilitate merging with a syndicated source; e.g. adding D&B site duns numbers. " Second, the D&B site duns numbers were referenced and added to the data set and mismatches were noted. These steps were done outside of Enterprise Miner. 6 Database Mgmt. &

7 Data Preparation Methods. " Third, the D&B site duns numbers were now merged with the more complete D&B database. " Fourth, the data was placed read into Enterprise Miner. " Fifth, data was then surveyed.! The data survey is a rather important component in the data mining process [1]. " Using the data transformation node data on the number if site employees and corporate employees needed to be transformed. 7 Database Mgmt. &

8 Data Preparation Methods. Distribution of Site Employee Counts 8 Database Mgmt. &

9 Data Preparation Methods. Site Employee Count after bucket transformation 9 Database Mgmt. &

10 Data Preparation Methods.! Using the Input Data Source node, the view of basic frequency distributions of fields is very valuable.! The original data source has three levels in the target or response field. " Local " Parent " Missing! It was then thought best to try and keep the missing in the target data. This was then modified to not include missing values. 10 Database Mgmt. &

11 Purchasing Decisions Model Building.! Three Different Models were tried and built. 11 Database Mgmt. &

12 Purchasing Decisions Model Building.! The first modeling attempt used a fairly standard Decision Tree and a single layer 4 neuron Neural Network. This produced fair results with the Decision Tree but very poor results with the Neural Net.! The second attempt used a similar Decision Tree and also a Decision Tree with an Ensemble node. This was used in the Bagging mode with 10 iterations. See reference [2].! The third attempt uses a new technique called data cleansing or an Ensemble Filter[3]. These will now be explained. 12 Database Mgmt. &

13 Purchasing Decisions Model Building.! An Ensemble model (Bagging) vs.. typical classifier training. A sample of a single classifier on a data set. Original Training Set Training-set 1: 1,2,3,4,5,6,7,8, A sample of Boosting on the same data set. Resampled Training Set Training-set 1: 2,7,8,3,7,6,3,1 Training-set 2: 1,4,5,4,1,5,6,4 Training-set 3: 7,1,5,8,1,8,1,4 13 Database Mgmt. &

14 Purchasing Decisions Model Building.! Ensemble Filters combine the outputs of base- level classifiers and then take a vote to see which instances should be kept. Training Correctly Learning Instances ==> Filter ==> Labeled ==>Algorithm Instances! Instances which are not correctly labeled are then discarded from model training. 14 Database Mgmt. &

15 Purchasing Decisions Model Building.! How decisions on instances to be used in training are determined. " Once different models are fit from x number of sampling methods, one now has predictions of x models. " Two methods: Majority vote vs.. Consensus vote. " Majority Vote: Will tag an instance as mislabeled if more than half of the x classifier models classify it incorrectly. " Consensus Vote: Requires that all of the x classifier models must fail to classify correctly in order for that instance to be eliminated from training. 15 Database Mgmt. &

16 Purchasing Decisions Model Building. Majority Vote: Models from sample sets X X X X O O O O O O X X X X X X O O O O This instance agrees This instance out Consesus Vote: X X X X X X O O X X X X X X X X This instance agrees This instance out 16 Database Mgmt. &

17 Purchasing Decisions Model Building.! Some preliminary results on Purchasing Decisions Model. % Response 17 Database Mgmt. &

18 Purchasing Decisions Model Building. % Captured Response 18 Database Mgmt. &

19 Purchasing Decisions Model Building. Ensemble Model Results 19 Database Mgmt. &

20 Purchasing Decisions Model Building. Data Filtering Method Results 20 Database Mgmt. &

21 Summary! A Purchasing Decisions Model can be useful in Marketing and Campaign programs.! Both Customer and Prospect data analysis can be scored with this model and used in subsequent analysis such as segmentation.! Data Filtering can be used as an Ensemble method to discard instances which are misclassified.! More work on data filtering methods will be investigated for noisy data analysis. 21 Database Mgmt. &

22 References! [1] Pyle, Dorian, Data Preparation for Data Mining, Morgan Kaufman,, San Francisco, 1999.! [2] Brodley,, Carla E. and Friedl,, Mark A., Identifying Mislabeled Training Data, Jou.. of AI Research, vol.. 11, 1999, pp ! [3] Opitz,, David, and Maclin,, Richard, Popular Ensemble Methods: An Empirical Study, Jou.. of AI Research, vol.. 11, 1999, pp Database Mgmt. &

23 Acknowledgements! I would like to thank my cohort who worked on the data cleansing method and implementation in SAS Enterprise Miner.! I would also like to thank Mr.. Scott Berg and Victor Howard for encouraging me to submit this work.! Mr.. William Sommerfeld and Janice Shineman for inviting me to present this work at SUGI25.! Lastly, I would like to thank my supervisor, Mr. Gary Alen who always gives continued support in this area. 23 Database Mgmt. &

24

Data Mining. Nonlinear Classification

Data Mining. Nonlinear Classification Data Mining Unit # 6 Sajjad Haider Fall 2014 1 Nonlinear Classification Classes may not be separable by a linear boundary Suppose we randomly generate a data set as follows: X has range between 0 to 15

More information

Data Mining Practical Machine Learning Tools and Techniques

Data Mining Practical Machine Learning Tools and Techniques Ensemble learning Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 8 of Data Mining by I. H. Witten, E. Frank and M. A. Hall Combining multiple models Bagging The basic idea

More information

Introduction to Machine Learning and Data Mining. Prof. Dr. Igor Trajkovski trajkovski@nyus.edu.mk

Introduction to Machine Learning and Data Mining. Prof. Dr. Igor Trajkovski trajkovski@nyus.edu.mk Introduction to Machine Learning and Data Mining Prof. Dr. Igor Trajkovski trajkovski@nyus.edu.mk Ensembles 2 Learning Ensembles Learn multiple alternative definitions of a concept using different training

More information

Knowledge Discovery and Data Mining

Knowledge Discovery and Data Mining Knowledge Discovery and Data Mining Unit # 11 Sajjad Haider Fall 2013 1 Supervised Learning Process Data Collection/Preparation Data Cleaning Discretization Supervised/Unuspervised Identification of right

More information

Use Data Mining Techniques to Assist Institutions in Achieving Enrollment Goals: A Case Study

Use Data Mining Techniques to Assist Institutions in Achieving Enrollment Goals: A Case Study Use Data Mining Techniques to Assist Institutions in Achieving Enrollment Goals: A Case Study Tongshan Chang The University of California Office of the President CAIR Conference in Pasadena 11/13/2008

More information

CI6227: Data Mining. Lesson 11b: Ensemble Learning. Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore.

CI6227: Data Mining. Lesson 11b: Ensemble Learning. Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore. CI6227: Data Mining Lesson 11b: Ensemble Learning Sinno Jialin PAN Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore Acknowledgements: slides are adapted from the lecture notes

More information

Application of SAS! Enterprise Miner in Credit Risk Analytics. Presented by Minakshi Srivastava, VP, Bank of America

Application of SAS! Enterprise Miner in Credit Risk Analytics. Presented by Minakshi Srivastava, VP, Bank of America Application of SAS! Enterprise Miner in Credit Risk Analytics Presented by Minakshi Srivastava, VP, Bank of America 1 Table of Contents Credit Risk Analytics Overview Journey from DATA to DECISIONS Exploratory

More information

Leveraging Ensemble Models in SAS Enterprise Miner

Leveraging Ensemble Models in SAS Enterprise Miner ABSTRACT Paper SAS133-2014 Leveraging Ensemble Models in SAS Enterprise Miner Miguel Maldonado, Jared Dean, Wendy Czika, and Susan Haller SAS Institute Inc. Ensemble models combine two or more models to

More information

Application of Predictive Analytics to Higher Degree Research Course Completion Times

Application of Predictive Analytics to Higher Degree Research Course Completion Times Application of Predictive Analytics to Higher Degree Research Course Completion Times Application of Decision Theory to PhD Course Completions (2006 2013) Rachna 1 I Dhand, Senior Strategic Information

More information

Data Mining Algorithms Part 1. Dejan Sarka

Data Mining Algorithms Part 1. Dejan Sarka Data Mining Algorithms Part 1 Dejan Sarka Join the conversation on Twitter: @DevWeek #DW2015 Instructor Bio Dejan Sarka (dsarka@solidq.com) 30 years of experience SQL Server MVP, MCT, 13 books 7+ courses

More information

A.M. MAILING SERVICES, LLC ammailing.com. AccuModel SnapShot. An Introduction to Descriptive Profile Technology

A.M. MAILING SERVICES, LLC ammailing.com. AccuModel SnapShot. An Introduction to Descriptive Profile Technology AccuModel SnapShot An Introduction to Descriptive Profile Technology AccuData Corporation AccuData A client focused and responsive strategic partner to hundreds of direct marketing firms, printers and

More information

Using multiple models: Bagging, Boosting, Ensembles, Forests

Using multiple models: Bagging, Boosting, Ensembles, Forests Using multiple models: Bagging, Boosting, Ensembles, Forests Bagging Combining predictions from multiple models Different models obtained from bootstrap samples of training data Average predictions or

More information

Ensemble Methods. Knowledge Discovery and Data Mining 2 (VU) (707.004) Roman Kern. KTI, TU Graz 2015-03-05

Ensemble Methods. Knowledge Discovery and Data Mining 2 (VU) (707.004) Roman Kern. KTI, TU Graz 2015-03-05 Ensemble Methods Knowledge Discovery and Data Mining 2 (VU) (707004) Roman Kern KTI, TU Graz 2015-03-05 Roman Kern (KTI, TU Graz) Ensemble Methods 2015-03-05 1 / 38 Outline 1 Introduction 2 Classification

More information

Chapter 6. The stacking ensemble approach

Chapter 6. The stacking ensemble approach 82 This chapter proposes the stacking ensemble approach for combining different data mining classifiers to get better performance. Other combination techniques like voting, bagging etc are also described

More information

DECISION TREE INDUCTION FOR FINANCIAL FRAUD DETECTION USING ENSEMBLE LEARNING TECHNIQUES

DECISION TREE INDUCTION FOR FINANCIAL FRAUD DETECTION USING ENSEMBLE LEARNING TECHNIQUES DECISION TREE INDUCTION FOR FINANCIAL FRAUD DETECTION USING ENSEMBLE LEARNING TECHNIQUES Vijayalakshmi Mahanra Rao 1, Yashwant Prasad Singh 2 Multimedia University, Cyberjaya, MALAYSIA 1 lakshmi.mahanra@gmail.com

More information

Knowledge Discovery and Data Mining

Knowledge Discovery and Data Mining Knowledge Discovery and Data Mining Unit # 10 Sajjad Haider Fall 2012 1 Supervised Learning Process Data Collection/Preparation Data Cleaning Discretization Supervised/Unuspervised Identification of right

More information

not possible or was possible at a high cost for collecting the data.

not possible or was possible at a high cost for collecting the data. Data Mining and Knowledge Discovery Generating knowledge from data Knowledge Discovery Data Mining White Paper Organizations collect a vast amount of data in the process of carrying out their day-to-day

More information

Model Combination. 24 Novembre 2009

Model Combination. 24 Novembre 2009 Model Combination 24 Novembre 2009 Datamining 1 2009-2010 Plan 1 Principles of model combination 2 Resampling methods Bagging Random Forests Boosting 3 Hybrid methods Stacking Generic algorithm for mulistrategy

More information

BOOSTING - A METHOD FOR IMPROVING THE ACCURACY OF PREDICTIVE MODEL

BOOSTING - A METHOD FOR IMPROVING THE ACCURACY OF PREDICTIVE MODEL The Fifth International Conference on e-learning (elearning-2014), 22-23 September 2014, Belgrade, Serbia BOOSTING - A METHOD FOR IMPROVING THE ACCURACY OF PREDICTIVE MODEL SNJEŽANA MILINKOVIĆ University

More information

REVIEW OF ENSEMBLE CLASSIFICATION

REVIEW OF ENSEMBLE CLASSIFICATION Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320 088X IJCSMC, Vol. 2, Issue.

More information

CS570 Data Mining Classification: Ensemble Methods

CS570 Data Mining Classification: Ensemble Methods CS570 Data Mining Classification: Ensemble Methods Cengiz Günay Dept. Math & CS, Emory University Fall 2013 Some slides courtesy of Han-Kamber-Pei, Tan et al., and Li Xiong Günay (Emory) Classification:

More information

L25: Ensemble learning

L25: Ensemble learning L25: Ensemble learning Introduction Methods for constructing ensembles Combination strategies Stacked generalization Mixtures of experts Bagging Boosting CSCE 666 Pattern Analysis Ricardo Gutierrez-Osuna

More information

STATISTICA. Financial Institutions. Case Study: Credit Scoring. and

STATISTICA. Financial Institutions. Case Study: Credit Scoring. and Financial Institutions and STATISTICA Case Study: Credit Scoring STATISTICA Solutions for Business Intelligence, Data Mining, Quality Control, and Web-based Analytics Table of Contents INTRODUCTION: WHAT

More information

What is Data Mining? MS4424 Data Mining & Modelling. MS4424 Data Mining & Modelling. MS4424 Data Mining & Modelling. MS4424 Data Mining & Modelling

What is Data Mining? MS4424 Data Mining & Modelling. MS4424 Data Mining & Modelling. MS4424 Data Mining & Modelling. MS4424 Data Mining & Modelling MS4424 Data Mining & Modelling MS4424 Data Mining & Modelling Lecturer : Dr Iris Yeung Room No : P7509 Tel No : 2788 8566 Email : msiris@cityu.edu.hk 1 Aims To introduce the basic concepts of data mining

More information

Knowledge Discovery and Data Mining. Bootstrap review. Bagging Important Concepts. Notes. Lecture 19 - Bagging. Tom Kelsey. Notes

Knowledge Discovery and Data Mining. Bootstrap review. Bagging Important Concepts. Notes. Lecture 19 - Bagging. Tom Kelsey. Notes Knowledge Discovery and Data Mining Lecture 19 - Bagging Tom Kelsey School of Computer Science University of St Andrews http://tom.host.cs.st-andrews.ac.uk twk@st-andrews.ac.uk Tom Kelsey ID5059-19-B &

More information

Enhanced Boosted Trees Technique for Customer Churn Prediction Model

Enhanced Boosted Trees Technique for Customer Churn Prediction Model IOSR Journal of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vol. 04, Issue 03 (March. 2014), V5 PP 41-45 www.iosrjen.org Enhanced Boosted Trees Technique for Customer Churn Prediction

More information

Gerry Hobbs, Department of Statistics, West Virginia University

Gerry Hobbs, Department of Statistics, West Virginia University Decision Trees as a Predictive Modeling Method Gerry Hobbs, Department of Statistics, West Virginia University Abstract Predictive modeling has become an important area of interest in tasks such as credit

More information

Predictive Modeling of Titanic Survivors: a Learning Competition

Predictive Modeling of Titanic Survivors: a Learning Competition SAS Analytics Day Predictive Modeling of Titanic Survivors: a Learning Competition Linda Schumacher Problem Introduction On April 15, 1912, the RMS Titanic sank resulting in the loss of 1502 out of 2224

More information

Data Mining Applications in Fund Raising

Data Mining Applications in Fund Raising Data Mining Applications in Fund Raising Nafisseh Heiat Data mining tools make it possible to apply mathematical models to the historical data to manipulate and discover new information. In this study,

More information

EMPIRICAL STUDY ON SELECTION OF TEAM MEMBERS FOR SOFTWARE PROJECTS DATA MINING APPROACH

EMPIRICAL STUDY ON SELECTION OF TEAM MEMBERS FOR SOFTWARE PROJECTS DATA MINING APPROACH EMPIRICAL STUDY ON SELECTION OF TEAM MEMBERS FOR SOFTWARE PROJECTS DATA MINING APPROACH SANGITA GUPTA 1, SUMA. V. 2 1 Jain University, Bangalore 2 Dayanada Sagar Institute, Bangalore, India Abstract- One

More information

An Overview of Knowledge Discovery Database and Data mining Techniques

An Overview of Knowledge Discovery Database and Data mining Techniques An Overview of Knowledge Discovery Database and Data mining Techniques Priyadharsini.C 1, Dr. Antony Selvadoss Thanamani 2 M.Phil, Department of Computer Science, NGM College, Pollachi, Coimbatore, Tamilnadu,

More information

Welcome. Data Mining: Updates in Technologies. Xindong Wu. Colorado School of Mines Golden, Colorado 80401, USA

Welcome. Data Mining: Updates in Technologies. Xindong Wu. Colorado School of Mines Golden, Colorado 80401, USA Welcome Xindong Wu Data Mining: Updates in Technologies Dept of Math and Computer Science Colorado School of Mines Golden, Colorado 80401, USA Email: xwu@ mines.edu Home Page: http://kais.mines.edu/~xwu/

More information

In this presentation, you will be introduced to data mining and the relationship with meaningful use.

In this presentation, you will be introduced to data mining and the relationship with meaningful use. In this presentation, you will be introduced to data mining and the relationship with meaningful use. Data mining refers to the art and science of intelligent data analysis. It is the application of machine

More information

Data Mining + Business Intelligence. Integration, Design and Implementation

Data Mining + Business Intelligence. Integration, Design and Implementation Data Mining + Business Intelligence Integration, Design and Implementation ABOUT ME Vijay Kotu Data, Business, Technology, Statistics BUSINESS INTELLIGENCE - Result Making data accessible Wider distribution

More information

ON INTEGRATING UNSUPERVISED AND SUPERVISED CLASSIFICATION FOR CREDIT RISK EVALUATION

ON INTEGRATING UNSUPERVISED AND SUPERVISED CLASSIFICATION FOR CREDIT RISK EVALUATION ISSN 9 X INFORMATION TECHNOLOGY AND CONTROL, 00, Vol., No.A ON INTEGRATING UNSUPERVISED AND SUPERVISED CLASSIFICATION FOR CREDIT RISK EVALUATION Danuta Zakrzewska Institute of Computer Science, Technical

More information

Knowledge Discovery and Data Mining

Knowledge Discovery and Data Mining Knowledge Discovery and Data Mining Unit # 6 Sajjad Haider Fall 2014 1 Evaluating the Accuracy of a Classifier Holdout, random subsampling, crossvalidation, and the bootstrap are common techniques for

More information

Ensembles and PMML in KNIME

Ensembles and PMML in KNIME Ensembles and PMML in KNIME Alexander Fillbrunn 1, Iris Adä 1, Thomas R. Gabriel 2 and Michael R. Berthold 1,2 1 Department of Computer and Information Science Universität Konstanz Konstanz, Germany First.Last@Uni-Konstanz.De

More information

A STUDY OF DATA MINING ACTIVITIES FOR MARKET RESEARCH

A STUDY OF DATA MINING ACTIVITIES FOR MARKET RESEARCH 205 A STUDY OF DATA MINING ACTIVITIES FOR MARKET RESEARCH ABSTRACT MR. HEMANT KUMAR*; DR. SARMISTHA SARMA** *Assistant Professor, Department of Information Technology (IT), Institute of Innovation in Technology

More information

A Basic Guide to Modeling Techniques for All Direct Marketing Challenges

A Basic Guide to Modeling Techniques for All Direct Marketing Challenges A Basic Guide to Modeling Techniques for All Direct Marketing Challenges Allison Cornia Database Marketing Manager Microsoft Corporation C. Olivia Rud Executive Vice President Data Square, LLC Overview

More information

DATA MINING TECHNIQUES AND APPLICATIONS

DATA MINING TECHNIQUES AND APPLICATIONS DATA MINING TECHNIQUES AND APPLICATIONS Mrs. Bharati M. Ramageri, Lecturer Modern Institute of Information Technology and Research, Department of Computer Application, Yamunanagar, Nigdi Pune, Maharashtra,

More information

Predicting the Risk of Heart Attacks using Neural Network and Decision Tree

Predicting the Risk of Heart Attacks using Neural Network and Decision Tree Predicting the Risk of Heart Attacks using Neural Network and Decision Tree S.Florence 1, N.G.Bhuvaneswari Amma 2, G.Annapoorani 3, K.Malathi 4 PG Scholar, Indian Institute of Information Technology, Srirangam,

More information

How To Make A Credit Risk Model For A Bank Account

How To Make A Credit Risk Model For A Bank Account TRANSACTIONAL DATA MINING AT LLOYDS BANKING GROUP Csaba Főző csaba.fozo@lloydsbanking.com 15 October 2015 CONTENTS Introduction 04 Random Forest Methodology 06 Transactional Data Mining Project 17 Conclusions

More information

How to create an effective data management strategy

How to create an effective data management strategy How to create an effective data management strategy Companies today are storing more and more data, whether that s your key account contacts, existing customer information or potential prospects it s not

More information

Ensemble Data Mining Methods

Ensemble Data Mining Methods Ensemble Data Mining Methods Nikunj C. Oza, Ph.D., NASA Ames Research Center, USA INTRODUCTION Ensemble Data Mining Methods, also known as Committee Methods or Model Combiners, are machine learning methods

More information

A Study Of Bagging And Boosting Approaches To Develop Meta-Classifier

A Study Of Bagging And Boosting Approaches To Develop Meta-Classifier A Study Of Bagging And Boosting Approaches To Develop Meta-Classifier G.T. Prasanna Kumari Associate Professor, Dept of Computer Science and Engineering, Gokula Krishna College of Engg, Sullurpet-524121,

More information

Telemarketing. trust the Experts. professionals. focus growth sales results

Telemarketing. trust the Experts. professionals. focus growth sales results Telemarketing professionals trust the Experts focus growth sales results who we are We are the experts in lead generation and appointment setting to a variety of industries with a focus on the IT industry.

More information

Data Mining Techniques

Data Mining Techniques 15.564 Information Technology I Business Intelligence Outline Operational vs. Decision Support Systems What is Data Mining? Overview of Data Mining Techniques Overview of Data Mining Process Data Warehouses

More information

Potential Value of Data Mining for Customer Relationship Marketing in the Banking Industry

Potential Value of Data Mining for Customer Relationship Marketing in the Banking Industry Advances in Natural and Applied Sciences, 3(1): 73-78, 2009 ISSN 1995-0772 2009, American Eurasian Network for Scientific Information This is a refereed journal and all articles are professionally screened

More information

Fraud Detection for Online Retail using Random Forests

Fraud Detection for Online Retail using Random Forests Fraud Detection for Online Retail using Random Forests Eric Altendorf, Peter Brende, Josh Daniel, Laurent Lessard Abstract As online commerce becomes more common, fraud is an increasingly important concern.

More information

LVQ Plug-In Algorithm for SQL Server

LVQ Plug-In Algorithm for SQL Server LVQ Plug-In Algorithm for SQL Server Licínia Pedro Monteiro Instituto Superior Técnico licinia.monteiro@tagus.ist.utl.pt I. Executive Summary In this Resume we describe a new functionality implemented

More information

Improper Payment Detection in Department of Defense Financial Transactions 1

Improper Payment Detection in Department of Defense Financial Transactions 1 Improper Payment Detection in Department of Defense Financial Transactions 1 Dean Abbott Abbott Consulting San Diego, CA dean@abbottconsulting.com Haleh Vafaie, PhD. Federal Data Corporation Bethesda,

More information

Neural Networks and Support Vector Machines

Neural Networks and Support Vector Machines INF5390 - Kunstig intelligens Neural Networks and Support Vector Machines Roar Fjellheim INF5390-13 Neural Networks and SVM 1 Outline Neural networks Perceptrons Neural networks Support vector machines

More information

Sanjeev Kumar. contribute

Sanjeev Kumar. contribute RESEARCH ISSUES IN DATAA MINING Sanjeev Kumar I.A.S.R.I., Library Avenue, Pusa, New Delhi-110012 sanjeevk@iasri.res.in 1. Introduction The field of data mining and knowledgee discovery is emerging as a

More information

Critical Success Factors of. Presented by: Kathleen Maher, Email Product Manager, V12 Group

Critical Success Factors of. Presented by: Kathleen Maher, Email Product Manager, V12 Group Critical Success Factors of Email Acquisition Marketing Presented by: Kathleen Maher, Email Product Manager, V12 Group Introduction Choosing the right campaign deployment strategy Selecting the right target

More information

Université de Montpellier 2 Hugo Alatrista-Salas : hugo.alatrista-salas@teledetection.fr

Université de Montpellier 2 Hugo Alatrista-Salas : hugo.alatrista-salas@teledetection.fr Université de Montpellier 2 Hugo Alatrista-Salas : hugo.alatrista-salas@teledetection.fr WEKA Gallirallus Zeland) australis : Endemic bird (New Characteristics Waikato university Weka is a collection

More information

WHITEPAPER. Creating and Deploying Predictive Strategies that Drive Customer Value in Marketing, Sales and Risk

WHITEPAPER. Creating and Deploying Predictive Strategies that Drive Customer Value in Marketing, Sales and Risk WHITEPAPER Creating and Deploying Predictive Strategies that Drive Customer Value in Marketing, Sales and Risk Overview Angoss is helping its clients achieve significant revenue growth and measurable return

More information

Course Syllabus. Purposes of Course:

Course Syllabus. Purposes of Course: Course Syllabus Eco 5385.701 Predictive Analytics for Economists Summer 2014 TTh 6:00 8:50 pm and Sat. 12:00 2:50 pm First Day of Class: Tuesday, June 3 Last Day of Class: Tuesday, July 1 251 Maguire Building

More information

Data Mining - Evaluation of Classifiers

Data Mining - Evaluation of Classifiers Data Mining - Evaluation of Classifiers Lecturer: JERZY STEFANOWSKI Institute of Computing Sciences Poznan University of Technology Poznan, Poland Lecture 4 SE Master Course 2008/2009 revised for 2010

More information

PharmaSUG2011 Paper HS03

PharmaSUG2011 Paper HS03 PharmaSUG2011 Paper HS03 Using SAS Predictive Modeling to Investigate the Asthma s Patient Future Hospitalization Risk Yehia H. Khalil, University of Louisville, Louisville, KY, US ABSTRACT The focus of

More information

Dawn Broschard, EdD Senior Research Analyst Office of Retention and Graduation Success dbroscha@fiu.edu

Dawn Broschard, EdD Senior Research Analyst Office of Retention and Graduation Success dbroscha@fiu.edu Using Decision Trees to Analyze Students at Risk of Dropping Out in Their First Year of College Based on Data Gathered Prior to Attending Their First Semester Dawn Broschard, EdD Senior Research Analyst

More information

Successfully Implementing Predictive Analytics in Direct Marketing

Successfully Implementing Predictive Analytics in Direct Marketing Successfully Implementing Predictive Analytics in Direct Marketing John Blackwell and Tracy DeCanio, The Nature Conservancy, Arlington, VA ABSTRACT Successfully Implementing Predictive Analytics in Direct

More information

Roulette Sampling for Cost-Sensitive Learning

Roulette Sampling for Cost-Sensitive Learning Roulette Sampling for Cost-Sensitive Learning Victor S. Sheng and Charles X. Ling Department of Computer Science, University of Western Ontario, London, Ontario, Canada N6A 5B7 {ssheng,cling}@csd.uwo.ca

More information

Example 3: Predictive Data Mining and Deployment for a Continuous Output Variable

Example 3: Predictive Data Mining and Deployment for a Continuous Output Variable Página 1 de 6 Example 3: Predictive Data Mining and Deployment for a Continuous Output Variable STATISTICA Data Miner includes a complete deployment engine with various options for deploying solutions

More information

ISSN: 2321-7782 (Online) Volume 3, Issue 4, April 2015 International Journal of Advance Research in Computer Science and Management Studies

ISSN: 2321-7782 (Online) Volume 3, Issue 4, April 2015 International Journal of Advance Research in Computer Science and Management Studies ISSN: 2321-7782 (Online) Volume 3, Issue 4, April 2015 International Journal of Advance Research in Computer Science and Management Studies Research Article / Survey Paper / Case Study Available online

More information

Artificial Neural Network, Decision Tree and Statistical Techniques Applied for Designing and Developing E-mail Classifier

Artificial Neural Network, Decision Tree and Statistical Techniques Applied for Designing and Developing E-mail Classifier International Journal of Recent Technology and Engineering (IJRTE) ISSN: 2277-3878, Volume-1, Issue-6, January 2013 Artificial Neural Network, Decision Tree and Statistical Techniques Applied for Designing

More information

Predictive Dynamix Inc Turning Business Experience Into Better Decisions

Predictive Dynamix Inc Turning Business Experience Into Better Decisions Overview Geospatial Data Mining for Market Intelligence By Paul Duke, Predictive Dynamix, Inc. Copyright 2000-2001. All rights reserved. Today, there is a huge amount of information readily available describing

More information

Keywords Data mining, Classification Algorithm, Decision tree, J48, Random forest, Random tree, LMT, WEKA 3.7. Fig.1. Data mining techniques.

Keywords Data mining, Classification Algorithm, Decision tree, J48, Random forest, Random tree, LMT, WEKA 3.7. Fig.1. Data mining techniques. International Journal of Emerging Research in Management &Technology Research Article October 2015 Comparative Study of Various Decision Tree Classification Algorithm Using WEKA Purva Sewaiwar, Kamal Kant

More information

Towards better accuracy for Spam predictions

Towards better accuracy for Spam predictions Towards better accuracy for Spam predictions Chengyan Zhao Department of Computer Science University of Toronto Toronto, Ontario, Canada M5S 2E4 czhao@cs.toronto.edu Abstract Spam identification is crucial

More information

Data Mining Solutions for the Business Environment

Data Mining Solutions for the Business Environment Database Systems Journal vol. IV, no. 4/2013 21 Data Mining Solutions for the Business Environment Ruxandra PETRE University of Economic Studies, Bucharest, Romania ruxandra_stefania.petre@yahoo.com Over

More information

Ensembles of data-reduction-based classifiers for distributed learning from very large data sets

Ensembles of data-reduction-based classifiers for distributed learning from very large data sets Ensembles of data-reduction-based classifiers for distributed learning from very large data sets R. A. Mollineda, J. M. Sotoca, J. S. Sánchez Dept. de Lenguajes y Sistemas Informáticos Universidad Jaume

More information

III. DATA SETS. Training the Matching Model

III. DATA SETS. Training the Matching Model A Machine-Learning Approach to Discovering Company Home Pages Wojciech Gryc Oxford Internet Institute University of Oxford Oxford, UK OX1 3JS Email: wojciech.gryc@oii.ox.ac.uk Prem Melville IBM T.J. Watson

More information

Classification On The Clouds Using MapReduce

Classification On The Clouds Using MapReduce Classification On The Clouds Using MapReduce Simão Martins Instituto Superior Técnico Lisbon, Portugal simao.martins@tecnico.ulisboa.pt Cláudia Antunes Instituto Superior Técnico Lisbon, Portugal claudia.antunes@tecnico.ulisboa.pt

More information

Questions to Ask When Selecting Your Customer Data Platform

Questions to Ask When Selecting Your Customer Data Platform Questions to Ask When Selecting Your Customer Data Platform 730 Yale Avenue Swarthmore, PA 19081 www.raabassociatesinc.com info@raabassociatesinc.com Introduction Marketers know they need better data about

More information

The multilayer sentiment analysis model based on Random forest Wei Liu1, Jie Zhang2

The multilayer sentiment analysis model based on Random forest Wei Liu1, Jie Zhang2 2nd International Conference on Advances in Mechanical Engineering and Industrial Informatics (AMEII 2016) The multilayer sentiment analysis model based on Random forest Wei Liu1, Jie Zhang2 1 School of

More information

New Ensemble Combination Scheme

New Ensemble Combination Scheme New Ensemble Combination Scheme Namhyoung Kim, Youngdoo Son, and Jaewook Lee, Member, IEEE Abstract Recently many statistical learning techniques are successfully developed and used in several areas However,

More information

Experiments in Web Page Classification for Semantic Web

Experiments in Web Page Classification for Semantic Web Experiments in Web Page Classification for Semantic Web Asad Satti, Nick Cercone, Vlado Kešelj Faculty of Computer Science, Dalhousie University E-mail: {rashid,nick,vlado}@cs.dal.ca Abstract We address

More information

Data Mining from A to Z: Better Insights, New Opportunities WHITE PAPER

Data Mining from A to Z: Better Insights, New Opportunities WHITE PAPER Data Mining from A to Z: Better Insights, New Opportunities WHITE PAPER SAS White Paper Table of Contents Introduction.... 1 How Do Predictive Analytics and Data Mining Work?.... 2 The Data Mining Process....

More information

DIGITAL LIFT-OFF HOW TO INCREASE RESULTS THROUGH INTEGRATION HENRY BRAITHWAITE MARKET MAKERS

DIGITAL LIFT-OFF HOW TO INCREASE RESULTS THROUGH INTEGRATION HENRY BRAITHWAITE MARKET MAKERS DIGITAL LIFT-OFF HOW TO INCREASE RESULTS THROUGH INTEGRATION HENRY BRAITHWAITE MARKET MAKERS MARKET MAKERS Award winning Direct Marketing agency 100 Full Time B2B Telemarketers In house B2B telemarketing

More information

Data Mining for Fun and Profit

Data Mining for Fun and Profit Data Mining for Fun and Profit Data mining is the extraction of implicit, previously unknown, and potentially useful information from data. - Ian H. Witten, Data Mining: Practical Machine Learning Tools

More information

Operations Research and Knowledge Modeling in Data Mining

Operations Research and Knowledge Modeling in Data Mining Operations Research and Knowledge Modeling in Data Mining Masato KODA Graduate School of Systems and Information Engineering University of Tsukuba, Tsukuba Science City, Japan 305-8573 koda@sk.tsukuba.ac.jp

More information

Nine Common Types of Data Mining Techniques Used in Predictive Analytics

Nine Common Types of Data Mining Techniques Used in Predictive Analytics 1 Nine Common Types of Data Mining Techniques Used in Predictive Analytics By Laura Patterson, President, VisionEdge Marketing Predictive analytics enable you to develop mathematical models to help better

More information

Definitive Guide to Telemarketing helping you get maximum value from this business development resource

Definitive Guide to Telemarketing helping you get maximum value from this business development resource Definitive Guide to Telemarketing helping you get maximum value from this business development resource Introduction: Telemarketing/telesales (noun); the practice of marketing products and services by

More information

Customer Relationship Management using SAS Software. Julian Kulkarni, SAS Europe Joanna Crosse, SAS UK

Customer Relationship Management using SAS Software. Julian Kulkarni, SAS Europe Joanna Crosse, SAS UK Relationship using SAS Software Julian Kulkarni, SAS Europe Joanna Crosse, SAS UK Relationship The Growing Pains... Complete CRM Business Model The Cycle Applications The growing pains of Mrs I. Deer,

More information

Insurance Rate Making Using Data Mining

Insurance Rate Making Using Data Mining Insurance Rate Making Using Data Mining Bernd Drewes SAS EMEA or: Dollars from your Data Is Data Mining Important? Postbank N.V. 50% response on first mailing paid for DM investment US West Reducing customer

More information

Analytical CRM solution for Banking industry

Analytical CRM solution for Banking industry Analytical CRM solution for Banking industry Harbinger TechAxes PVT. LTD. 2005 Insights about What are the reasons and freq. for a customer contact? What are my product holding patterns? Which of my are

More information

Data Mining. 1 Introduction 2 Data Mining methods. Alfred Holl Data Mining 1

Data Mining. 1 Introduction 2 Data Mining methods. Alfred Holl Data Mining 1 Data Mining 1 Introduction 2 Data Mining methods Alfred Holl Data Mining 1 1 Introduction 1.1 Motivation 1.2 Goals and problems 1.3 Definitions 1.4 Roots 1.5 Data Mining process 1.6 Epistemological constraints

More information

DATA CLEANING TECHNIQUES FOR SOFTWARE ENGINEERING DATA SETS

DATA CLEANING TECHNIQUES FOR SOFTWARE ENGINEERING DATA SETS DATA CLEANING TECHNIQUES FOR SOFTWARE ENGINEERING DATA SETS A thesis submitted towards the degree of Doctor of Philosophy by GERNOT ARMIN LIEBCHEN School of Information Systems, Computing and Mathematics

More information

Financial Trading System using Combination of Textual and Numerical Data

Financial Trading System using Combination of Textual and Numerical Data Financial Trading System using Combination of Textual and Numerical Data Shital N. Dange Computer Science Department, Walchand Institute of Rajesh V. Argiddi Assistant Prof. Computer Science Department,

More information

MBA - INFORMATION TECHNOLOGY MANAGEMENT (MBAITM) Term-End Examination December, 2014 MBMI-012 : BUSINESS INTELLIGENCE SECTION I

MBA - INFORMATION TECHNOLOGY MANAGEMENT (MBAITM) Term-End Examination December, 2014 MBMI-012 : BUSINESS INTELLIGENCE SECTION I No. of Printed Pages : 8 I MBMI-012 I MBA - INFORMATION TECHNOLOGY MANAGEMENT (MBAITM) Term-End Examination December, 2014 Time : 3 hours Note : (i) (ii) (iii) (iv) (v) MBMI-012 : BUSINESS INTELLIGENCE

More information

Text Analytics using High Performance SAS Text Miner

Text Analytics using High Performance SAS Text Miner Text Analytics using High Performance SAS Text Miner Edward R. Jones, Ph.D. Exec. Vice Pres.; Texas A&M Statistical Services Abstract: The latest release of SAS Enterprise Miner, version 13.1, contains

More information

An Overview of Data Mining: Predictive Modeling for IR in the 21 st Century

An Overview of Data Mining: Predictive Modeling for IR in the 21 st Century An Overview of Data Mining: Predictive Modeling for IR in the 21 st Century Nora Galambos, PhD Senior Data Scientist Office of Institutional Research, Planning & Effectiveness Stony Brook University AIRPO

More information

APPLICATION PROGRAMMING: DATA MINING AND DATA WAREHOUSING

APPLICATION PROGRAMMING: DATA MINING AND DATA WAREHOUSING Wrocław University of Technology Internet Engineering Henryk Maciejewski APPLICATION PROGRAMMING: DATA MINING AND DATA WAREHOUSING PRACTICAL GUIDE Wrocław (2011) 1 Copyright by Wrocław University of Technology

More information

WebFOCUS RStat. RStat. Predict the Future and Make Effective Decisions Today. WebFOCUS RStat

WebFOCUS RStat. RStat. Predict the Future and Make Effective Decisions Today. WebFOCUS RStat Information Builders enables agile information solutions with business intelligence (BI) and integration technologies. WebFOCUS the most widely utilized business intelligence platform connects to any enterprise

More information

BY 35% DATA APPENDING SERVICES HELPED INCREASE SALES OPPORTUNITIES HOW OUR. Here s how our comprehensive data appending process led to:

BY 35% DATA APPENDING SERVICES HELPED INCREASE SALES OPPORTUNITIES HOW OUR. Here s how our comprehensive data appending process led to: HOW OUR DATA APPENDING SERVICES HELPED INCREASE SALES OPPORTUNITIES BY 35% Here s how our comprehensive data appending process led to: Increase in quality of the client database of 79,000 records in 7

More information

Business Intelligence (BI) Data Store Project Discussion / Draft Outline for Requirements Document

Business Intelligence (BI) Data Store Project Discussion / Draft Outline for Requirements Document Business Intelligence (BI) Data Store Project Discussion / Draft Outline for Requirements Document Approval Contacts Sign-off Copy Distribution (List of Names) Revision History Definitions (Organization

More information

IBM SPSS Direct Marketing

IBM SPSS Direct Marketing IBM Software IBM SPSS Statistics 19 IBM SPSS Direct Marketing Understand your customers and improve marketing campaigns Highlights With IBM SPSS Direct Marketing, you can: Understand your customers in

More information

Assessing Data Mining: The State of the Practice

Assessing Data Mining: The State of the Practice Assessing Data Mining: The State of the Practice 2003 Herbert A. Edelstein Two Crows Corporation 10500 Falls Road Potomac, Maryland 20854 www.twocrows.com (301) 983-3555 Objectives Separate myth from reality

More information

Graph Mining and Social Network Analysis

Graph Mining and Social Network Analysis Graph Mining and Social Network Analysis Data Mining and Text Mining (UIC 583 @ Politecnico di Milano) References Jiawei Han and Micheline Kamber, "Data Mining: Concepts and Techniques", The Morgan Kaufmann

More information

Data Mining Framework for Direct Marketing: A Case Study of Bank Marketing

Data Mining Framework for Direct Marketing: A Case Study of Bank Marketing www.ijcsi.org 198 Data Mining Framework for Direct Marketing: A Case Study of Bank Marketing Lilian Sing oei 1 and Jiayang Wang 2 1 School of Information Science and Engineering, Central South University

More information