# Overview of Factor Analysis

Size: px
Start display at page:

## Transcription

1 Overview of Factor Analysis Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box Tuscaloosa, AL Phone: (205) Fax: (205) August 1, 1998 If you wish to cite the contents of this document, the APA reference for them would be DeCoster, J. (1998). Overview of Factor Analysis. Retrieved <month, day, and year you downloaded this file> from For future versions of these notes or help with data analysis visit ALL RIGHTS TO THIS DOCUMENT ARE RESERVED.

2 Contents 1 Theoretical Introduction 1 2 Exploratory Factor Analysis 2 3 Confirmatory Factor Analysis 5 4 Combining Exploratory and Confirmatory Factor Analyses 7 i

3 Chapter 1 Theoretical Introduction Factor analysis is a collection of methods used to examine how underlying constructs influence the responses on a number of measured variables. There are basically two types of factor analysis: exploratory and confirmatory. Exploratory factor analysis (EFA) attempts to discover the nature of the constructs influencing a set of responses. Confirmatory factor analysis (CFA) tests whether a specified set of constructs is influencing responses in a predicted way. Both types of factor analyses are based on the Common Factor Model, illustrated in figure 1.1. This model proposes that each observed response (measure 1 through measure 5) is influenced partially by underlying common factors (factor 1 and factor 2) and partially by underlying unique factors (E1 through E5). The strength of the link between each factor and each measure varies, such that a given factor influences some measures more than others. This is the same basic model as is used for LISREL analyses. Measure 1 E1 Factor 1 Measure 2 E2 7 Measure 3 E3 Factor 2 Measure 4 E4 7 Measure 5 E5 Figure 1.1: The Common Factor Model. Factor analyses are performed by examining the pattern of correlations (or covariances) between the observed measures. Measures that are highly correlated (either positively or negatively) are likely influenced by the same factors, while those that are relatively uncorrelated are likely influenced by different factors. 1

4 Chapter 2 Exploratory Factor Analysis 2.1 Objectives The primary objectives of an EFA are to determine 1. The number of common factors influencing a set of measures. 2. The strength of the relationship between each factor and each observed measure. Some common uses of EFA are to Identify the nature of the constructs underlying responses in a specific content area. Determine what sets of items hang together in a questionnaire. Demonstrate the dimensionality of a measurement scale. Researchers often wish to develop scales that respond to a single characteristic. Determine what features are most important when classifying a group of items. Generate factor scores representing values of the underlying constructs for use in other analyses. 2.2 Performing EFA There are seven basic steps to performing an EFA: 1. Collect measurements. You need to measure your variables on the same (or matched) experimental units. 2. Obtain the correlation matrix. You need to obtain the correlations (or covariances) between each of your variables. 3. Select the number of factors for inclusion. Sometimes you have a specific hypothesis that will determine the number factors you will include, while other times you simply want your final model to account for as much of the covariance in your data with as few factors as possible. If you have k measures, then you can at most extract k factors. There are a number of methods to determine the optimal number of factors by examining your data. The Kaiser criterion states that you should use a number of factors equal to the number of the eigenvalues of the correlation matrix that are greater than one. The Scree test states that you should plot the eigenvalues of the correlation matrix in descending order, and then use a number of factors equal to the number of eigenvalues that occur prior to the last major drop in eigenvalue magnitude. 4. Extract your initial set of factors. You must submit your correlations or covariances into a computer program to extract your factors. This step is too complex to reasonably be done by hand. There are a number of different extraction methods, including maximum likelihood, principal component, and principal axis extraction. The best method is generally maximum likelihood extraction, unless you seriously lack multivariate normality in your measures. 2

6 Measure 1 7 Measure 2 Component 1 Measure 3 7 Measure 4 Component 2 Measure 5 Figure 2.1: The model for principal components analysis. 2.4 Miscellaneous notes on EFA To have acceptable reliability in your parameter estimates it is best to have data from at least 10 subjects for every measured variable in the model. This number should be increased if you expect that the influence of the common factors is relatively weak. You should also have measurements from at least three variables for every factor that you want to include in your model. You should endeavor to have a wide variety of measurements for your EFA. The more accurately that your selection of measurements properly represents the population of measurements that could be taken, the more generality you will have in your findings. The procedures used to measure the fit of a model in CFA (described below) can also be used to test the fit of an EFA model. These tests reject the null hypothesis when the model does not fit, so you must be cautious interpreting the results. Even a very accurate model will generate a significant lack of fit statistic if the sample size is large. EFA can be performed in SAS using proc factor. Principal component analysis can be performed in SAS using proc princomp, while it can be performed in SPSS using the Analyze/Data reduction/factor analysis menu selection. EFA cannot actually be performed in SPSS (despite the name of menu item used to perform PCA). You can, however, simply use component scores for the same purposes as you would typically use for EFA. 4

7 Chapter 3 Confirmatory Factor Analysis 3.1 Objectives The primary objective of a CFA is to determine the ability of a predefined factor model to fit an observed set of data. Some common uses of CFA are to Establish the validity of a single factor model. Compare the ability of two different models to account for the same set of data. Test the signficance of a specific factor loading. Test the relationship between two or more factor loadings. Test whether a set of factors are correlated or uncorrelated. Assess the convergent and discriminant validity of a set of measures. 3.2 Performing CFA There are six basic steps to performing an CFA: 1. Define the factor model. The first thing you need to do is to precisely define the model you wish to test. This involves selecting the number of factors, and defining the nature of the loadings between the factors and the measures. These loadings can be fixed at zero, fixed at another constant value, allowed to vary freely, or be allowed to vary under specified constraints (such as being equal to another loading in the model). 2. Collect measurements. You need to measure your variables on the same (or matched) experimental units. 3. Obtain the correlation matrix. You need to obtain the correlations (or covariances) between each of your variables. 4. Fit the model to the data. You will need to choose a method to obtain the estimates of factor loadings that were free to vary. The most common model-fitting procedure is Maximum likelihood estimation, which should probably be used unless your measures seriously lack multivariate normality. In this case you might wish to try using Asymptotically distribution free estimation. 5. Evaluate model adequacy. When the factor model is fit to the data, the factor loadings are chosen to minimize the discrepency between the correlation matrix implied by the model and the actual observed matrix. The amount of discrepency after the best parameters are chosen can be used as a measure of how consistent the model is with the data. 5

8 The most commonly used test of model adequacy is the χ 2 goodness-of-fit test. The null hypothesis for this test is that the model adequately accounts for the data, while the alternative is that there is a significant amount of discepency. Unfortunately, this test is highly sensitive to the size of your sample, such that tests involving large samples will generally lead to a rejection of the null hypothesis, even when the factor model is appropriate. Other statistics such as the Tucker-Lewis index, compare the fit of the proposed model to that of a null model. These statistics have been shown to be much less sensitive to sample size. 6. Compare with other models. If you want to compare two models, one of which is a reduced form of the other, you can just examine the difference between their χ 2 statistics, which will also have an approximately χ 2 distribution. Almost all tests of individual factor loadings can be made as comparisons of full and reduced factor models. In cases where you are not examining full and reduced models you can compare the Root mean square error of approximation (RMSEA), which is an estimate of discrepancy per degree of freedom in the model. 3.3 Miscellaneous notes on CFA CFA has strong links to structural equation modeling, a relatively nonstandard area of statistics. It is much more difficult to perform a CFA than it is to perform an EFA. A CFA requires a larger sample size than an EFA, basically because the CFA produces inferential statistics. The exact sample size necessary will vary heavily with the number of measures and factors in the model, but you can expect to require around 200 subjects for a standard model. As in EFA, you should have at least three measures for each factor in your model. Unlike EFA, however, you should choose measures that are strongly associated with the factors in your model (rather than those that would be a random sample of potential measures). CFA can be perfomed in SAS using proc calis, but cannot be performed in SPSS. However, SPSS does produce another software package called AMOS which will perform CFA. CFA are also commonly analyzed using LISREL. 6

9 Chapter 4 Combining Exploratory and Confirmatory Factor Analyses In general, you want to use EFA if you do not have strong theory about the constructs underlying responses to your measures and CFA if you do. It is reasonable to use an EFA to generate a theory about the constructs underlying your measures and then follow this up with a CFA, but this must be done using seperate data sets. You are merely fitting the data (and not testing theoretical constructs) if you directly put the results of an EFA directly into a CFA on the same data. An acceptable procedure is to perform an EFA on one half of your data, and then test the generality of the extracted factors with a CFA on the second half of the data. If you perform a CFA and get a significant lack of fit, it is perfectly acceptable to follow this up with an EFA to try to locate inconsistencies between the data and your model. However, you should test any modifications you decide to make to your model on new data. 7

10 References on Factor Analysis Hatcher, L. (1994). A step-by-step approach to using the SAS system for factor analysis and structural equation modeling. Cary, NC: SAS Institute Press. This is an excellent resource for information about how to perform both exploratory and confirmatory factor analysis. It does a good job explaining both theoretical and applied issues. Kim, J. O., & Mueller, C. W. (1978). Factor analysis: Statistical methods and practical issues. (Sage University Paper Series on Quantitative Applications n the Social Sciences, series no ). Newbury Park, CA: Sage. This manual details more advanced topics in factor analysis, such as the different extraction methods, rotation methods, and procedures for confirmatory factor analysis. Kim, J. O., & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. (Sage University Paper Series on Quantitative Applications n the Social Sciences, series no ). Newbury Park, CA: Sage. This manual provides an excellent overview to the theory behind factor analysis, including the common factor model. It also provides procedures for performing an exploratory factor analysis. Wegener, D. T., & Fabrigar, L. R. (in press). Analysis and design for nonexperimental data: Addressing causal and noncausal hypotheses. In R. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social psychology. London: Cambridge University Press. This book chapter provides an overview of several nonexperimental statistical methods, including confirmatory and exploratory factor analysis, structural equation modeling, multidimensional scaling, cluster analysis, and hierarchical linear modeling. 8

### Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA

PROC FACTOR: How to Interpret the Output of a Real-World Example Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA ABSTRACT THE METHOD This paper summarizes a real-world example of a factor

### Common factor analysis

Common factor analysis This is what people generally mean when they say "factor analysis" This family of techniques uses an estimate of common variance among the original variables to generate the factor

### A Brief Introduction to Factor Analysis

1. Introduction A Brief Introduction to Factor Analysis Factor analysis attempts to represent a set of observed variables X 1, X 2. X n in terms of a number of 'common' factors plus a factor which is unique

### 4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as:

1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data 2. Linearity (in the relationships among the variables--factors are linear constructions of the set of variables; the critical source

### T-test & factor analysis

Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue

### Applications of Structural Equation Modeling in Social Sciences Research

American International Journal of Contemporary Research Vol. 4 No. 1; January 2014 Applications of Structural Equation Modeling in Social Sciences Research Jackson de Carvalho, PhD Assistant Professor

### Exploratory Factor Analysis

Exploratory Factor Analysis ( 探 索 的 因 子 分 析 ) Yasuyo Sawaki Waseda University JLTA2011 Workshop Momoyama Gakuin University October 28, 2011 1 Today s schedule Part 1: EFA basics Introduction to factor

### Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 FA is not worth the time necessary to understand it and carry it out. -Hills, 1977 Factor analysis should not

### Introduction to Principal Components and FactorAnalysis

Introduction to Principal Components and FactorAnalysis Multivariate Analysis often starts out with data involving a substantial number of correlated variables. Principal Component Analysis (PCA) is a

### Practical Considerations for Using Exploratory Factor Analysis in Educational Research

A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

### Getting Started in Factor Analysis (using Stata 10) (ver. 1.5)

Getting Started in Factor Analysis (using Stata 10) (ver. 1.5) Oscar Torres-Reyna Data Consultant otorres@princeton.edu http://dss.princeton.edu/training/ Factor analysis is used mostly for data reduction

### PRINCIPAL COMPONENT ANALYSIS

1 Chapter 1 PRINCIPAL COMPONENT ANALYSIS Introduction: The Basics of Principal Component Analysis........................... 2 A Variable Reduction Procedure.......................................... 2

### Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models

Factor Analysis Principal components factor analysis Use of extracted factors in multivariate dependency models 2 KEY CONCEPTS ***** Factor Analysis Interdependency technique Assumptions of factor analysis

### SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

### How to report the percentage of explained common variance in exploratory factor analysis

UNIVERSITAT ROVIRA I VIRGILI How to report the percentage of explained common variance in exploratory factor analysis Tarragona 2013 Please reference this document as: Lorenzo-Seva, U. (2013). How to report

### Social Media Marketing Management 社 會 媒 體 行 銷 管 理 確 認 性 因 素 分 析. (Confirmatory Factor Analysis) 1002SMMM12 TLMXJ1A Tue 12,13,14 (19:20-22:10) D325

Social Media Marketing Management 社 會 媒 體 行 銷 管 理 確 認 性 因 素 分 析 (Confirmatory Factor Analysis) 1002SMMM12 TLMXJ1A Tue 12,13,14 (19:20-22:10) D325 Min-Yuh Day 戴 敏 育 Assistant Professor 專 任 助 理 教 授 Dept.

### FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables.

FACTOR ANALYSIS Introduction Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables Both methods differ from regression in that they don t have

### Using Principal Components Analysis in Program Evaluation: Some Practical Considerations

http://evaluation.wmich.edu/jmde/ Articles Using Principal Components Analysis in Program Evaluation: Some Practical Considerations J. Thomas Kellow Assistant Professor of Research and Statistics Mercer

### Factor Analysis and Structural equation modelling

Factor Analysis and Structural equation modelling Herman Adèr Previously: Department Clinical Epidemiology and Biostatistics, VU University medical center, Amsterdam Stavanger July 4 13, 2006 Herman Adèr

### Principal Component Analysis

Principal Component Analysis Principle Component Analysis: A statistical technique used to examine the interrelations among a set of variables in order to identify the underlying structure of those variables.

### 2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4

1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) 3. Univariate and multivariate

### Factor Analysis. Chapter 420. Introduction

Chapter 420 Introduction (FA) is an exploratory technique applied to a set of observed variables that seeks to find underlying factors (subsets of variables) from which the observed variables were generated.

### I n d i a n a U n i v e r s i t y U n i v e r s i t y I n f o r m a t i o n T e c h n o l o g y S e r v i c e s

I n d i a n a U n i v e r s i t y U n i v e r s i t y I n f o r m a t i o n T e c h n o l o g y S e r v i c e s Confirmatory Factor Analysis using Amos, LISREL, Mplus, SAS/STAT CALIS* Jeremy J. Albright

### Applied Multivariate Analysis

Neil H. Timm Applied Multivariate Analysis With 42 Figures Springer Contents Preface Acknowledgments List of Tables List of Figures vii ix xix xxiii 1 Introduction 1 1.1 Overview 1 1.2 Multivariate Models

### What is Rotating in Exploratory Factor Analysis?

A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

### A Brief Introduction to SPSS Factor Analysis

A Brief Introduction to SPSS Factor Analysis SPSS has a procedure that conducts exploratory factor analysis. Before launching into a step by step example of how to use this procedure, it is recommended

### CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C.

CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES From Exploratory Factor Analysis Ledyard R Tucker and Robert C MacCallum 1997 180 CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES In

### Topic 10: Factor Analysis

Topic 10: Factor Analysis Introduction Factor analysis is a statistical method used to describe variability among observed variables in terms of a potentially lower number of unobserved variables called

### Chapter 7 Factor Analysis SPSS

Chapter 7 Factor Analysis SPSS Factor analysis attempts to identify underlying variables, or factors, that explain the pattern of correlations within a set of observed variables. Factor analysis is often

### Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis

A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

### To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method.

Factor Analysis in SPSS To conduct a Factor Analysis, start from the Analyze menu. This procedure is intended to reduce the complexity in a set of data, so we choose Data Reduction from the menu. And the

### 5.2 Customers Types for Grocery Shopping Scenario

------------------------------------------------------------------------------------------------------- CHAPTER 5: RESULTS AND ANALYSIS -------------------------------------------------------------------------------------------------------

### Choosing the Right Type of Rotation in PCA and EFA James Dean Brown (University of Hawai i at Manoa)

Shiken: JALT Testing & Evaluation SIG Newsletter. 13 (3) November 2009 (p. 20-25) Statistics Corner Questions and answers about language testing statistics: Choosing the Right Type of Rotation in PCA and

### Factor Rotations in Factor Analyses.

Factor Rotations in Factor Analyses. Hervé Abdi 1 The University of Texas at Dallas Introduction The different methods of factor analysis first extract a set a factors from a data set. These factors are

### Data analysis process

Data analysis process Data collection and preparation Collect data Prepare codebook Set up structure of data Enter data Screen data for errors Exploration of data Descriptive Statistics Graphs Analysis

### EXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS. sigbert@wiwi.hu-berlin.de

EXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS Sigbert Klinke 1,2 Andrija Mihoci 1,3 and Wolfgang Härdle 1,3 1 School of Business and Economics, Humboldt-Universität zu Berlin, Germany 2 Department of

### Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis

Factor Analysis Overview Factor analysis is used to uncover the latent structure (dimensions) of a set of variables. It reduces attribute space from a larger number of variables to a smaller number of

: Table of Contents... 1 Overview of Model... 1 Dispersion... 2 Parameterization... 3 Sigma-Restricted Model... 3 Overparameterized Model... 4 Reference Coding... 4 Model Summary (Summary Tab)... 5 Summary

Factor Analysis Advanced Financial Accounting II Åbo Akademi School of Business Factor analysis A statistical method used to describe variability among observed variables in terms of fewer unobserved variables

### Exploratory Factor Analysis: rotation. Psychology 588: Covariance structure and factor models

Exploratory Factor Analysis: rotation Psychology 588: Covariance structure and factor models Rotational indeterminacy Given an initial (orthogonal) solution (i.e., Φ = I), there exist infinite pairs of

### RR765 Applied Multivariate Analysis

Semester: Fall 2007 RR765 Applied Multivariate Analysis Course Instructor: Dr. Jerry J. Vaske 491-2360 email: jerryv@cnr.colostate.edu Office: 244 Forestry Bldg. Office Hours: Tuesday/Thursdays 1:00 2:00

### FACTOR ANALYSIS NASC

FACTOR ANALYSIS NASC Factor Analysis A data reduction technique designed to represent a wide range of attributes on a smaller number of dimensions. Aim is to identify groups of variables which are relatively

### Mehtap Ergüven Abstract of Ph.D. Dissertation for the degree of PhD of Engineering in Informatics

INTERNATIONAL BLACK SEA UNIVERSITY COMPUTER TECHNOLOGIES AND ENGINEERING FACULTY ELABORATION OF AN ALGORITHM OF DETECTING TESTS DIMENSIONALITY Mehtap Ergüven Abstract of Ph.D. Dissertation for the degree

### Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk

Doi:10.5901/mjss.2014.v5n20p303 Abstract Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Wilbert Sibanda Philip D. Pretorius

### Factor analysis. Angela Montanari

Factor analysis Angela Montanari 1 Introduction Factor analysis is a statistical model that allows to explain the correlations between a large number of observed correlated variables through a small number

### Structural Equation Modelling (SEM)

(SEM) Aims and Objectives By the end of this seminar you should: Have a working knowledge of the principles behind causality. Understand the basic steps to building a Model of the phenomenon of interest.

### Exploratory Factor Analysis

Exploratory Factor Analysis Definition Exploratory factor analysis (EFA) is a procedure for learning the extent to which k observed variables might measure m abstract variables, wherein m is less than

### FEATURE. Abstract. Introduction. Background

FEATURE From Data to Information: Using Factor Analysis with Survey Data Ronald D. Fricker, Jr., Walter W. Kulzy, and Jeffrey A. Appleget, Naval Postgraduate School; rdfricker@nps.edu Abstract In irregular

### SEM Analysis of the Impact of Knowledge Management, Total Quality Management and Innovation on Organizational Performance

2015, TextRoad Publication ISSN: 2090-4274 Journal of Applied Environmental and Biological Sciences www.textroad.com SEM Analysis of the Impact of Knowledge Management, Total Quality Management and Innovation

### Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round \$200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

### Multivariate Normal Distribution

Multivariate Normal Distribution Lecture 4 July 21, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Lecture #4-7/21/2011 Slide 1 of 41 Last Time Matrices and vectors Eigenvalues

### Factorial Invariance in Student Ratings of Instruction

Factorial Invariance in Student Ratings of Instruction Isaac I. Bejar Educational Testing Service Kenneth O. Doyle University of Minnesota The factorial invariance of student ratings of instruction across

### Factor Analysis Using SPSS

Psychology 305 p. 1 Factor Analysis Using SPSS Overview For this computer assignment, you will conduct a series of principal factor analyses to examine the factor structure of a new instrument developed

### Indices of Model Fit STRUCTURAL EQUATION MODELING 2013

Indices of Model Fit STRUCTURAL EQUATION MODELING 2013 Indices of Model Fit A recommended minimal set of fit indices that should be reported and interpreted when reporting the results of SEM analyses:

### SAS Software to Fit the Generalized Linear Model

SAS Software to Fit the Generalized Linear Model Gordon Johnston, SAS Institute Inc., Cary, NC Abstract In recent years, the class of generalized linear models has gained popularity as a statistical modeling

### CHAPTER 4 EXAMPLES: EXPLORATORY FACTOR ANALYSIS

Examples: Exploratory Factor Analysis CHAPTER 4 EXAMPLES: EXPLORATORY FACTOR ANALYSIS Exploratory factor analysis (EFA) is used to determine the number of continuous latent variables that are needed to

### Multivariate Analysis (Slides 13)

Multivariate Analysis (Slides 13) The final topic we consider is Factor Analysis. A Factor Analysis is a mathematical approach for attempting to explain the correlation between a large set of variables

### Dimensionality Reduction: Principal Components Analysis

Dimensionality Reduction: Principal Components Analysis In data mining one often encounters situations where there are a large number of variables in the database. In such situations it is very likely

### DISCRIMINANT FUNCTION ANALYSIS (DA)

DISCRIMINANT FUNCTION ANALYSIS (DA) John Poulsen and Aaron French Key words: assumptions, further reading, computations, standardized coefficents, structure matrix, tests of signficance Introduction Discriminant

### SPSS and AMOS. Miss Brenda Lee 2:00p.m. 6:00p.m. 24 th July, 2015 The Open University of Hong Kong

Seminar on Quantitative Data Analysis: SPSS and AMOS Miss Brenda Lee 2:00p.m. 6:00p.m. 24 th July, 2015 The Open University of Hong Kong SBAS (Hong Kong) Ltd. All Rights Reserved. 1 Agenda MANOVA, Repeated

### An introduction to. Principal Component Analysis & Factor Analysis. Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co.

An introduction to Principal Component Analysis & Factor Analysis Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co.uk Monday, 23 April 2012 Acknowledgment: The original version

### Using R and the psych package to find ω

Using R and the psych package to find ω William Revelle Department of Psychology Northwestern University February 23, 2013 Contents 1 Overview of this and related documents 1 2 Install R and relevant packages

### Service courses for graduate students in degree programs other than the MS or PhD programs in Biostatistics.

Course Catalog In order to be assured that all prerequisites are met, students must acquire a permission number from the education coordinator prior to enrolling in any Biostatistics course. Courses are

### Chapter 6: Multivariate Cointegration Analysis

Chapter 6: Multivariate Cointegration Analysis 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie VI. Multivariate Cointegration

### NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates

### Factor Analysis. Sample StatFolio: factor analysis.sgp

STATGRAPHICS Rev. 1/10/005 Factor Analysis Summary The Factor Analysis procedure is designed to extract m common factors from a set of p quantitative variables X. In many situations, a small number of

### Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016

and Principal Components Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 Agenda Brief History and Introductory Example Factor Model Factor Equation Estimation of Loadings

### Questionnaire Evaluation with Factor Analysis and Cronbach s Alpha An Example

Questionnaire Evaluation with Factor Analysis and Cronbach s Alpha An Example - Melanie Hof - 1. Introduction The pleasure writers experience in writing considerably influences their motivation and consequently

### 9.2 User s Guide SAS/STAT. The FACTOR Procedure. (Book Excerpt) SAS Documentation

SAS/STAT 9.2 User s Guide The FACTOR Procedure (Book Excerpt) SAS Documentation This document is an individual chapter from SAS/STAT 9.2 User s Guide. The correct bibliographic citation for the complete

### Research Methodology: Tools

MSc Business Administration Research Methodology: Tools Applied Data Analysis (with SPSS) Lecture 02: Item Analysis / Scale Analysis / Factor Analysis February 2014 Prof. Dr. Jürg Schwarz Lic. phil. Heidi

### Rens van de Schoot a b, Peter Lugtig a & Joop Hox a a Department of Methods and Statistics, Utrecht

This article was downloaded by: [University Library Utrecht] On: 15 May 2012, At: 01:20 Publisher: Psychology Press Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office:

### " Y. Notation and Equations for Regression Lecture 11/4. Notation:

Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

### A revalidation of the SET37 questionnaire for student evaluations of teaching

Educational Studies Vol. 35, No. 5, December 2009, 547 552 A revalidation of the SET37 questionnaire for student evaluations of teaching Dimitri Mortelmans and Pieter Spooren* Faculty of Political and

### Principal Component Analysis

Principal Component Analysis ERS70D George Fernandez INTRODUCTION Analysis of multivariate data plays a key role in data analysis. Multivariate data consists of many different attributes or variables recorded

### Data Mining for Model Creation. Presentation by Paul Below, EDS 2500 NE Plunkett Lane Poulsbo, WA USA 98370 paul.below@eds.

Sept 03-23-05 22 2005 Data Mining for Model Creation Presentation by Paul Below, EDS 2500 NE Plunkett Lane Poulsbo, WA USA 98370 paul.below@eds.com page 1 Agenda Data Mining and Estimating Model Creation

### Confirmatory factor analysis in MPlus

Jan Štochl, Ph.D. Department of Psychiatry University of Cambridge Email: js883@cam.ac.uk Confirmatory factor analysis in MPlus The Psychometrics Centre Agenda of day 1 General ideas and introduction to

### Module 3: Correlation and Covariance

Using Statistical Data to Make Decisions Module 3: Correlation and Covariance Tom Ilvento Dr. Mugdim Pašiƒ University of Delaware Sarajevo Graduate School of Business O ften our interest in data analysis

### Validation of the Core Self-Evaluations Scale research instrument in the conditions of Slovak Republic

Validation of the Core Self-Evaluations Scale research instrument in the conditions of Slovak Republic Lenka Selecká, Jana Holienková Faculty of Arts, Department of psychology University of SS. Cyril and

### Data Mining and Data Warehousing. Henryk Maciejewski. Data Mining Predictive modelling: regression

Data Mining and Data Warehousing Henryk Maciejewski Data Mining Predictive modelling: regression Algorithms for Predictive Modelling Contents Regression Classification Auxiliary topics: Estimation of prediction

### Simple Linear Regression Inference

Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation

### Partial Least Squares (PLS) Regression.

Partial Least Squares (PLS) Regression. Hervé Abdi 1 The University of Texas at Dallas Introduction Pls regression is a recent technique that generalizes and combines features from principal component

### Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone:

### Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red)

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) The following DATA procedure is to read input data. This will create a SAS dataset named CORRMATR

### A Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis

Tutorials in Quantitative Methods for Psychology 2013, Vol. 9(2), p. 79-94. A Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis An Gie Yong and Sean Pearce University of Ottawa

### PARTIAL LEAST SQUARES IS TO LISREL AS PRINCIPAL COMPONENTS ANALYSIS IS TO COMMON FACTOR ANALYSIS. Wynne W. Chin University of Calgary, CANADA

PARTIAL LEAST SQUARES IS TO LISREL AS PRINCIPAL COMPONENTS ANALYSIS IS TO COMMON FACTOR ANALYSIS. Wynne W. Chin University of Calgary, CANADA ABSTRACT The decision of whether to use PLS instead of a covariance

### Correlational Research

Correlational Research Chapter Fifteen Correlational Research Chapter Fifteen Bring folder of readings The Nature of Correlational Research Correlational Research is also known as Associational Research.

### Data Analysis in Mixed Research: A Primer

Data Analysis in Mixed Research: A Primer Anthony J. Onwuegbuzie (Corresponding author) & Julie P. Combs Department of Educational Leadership and Counseling Sam Houston State University, USA Box 2119,

### Common factor analysis versus principal component analysis: a comparison of loadings by means of simulations

1 Common factor analysis versus principal component analysis: a comparison of loadings by means of simulations Joost C. F. de Winter, Dimitra Dodou Faculty of Mechanical, Maritime and Materials Engineering,

### Component Ordering in Independent Component Analysis Based on Data Power

Component Ordering in Independent Component Analysis Based on Data Power Anne Hendrikse Raymond Veldhuis University of Twente University of Twente Fac. EEMCS, Signals and Systems Group Fac. EEMCS, Signals

### The president of a Fortune 500 firm wants to measure the firm s image.

4. Factor Analysis A related method to the PCA is the Factor Analysis (FA) with the crucial difference that in FA a statistical model is constructed to explain the interrelations (correlations) between

### Factor Analysis. Factor Analysis

Factor Analysis Principal Components Analysis, e.g. of stock price movements, sometimes suggests that several variables may be responding to a small number of underlying forces. In the factor model, we

### Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use

: Suggestions on Use Background: Factor analysis requires several arbitrary decisions. The choices you make are the options that you must insert in the following SAS statements: PROC FACTOR METHOD=????

### Conducting Exploratory and Confirmatory Factor Analyses for Competency in Malaysia Logistics Companies

Conducting Exploratory and Confirmatory Factor Analyses for Competency in Malaysia Logistics Companies Dazmin Daud Faculty of Business and Information Science, UCSI University, Kuala Lumpur, MALAYSIA.

### 4.1 Exploratory Analysis: Once the data is collected and entered, the first question is: "What do the data look like?"

Data Analysis Plan The appropriate methods of data analysis are determined by your data types and variables of interest, the actual distribution of the variables, and the number of cases. Different analyses

### What Are Principal Components Analysis and Exploratory Factor Analysis?

Statistics Corner Questions and answers about language testing statistics: Principal components analysis and exploratory factor analysis Definitions, differences, and choices James Dean Brown University