Lecture 7: Factor Analysis. Laura McAvinue School of Psychology Trinity College Dublin

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Lecture 7: Factor Analysis. Laura McAvinue School of Psychology Trinity College Dublin"

Transcription

1 Lecture 7: Factor Analysis Laura McAvinue School of Psychology Trinity College Dublin

2 The Relationship between Variables Previous lectures Correlation Measure of strength of association between two variables Simple linear regression Describes the relationship between two variables by expressing one variable as a function of the other, enabling us to predict one variable on the basis of the other

3 The Relationship between Variables Multiple Regression Describes the relationship between several variables, expressing one variable as a function of several others, enabling us to predict this variable on the basis of the combination of the other variables Factor Analysis Also a tool used to investigate the relationship between several variables Investigates whether the pattern of correlations between a number of variables can be explained by any underlying dimensions, known as factors

4 Uses of Factor Analysis Test / questionnaire construction o For example, you wish to design an anxiety questionnaire o Create 50 items, which you think measure anxiety o Give your questionnaire to a large sample of people o Calculate correlations between the 50 items & run a factor analysis on the correlation matrix o If all 50 items are indeed measuring anxiety All correlations will be high One underlying factor, anxiety Verification of test / questionnaire structure o Hospital Anxiety & Depression Scale o Expect two factors, anxiety & depression

5 Uses of Factor Analysis Examining of the structure of a psychological construct What is attention? A single ability? Several different abilities? Some neuropsychological evidence for existence of different neural pathways for selective & sustained attention Administer tests measuring both aspects to large sample & run factor analysis One underlying factor? Two?

6 An example Visual Imagery Ability Two kinds of measure Self-report questionnaires v Objective tests Is self-reported imagery related to imagery measured by objective tests? Do tests and questionnaires measure the same thing?

7 How does it work? Correlation Matrix Analyses the pattern of correlations between variables in the correlation matrix Which variables tend to correlate highly together? If variables are highly correlated, likely that they represent the same underlying dimension Factor analysis pinpoints the clusters of high correlations between variables and for each cluster, it will assign a factor

8 Correlation Matrix Q1 Q2 Q3 Q4 Q5 Q6 Q1 1 Q Q Q Q Q Q1-3 correlate strongly with each other and hardly at all with 4-6 Q4-6 correlate strongly with each other and hardly at all with 1-3 Two factors!

9 Factor Analysis Two main things you want to know How many factors underlie the correlations between the variables? What do these factors represent? Which variables belong to which factors?

10 Steps of Factor Analysis 1. Suitability of the Dataset 2. Choosing the method of extraction 3. Choosing the number of factors to extract 4. Interpreting the factor solution

11 1. Suitability of Dataset Selection of Variables Sample Characteristics Statistical Considerations

12 Selection of Variables Are the variables meaningful? Factor analysis can be run on any dataset Garbage in, garbage out (Cooper, 2002) Psychometrics The field of measurement of psychological constructs Good measurement is crucial in Psychology Indicator approach Measurement is often indirect Can t measure depression directly, infer on the basis of an indicator, such as questionnaire Based on some theoretical / conceptual framework, what are these variables measuring?

13 Selection of Variables, Example Variables selected were measures of key aspects of imagery ability, according to theory Questionnaires (Richardson, 1994) Vividness Control Preference Objective Tests (Kosslyn, 1999) Generation Inspection Maintenance Transformation Visual STM

14 Sample Characteristics Size At least 100 participants Participant : Variable Ratio Estimates vary Minimum of 5 : 1, ideal of 10 : 1 Characteristics Representative of the population of interest? Contains different subgroups?

15 Sample Characteristics, Example Size 101 participants Participant : Variable Ratio 101 : : 1 Characteristics Interested in imagery ability of general adult population so took a mixed sample of males and females, varying widely in age, educational and employment backgrounds

16 Statistical Considerations Assumptions of factor analysis regarding data Continuous Normally distributed Linear relationships These properties affect the correlations between variables Independence of variables Variables should not be calculated from each other e.g. Item 4 = Item

17 Statistical Considerations Are there enough significant correlations (>.3) between the variables to merit factor analysis? Bartlett Test of Sphericity Tests H o that all correlations between variables = 0 If p <.05, reject H o and conclude there are significant correlations between variables so factor analysis is possible

18 Statistical Considerations Are there enough significant correlations (>.3) between the variables to merit factor analysis? Kaiser-Meyer-Olkin Measure of Sampling Adequacy Quantifies the degree of inter-correlations among variables Value from 0 1, 1 meaning that each variable is perfectly predicted by the others Closer to 1 the better If KMO >.6, conclude there is a sufficient number of correlations in the matrix to merit factor analysis

19 Statistical Considerations, Example All variables Continuous Normally Distributed Linear relationships Independent Enough correlations? Bartlett Test of Sphericity (_ 2 = ; df = 36; p <.001) KMO =.734

20 2. Choosing the method of extraction Two methods Factor Analysis Principal Components Analysis Differ in how they analyse the variance in the correlation matrix

21 Variable Specific Variance Error Variance Common Variance Variance unique to the variable itself Variance due to measurement error or some random, unknown source Variance that a variable shares with other variables in a matrix When searching for the factors underlying the relationships between a set of variables, we are interested in detecting and explaining the common variance

22 Principal Components Analysis Ignores the distinction between the different sources of variance Analyses total variance in the correlation matrix, assuming the components derived can explain all variance Result: Any component extracted will include a certain amount of error & specific variance V Factor Analysis Separates specific & error variance from common variance Attempts to estimate common variance and identify the factors underlying this Which to choose? Different opinions Theoretically, factor analysis is more sophisticated but statistical calculations are more complicated, often leading to impossible results Often, both techniques yield similar solutions

23 2. Choosing the method of extraction, Example Tried both Chose Principal Components Analysis as Factor Analysis proved impossible (estimated communalities > 1)

24 3. Choosing the number of factors to extract Statistical Modelling You can create many solutions using different numbers of factors An important decision Aim is to determine the smallest number of factors that adequately explain the variance in the matrix Too few factors Second-order factors Too many factors Factors that explain little variance & may be meaningless

25 Criteria for determining Extraction Theory / past experience Latent Root Criterion Scree Test Percentage of Variance Explained by the factors

26 Latent Root Criterion (Kaiser-Guttman) Eigenvalues Expression of the amount of variance in the matrix that is explained by the factor Factors with eigenvalues > 1 are extracted Limitations Sensitive to the number of variables in the matrix More variables eigenvalues inflated overestimation of number of underlying factors

27 Scree Test (Cattell, 1966) Scree Plot Based on the relative values of the eigenvalues Plot the eigenvalues of the factors Cut-off point The last component before the slope of the line becomes flat (before the scree)

28 3.5 Scree Plot Elbow in the graph Component Number Take the components above the elbow

29 Percentage of Variance Percentage of variance explained by the factors Convention Components should explain at least 60% of the variance in the matrix (Hair et al., 1995)

30 3. Choosing the number of factors to extract, Example Scree Plot Three components with eigenvalues > 1 Eigenvalue Explained 67.26% of the variance Component Number

31 4. Interpreting the Factor Solution Factor Matrix Shows the loadings of each of the variables on the factors that you extracted Loadings are the correlations between the variables and the factors Loadings allow you to interpret the factors Sign indicates whether the variable has a positive or negative correlation with the factor Size of loading indicates whether a variable makes a significant contribution to a factor.3

32 Variables Component 1 Component 2 Component 3 Vividness Qu Control Qu Preference Qu Generate Test Inspect Test Maintain Transform (P&P) Test Transform (Comp) Test Visual STM Test Component 1 Visual imagery tests Component 2 Visual imagery questionnaires Component 3?

33 Factor Matrix Interpret the factors Communality of the variables Percentage of variance in each variable that can be explained by the factors Eigenvalues of the factors Helps us work out the percentage of variance in the correlation matrix that the factor explains

34 Variables Component 1 Component 2 Component 3 Communality Vividness Qu % Control Qu % Preference Qu % Generate Test % Inspect Test % Maintain % Transform (P&P) Test % Transform (Comp) Test % Visual STM Test % Eigenvalues / % Variance 37.3% 18.6% 11.3% / Communality of Variable 1 (Vividness Qu) = (-.198) 2 + (-.805) 2 + (.061) 2 =. 69 or 69% Eigenvalue of Comp 1 = ( [-.198] 2 + [.173] 2 + [.353] 2 + [-.444] 2 + [-.773] 2 +[.734] 2 + [.759] 2 + [-.792] 2 + [.792] 2 ) = / 9 = 37.3%

35 Factor Matrix Unrotated Solution Initial solution Can be difficult to interpret Factor axes are arbitrarily aligned with the variables Rotated Solution Easier to interpret Simple structure Maximises the number of high and low loadings on each factor

36 Factor Analysis through Geometry It is possible to represent correlation matrices geometrically Variables Represented by straight lines of equal length All start from the same point High correlation between variables, lines positioned close together Low correlation between variables, lines positioned further apart Correlation = Cosine of the angle between the lines

37 V1 V2 V1 & V3 90º angle Cosine = 0 No relationship 30º 60º V3 V1 & V2 30º angle Cosine =.867 r =.867 The smaller the angle, the bigger the cosine and the bigger the correlation V2 & V3 60º angle Cosine =.5 R =.5

38 F1 V1 V2 V3 V4 V5 V6 F2 Factor Analysis Fits a factor to each cluster of variables Passes a factor line through the groups of variables Factor Loading Cosine of the angle between each factor and the variable

39 Two Methods of fitting Factors F1 F1 V1 V2 V3 V1 V2 V3 V4 V5 V6 V4 V5 V6 F2 F2 Orthogonal Solution Factors are at right angles Uncorrelated Oblique Solution Factors are not at right angles Correlated

40 Two Step Process F1 F1 V1 V2 V3 V1 V2 V3 V4 V4 F2 V5 V6 F2 V5 V6 Factors are fit arbitrarily Factors are rotated to fit the clusters of variables better

41 For example Unrotated Solution Solution following Orthogonal Rotation Variables C1 C2 C3 Variables C1 C2 C3 Vividness Qu Vividness Qu Control Qu Control Qu Preference Qu Preference Qu Generate Test Generate Test Inspect Test Inspect Test Maintain Test Maintain Test Transform (P&P) Test Transform (P&P) Test Transform (Comp) Test Transform (Comp) Test Visual STM Test VisualSTM Test

42 Factor Rotation Changes the position of the factors so that the solution is easier to interpret Achieves simple structure Factor matrix where variables have either high or low loadings on factors rather than lots of moderate loadings

43 Evaluating your Factor Solution Is the solution interpretable? Should you re-run and extract a bigger or smaller number of factors? What percentage of variance is explained by the factors? >60%? Are all variables represented by the factors? If the communality of one variable is very low, suggests it is not related to the other variables, should re-run and exclude

44 For example First Solution Second Solution Variables C1 C2 C3 Variables Component 1 Component 2 Vividness Qu Vividness Qu Control Qu Preference Qu Control Qu Preference Qu Generate Test Generate Test Inspect Test Inspect Test Maintain Test Maintain Test Transform (P&P) Test Transform (Comp) Test VisualSTM Test Transform (P&P) Test Transform (Comp) Test Visual STM Test Component 3 =? C1 = Efficiency of objective visual imagery C2 = Self-reported imagery efficacy

45 References Cooper, C. (1998). Individual differences. London: Arnold. Kline, P. (1994). An easy guide to factor analysis. London: Routledge.

Doing Quantitative Research 26E02900, 6 ECTS Lecture 2: Measurement Scales. Olli-Pekka Kauppila Rilana Riikkinen

Doing Quantitative Research 26E02900, 6 ECTS Lecture 2: Measurement Scales. Olli-Pekka Kauppila Rilana Riikkinen Doing Quantitative Research 26E02900, 6 ECTS Lecture 2: Measurement Scales Olli-Pekka Kauppila Rilana Riikkinen Learning Objectives 1. Develop the ability to assess a quality of measurement instruments

More information

Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models

Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models Factor Analysis Principal components factor analysis Use of extracted factors in multivariate dependency models 2 KEY CONCEPTS ***** Factor Analysis Interdependency technique Assumptions of factor analysis

More information

Principal Components Analysis (PCA)

Principal Components Analysis (PCA) Principal Components Analysis (PCA) Janette Walde janette.walde@uibk.ac.at Department of Statistics University of Innsbruck Outline I Introduction Idea of PCA Principle of the Method Decomposing an Association

More information

FACTOR ANALYSIS NASC

FACTOR ANALYSIS NASC FACTOR ANALYSIS NASC Factor Analysis A data reduction technique designed to represent a wide range of attributes on a smaller number of dimensions. Aim is to identify groups of variables which are relatively

More information

4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as:

4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as: 1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data 2. Linearity (in the relationships among the variables--factors are linear constructions of the set of variables; the critical source

More information

FACTOR ANALYSIS EXPLORATORY APPROACHES. Kristofer Årestedt

FACTOR ANALYSIS EXPLORATORY APPROACHES. Kristofer Årestedt FACTOR ANALYSIS EXPLORATORY APPROACHES Kristofer Årestedt 2013-04-28 UNIDIMENSIONALITY Unidimensionality imply that a set of items forming an instrument measure one thing in common Unidimensionality is

More information

T-test & factor analysis

T-test & factor analysis Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue

More information

Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk

Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Doi:10.5901/mjss.2014.v5n20p303 Abstract Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Wilbert Sibanda Philip D. Pretorius

More information

2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4

2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4 1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) 3. Univariate and multivariate

More information

PRINCIPAL COMPONENTS AND THE MAXIMUM LIKELIHOOD METHODS AS TOOLS TO ANALYZE LARGE DATA WITH A PSYCHOLOGICAL TESTING EXAMPLE

PRINCIPAL COMPONENTS AND THE MAXIMUM LIKELIHOOD METHODS AS TOOLS TO ANALYZE LARGE DATA WITH A PSYCHOLOGICAL TESTING EXAMPLE PRINCIPAL COMPONENTS AND THE MAXIMUM LIKELIHOOD METHODS AS TOOLS TO ANALYZE LARGE DATA WITH A PSYCHOLOGICAL TESTING EXAMPLE Markela Muca Llukan Puka Klodiana Bani Department of Mathematics, Faculty of

More information

Common factor analysis

Common factor analysis Common factor analysis This is what people generally mean when they say "factor analysis" This family of techniques uses an estimate of common variance among the original variables to generate the factor

More information

Pull and Push Factors of Migration: A Case Study in the Urban Area of Monywa Township, Myanmar

Pull and Push Factors of Migration: A Case Study in the Urban Area of Monywa Township, Myanmar Pull and Push Factors of Migration: A Case Study in the Urban Area of Monywa Township, Myanmar By Kyaing Kyaing Thet Abstract: Migration is a global phenomenon caused not only by economic factors, but

More information

DATA ANALYSIS AND INTERPRETATION OF EMPLOYEES PERSPECTIVES ON HIGH ATTRITION

DATA ANALYSIS AND INTERPRETATION OF EMPLOYEES PERSPECTIVES ON HIGH ATTRITION DATA ANALYSIS AND INTERPRETATION OF EMPLOYEES PERSPECTIVES ON HIGH ATTRITION Analysis is the key element of any research as it is the reliable way to test the hypotheses framed by the investigator. This

More information

Overview of Factor Analysis

Overview of Factor Analysis Overview of Factor Analysis Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone: (205) 348-4431 Fax: (205) 348-8648 August 1,

More information

Introduction to Principal Components and FactorAnalysis

Introduction to Principal Components and FactorAnalysis Introduction to Principal Components and FactorAnalysis Multivariate Analysis often starts out with data involving a substantial number of correlated variables. Principal Component Analysis (PCA) is a

More information

JORIND 9(2) December, ISSN

JORIND 9(2) December, ISSN AN ANALYSIS OF RURAL POVERTY IN OYO STATE: A PRINCIPAL COMPONENT APPROACH O.I. Osowole Department of Statistics University of Ibadan and Rita Ugbechie Department of Mathematics, College of Education Agbor,

More information

Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use

Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use : Suggestions on Use Background: Factor analysis requires several arbitrary decisions. The choices you make are the options that you must insert in the following SAS statements: PROC FACTOR METHOD=????

More information

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red)

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) The following DATA procedure is to read input data. This will create a SAS dataset named CORRMATR

More information

11/20/2014. Correlational research is used to describe the relationship between two or more naturally occurring variables.

11/20/2014. Correlational research is used to describe the relationship between two or more naturally occurring variables. Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection

More information

5.2 Customers Types for Grocery Shopping Scenario

5.2 Customers Types for Grocery Shopping Scenario ------------------------------------------------------------------------------------------------------- CHAPTER 5: RESULTS AND ANALYSIS -------------------------------------------------------------------------------------------------------

More information

FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables.

FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables. FACTOR ANALYSIS Introduction Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables Both methods differ from regression in that they don t have

More information

Factor Analysis. Chapter 420. Introduction

Factor Analysis. Chapter 420. Introduction Chapter 420 Introduction (FA) is an exploratory technique applied to a set of observed variables that seeks to find underlying factors (subsets of variables) from which the observed variables were generated.

More information

Chapter 7 Factor Analysis SPSS

Chapter 7 Factor Analysis SPSS Chapter 7 Factor Analysis SPSS Factor analysis attempts to identify underlying variables, or factors, that explain the pattern of correlations within a set of observed variables. Factor analysis is often

More information

To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method.

To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method. Factor Analysis in SPSS To conduct a Factor Analysis, start from the Analyze menu. This procedure is intended to reduce the complexity in a set of data, so we choose Data Reduction from the menu. And the

More information

USEFULNESS AND BENEFITS OF E-BANKING / INTERNET BANKING SERVICES

USEFULNESS AND BENEFITS OF E-BANKING / INTERNET BANKING SERVICES CHAPTER 6 USEFULNESS AND BENEFITS OF E-BANKING / INTERNET BANKING SERVICES 6.1 Introduction In the previous two chapters, bank customers adoption of e-banking / internet banking services and functional

More information

A Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis

A Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis Tutorials in Quantitative Methods for Psychology 2013, Vol. 9(2), p. 79-94. A Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis An Gie Yong and Sean Pearce University of Ottawa

More information

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

More information

Statistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer

Statistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis Principle Component Analysis: A statistical technique used to examine the interrelations among a set of variables in order to identify the underlying structure of those variables.

More information

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy. Blue vs. Orange. Review Jeopardy Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

More information

HANDOUT ON VALIDITY. 1. Content Validity

HANDOUT ON VALIDITY. 1. Content Validity HANDOUT ON VALIDITY A measure (e.g. a test, a questionnaire or a scale) is useful if it is reliable and valid. A measure is valid if it measures what it purports to measure. Validity can be assessed in

More information

The Effectiveness of Ethics Program among Malaysian Companies

The Effectiveness of Ethics Program among Malaysian Companies 2011 2 nd International Conference on Economics, Business and Management IPEDR vol.22 (2011) (2011) IACSIT Press, Singapore The Effectiveness of Ethics Program among Malaysian Companies Rabiatul Alawiyah

More information

PATTERNS OF ENVIRONMENTAL MANAGEMENT IN THE CHILEAN MANUFACTURING INDUSTRY: AN EMPIRICAL APPROACH

PATTERNS OF ENVIRONMENTAL MANAGEMENT IN THE CHILEAN MANUFACTURING INDUSTRY: AN EMPIRICAL APPROACH PATTERS OF EVIROMETAL MAAGEMET I THE CHILEA MAUFACTURIG IDUSTRY: A EMPIRICAL APPROACH Dr. Maria Teresa Ruiz-Tagle Research Associate, University of Cambridge, UK Research Associate, Universidad de Chile,

More information

Validation of the Core Self-Evaluations Scale research instrument in the conditions of Slovak Republic

Validation of the Core Self-Evaluations Scale research instrument in the conditions of Slovak Republic Validation of the Core Self-Evaluations Scale research instrument in the conditions of Slovak Republic Lenka Selecká, Jana Holienková Faculty of Arts, Department of psychology University of SS. Cyril and

More information

Lecture 7: Principal component analysis (PCA) What is PCA? Why use PCA?

Lecture 7: Principal component analysis (PCA) What is PCA? Why use PCA? Lecture 7: Princial comonent analysis (PCA) Rationale and use of PCA The underlying model (what is a rincial comonent anyway?) Eigenvectors and eigenvalues of the samle covariance matrix revisited! PCA

More information

Exploratory Factor Analysis

Exploratory Factor Analysis Exploratory Factor Analysis ( 探 索 的 因 子 分 析 ) Yasuyo Sawaki Waseda University JLTA2011 Workshop Momoyama Gakuin University October 28, 2011 1 Today s schedule Part 1: EFA basics Introduction to factor

More information

Factor Analysis Using SPSS

Factor Analysis Using SPSS Psychology 305 p. 1 Factor Analysis Using SPSS Overview For this computer assignment, you will conduct a series of principal factor analyses to examine the factor structure of a new instrument developed

More information

What is Rotating in Exploratory Factor Analysis?

What is Rotating in Exploratory Factor Analysis? A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016

Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 and Principal Components Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 Agenda Brief History and Introductory Example Factor Model Factor Equation Estimation of Loadings

More information

Research Methodology: Tools

Research Methodology: Tools MSc Business Administration Research Methodology: Tools Applied Data Analysis (with SPSS) Lecture 02: Item Analysis / Scale Analysis / Factor Analysis February 2014 Prof. Dr. Jürg Schwarz Lic. phil. Heidi

More information

The ith principal component (PC) is the line that follows the eigenvector associated with the ith largest eigenvalue.

The ith principal component (PC) is the line that follows the eigenvector associated with the ith largest eigenvalue. More Principal Components Summary Principal Components (PCs) are associated with the eigenvectors of either the covariance or correlation matrix of the data. The ith principal component (PC) is the line

More information

Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA

Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA PROC FACTOR: How to Interpret the Output of a Real-World Example Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA ABSTRACT THE METHOD This paper summarizes a real-world example of a factor

More information

Canonical Correlation Analysis

Canonical Correlation Analysis Canonical Correlation Analysis LEARNING OBJECTIVES Upon completing this chapter, you should be able to do the following: State the similarities and differences between multiple regression, factor analysis,

More information

Running head: ASSUMPTIONS IN MULTIPLE REGRESSION 1. Assumptions in Multiple Regression: A Tutorial. Dianne L. Ballance ID#

Running head: ASSUMPTIONS IN MULTIPLE REGRESSION 1. Assumptions in Multiple Regression: A Tutorial. Dianne L. Ballance ID# Running head: ASSUMPTIONS IN MULTIPLE REGRESSION 1 Assumptions in Multiple Regression: A Tutorial Dianne L. Ballance ID#00939966 University of Calgary APSY 607 ASSUMPTIONS IN MULTIPLE REGRESSION 2 Assumptions

More information

Simple Linear Regression Chapter 11

Simple Linear Regression Chapter 11 Simple Linear Regression Chapter 11 Rationale Frequently decision-making situations require modeling of relationships among business variables. For instance, the amount of sale of a product may be related

More information

A Introduction to Matrix Algebra and Principal Components Analysis

A Introduction to Matrix Algebra and Principal Components Analysis A Introduction to Matrix Algebra and Principal Components Analysis Multivariate Methods in Education ERSH 8350 Lecture #2 August 24, 2011 ERSH 8350: Lecture 2 Today s Class An introduction to matrix algebra

More information

Factor Analysis Using SPSS

Factor Analysis Using SPSS Factor Analysis Using SPSS The theory of factor analysis was described in your lecture, or read Field (2005) Chapter 15. Example Factor analysis is frequently used to develop questionnaires: after all

More information

STA 4107/5107. Chapter 3

STA 4107/5107. Chapter 3 STA 4107/5107 Chapter 3 Factor Analysis 1 Key Terms Please review and learn these terms. 2 What is Factor Analysis? Factor analysis is an interdependence technique (see chapter 1) that primarily uses metric

More information

Practical Considerations for Using Exploratory Factor Analysis in Educational Research

Practical Considerations for Using Exploratory Factor Analysis in Educational Research A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

APPRAISAL OF FINANCIAL AND ADMINISTRATIVE FUNCTIONING OF PUNJAB TECHNICAL UNIVERSITY

APPRAISAL OF FINANCIAL AND ADMINISTRATIVE FUNCTIONING OF PUNJAB TECHNICAL UNIVERSITY APPRAISAL OF FINANCIAL AND ADMINISTRATIVE FUNCTIONING OF PUNJAB TECHNICAL UNIVERSITY In the previous chapters the budgets of the university have been analyzed using various techniques to understand the

More information

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( ) Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates

More information

CHAPTER 4 KEY PERFORMANCE INDICATORS

CHAPTER 4 KEY PERFORMANCE INDICATORS CHAPTER 4 KEY PERFORMANCE INDICATORS As the study was focused on Key Performance Indicators of Information Systems in banking industry, the researcher would evaluate whether the IS implemented in bank

More information

Data analysis process

Data analysis process Data analysis process Data collection and preparation Collect data Prepare codebook Set up structure of data Enter data Screen data for errors Exploration of data Descriptive Statistics Graphs Analysis

More information

Using Principal Components Analysis in Program Evaluation: Some Practical Considerations

Using Principal Components Analysis in Program Evaluation: Some Practical Considerations http://evaluation.wmich.edu/jmde/ Articles Using Principal Components Analysis in Program Evaluation: Some Practical Considerations J. Thomas Kellow Assistant Professor of Research and Statistics Mercer

More information

Factor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business

Factor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business Factor Analysis Advanced Financial Accounting II Åbo Akademi School of Business Factor analysis A statistical method used to describe variability among observed variables in terms of fewer unobserved variables

More information

Writing Up A Factor Analysis. Table of Contents

Writing Up A Factor Analysis. Table of Contents Writing Up A Factor Analysis James Neill Centre for Applied Psychology University of Canberra 30 March, 2008 Creative Commons Attribution 2.5 Australia http://creativecommons.org/licenses/by/2.5/au/ Table

More information

PRINCIPAL COMPONENT ANALYSIS

PRINCIPAL COMPONENT ANALYSIS 1 Chapter 1 PRINCIPAL COMPONENT ANALYSIS Introduction: The Basics of Principal Component Analysis........................... 2 A Variable Reduction Procedure.......................................... 2

More information

Introduction to Principal Component Analysis: Stock Market Values

Introduction to Principal Component Analysis: Stock Market Values Chapter 10 Introduction to Principal Component Analysis: Stock Market Values The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from

More information

One-Minute Spotlight. The Crystal Ball Scatter Chart

One-Minute Spotlight. The Crystal Ball Scatter Chart The Crystal Ball Scatter Chart Once you have run a simulation with Oracle s Crystal Ball, you can view several charts to help you visualize, understand, and communicate the simulation results. This Spotlight

More information

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 FA is not worth the time necessary to understand it and carry it out. -Hills, 1977 Factor analysis should not

More information

THE USING FACTOR ANALYSIS METHOD IN PREDICTION OF BUSINESS FAILURE

THE USING FACTOR ANALYSIS METHOD IN PREDICTION OF BUSINESS FAILURE THE USING FACTOR ANALYSIS METHOD IN PREDICTION OF BUSINESS FAILURE Mary Violeta Petrescu Ph. D University of Craiova Faculty of Economics and Business Administration Craiova, Romania Abstract: : After

More information

psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression

psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression 1 last week this week last week we revised correlation & regression

More information

SOME NOTES ON STATISTICAL INTERPRETATION. Below I provide some basic notes on statistical interpretation for some selected procedures.

SOME NOTES ON STATISTICAL INTERPRETATION. Below I provide some basic notes on statistical interpretation for some selected procedures. 1 SOME NOTES ON STATISTICAL INTERPRETATION Below I provide some basic notes on statistical interpretation for some selected procedures. The information provided here is not exhaustive. There is more to

More information

Simple Regression Theory II 2010 Samuel L. Baker

Simple Regression Theory II 2010 Samuel L. Baker SIMPLE REGRESSION THEORY II 1 Simple Regression Theory II 2010 Samuel L. Baker Assessing how good the regression equation is likely to be Assignment 1A gets into drawing inferences about how close the

More information

A correlation exists between two variables when one of them is related to the other in some way.

A correlation exists between two variables when one of them is related to the other in some way. Lecture #10 Chapter 10 Correlation and Regression The main focus of this chapter is to form inferences based on sample data that come in pairs. Given such paired sample data, we want to determine whether

More information

Algebra I: Lesson 5-4 (5074) SAS Curriculum Pathways

Algebra I: Lesson 5-4 (5074) SAS Curriculum Pathways Two-Variable Quantitative Data: Lesson Summary with Examples Bivariate data involves two quantitative variables and deals with relationships between those variables. By plotting bivariate data as ordered

More information

A Brief Introduction to SPSS Factor Analysis

A Brief Introduction to SPSS Factor Analysis A Brief Introduction to SPSS Factor Analysis SPSS has a procedure that conducts exploratory factor analysis. Before launching into a step by step example of how to use this procedure, it is recommended

More information

Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis

Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis Factor Analysis Overview Factor analysis is used to uncover the latent structure (dimensions) of a set of variables. It reduces attribute space from a larger number of variables to a smaller number of

More information

Multivariate analysis of variance

Multivariate analysis of variance 21 Multivariate analysis of variance In previous chapters, we explored the use of analysis of variance to compare groups on a single dependent variable. In many research situations, however, we are interested

More information

How to report the percentage of explained common variance in exploratory factor analysis

How to report the percentage of explained common variance in exploratory factor analysis UNIVERSITAT ROVIRA I VIRGILI How to report the percentage of explained common variance in exploratory factor analysis Tarragona 2013 Please reference this document as: Lorenzo-Seva, U. (2013). How to report

More information

12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2

12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 Understand linear regression with a single predictor Understand how we assess the fit of a regression model Total Sum of Squares

More information

Use of Factor Scores in Multiple Regression Analysis for Estimation of Body Weight by Several Body Measurements in Brown Trouts (Salmo trutta fario)

Use of Factor Scores in Multiple Regression Analysis for Estimation of Body Weight by Several Body Measurements in Brown Trouts (Salmo trutta fario) INTERNATİONAL JOURNAL OF AGRİCULTURE & BİOLOGY ISSN Print: 1560 8530; ISSN Online: 1814 9596 10 164/DJZ/2010/12 4 611 615 http://www.fspublishers.org Full Length Article Use of Factor Scores in Multiple

More information

An introduction to. Principal Component Analysis & Factor Analysis. Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co.

An introduction to. Principal Component Analysis & Factor Analysis. Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co. An introduction to Principal Component Analysis & Factor Analysis Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co.uk Monday, 23 April 2012 Acknowledgment: The original version

More information

1. The standardised parameters are given below. Remember to use the population rather than sample standard deviation.

1. The standardised parameters are given below. Remember to use the population rather than sample standard deviation. Kapitel 5 5.1. 1. The standardised parameters are given below. Remember to use the population rather than sample standard deviation. The graph of cross-validated error versus component number is presented

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis ERS70D George Fernandez INTRODUCTION Analysis of multivariate data plays a key role in data analysis. Multivariate data consists of many different attributes or variables recorded

More information

A REVIEW OF SCALE DEVELOPMENT PRACTICES IN NONPROFIT MANAGEMENT AND MARKETING

A REVIEW OF SCALE DEVELOPMENT PRACTICES IN NONPROFIT MANAGEMENT AND MARKETING Walter Wymer, Helena Maria Baptista Alves 143 Walter Wymer, Helena Maria Baptista Alves, A Review of Scale Development Practices in Nonprofit Management and Marketing, Economics & Sociology, Vol. 5, No

More information

MODERATING EFFECT OF INFORMATION TECHNOLOGY UTILIZATION ON THE RELATIONSHIP BETWEEN COMMITMENT AND CUSTOMER SATISFACTION

MODERATING EFFECT OF INFORMATION TECHNOLOGY UTILIZATION ON THE RELATIONSHIP BETWEEN COMMITMENT AND CUSTOMER SATISFACTION MODERATING EFFECT OF INFORMATION TECHNOLOGY UTILIZATION ON THE RELATIONSHIP BETWEEN COMMITMENT AND CUSTOMER SATISFACTION Charles Boise Nyameino Dr. Ronald Bonuke Prof. Thomas Kimeli Cheruiyot Moi University

More information

Topic 10: Factor Analysis

Topic 10: Factor Analysis Topic 10: Factor Analysis Introduction Factor analysis is a statistical method used to describe variability among observed variables in terms of a potentially lower number of unobserved variables called

More information

Inferential Statistics

Inferential Statistics Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are

More information

EFA II. Review of Conceptual Model Steps in EFA Sample Size Conceptual Issues in Interpretation Presenting Results. 09SEM2a 1

EFA II. Review of Conceptual Model Steps in EFA Sample Size Conceptual Issues in Interpretation Presenting Results. 09SEM2a 1 EFA II Review of Conceptual Model Steps in EFA Sample Size Conceptual Issues in Interpretation Presenting Results 09SEM2a 1 Review of Conceptual Model Variables of interest typically can't be measured

More information

Factor Analysis and Structural equation modelling

Factor Analysis and Structural equation modelling Factor Analysis and Structural equation modelling Herman Adèr Previously: Department Clinical Epidemiology and Biostatistics, VU University medical center, Amsterdam Stavanger July 4 13, 2006 Herman Adèr

More information

MODERATING EFFECT OF INFORMATION TECHNOLOGY UTILIZATION ON THE RELATIONSHIP BETWEEN SERVICE QUALITY AND CUSTOMER SATISFACTION

MODERATING EFFECT OF INFORMATION TECHNOLOGY UTILIZATION ON THE RELATIONSHIP BETWEEN SERVICE QUALITY AND CUSTOMER SATISFACTION International Journal of Economics, Commerce and Management United Kingdom Vol. III, Issue 5, May 2015 http://ijecm.co.uk/ ISSN 2348 0386 MODERATING EFFECT OF INFORMATION TECHNOLOGY UTILIZATION ON THE

More information

SPSS: Descriptive and Inferential Statistics. For Windows

SPSS: Descriptive and Inferential Statistics. For Windows For Windows August 2012 Table of Contents Section 1: Summarizing Data...3 1.1 Descriptive Statistics...3 Section 2: Inferential Statistics... 10 2.1 Chi-Square Test... 10 2.2 T tests... 11 2.3 Correlation...

More information

Hatice Camgöz Akdağ. findings of previous research in which two independent firm clusters were

Hatice Camgöz Akdağ. findings of previous research in which two independent firm clusters were Innovative Culture and Total Quality Management as a Tool for Sustainable Competitiveness: A Case Study of Turkish Fruit and Vegetable Processing Industry SMEs, Sedef Akgüngör Hatice Camgöz Akdağ Aslı

More information

A Brief Introduction to Factor Analysis

A Brief Introduction to Factor Analysis 1. Introduction A Brief Introduction to Factor Analysis Factor analysis attempts to represent a set of observed variables X 1, X 2. X n in terms of a number of 'common' factors plus a factor which is unique

More information

Block designs/1. 1 Background

Block designs/1. 1 Background Block designs 1 Background In a typical experiment, we have a set Ω of experimental units or plots, and (after some preparation) we make a measurement on each plot (for example, the yield of the plot).

More information

Factor Rotations in Factor Analyses.

Factor Rotations in Factor Analyses. Factor Rotations in Factor Analyses. Hervé Abdi 1 The University of Texas at Dallas Introduction The different methods of factor analysis first extract a set a factors from a data set. These factors are

More information

Students Motivation and Preference of Studying Hospitality and Tourism Management Programmes in Polytechnics: A Case Study Ho Polytechnic

Students Motivation and Preference of Studying Hospitality and Tourism Management Programmes in Polytechnics: A Case Study Ho Polytechnic Students Motivation and Preference of Studying Hospitality and Tourism Management Programmes in Polytechnics: A Case Study Ho Polytechnic Appaw-Agbola Esther Theresa Ho Polytechnic,Box 217,HoV/R, W/A,Ghana

More information

Chapter 6 Partial Correlation

Chapter 6 Partial Correlation Chapter 6 Partial Correlation Chapter Overview Partial correlation is a statistical technique for computing the Pearson correlation between a predictor and a criterion variable while controlling for (removing)

More information

Correlation. What Is Correlation? Perfect Correlation. Perfect Correlation. Greg C Elvers

Correlation. What Is Correlation? Perfect Correlation. Perfect Correlation. Greg C Elvers Correlation Greg C Elvers What Is Correlation? Correlation is a descriptive statistic that tells you if two variables are related to each other E.g. Is your related to how much you study? When two variables

More information

Rockefeller College University at Albany

Rockefeller College University at Albany Rockefeller College University at Albany PAD 705 Handout: Throughout this course, I have emphasized that statistical analysis is part science, part art. Our final topic, factor analysis, strays the farthest

More information

INSIGHTMirror 360 Survey Analysis

INSIGHTMirror 360 Survey Analysis INSIGHTMirror 360 Survey Analysis Prepared for: Bookman Resources, Inc. / InsightMirror 360 Date Delivered: May 14, 2011 Overview: Reliability and Validity Study for Bookman Resources, Inc. / INSIGHTMirror

More information

Chapter 8: Quantitative Sampling

Chapter 8: Quantitative Sampling Chapter 8: Quantitative Sampling I. Introduction to Sampling a. The primary goal of sampling is to get a representative sample, or a small collection of units or cases from a much larger collection or

More information

The Effect of Macroeconomic Factors on Indian Stock Market Performance: A Factor Analysis Approach

The Effect of Macroeconomic Factors on Indian Stock Market Performance: A Factor Analysis Approach IOSR Journal of Economics and Finance (IOSR-JEF) e-issn: 2321-5933, p-issn: 2321-5925. Volume 1, Issue 3 (Sep. Oct. 2013), PP 14-21 The Effect of Macroeconomic Factors on Indian Stock Market Performance:

More information

Facebook Friend Suggestion Eytan Daniyalzade and Tim Lipus

Facebook Friend Suggestion Eytan Daniyalzade and Tim Lipus Facebook Friend Suggestion Eytan Daniyalzade and Tim Lipus 1. Introduction Facebook is a social networking website with an open platform that enables developers to extract and utilize user information

More information

, then the form of the model is given by: which comprises a deterministic component involving the three regression coefficients (

, then the form of the model is given by: which comprises a deterministic component involving the three regression coefficients ( Multiple regression Introduction Multiple regression is a logical extension of the principles of simple linear regression to situations in which there are several predictor variables. For instance if we

More information

Chapter 8. Linear Regression. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 8. Linear Regression. Copyright 2012, 2008, 2005 Pearson Education, Inc. Chapter 8 Linear Regression Copyright 2012, 2008, 2005 Pearson Education, Inc. Fat Versus Protein: An Example The following is a scatterplot of total fat versus protein for 30 items on the Burger King

More information

Sense of Community (SOC) as a Predictor of Adult Learner Persistence in Accelerated Degree Completion Programs (ADCPs)?

Sense of Community (SOC) as a Predictor of Adult Learner Persistence in Accelerated Degree Completion Programs (ADCPs)? Sense of Community (SOC) as a Predictor of Adult Learner Persistence in Accelerated Degree Completion Programs (ADCPs)? Michael O. Minor, EdD mominor1@email.phoenix.edu The University of Phoenix John Sperling

More information

GRADES 7, 8, AND 9 BIG IDEAS

GRADES 7, 8, AND 9 BIG IDEAS Table 1: Strand A: BIG IDEAS: MATH: NUMBER Introduce perfect squares, square roots, and all applications Introduce rational numbers (positive and negative) Introduce the meaning of negative exponents for

More information

Examples on Variable Selection in PCA in Sensory Descriptive and Consumer Data

Examples on Variable Selection in PCA in Sensory Descriptive and Consumer Data Examples on Variable Selection in PCA in Sensory Descriptive and Consumer Data Per Lea, Frank Westad, Margrethe Hersleth MATFORSK, Ås, Norway Harald Martens KVL, Copenhagen, Denmark 6 th Sensometrics Meeting

More information