Factor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business

Size: px
Start display at page:

Download "Factor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business"

Transcription

1 Factor Analysis Advanced Financial Accounting II Åbo Akademi School of Business

2 Factor analysis A statistical method used to describe variability among observed variables in terms of fewer unobserved variables called factors The observed variables are modeled as linear combinations of the factors plus error terms The information gained about the interdependencies can be used later to reduce the set of variables in a dataset Related to principal component analysis (PCA) PCA performs a variance-maximizing rotation of the variable space, i.e. takes into account all variability in the variables Factor analysis estimates how much of the variability is due to common factors

3 Factor analysis Variables Factors X 1 Factor 1 X 2 X 3 X 4 Factor 2 Factor k < p X p

4 Factor analysis - an example: Financial ratios Variables DSales DAssets Factors Growth EBIT-% ROI ROE Profitability CF/Sales Equity Ratio QR Solidity CR

5 Types/purposes of factor analysis Exploratory factor analysis Used to uncover the underlying structure of a relatively large set of variables A priori assumption is that any indicator may be associated with any factor No prior theory, factor loadings are used to intuit the factor structure of the data Confirmatory factor analysis Seeks to determine if the number of factors and the loadings of the measured variables on them confirm to what is expected on the basis of a preestablished theory

6 Factor analysis with SPSS Analyze Dimension Reduction Factor Extraction method, several alternatives e.g. Principal Components (the most common) Maximum Likelihood Number of factors Statistically defined (based on eigenvalues) Used defined (Fixed) when prior assumption on factor structure Rotation in order to extract a clearer factor pattern, several alternatives, e.g. Varimax Oblimin

7 Confirmatory Factor analysis - an example: Financial Ratios for Finnish listed companies 9 variables DSales, DAssets, EBIT-%, ROI, ROE, Cash Flow(Operations)/Sales, Equity Ratio, Quick Ratio Current Ratio Fixed number of factors: 3 Predefined assumption on three factors: Growth, Profitability and Solidity Extraction method: Principal Components Analysis Rotation method: Varimax

8 Factor analysis: Component matrix (Factor loadings) Component DSales (%),231,835,422 Dassets (%),212,829,450 EBIT-%,900,138 -,248 CF(Oper)/Sales,669,271 -,155 ROI,765,122 -,408 ROE,665,213 -,459 Equity Ratio,689 -,422,247 Quick Ratio,701 -,431,429 Current Ratio,645 -,488,435

9 Factor loadings Called Component loadings in PCA Correlation coefficients between the variables (rows) and factors (columns) Values between -1 and 1 The larger the absolute value of the factor loading, the stronger the connection between the variable and the factor Analogous to Pearson's r, the squared factor loading is the percent of variance in that indicator variable explained by the factor For example: 0,701 2 = 0,491 = 49,1 % of the variability in Quick Ratio is explained by the first common factor

10 Interpreting the factor loadings and rotating the loadings matrix A common problem in interpreting the unrotated factor loadings matrix is that all the most significant loadings are concentrated in one or two first factors One way to obtain more interpretable results is to rotate the solution The most common rotation method is Varimax rotation An orthogonal rotation (Rotated factors uncorrelated) Maximizes the variance of the squared loadings of a factor on all the variables in the matrix Each factor will tend to have either large or small loadings of any particular variable Yields results that make it as easy as possible to identify each variable with a single factor

11 Factor analysis: Varimax-rotated component matrix Component DSales (%),132 -,055,953 DAssets (%),100 -,048,960 EBIT-%,869,344,128 CF(Oper)/Sales,671,183,248 ROI,875,177,003 ROE,834,037,031 Equity Ratio,274,795 -,086 Quick Ratio,173,911,011 Current Ratio,111,911 -,042

12 Factor analysis - an example: Financial ratios for Finnish listed companies The three pre-assumed factors Growth, Profitability and Solidity - may be clearly identified in the rotated component matrix For example Growth is represented by component 3 combining the major part of ratios DSales and DAssets with minor influences from the other seven variables In the same manner Profitability is represented by component 1 and Solidity by component 2 The component matrix may be further transformed into a Component score coefficient matrix to be used to create new ratios describing the factors

13 Factor analysis: Communalities Initial Extraction DSales (%) 1,000,928 DAssets (%) 1,000,934 EBIT-% 1,000,890 CF(Oper)/Sales 1,000,545 ROI 1,000,766 ROE 1,000,698 Equity Ratio 1,000,715 Quick Ratio 1,000,861 Current Ratio 1,000,843

14 Communalities The communalities for a variable are computed by taking the sum of the squared loadings for that variable May be interpreted as multiple R 2 values for regression models predicting the variables of interest from the factors The sum of the squared factor loadings for all factors for a given variable (row) is the variance in that variable accounted for by all the factors For example 86.1 % of the variation in Quick Ratio is explained by the three common factors, 13.9 % is left unexplained

15 Communalities... One assessment of how well the model is doing can be obtained from the communalities Values close to one indicate that the model explains most of the variation for the variables Adding up the communality values for individual variables gives the Total communality of the model In the example case we have total communality of Dividing total communality by the number of variables gives the percentage of variation explained in the model In the example case 7.182/9 = 79.8 %

16 SPSS: Total Variance Explained Component Total Initial Eigenvalues % of Variance Cumulative % Extraction Sums of Squared Loadings Total % of Variance Cumulative % 1 3,765 41,832 41,832 3,765 41,832 41, ,139 23,764 65,595 2,139 23,764 65, ,277 14,184 79,780 1,277 14,184 79,780 4,708 7,871 87, ,103 1, ,000 Even an Explorative Factor Analysis with the default eigenvalue limit 1,0 in SPSS would have resulted in extractíng three factors Total variance explained by the three factor model %

17 Factor analysis: Computing factor scores The observed nine ratios for Alma Media 2005 were DSales DAssets EBIT-% Cash Flow(Oper.)/Sales ROI ROE Equity Ratio Quick Ratio Current Ratio

18 Factor analysis: Computing factor scores The nine variables may be summarized in three new variables Profitability, Solidity and Growth by multiplying the observed ratio values with component scores: Profitability = ( ) ( ) = Solidity = Growth =

19 Alternative rotation methods: Orthogonal rotations Varimax Quartimax An orthogonal alternative which minimizes the number of factors needed to explain each variable Generates often a general factor on which most variables are loaded to a high or medium degree Creates a factor structure usually not helpful to the research purpose Equimax A compromise between Varimax and Quartimax criteria

Empirical data analysis in accounting and finance

Empirical data analysis in accounting and finance Empirical data analysis in accounting and finance Some examples on quantitative empirical research problems in accounting and finance Pattern recognition Financial classification models Financial distress

More information

This example of a factor analysis is annotated with some notes explaining the output.

This example of a factor analysis is annotated with some notes explaining the output. Factor Analysis This example of a factor analysis is annotated with some notes explaining the output. Overview: The what and why of factor analysis Factor analysis is a method of data reduction. It does

More information

Exploratory factor analysis

Exploratory factor analysis Exploratory factor analysis Coverage: The purpose and requirements of EFA Deriving and interpreting the factors Validating the EFA findings Using EFA results for further analysis Practice with SPSS Required

More information

Psychology Seminar Psych 406 Structural Equation Modeling Jeffrey D. Leitzel, Ph.D. Factor Analysis

Psychology Seminar Psych 406 Structural Equation Modeling Jeffrey D. Leitzel, Ph.D. Factor Analysis Psychology Seminar Psych 406 Structural Equation Modeling Jeffrey D. Leitzel, Ph.D. Factor Analysis Outline/overview Applications of Factor Analysis Types of Factor Analysis (EFA vs. CFA) Terminology/Concepts

More information

FACTOR ANALYSIS EXPLORATORY APPROACHES. Kristofer Årestedt

FACTOR ANALYSIS EXPLORATORY APPROACHES. Kristofer Årestedt FACTOR ANALYSIS EXPLORATORY APPROACHES Kristofer Årestedt 2013-04-28 UNIDIMENSIONALITY Unidimensionality imply that a set of items forming an instrument measure one thing in common Unidimensionality is

More information

Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models

Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models Factor Analysis Principal components factor analysis Use of extracted factors in multivariate dependency models 2 KEY CONCEPTS ***** Factor Analysis Interdependency technique Assumptions of factor analysis

More information

Doing Quantitative Research 26E02900, 6 ECTS Lecture 2: Measurement Scales. Olli-Pekka Kauppila Rilana Riikkinen

Doing Quantitative Research 26E02900, 6 ECTS Lecture 2: Measurement Scales. Olli-Pekka Kauppila Rilana Riikkinen Doing Quantitative Research 26E02900, 6 ECTS Lecture 2: Measurement Scales Olli-Pekka Kauppila Rilana Riikkinen Learning Objectives 1. Develop the ability to assess a quality of measurement instruments

More information

Introduction to Principal Components and FactorAnalysis

Introduction to Principal Components and FactorAnalysis Introduction to Principal Components and FactorAnalysis Multivariate Analysis often starts out with data involving a substantial number of correlated variables. Principal Component Analysis (PCA) is a

More information

Topic 10: Factor Analysis

Topic 10: Factor Analysis Topic 10: Factor Analysis Introduction Factor analysis is a statistical method used to describe variability among observed variables in terms of a potentially lower number of unobserved variables called

More information

Chapter 11: Exploratory Factor Analysis

Chapter 11: Exploratory Factor Analysis Chapter : Exploratory Factor Analysis Prerequisites: Chapter 9, Sections 3.5-3.8. Some Comments on the History of Factor Analysis In this chapter we are going to cover a set of techniques known as Exploratory

More information

By Hui Bian Office for Faculty Excellence

By Hui Bian Office for Faculty Excellence By Hui Bian Office for Faculty Excellence 1 Email: bianh@ecu.edu Phone: 328-5428 Location: 2307 Old Cafeteria Complex (east campus) Website: http://www.ecu.edu/cs-acad/ofe/index.cfm 2 Structure analyzing

More information

Graphical ilustration

Graphical ilustration Factor analysis Exploratory Factor analysis statistical model, when latent (directly unobservable) variables influence a few observable interval variables. 1 Graphical ilustration Mathematics talent Physics

More information

Common factor analysis

Common factor analysis Common factor analysis This is what people generally mean when they say "factor analysis" This family of techniques uses an estimate of common variance among the original variables to generate the factor

More information

Exploratory Factor Analysis

Exploratory Factor Analysis Introduction Principal components: explain many variables using few new variables. Not many assumptions attached. Exploratory Factor Analysis Exploratory factor analysis: similar idea, but based on model.

More information

Marketing Research. Chapter Twenty-one. Factor Analysis. Factor Analysis. Factor Analysis (Contd.) Aaker, Kumar, Day Ninth Edition

Marketing Research. Chapter Twenty-one. Factor Analysis. Factor Analysis. Factor Analysis (Contd.) Aaker, Kumar, Day Ninth Edition Chapter Twenty-one Marketing Research Factor Analysis Ninth Edition 1 2 Factor Analysis Factor Analysis (Contd.) Combines questions or variables to create new factors Combines objects to create new groups

More information

4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as:

4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as: 1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data 2. Linearity (in the relationships among the variables--factors are linear constructions of the set of variables; the critical source

More information

What Is Factor Analysis? A Simple Explanation

What Is Factor Analysis? A Simple Explanation What Is Factor Analysis? A Simple Explanation Factor analysis is a statistical procedure used to identify a small number of factors that can be used to represent relationships among sets of interrelated

More information

FACTOR ANALYSIS. Examples. Identification of factors of intelligence out of a variety of tests.

FACTOR ANALYSIS. Examples. Identification of factors of intelligence out of a variety of tests. FACTOR ANALYSIS Factor Analysis is an explorative statistical technique to identify a relatively small number of factors that can be used to represent relationships among sets of many interrelated variables.

More information

T-test & factor analysis

T-test & factor analysis Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue

More information

Factor Analysis. Goals and uses of FA

Factor Analysis. Goals and uses of FA Factor Analysis Marieke E. Timmerman Heymans Institute for Psychology, DPMG m.e.timmerman@rug.nl 1 Goals and uses of FA Type of data: scores of n subject on (large) number (j) variables in j variables

More information

Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016

Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 and Principal Components Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 Agenda Brief History and Introductory Example Factor Model Factor Equation Estimation of Loadings

More information

To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method.

To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method. Factor Analysis in SPSS To conduct a Factor Analysis, start from the Analyze menu. This procedure is intended to reduce the complexity in a set of data, so we choose Data Reduction from the menu. And the

More information

2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4

2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4 1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) 3. Univariate and multivariate

More information

Introduction to Factor Analysis In Stata

Introduction to Factor Analysis In Stata Introduction to Factor Analysis In Stata Intentions Understand main principles behind Factor Analysis (FA) Be able to correctly specify and run FA programmes in Stata Interpret output Content of the presentation

More information

Principal Components Analysis (PCA)

Principal Components Analysis (PCA) Principal Components Analysis (PCA) Janette Walde janette.walde@uibk.ac.at Department of Statistics University of Innsbruck Outline I Introduction Idea of PCA Principle of the Method Decomposing an Association

More information

A Brief Introduction to SPSS Factor Analysis

A Brief Introduction to SPSS Factor Analysis A Brief Introduction to SPSS Factor Analysis SPSS has a procedure that conducts exploratory factor analysis. Before launching into a step by step example of how to use this procedure, it is recommended

More information

Chapter 7 Factor Analysis SPSS

Chapter 7 Factor Analysis SPSS Chapter 7 Factor Analysis SPSS Factor analysis attempts to identify underlying variables, or factors, that explain the pattern of correlations within a set of observed variables. Factor analysis is often

More information

FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables.

FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables. FACTOR ANALYSIS Introduction Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables Both methods differ from regression in that they don t have

More information

FACTOR ANALYSIS NASC

FACTOR ANALYSIS NASC FACTOR ANALYSIS NASC Factor Analysis A data reduction technique designed to represent a wide range of attributes on a smaller number of dimensions. Aim is to identify groups of variables which are relatively

More information

Statistics in Psychosocial Research Lecture 9 Factor Analysis II. Lecturer: Elizabeth Garrett-Mayer

Statistics in Psychosocial Research Lecture 9 Factor Analysis II. Lecturer: Elizabeth Garrett-Mayer This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Research Design - - Topic 20 Exploratory Factor Analysis 2009 R. C. Gardner, Ph.D.

Research Design - - Topic 20 Exploratory Factor Analysis 2009 R. C. Gardner, Ph.D. Research Design - - Topic 20 Exploratory Factor Analysis 2009 R. C. Gardner, Ph.D. General Rationale and Purpose An Example Using SPSS Factor Constructs and Terms Principal Components Analysis Basic Mathematics

More information

STEPS INVOLVED IN FACTOR ANALYSIS

STEPS INVOLVED IN FACTOR ANALYSIS 15 Factor analysis Factor analysis is different from many of the other techniques presented in this book. It is not designed to test hypotheses or to tell you whether one group is significantly different

More information

Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA

Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA PROC FACTOR: How to Interpret the Output of a Real-World Example Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA ABSTRACT THE METHOD This paper summarizes a real-world example of a factor

More information

Getting Started in Factor Analysis (using Stata 10) (ver. 1.5)

Getting Started in Factor Analysis (using Stata 10) (ver. 1.5) Getting Started in Factor Analysis (using Stata 10) (ver. 1.5) Oscar Torres-Reyna Data Consultant otorres@princeton.edu http://dss.princeton.edu/training/ Factor analysis is used mostly for data reduction

More information

Statistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer

Statistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy. Blue vs. Orange. Review Jeopardy Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

More information

Factor Analysis. Chapter 420. Introduction

Factor Analysis. Chapter 420. Introduction Chapter 420 Introduction (FA) is an exploratory technique applied to a set of observed variables that seeks to find underlying factors (subsets of variables) from which the observed variables were generated.

More information

Dimensionality Reduction: Principal Components Analysis

Dimensionality Reduction: Principal Components Analysis Dimensionality Reduction: Principal Components Analysis In data mining one often encounters situations where there are a large number of variables in the database. In such situations it is very likely

More information

Data Reduction I : PCA and Factor Analysis

Data Reduction I : PCA and Factor Analysis Data Reduction I : PCA and Factor Analysis Carlos Pinto 1 1 Neuropsychiatric Genetics Group University of Dublin Data Analysis Seminars 11 November 2009 Overview 1. Distortions in Data 2. Variance and

More information

Introduction to SPSS: Basic Analyses

Introduction to SPSS: Basic Analyses Introduction to SPSS: Basic Analyses I. Obtaining Descriptive Statistics of the Data In SPSS, there are three different ways of obtaining descriptions of the data: Descriptives Frequencies Crosstabs 1.

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis Principle Component Analysis: A statistical technique used to examine the interrelations among a set of variables in order to identify the underlying structure of those variables.

More information

Multivariate Analysis (Slides 13)

Multivariate Analysis (Slides 13) Multivariate Analysis (Slides 13) The final topic we consider is Factor Analysis. A Factor Analysis is a mathematical approach for attempting to explain the correlation between a large set of variables

More information

Factor Analysis. Sample StatFolio: factor analysis.sgp

Factor Analysis. Sample StatFolio: factor analysis.sgp STATGRAPHICS Rev. 1/10/005 Factor Analysis Summary The Factor Analysis procedure is designed to extract m common factors from a set of p quantitative variables X. In many situations, a small number of

More information

Multivariate Analysis

Multivariate Analysis Table Of Contents Multivariate Analysis... 1 Overview... 1 Principal Components... 2 Factor Analysis... 5 Cluster Observations... 12 Cluster Variables... 17 Cluster K-Means... 20 Discriminant Analysis...

More information

Exploratory Factor Analysis

Exploratory Factor Analysis Exploratory Factor Analysis Definition Exploratory factor analysis (EFA) is a procedure for learning the extent to which k observed variables might measure m abstract variables, wherein m is less than

More information

Title. Description. multivariate Introduction to multivariate commands

Title. Description. multivariate Introduction to multivariate commands Title multivariate Introduction to multivariate commands Description The Multivariate Reference Manual organizes the commands alphabetically, which makes it easy to find individual command entries if you

More information

Canonical Correlation

Canonical Correlation Canonical Correlation A Supplement to Multivariate Data Analysis Multivariate Data Analysis Pearson Prentice Hall Publishing Multivariate Data Analysis, Pearson Prentice Hall Publishing Page 1 Table of

More information

THE USING FACTOR ANALYSIS METHOD IN PREDICTION OF BUSINESS FAILURE

THE USING FACTOR ANALYSIS METHOD IN PREDICTION OF BUSINESS FAILURE THE USING FACTOR ANALYSIS METHOD IN PREDICTION OF BUSINESS FAILURE Mary Violeta Petrescu Ph. D University of Craiova Faculty of Economics and Business Administration Craiova, Romania Abstract: : After

More information

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

More information

Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis

Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis Factor Analysis Overview Factor analysis is used to uncover the latent structure (dimensions) of a set of variables. It reduces attribute space from a larger number of variables to a smaller number of

More information

DATA REDUCTION TECHNIQUES

DATA REDUCTION TECHNIQUES DATA REDUCTION TECHNIQUES RANJANA AGARWAL AND A.R. RAO Indian Agricultural Statistics Research Institute Library Avenue, New Delhi-110 01 ranjana@iasri.res.in 1. Introduction Data reduction techniques

More information

Principal Component Analysis and Factor Analysis

Principal Component Analysis and Factor Analysis Principal Component Analysis and Factor Analysis Scenario We have a n p numerical data matrix. Assume n p (or transpose it). We want to do one of show the relationships between the row (cases) in a low-dimensional

More information

Principal Component Analysis Example Robin Beaumont / Chris Dracup 28 February 2006

Principal Component Analysis Example Robin Beaumont / Chris Dracup 28 February 2006 Principal Component Analysis Example Robin Beaumont / Chris Dracup 28 February 2006 Contents 1 Learning outcomes...1 2 Introduction...2 3 Data layout and initial inspection...2 4 Carrying out the Principal

More information

A Student Guide to SPSS

A Student Guide to SPSS A Student Guide to SPSS - Getting Started - Data Operations - Univariate Analysis - Bivariate Analysis - Multiple Linear Regression - Exploratory Factor Analysis Luke Sloan School of Social Science Cardiff

More information

PRINCIPAL COMPONENTS AND THE MAXIMUM LIKELIHOOD METHODS AS TOOLS TO ANALYZE LARGE DATA WITH A PSYCHOLOGICAL TESTING EXAMPLE

PRINCIPAL COMPONENTS AND THE MAXIMUM LIKELIHOOD METHODS AS TOOLS TO ANALYZE LARGE DATA WITH A PSYCHOLOGICAL TESTING EXAMPLE PRINCIPAL COMPONENTS AND THE MAXIMUM LIKELIHOOD METHODS AS TOOLS TO ANALYZE LARGE DATA WITH A PSYCHOLOGICAL TESTING EXAMPLE Markela Muca Llukan Puka Klodiana Bani Department of Mathematics, Faculty of

More information

Overview of Factor Analysis

Overview of Factor Analysis Overview of Factor Analysis Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone: (205) 348-4431 Fax: (205) 348-8648 August 1,

More information

Reduction of Measuring Items; Contemporary Issue in Assessing Internal Consistency

Reduction of Measuring Items; Contemporary Issue in Assessing Internal Consistency www.ijcsi.org 218 Reduction of Measuring Items; Contemporary Issue in Assessing Internal Consistency Oluwaseun Gbenga Fadare 1,*, Hezekiah Oluleye Babatunde 2, Gbenga Olayinka Ojo 3, John Niyi Iyanda 4

More information

Dimensionality Reduction with PCA

Dimensionality Reduction with PCA Dimensionality Reduction with PCA Ke Tran May 24, 2011 Introduction Dimensionality Reduction PCA - Principal Components Analysis PCA Experiment The Dataset Discussion Conclusion Why dimensionality reduction?

More information

Factor Analysis and Structural equation modelling

Factor Analysis and Structural equation modelling Factor Analysis and Structural equation modelling Herman Adèr Previously: Department Clinical Epidemiology and Biostatistics, VU University medical center, Amsterdam Stavanger July 4 13, 2006 Herman Adèr

More information

Exploratory Factor Analysis: rotation. Psychology 588: Covariance structure and factor models

Exploratory Factor Analysis: rotation. Psychology 588: Covariance structure and factor models Exploratory Factor Analysis: rotation Psychology 588: Covariance structure and factor models Rotational indeterminacy Given an initial (orthogonal) solution (i.e., Φ = I), there exist infinite pairs of

More information

PCA Principal Component Analysis

PCA Principal Component Analysis PCA Principal Component Analysis Dr. Saed Sayad University of Toronto 2010 saed.sayad@utoronto.ca 1 Basic Statistics 2 Statistics - Example X SumX Count Average X-Xbar (X-Xbar)^2 Sxx Variance SD 0 40 4

More information

Principal Component Analysis of Nigeria Value of Major Imports

Principal Component Analysis of Nigeria Value of Major Imports American Journal of Economics 2015, 5(5): 508-512 DOI: 10.5923/j.economics.20150505.11 Principal Component Analysis of Nigeria Value of Major Imports Usoro Anthony E. 1,*, Moffat I. U. 2 1 Department of

More information

Factor Analysis Using SPSS

Factor Analysis Using SPSS Psychology 305 p. 1 Factor Analysis Using SPSS Overview For this computer assignment, you will conduct a series of principal factor analyses to examine the factor structure of a new instrument developed

More information

General Term Multivariate method Preprocessing 2 data matrix. 4 discriminant analysis. 1 centering 5 factor

General Term Multivariate method Preprocessing 2 data matrix. 4 discriminant analysis. 1 centering 5 factor Extract of Multivariate Analysis Terminology from ISO 18115-1 Surface Chemical Analysis Vocabulary Part 1: General Terms and Terms for the Spectroscopies J L S Lee, I S Gilmore and M P Seah (Email: joanna.lee@npl.co.uk)

More information

STA 4107/5107. Chapter 3

STA 4107/5107. Chapter 3 STA 4107/5107 Chapter 3 Factor Analysis 1 Key Terms Please review and learn these terms. 2 What is Factor Analysis? Factor analysis is an interdependence technique (see chapter 1) that primarily uses metric

More information

What is Rotating in Exploratory Factor Analysis?

What is Rotating in Exploratory Factor Analysis? A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

Canonical Correlation

Canonical Correlation Chapter 400 Introduction Canonical correlation analysis is the study of the linear relations between two sets of variables. It is the multivariate extension of correlation analysis. Although we will present

More information

Principal Component Analysis (PCA) Principal Component Analysis (PCA)

Principal Component Analysis (PCA) Principal Component Analysis (PCA) Recall: Eigenvectors of the Covariance Matrix Covariance matrices are symmetric. Recall: Eigenvectors of the Covariance Matrix Covariance matrices are symmetric. Eigenvectors are orthogonal Recall: Eigenvectors

More information

Factor Analysis. The Measurement Model

Factor Analysis. The Measurement Model Factor Analysis The Measurement Model Factor Analysis: The Measurement Model D i = ΛF i + e i D 1 D 2 D 3 D 4 D 5 D 6 D 7 D 8 F 1 F 2 Example with 2 factors and 8 observed variables D i,1 D i,2 D i,3 D

More information

Biostatistics 658: Statistics for Psychosocial Research II Problem Set #2

Biostatistics 658: Statistics for Psychosocial Research II Problem Set #2 Biostatistics 658: Statistics for Psychosocial Research II Problem Set #2 This problem uses the data set pset2.sav, which is in SPSS format and consistent for use with AMOS. A version of the data in Stata

More information

PRINCIPAL COMPONENT ANALYSIS

PRINCIPAL COMPONENT ANALYSIS 1 Chapter 1 PRINCIPAL COMPONENT ANALYSIS Introduction: The Basics of Principal Component Analysis........................... 2 A Variable Reduction Procedure.......................................... 2

More information

CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C.

CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C. CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES From Exploratory Factor Analysis Ledyard R Tucker and Robert C MacCallum 1997 180 CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES In

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis ERS70D George Fernandez INTRODUCTION Analysis of multivariate data plays a key role in data analysis. Multivariate data consists of many different attributes or variables recorded

More information

Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use

Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use : Suggestions on Use Background: Factor analysis requires several arbitrary decisions. The choices you make are the options that you must insert in the following SAS statements: PROC FACTOR METHOD=????

More information

Lecture 7: Principal component analysis (PCA) What is PCA? Why use PCA?

Lecture 7: Principal component analysis (PCA) What is PCA? Why use PCA? Lecture 7: Princial comonent analysis (PCA) Rationale and use of PCA The underlying model (what is a rincial comonent anyway?) Eigenvectors and eigenvalues of the samle covariance matrix revisited! PCA

More information

Statistics for Business Decision Making

Statistics for Business Decision Making Statistics for Business Decision Making Faculty of Economics University of Siena 1 / 62 You should be able to: ˆ Summarize and uncover any patterns in a set of multivariate data using the (FM) ˆ Apply

More information

A Brief Introduction to Factor Analysis

A Brief Introduction to Factor Analysis 1. Introduction A Brief Introduction to Factor Analysis Factor analysis attempts to represent a set of observed variables X 1, X 2. X n in terms of a number of 'common' factors plus a factor which is unique

More information

Understanding and Using Factor Scores: Considerations for the Applied Researcher

Understanding and Using Factor Scores: Considerations for the Applied Researcher A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

Using Principal Components Analysis in Program Evaluation: Some Practical Considerations

Using Principal Components Analysis in Program Evaluation: Some Practical Considerations http://evaluation.wmich.edu/jmde/ Articles Using Principal Components Analysis in Program Evaluation: Some Practical Considerations J. Thomas Kellow Assistant Professor of Research and Statistics Mercer

More information

Principal Components Analysis

Principal Components Analysis Chapter 425 Principal Components Analysis Introduction, or PCA, is a data analysis tool that is usually used to reduce the dimensionality (number of variables) of a large number of interrelated variables,

More information

Section 1. Principal Component Analysis

Section 1. Principal Component Analysis Section 1 Principal Component Analysis 1 / 16 Principal Component Analysis Background Principal Component Analysis (PCA) is a tool for looking at multivariate data. General setup: we observe several variables

More information

Factor Rotations in Factor Analyses.

Factor Rotations in Factor Analyses. Factor Rotations in Factor Analyses. Hervé Abdi 1 The University of Texas at Dallas Introduction The different methods of factor analysis first extract a set a factors from a data set. These factors are

More information

RISK ANALYSIS ON THE LEASING MARKET

RISK ANALYSIS ON THE LEASING MARKET The Academy of Economic Studies Master DAFI RISK ANALYSIS ON THE LEASING MARKET Coordinator: Prof.Dr. Radu Radut Student: Carla Biclesanu Bucharest, 2008 Table of contents Introduction Chapter I Financial

More information

A multivariate analysis of automobile rating data

A multivariate analysis of automobile rating data A multivariate analysis of automobile rating data Sai Xiao, Cheng-Han Yu Introduction In this project, we are exploring a multivariate analysis of automobile data, which can be downloaded from https://archive.ics.uci.edu/ml/datasets/automobile.

More information

Fall 2010 PSY515 Factor Analysis Project

Fall 2010 PSY515 Factor Analysis Project Fall 2010 PSY515 Factor Analysis Project The dataset includes information from approximately 300 individuals who are currently involved in a committed romantic relationship. Participants were given the

More information

Lecture 7: Analysis of Factors and Canonical Correlations

Lecture 7: Analysis of Factors and Canonical Correlations 1/33 Lecture 7: Analysis of Factors and Canonical Correlations Måns Thulin Department of Mathematics, Uppsala University thulin@math.uu.se Multivariate Methods 6/5 2011 2/33 Outline Factor analysis Basic

More information

Data analysis process

Data analysis process Data analysis process Data collection and preparation Collect data Prepare codebook Set up structure of data Enter data Screen data for errors Exploration of data Descriptive Statistics Graphs Analysis

More information

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 FA is not worth the time necessary to understand it and carry it out. -Hills, 1977 Factor analysis should not

More information

ANSWERS TO EXERCISES AND REVIEW QUESTIONS

ANSWERS TO EXERCISES AND REVIEW QUESTIONS ASWERS TO EXERCISES AD REVIEW QUESTIOS PART FOUR: STATISTICAL TECHIQUES TO EXPLORE RELATIOSHIPS AMOG VARIABLES You should review the material in the introduction to Part Four and in Chapters, 2, 3, 4 and

More information

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red)

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) The following DATA procedure is to read input data. This will create a SAS dataset named CORRMATR

More information

5.2 Customers Types for Grocery Shopping Scenario

5.2 Customers Types for Grocery Shopping Scenario ------------------------------------------------------------------------------------------------------- CHAPTER 5: RESULTS AND ANALYSIS -------------------------------------------------------------------------------------------------------

More information

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( ) Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates

More information

Principal Component Analysis using R

Principal Component Analysis using R Principal Component Analysis using R November 25, 2009 This tutorial is designed to give the reader a short overview of Principal Component Analysis (PCA) using R. PCA is a useful statistical method that

More information

6/17/2016. Introduction

6/17/2016. Introduction FACTOR ANALYTIC METHODS: CONCEPTUAL FOUNDATIONS FOR EXPLORING THE STRUCTURE OF INTELLIGENCE TESTS AND RELATED ABILITY MEASURES Ryan J. McGill, Ph.D., BCBA-D, NCSP Assistant Professor of Psychology Co-Director

More information

Factor Analysis Using SPSS

Factor Analysis Using SPSS Factor Analysis Using SPSS The theory of factor analysis was described in your lecture, or read Field (2005) Chapter 15. Example Factor analysis is frequently used to develop questionnaires: after all

More information

HANDOUT ON VALIDITY. 1. Content Validity

HANDOUT ON VALIDITY. 1. Content Validity HANDOUT ON VALIDITY A measure (e.g. a test, a questionnaire or a scale) is useful if it is reliable and valid. A measure is valid if it measures what it purports to measure. Validity can be assessed in

More information

A Demonstration of Canonical Correlation Analysis with Orthogonal Rotation to Facilitate Interpretation

A Demonstration of Canonical Correlation Analysis with Orthogonal Rotation to Facilitate Interpretation Virginia Commonwealth University VCU Scholars Compass Social Work Publications School of Social Work 2014 A Demonstration of Canonical Correlation Analysis with Orthogonal Rotation to Facilitate Interpretation

More information

Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk

Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Doi:10.5901/mjss.2014.v5n20p303 Abstract Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Wilbert Sibanda Philip D. Pretorius

More information

A Introduction to Matrix Algebra and Principal Components Analysis

A Introduction to Matrix Algebra and Principal Components Analysis A Introduction to Matrix Algebra and Principal Components Analysis Multivariate Methods in Education ERSH 8350 Lecture #2 August 24, 2011 ERSH 8350: Lecture 2 Today s Class An introduction to matrix algebra

More information

Factor analysis. Angela Montanari

Factor analysis. Angela Montanari Factor analysis Angela Montanari 1 Introduction Factor analysis is a statistical model that allows to explain the correlations between a large number of observed correlated variables through a small number

More information