The president of a Fortune 500 firm wants to measure the firm s image.
|
|
- Lilian Parker
- 7 years ago
- Views:
Transcription
1 4. Factor Analysis A related method to the PCA is the Factor Analysis (FA) with the crucial difference that in FA a statistical model is constructed to explain the interrelations (correlations) between observed variables. 1
2 Example 4.1: The marketing manager of an apparel firm wants to determine whether or not a relationship exist between patriotism and consumers attitudes about domestic and foreign products. The president of a Fortune 500 firm wants to measure the firm s image. In each of these cases the concepts are evidently so large that they hardly can be measured satisfactorily with a single variable. Instead several indicators must be constructed to get an idea, for example, of the image of a firm. Hence, the manager has a thought (model) that the image is the background determinant of the observed indicators (or variables). 2
3 Variables that cannot be measured (observed) directly are usually called latent variables or factors, and those that are observed directly as manifest variables. 3
4 The Model Observed variables: x 1,..., x p Latent, common factors: ξ 1,..., ξ m, with m << p. such that (1) x i = µ i + λ i1 ξ λ im ξ m + δ i, where λ ij : the loading of variable variable x i on factor ξ j, δ i : is the error term, sometimes called a unique factor of variable x i, µ i : the expected value of x i (in the following we assume µ i = 0). 4
5 Remark 4.1: The factors ξ j are unobserved. Thus model (1) cannot be estimated like the usual regression model. Remark 4.2: Often factors are denoted by f j, but here we use the same notations that are custom in the latent variable structural equation models, dealt with later. A basic assumption is that Cov[ɛ i, ɛ k ] = 0, i.e., the error terms between variables x i and x k are uncorrelated (i k). Thus, all the correlation between the observed variables are explained by the common factors. 5
6 Example 4.2: Two factors (idelized) model for six observed variables. λ 11 ξ λ 21 1 x 1 x 2 δ1 δ2 7 λ 31 x 3 δ3 φ 12 λ 42 λ ξ 52 2 x 4 x 5 δ4 δ5 7 λ 62 x 6 δ6 In this idealized model all correlations are determined through the correlation, φ 12, between the factors and the appropriate factor loadings λ ij. Thus, due to the structuring the covariances these models are usally called covariance structure models 6
7 The solution for the factor problem is obtained by solving the unknown parameters in the implied covariance matrix of the x- variables (the fundamental equation of factor analysis) (2) Σ = ΛΦΛ + Θ δ, where Σ is the covariance matrix of the x- variables, Λ is the matrix of the loadings λ ij, Φ is the correlation matrix of the factors, and Θ δ is a diagonal matrix with error variances, Var[δ i ] on the diagonal. Remark 4.3: In exploratory factor analysis, due to the non-uniqueness of the solution, we can select initially Φ = I, the identity matrix, which implies that the factors are assumed to be uncorrelated. Then (2) reduces to (3) Σ = ΛΛ + Θ δ. 7
8 Example 4.3: Holzinger and Swineford (1939) data. The following psychological test were measured from 145 student in two Chicago school. The three first are aimed to measure spatial or visual perception and the last three verbal ability. Variables: visperc: Visual perception scores cubes: Test of spatial visualization lozenges: Test of spatial orientation paragraph: Paragraph comprehension score sentence: Sentence completion score wordmean: Word meaning test score 8
9 Spatial perception and verbal ability are considered as underlying abilities that are not directly measurable. The tests perform indicators of these abilities. The correlation matrix of the variables: ================================================================ visperc cubes lozenges paragraph sentence wordmean visperc 1 cubes lozenges paragraph sentence wordmean ================================================================ 9
10 Using AMOS, we can first visually structure the model and then estimate. Below are reported standardized estimates and a goodness of fit statistic. 10
11 In Amos an alternative to graphic specification is to specify and fit a model the model by VB.NE or C# classes. Below is C#. #region "Header" using System; using System.Diagnostics; using AmosEngineLib; using AmosGraphics; using PBayes; using tm = AmosEngineLib.AmosEngine.TMatrixID; #endregion 11
12 class MainModule { static void Main() { // Your code goes here. AmosEngine holz = new AmosEngine(); try { holz.textoutput(); holz.smc(); holz.standardized(); holz.begingroup("grant.sav"); holz.astructure("visperc <-- e_v (1)"); holz.astructure("visperc <-- spatial"); holz.astructure("cubes <-- e_c (1)"); holz.astructure("cubes <-- spatial"); holz.astructure("lozenges <-- e_l (1)"); holz.astructure("lozenges <-- spatial"); } } holz.astructure("paragrap <-- e_p (1)"); holz.astructure("paragrap <-- visual"); holz.astructure("sentence <-- e_s (1)"); holz.astructure("sentence <-- visual"); holz.astructure("wordmean <-- e_w (1)"); holz.astructure("wordmean <-- visual"); holz.astructure("spatial <--> visual"); holz.astructure("spatial (1)"); holz.astructure("visual (1)"); holz.fitmodel(); } finally { holz.dispose(); } 12
13 This is an example of confirmatory factor analysis (CFA). In practice, however, there is usually no clear idea about the latent variables. In such a case the task is to try to find whether there exist common latent factors and how many. This is the traditional exploratory factor analysis (EFA) set up. 13
14 Objectives of Exploratory Factor Analysis 1. Determine the smallest number of common factors that best account for the correlations among the indicators,i.e., determine m in model 1). 2. Identify the most plausible factors via rotation. 3. Estimate the pattern coefficients, structure loadings, communalities, and unique variances of the variables. 4. Provide interpretation for the common factors. 5. If necessary, estimate the factor scores. 14
15 Factors are usually extracted from a correlation matrix (standardized solution). Qualitatively it should not make difference whether the factors are extracted from a correlation or a covariance matrix, i.e., the interpretation of the end result should be the same. 15
16 The following data is used to illustrate the above steps. data. Example 4.4: The product manager of a consumer package goods firm is interested in identifying the major underlying dimensions that consumers use to evaluate detergents in the market place. A sample of 143 respondents rated three brands of detergents on 12 product attributes using a five-point semantic differential scale. The attributes were: V 1 : V 2 : V 3 : V 4 : V 5 : V 6 : V 7 : V 8 : V 9 : V 10 : V 11 : V 12 : Gentle to natural fabrics Won t harm colors Won t harm synthetics Safe for lingerie Strong, powerful Gets dirt out Makes color bright Removes grease stains Good for greasy oil Pleasant fragrance Removes collar soil Removes stubborn stains 16
17 The sample correlation matrix is V1 V2 V3 V4 V5 V6 V7 V8 V9 V10 V11 V
18 The correlations between the variables are ranging from 0.17 to From factor analysis point of view this means that there are probably two or more factors behind the correlations of the variables. 18
19 Data Appropriate for Factor Analysis? As stated above, the main goal of the factor analysis is to explain the intercorrelations between observed variables with a small number of common factors. High correlations among the variables indicate that the variables can be grouped to homogeneous sets of variables such that each set measures the same underlying constructs or dimensions. Low correlations indicate that variables do not have much in common. 19
20 Kaiser s measure of overall sampling adequacy (MSA) provides a measure to assess to what extend the observed variables belong together (are homogeneous): MSA Recommendation 0.90 Marvelous Meritorious Middling Mediocre Miserable < 0.50 Unacceptable The overall MSA should be over 0.80, but a measure of above 0.60 is tolerable. In the above example MSA = Thus, the correlation matrix should be appropriate for factoring. 20
21 Number of common factor (i) General (heuristic) rules: a) As many factors as there are eigenvalues greater than one in the correlation matrix. b) Scree plot rule. c) As many factors as can be interpreted. (ii) Statistical rules: d) Likelihood ratio test: H 0 : m factors are sufficient H 1 : more factors are needed. e) Criterion functions (AIC, SC). Select that number of factors where the used criterion assumes the minimum. 21
22 The statistical rules are based on comparison how well the sample covariance (or correlation) matrix S can be reproduced by the fitted covariance matrix (4) ˆΣ = ˆΛˆΛ + ˆΘ δ. If the fit is perfect, S ˆΣ = 0. 22
23 Example 4.5 Eigenvalues and scree-plot for the detergent correlation matrix. When using a correlation matrix as data in SPSS, a little extra work is needed. The data is organized in Excel as as follows. rowtype_ varname_ v1 v2 v3 v4 v5 v6 v7 v8 v9 v10 v11 v12 n corr v1 1 corr v corr v corr v corr v corr v corr v corr v corr v corr v corr v corr v
24 The factor analysis must be run using the syntax, where it can be indicated to the program that we analyze a correlation matrix. FACTOR /matrix in(cor=*) /ANALYSIS V1 V2 V3 V4 V5 V6 V7 V8 V9 V10 V11 V12 /PRINT INITIAL CORRELATION DET EXTRACTION /CRITERIA factors(2) ITERATE(25) /EXTRACTION ml /ROTATION varimax /plot = eigen rotation /METHOD=CORRELATION. 24
25 Total Variance Explained Component Initial Eigenvalues Total % of Variance Cumulative % Total % of Variance Cumulative % Extraction Method: Principal Component Analysis. Extraction Sums of Squared Loadings Scree Plot Eigenvalue Component Number
26 Both the scree plot and the eigenvalue rule suggest two factors. ================================================= m AIC BIC ChiSq df p-val(chisq) * * ================================================= * = minimum The chi-square test indicates that more than two factors are needed. AIC suggests three and or BIC two factors. Combining the results of different criteria, the two factor solution seems appropriate. 26
27 The Factor Extraction Earlier the most popular method was the (iterated) Principal Axis procedure, which is technically analogous to the principal component solution, which is the default extraction method in SAS and SPSS. Another popular method now is the method of Maximum Likelihood for its several statistically attractive properties. 27
28 Example 4.6: In the detergent data the factors are extracted using the ML-method. Factor Matrix(a) ================================================= Factor v1: Gentle to natural fabrics, v2: Won t harm colors, v3: Won t harm synthetics, v4: Safe for lingerie, v5: Strong, powerful, v6: Gets dirt out, v7: Makes color bright, v8: Removes grease stains, v9: Good for greasy oil, v10: Pleasant fragrance, v11: Removes collar soil, v12: Removes stubborn stains ================================================= Extraction Method: Maximum Likelihood. a 2 factors extracted. 4 iterations required. 28
29 The variables are clustered in the factors space as follows Factor Plot V2 V1 V3 V4 Factor V6 V7 V8-0.3 V5 V Factor
30 Communalities The factor model (1) x i = λ i1 ξ λ im ξ m + ɛ i divides the variability of x in to two parts: the systematic part explained by the factors and the error part. The variance of x decomposes accordingly as varian (5) Var[x i ] = h 2 i + Var[ɛ i], where (6) h 2 i = Var[λ i1ξ λ im ξ m ] is called the communality of variable x i (variance due to the common factors). 30
31 Communality estimates of the detergent data are the following Communalities ============================================ Initial Extraction Gentle to natural fabrics, Won t harm colors, Won t harm synthetics, Safe for lingerie, Strong, powerful, Gets dirt out, Makes color bright, Removes grease stains, Good for greasy oil, Pleasant fragrance, Removes collar soil, Removes stubborn stains ============================================ Extraction Method: Maximum Likelihood. The initial column indicates the starting value for the solution algorithm of the factor solution. The final communalities indicate that the factor structure explain from 43.4 to 77.1 percent of the variances of the x-variables. 31
32 Factor Rotation A high loading of a variable on a factor indicates that the variable is strongly related to the factor. As a consequence the interpretation (naming) of a specific factor is based on those variables that have high (absolute) loadings on that factor. However, because there is no hierarchy between the factors as was the case of PCA, the first factor extraction is arbitrary in the sense that statistically there are indefinitely many equivalent solutions. The the factor axes can be rotated to clarify the structure. 32
33 This procedure can be utilized to reach a simple structure whose prototype is as follows (p = 10, m = 3) f 1 f 2 f 3 x x x x x x x x x x Hence, the most simple structure is if each variable loads only on a single factor. 33
34 The rotation methods are divided into roughly into two classes: Orthogonal and oblique methods. The most popular orthogonal rotation methods are VARIMAX and QUARTIMAX. The former aims especially at the above described simple structure, and the latter to a solution where there is expected to be a general factor and some special factors. 34
35 Example 4.7: VARIMAX rotated solution for the detergent two-factor solution is the following Factor Plot in Rotated Factor Space 0.9 V1 V3 V4 0.6 V2 Factor V11 V10 V7 V8 V9 V6 V12 V Factor Varimax Rotated Factor Matrix ============================================== Factor v1: Gentle to natural fabrics, v2: Won t harm colors, v3: Won t harm synthetics, v4: Safe for lingerie, v5: Strong, powerful, v6: Gets dirt out, v7: Makes color bright, v8: Removes grease stains, v9: Good for greasy oil, v10: Pleasant fragrance, v11: Removes collar soil, v12: Removes stubborn stains ============================================== Extraction Method: Maximum Likelihood. Rotation Method: Varimax with Kaiser Normalization. 35
36 The rotated solution indicates that variables V 1 V 4 are strongly associated to the second factor, and the rest to first. All the four first variables are measuring some mildness properties and the rest eight variables the efficacy of cleaning clothes. As a result the first factor could be named as mildness or gentleness and the second efficacy. Note: Usually the solution is not this clear cut, but variables are loading on several factors at the same time. 36
37 Remark 4.4: The factor loadings in the orthogonal (standardized) solution are at the same time correlations of the original variables with the factors. In the oblique rotation the correlations must be calculated separately. The correlation matrix of the original variables with the factors is called the factor structure matrix, while the rotated loading matrix is called the factor pattern matrix. 37
38 Oblimin rotated solution Pattern Matrix ============================================== Factor v1: Gentle to natural fabrics, v2: Won t harm colors, v3: Won t harm synthetics, v4: Safe for lingerie, v5: Strong, powerful, v6: Gets dirt out, v7: Makes color bright, v8: Removes grease stains, v9: Good for greasy oil, v10: Pleasant fragrance, v11: Removes collar soil, v12: Removes stubborn stains ============================================== Extraction Method: Maximum Likelihood. Rotation Method: Oblimin with Kaiser Normalization. 38
39 Factor structure of the Oblimin rotated solution Structure Matrix ================================================ Factor Gentle to natural fabrics, Won t harm colors, Won t harm synthetics, Safe for lingerie, Strong, powerful, Gets dirt out, Makes color bright, Removes grease stains, Good for greasy oil, Pleasant fragrance, Removes collar soil, Removes stubborn stains ================================================ Extraction Method: Maximum Likelihood. Rotation Method: Oblimin with Kaiser Normalization. Factor Correlation Matrix ====================== Factor ====================== Extraction Method: Maximum Likelihood. Rotation Method: Oblimin with Kaiser Normalization. 39
40 Goodness of a Factor Solution The goal of the FA is to explain the correlations between the observed variables. The more closely the factor solution can reproduce the correlations the better it is. 40
41 An overall measure for this is the RMSP (Root Mean Square off-diagonal Residual), calculated from the formula (7) RMSR = 1 p(p 1)/2 p 1 i 1 i=1 j=1 (r ij ˆρ ij ) 2, where ˆρ ij is the correlation of x i and x j predicted by the factor model. The overall measure for this is the RMSP (Root Mean Square off-diagonal Partials) calculated from the residual matrix. 41
42 In the detergent example RMSR = and RMSP = Yet other approaches are to investigate the standardized residual matrix and partial correlations where factors are partialed out. An absolute value of a standardized residual correlation larger than two indicates that the corresponding correlation may not explained satisfactorily by the factor solution. Large partial correlations indicate that the common factors do not explain the corresponding correlation. 42
43 An approximate standard error for a (partial) correlation is 1/ n 1 if the population partial correlation is zero (factor model captures the correlation). Thus, as a common rule, (residual or partial) correlations on absolute value larger than 2/ n 1 deserve attention. 43
44 Example 4.8: (Continues) SAS produced residual correlations are as follows Residual Correlations With Uniqueness on the Diagonal V1 V2 V3 V4 V V V V V V V V V V V V Residual Correlations With Uniqueness on the Diagonal V5 V6 V7 V8 V V V V V V V V V V V V
45 Residual Correlations With Uniqueness on the Diagonal V9 V10 V11 V12 V V V V V V V V V V V V Root Mean Square Off-Diagonal Residuals: Overall = V1 V2 V3 V4 V5 V Root Mean Square Off-Diagonal Residuals: Overall = V7 V8 V9 V10 V11 V
46 Partial Correlations Controlling Factors V1 V2 V3 V4 V V V V V V V V V V V V Partial Correlations Controlling Factors V5 V6 V7 V8 V V V V V V V V V V V V
47 Partial Correlations Controlling Factors V9 V10 V11 V12 V V V V V V V V V V V V Root Mean Square Off-Diagonal Partials: Overall = V1 V2 V3 V4 V5 V Root Mean Square Off-Diagonal Partials: Overall = V7 V8 V9 V10 V11 V
48 Factor Scores Factor analysis is often used as a preliminary data reduction step as a part of a larger analysis. In a later analysis factors themselves are used in place of the original variables from which they were derived. Therefore, the factor values, called factor scores are needed. 48
49 Factor scores are calculated as (8) ˆξ j = a j1 x 1 + a j2 x a jp x p, (j = 1,..., m) where the weights depend on factor loadings and residual variances. Remark 4.5: Factor scores cannot be calculated if the correlation matrix is available only. 49
Common factor analysis
Common factor analysis This is what people generally mean when they say "factor analysis" This family of techniques uses an estimate of common variance among the original variables to generate the factor
More informationExploratory Factor Analysis
Introduction Principal components: explain many variables using few new variables. Not many assumptions attached. Exploratory Factor Analysis Exploratory factor analysis: similar idea, but based on model.
More informationFactor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models
Factor Analysis Principal components factor analysis Use of extracted factors in multivariate dependency models 2 KEY CONCEPTS ***** Factor Analysis Interdependency technique Assumptions of factor analysis
More informationA Brief Introduction to SPSS Factor Analysis
A Brief Introduction to SPSS Factor Analysis SPSS has a procedure that conducts exploratory factor analysis. Before launching into a step by step example of how to use this procedure, it is recommended
More informationFACTOR ANALYSIS NASC
FACTOR ANALYSIS NASC Factor Analysis A data reduction technique designed to represent a wide range of attributes on a smaller number of dimensions. Aim is to identify groups of variables which are relatively
More informationExploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016
and Principal Components Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 Agenda Brief History and Introductory Example Factor Model Factor Equation Estimation of Loadings
More informationFactor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red)
Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) The following DATA procedure is to read input data. This will create a SAS dataset named CORRMATR
More informationT-test & factor analysis
Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue
More informationAn introduction to. Principal Component Analysis & Factor Analysis. Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co.
An introduction to Principal Component Analysis & Factor Analysis Using SPSS 19 and R (psych package) Robin Beaumont robin@organplayers.co.uk Monday, 23 April 2012 Acknowledgment: The original version
More informationFactor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business
Factor Analysis Advanced Financial Accounting II Åbo Akademi School of Business Factor analysis A statistical method used to describe variability among observed variables in terms of fewer unobserved variables
More information4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as:
1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data 2. Linearity (in the relationships among the variables--factors are linear constructions of the set of variables; the critical source
More informationMultivariate Analysis (Slides 13)
Multivariate Analysis (Slides 13) The final topic we consider is Factor Analysis. A Factor Analysis is a mathematical approach for attempting to explain the correlation between a large set of variables
More informationExploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk
Doi:10.5901/mjss.2014.v5n20p303 Abstract Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Wilbert Sibanda Philip D. Pretorius
More informationFactor Analysis. Chapter 420. Introduction
Chapter 420 Introduction (FA) is an exploratory technique applied to a set of observed variables that seeks to find underlying factors (subsets of variables) from which the observed variables were generated.
More informationOverview of Factor Analysis
Overview of Factor Analysis Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone: (205) 348-4431 Fax: (205) 348-8648 August 1,
More informationExploratory Factor Analysis: rotation. Psychology 588: Covariance structure and factor models
Exploratory Factor Analysis: rotation Psychology 588: Covariance structure and factor models Rotational indeterminacy Given an initial (orthogonal) solution (i.e., Φ = I), there exist infinite pairs of
More information5.2 Customers Types for Grocery Shopping Scenario
------------------------------------------------------------------------------------------------------- CHAPTER 5: RESULTS AND ANALYSIS -------------------------------------------------------------------------------------------------------
More informationFACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables.
FACTOR ANALYSIS Introduction Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables Both methods differ from regression in that they don t have
More informationExploratory Factor Analysis
Exploratory Factor Analysis Definition Exploratory factor analysis (EFA) is a procedure for learning the extent to which k observed variables might measure m abstract variables, wherein m is less than
More informationTo do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method.
Factor Analysis in SPSS To conduct a Factor Analysis, start from the Analyze menu. This procedure is intended to reduce the complexity in a set of data, so we choose Data Reduction from the menu. And the
More informationFactor Analysis. Factor Analysis
Factor Analysis Principal Components Analysis, e.g. of stock price movements, sometimes suggests that several variables may be responding to a small number of underlying forces. In the factor model, we
More informationExploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003
Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 FA is not worth the time necessary to understand it and carry it out. -Hills, 1977 Factor analysis should not
More informationIntroduction to Principal Components and FactorAnalysis
Introduction to Principal Components and FactorAnalysis Multivariate Analysis often starts out with data involving a substantial number of correlated variables. Principal Component Analysis (PCA) is a
More information2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4
1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) 3. Univariate and multivariate
More informationFactor analysis. Angela Montanari
Factor analysis Angela Montanari 1 Introduction Factor analysis is a statistical model that allows to explain the correlations between a large number of observed correlated variables through a small number
More informationPsychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use
: Suggestions on Use Background: Factor analysis requires several arbitrary decisions. The choices you make are the options that you must insert in the following SAS statements: PROC FACTOR METHOD=????
More informationFactor Analysis. Sample StatFolio: factor analysis.sgp
STATGRAPHICS Rev. 1/10/005 Factor Analysis Summary The Factor Analysis procedure is designed to extract m common factors from a set of p quantitative variables X. In many situations, a small number of
More informationCHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C.
CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES From Exploratory Factor Analysis Ledyard R Tucker and Robert C MacCallum 1997 180 CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES In
More informationFactor Analysis and Structural equation modelling
Factor Analysis and Structural equation modelling Herman Adèr Previously: Department Clinical Epidemiology and Biostatistics, VU University medical center, Amsterdam Stavanger July 4 13, 2006 Herman Adèr
More informationExploratory Factor Analysis
Exploratory Factor Analysis ( 探 索 的 因 子 分 析 ) Yasuyo Sawaki Waseda University JLTA2011 Workshop Momoyama Gakuin University October 28, 2011 1 Today s schedule Part 1: EFA basics Introduction to factor
More informationA Brief Introduction to Factor Analysis
1. Introduction A Brief Introduction to Factor Analysis Factor analysis attempts to represent a set of observed variables X 1, X 2. X n in terms of a number of 'common' factors plus a factor which is unique
More informationStatistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationTopic 10: Factor Analysis
Topic 10: Factor Analysis Introduction Factor analysis is a statistical method used to describe variability among observed variables in terms of a potentially lower number of unobserved variables called
More informationMplus Tutorial August 2012
August 2012 Mplus for Windows: An Introduction Section 1: Introduction... 3 1.1. About this Document... 3 1.2. Introduction to EFA, CFA, SEM and Mplus... 3 1.3. Accessing Mplus... 3 Section 2: Latent Variable
More informationWhat is Rotating in Exploratory Factor Analysis?
A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to
More informationRachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA
PROC FACTOR: How to Interpret the Output of a Real-World Example Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA ABSTRACT THE METHOD This paper summarizes a real-world example of a factor
More informationPATTERNS OF ENVIRONMENTAL MANAGEMENT IN THE CHILEAN MANUFACTURING INDUSTRY: AN EMPIRICAL APPROACH
PATTERS OF EVIROMETAL MAAGEMET I THE CHILEA MAUFACTURIG IDUSTRY: A EMPIRICAL APPROACH Dr. Maria Teresa Ruiz-Tagle Research Associate, University of Cambridge, UK Research Associate, Universidad de Chile,
More informationPARTIAL LEAST SQUARES IS TO LISREL AS PRINCIPAL COMPONENTS ANALYSIS IS TO COMMON FACTOR ANALYSIS. Wynne W. Chin University of Calgary, CANADA
PARTIAL LEAST SQUARES IS TO LISREL AS PRINCIPAL COMPONENTS ANALYSIS IS TO COMMON FACTOR ANALYSIS. Wynne W. Chin University of Calgary, CANADA ABSTRACT The decision of whether to use PLS instead of a covariance
More informationHow to report the percentage of explained common variance in exploratory factor analysis
UNIVERSITAT ROVIRA I VIRGILI How to report the percentage of explained common variance in exploratory factor analysis Tarragona 2013 Please reference this document as: Lorenzo-Seva, U. (2013). How to report
More informationCHAPTER 4 EXAMPLES: EXPLORATORY FACTOR ANALYSIS
Examples: Exploratory Factor Analysis CHAPTER 4 EXAMPLES: EXPLORATORY FACTOR ANALYSIS Exploratory factor analysis (EFA) is used to determine the number of continuous latent variables that are needed to
More informationFactor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis
Factor Analysis Overview Factor analysis is used to uncover the latent structure (dimensions) of a set of variables. It reduces attribute space from a larger number of variables to a smaller number of
More informationA Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis
Tutorials in Quantitative Methods for Psychology 2013, Vol. 9(2), p. 79-94. A Beginner s Guide to Factor Analysis: Focusing on Exploratory Factor Analysis An Gie Yong and Sean Pearce University of Ottawa
More information15.062 Data Mining: Algorithms and Applications Matrix Math Review
.6 Data Mining: Algorithms and Applications Matrix Math Review The purpose of this document is to give a brief review of selected linear algebra concepts that will be useful for the course and to develop
More informationPrincipal Component Analysis
Principal Component Analysis Principle Component Analysis: A statistical technique used to examine the interrelations among a set of variables in order to identify the underlying structure of those variables.
More informationFactor Analysis Using SPSS
Factor Analysis Using SPSS The theory of factor analysis was described in your lecture, or read Field (2005) Chapter 15. Example Factor analysis is frequently used to develop questionnaires: after all
More informationSPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011
SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis
More informationResearch Methodology: Tools
MSc Business Administration Research Methodology: Tools Applied Data Analysis (with SPSS) Lecture 02: Item Analysis / Scale Analysis / Factor Analysis February 2014 Prof. Dr. Jürg Schwarz Lic. phil. Heidi
More informationLeast-Squares Intersection of Lines
Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a
More informationIntroduction to Matrix Algebra
Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary
More informationStatistics for Business Decision Making
Statistics for Business Decision Making Faculty of Economics University of Siena 1 / 62 You should be able to: ˆ Summarize and uncover any patterns in a set of multivariate data using the (FM) ˆ Apply
More informationChapter 7 Factor Analysis SPSS
Chapter 7 Factor Analysis SPSS Factor analysis attempts to identify underlying variables, or factors, that explain the pattern of correlations within a set of observed variables. Factor analysis is often
More informationHow To Run Factor Analysis
Getting Started in Factor Analysis (using Stata 10) (ver. 1.5) Oscar Torres-Reyna Data Consultant otorres@princeton.edu http://dss.princeton.edu/training/ Factor analysis is used mostly for data reduction
More informationSTA 4107/5107. Chapter 3
STA 4107/5107 Chapter 3 Factor Analysis 1 Key Terms Please review and learn these terms. 2 What is Factor Analysis? Factor analysis is an interdependence technique (see chapter 1) that primarily uses metric
More informationPart III. Item-Level Analysis
Part III Item-Level Analysis 6241-029-P3-006-2pass-r02.indd 169 1/16/2013 9:14:56 PM 6241-029-P3-006-2pass-r02.indd 170 1/16/2013 9:14:57 PM 6 Exploratory and Confirmatory Factor Analysis Rex Kline 6.1
More informationPRINCIPAL COMPONENT ANALYSIS
1 Chapter 1 PRINCIPAL COMPONENT ANALYSIS Introduction: The Basics of Principal Component Analysis........................... 2 A Variable Reduction Procedure.......................................... 2
More informationPrincipal Component Analysis
Principal Component Analysis ERS70D George Fernandez INTRODUCTION Analysis of multivariate data plays a key role in data analysis. Multivariate data consists of many different attributes or variables recorded
More informationIndices of Model Fit STRUCTURAL EQUATION MODELING 2013
Indices of Model Fit STRUCTURAL EQUATION MODELING 2013 Indices of Model Fit A recommended minimal set of fit indices that should be reported and interpreted when reporting the results of SEM analyses:
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More informationNCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )
Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates
More informationSimilarity and Diagonalization. Similar Matrices
MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that
More informationPsychology 405: Psychometric Theory Homework on Factor analysis and structural equation modeling
Psychology 405: Psychometric Theory Homework on Factor analysis and structural equation modeling William Revelle Department of Psychology Northwestern University Evanston, Illinois USA June, 2014 1 / 20
More informationFactor Analysis Using SPSS
Psychology 305 p. 1 Factor Analysis Using SPSS Overview For this computer assignment, you will conduct a series of principal factor analyses to examine the factor structure of a new instrument developed
More informationUsing Principal Components Analysis in Program Evaluation: Some Practical Considerations
http://evaluation.wmich.edu/jmde/ Articles Using Principal Components Analysis in Program Evaluation: Some Practical Considerations J. Thomas Kellow Assistant Professor of Research and Statistics Mercer
More informationStatistical Machine Learning
Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes
More informationI n d i a n a U n i v e r s i t y U n i v e r s i t y I n f o r m a t i o n T e c h n o l o g y S e r v i c e s
I n d i a n a U n i v e r s i t y U n i v e r s i t y I n f o r m a t i o n T e c h n o l o g y S e r v i c e s Confirmatory Factor Analysis using Amos, LISREL, Mplus, SAS/STAT CALIS* Jeremy J. Albright
More informationPractical Considerations for Using Exploratory Factor Analysis in Educational Research
A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to
More informationHow to do a factor analysis with the psych package
How to do a factor analysis with the psych package William Revelle Department of Psychology Northwestern University February 28, 2013 Contents 0.1 Jump starting the psych package to do factor analysis
More informationIntroduction to Path Analysis
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationPrinciple Component Analysis and Partial Least Squares: Two Dimension Reduction Techniques for Regression
Principle Component Analysis and Partial Least Squares: Two Dimension Reduction Techniques for Regression Saikat Maitra and Jun Yan Abstract: Dimension reduction is one of the major tasks for multivariate
More informationData analysis process
Data analysis process Data collection and preparation Collect data Prepare codebook Set up structure of data Enter data Screen data for errors Exploration of data Descriptive Statistics Graphs Analysis
More informationSPSS and AMOS. Miss Brenda Lee 2:00p.m. 6:00p.m. 24 th July, 2015 The Open University of Hong Kong
Seminar on Quantitative Data Analysis: SPSS and AMOS Miss Brenda Lee 2:00p.m. 6:00p.m. 24 th July, 2015 The Open University of Hong Kong SBAS (Hong Kong) Ltd. All Rights Reserved. 1 Agenda MANOVA, Repeated
More informationEXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS. sigbert@wiwi.hu-berlin.de
EXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS Sigbert Klinke 1,2 Andrija Mihoci 1,3 and Wolfgang Härdle 1,3 1 School of Business and Economics, Humboldt-Universität zu Berlin, Germany 2 Department of
More informationFEATURE. Abstract. Introduction. Background
FEATURE From Data to Information: Using Factor Analysis with Survey Data Ronald D. Fricker, Jr., Walter W. Kulzy, and Jeffrey A. Appleget, Naval Postgraduate School; rdfricker@nps.edu Abstract In irregular
More informationQuestionnaire Evaluation with Factor Analysis and Cronbach s Alpha An Example
Questionnaire Evaluation with Factor Analysis and Cronbach s Alpha An Example - Melanie Hof - 1. Introduction The pleasure writers experience in writing considerably influences their motivation and consequently
More informationMultivariate Analysis
Table Of Contents Multivariate Analysis... 1 Overview... 1 Principal Components... 2 Factor Analysis... 5 Cluster Observations... 12 Cluster Variables... 17 Cluster K-Means... 20 Discriminant Analysis...
More informationFactorial Invariance in Student Ratings of Instruction
Factorial Invariance in Student Ratings of Instruction Isaac I. Bejar Educational Testing Service Kenneth O. Doyle University of Minnesota The factorial invariance of student ratings of instruction across
More informationSimple Linear Regression Inference
Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation
More informationExtending the debate between Spearman and Wilson 1929: When do single variables optimally reproduce the common part of the observed covariances?
1 Extending the debate between Spearman and Wilson 1929: When do single variables optimally reproduce the common part of the observed covariances? André Beauducel 1 & Norbert Hilger University of Bonn,
More informationPrincipal components analysis
CS229 Lecture notes Andrew Ng Part XI Principal components analysis In our discussion of factor analysis, we gave a way to model data x R n as approximately lying in some k-dimension subspace, where k
More informationThe Case for Hyperplane Fitting Rotations in Factor Analysis: A Comparative Study of Simple Structure
Journal of Data Science 10(2012), 419-439 The Case for Hyperplane Fitting Rotations in Factor Analysis: A Comparative Study of Simple Structure James S. Fleming Southwest Psychometrics and Psychology Resources
More informationIntroduction to General and Generalized Linear Models
Introduction to General and Generalized Linear Models General Linear Models - part I Henrik Madsen Poul Thyregod Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby
More information[1] Diagonal factorization
8.03 LA.6: Diagonalization and Orthogonal Matrices [ Diagonal factorization [2 Solving systems of first order differential equations [3 Symmetric and Orthonormal Matrices [ Diagonal factorization Recall:
More informationSpecification of Rasch-based Measures in Structural Equation Modelling (SEM) Thomas Salzberger www.matildabayclub.net
Specification of Rasch-based Measures in Structural Equation Modelling (SEM) Thomas Salzberger www.matildabayclub.net This document deals with the specification of a latent variable - in the framework
More informationIntroduction to Structural Equation Modeling. Course Notes
Introduction to Structural Equation Modeling Course Notes Introduction to Structural Equation Modeling Course Notes was developed by Werner Wothke, Ph.D., of the American Institute of Research. Additional
More informationDATA ANALYSIS AND INTERPRETATION OF EMPLOYEES PERSPECTIVES ON HIGH ATTRITION
DATA ANALYSIS AND INTERPRETATION OF EMPLOYEES PERSPECTIVES ON HIGH ATTRITION Analysis is the key element of any research as it is the reliable way to test the hypotheses framed by the investigator. This
More informationBest Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis
A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to
More informationConfirmatory factor analysis in MPlus
Jan Štochl, Ph.D. Department of Psychiatry University of Cambridge Email: js883@cam.ac.uk Confirmatory factor analysis in MPlus The Psychometrics Centre Agenda of day 1 General ideas and introduction to
More informationDATA ANALYSIS II. Matrix Algorithms
DATA ANALYSIS II Matrix Algorithms Similarity Matrix Given a dataset D = {x i }, i=1,..,n consisting of n points in R d, let A denote the n n symmetric similarity matrix between the points, given as where
More informationPull and Push Factors of Migration: A Case Study in the Urban Area of Monywa Township, Myanmar
Pull and Push Factors of Migration: A Case Study in the Urban Area of Monywa Township, Myanmar By Kyaing Kyaing Thet Abstract: Migration is a global phenomenon caused not only by economic factors, but
More informationApplications of Structural Equation Modeling in Social Sciences Research
American International Journal of Contemporary Research Vol. 4 No. 1; January 2014 Applications of Structural Equation Modeling in Social Sciences Research Jackson de Carvalho, PhD Assistant Professor
More informationFactor Analysis - SPSS
Factor Analysis - SPSS First Read Principal Components Analysis. The methods we have employed so far attempt to repackage all of the variance in the p variables into principal components. We may wish to
More informationQ FACTOR ANALYSIS (Q-METHODOLOGY) AS DATA ANALYSIS TECHNIQUE
Q FACTOR ANALYSIS (Q-METHODOLOGY) AS DATA ANALYSIS TECHNIQUE Gabor Manuela Rozalia Petru Maior Univerity of Tg. Mure, Faculty of Economic, Legal and Administrative Sciences, Rozalia_gabor@yahoo.com, 0742
More informationFactor Rotations in Factor Analyses.
Factor Rotations in Factor Analyses. Hervé Abdi 1 The University of Texas at Dallas Introduction The different methods of factor analysis first extract a set a factors from a data set. These factors are
More information9.2 User s Guide SAS/STAT. The FACTOR Procedure. (Book Excerpt) SAS Documentation
SAS/STAT 9.2 User s Guide The FACTOR Procedure (Book Excerpt) SAS Documentation This document is an individual chapter from SAS/STAT 9.2 User s Guide. The correct bibliographic citation for the complete
More informationHow to Get More Value from Your Survey Data
Technical report How to Get More Value from Your Survey Data Discover four advanced analysis techniques that make survey research more effective Table of contents Introduction..............................................................2
More informationExample: Credit card default, we may be more interested in predicting the probabilty of a default than classifying individuals as default or not.
Statistical Learning: Chapter 4 Classification 4.1 Introduction Supervised learning with a categorical (Qualitative) response Notation: - Feature vector X, - qualitative response Y, taking values in C
More informationManifold Learning Examples PCA, LLE and ISOMAP
Manifold Learning Examples PCA, LLE and ISOMAP Dan Ventura October 14, 28 Abstract We try to give a helpful concrete example that demonstrates how to use PCA, LLE and Isomap, attempts to provide some intuition
More informationMehtap Ergüven Abstract of Ph.D. Dissertation for the degree of PhD of Engineering in Informatics
INTERNATIONAL BLACK SEA UNIVERSITY COMPUTER TECHNOLOGIES AND ENGINEERING FACULTY ELABORATION OF AN ALGORITHM OF DETECTING TESTS DIMENSIONALITY Mehtap Ergüven Abstract of Ph.D. Dissertation for the degree
More informationLeast Squares Estimation
Least Squares Estimation SARA A VAN DE GEER Volume 2, pp 1041 1045 in Encyclopedia of Statistics in Behavioral Science ISBN-13: 978-0-470-86080-9 ISBN-10: 0-470-86080-4 Editors Brian S Everitt & David
More informationEFFECT OF ENVIRONMENTAL CONCERN & SOCIAL NORMS ON ENVIRONMENTAL FRIENDLY BEHAVIORAL INTENTIONS
169 EFFECT OF ENVIRONMENTAL CONCERN & SOCIAL NORMS ON ENVIRONMENTAL FRIENDLY BEHAVIORAL INTENTIONS Joshi Pradeep Assistant Professor, Quantum School of Business, Roorkee, Uttarakhand, India joshipradeep_2004@yahoo.com
More information