FACTOR ANALYSIS. Examples. Identification of factors of intelligence out of a variety of tests.

Size: px
Start display at page:

Download "FACTOR ANALYSIS. Examples. Identification of factors of intelligence out of a variety of tests."

Transcription

1 FACTOR ANALYSIS Factor Analysis is an explorative statistical technique to identify a relatively small number of factors that can be used to represent relationships among sets of many interrelated variables. Examples Identification of factors of intelligence out of a variety of tests. Calculation of touristic attractiveness from single touristic opportunities. Identification of factors of urban renewal out of single renewal measures. Steps in Factor Analysis 1. Standardization of the variables For the comparison of variables measured on different scales it is useful to perform the socalled z- transformation (mean: 0, variance: 1): 1

2 z ik = (x ik - x k ) / s k x ik x k s k z ik Value of variable k on observation i Mean of variable k Standard deviation of variable k Standardized value of variable x ik 2. Correlation analysis The correlation matrix is computed from the matrix of the standardized variables: Z Transposed of Z K Number of variables R = (1/(K-1))*ZZ Variables that do not appear to be related to other variables can be identified from the matrix. The appropriateness of the factor model can be evaluated. Factor analysis assumes, that the correlations between the (standardized) variables can be described by certain factors and tries to uncover these factors by mathematical and statististical techniques. 2

3 3. The basic assumptions of factor analysis Assumption: Each variable x ik (or the standardized z ik ) can be described as a linear combination of certain unobservable factors: z ik = a i1 *p 1k + a i2 *p 2k a iq *p qk Z = A * P (K*I) = (K*Q)*(Q*I) K I Q A P Number of variables Number of observations Number of factors K*Q matrix of factor-loadings; describing the relationship between variables and factors Q*I matrix of factor-scores; describing the relationship between factors and observations Substituting the last relationship into the first equation yields: R = 1/(K-1) ZZ = 1/(K-1) (AP)(AP) = 1/(K-1) APP A = ACA C Correlation matrix of the factor scores As the factors are supposed to be uncorrelated, C turns out to be the unity matrix and we can derive 3

4 the socalled fundamental theorem of factor analysis: R = AA The fundamental theorem implies, that the correlation matrix of the data to be analysed can be represented by the product of the matrix of the factor loadings and its transposed. If the extracted factors explain the variance of the basic data completely, then the squared sum of the factor loadings equals 1. But usually the basic variables are not only explained by the extracted factors (common factors), but also by factors which are unique to the dependent variable (unique factors). The squared sum of the loadings of common factors is called communality: R Reduced correlation matrix U Matrix of unique factors R = AA + UU R = AA 4

5 R differs from the correlation matrix, that in the main diagonal we find the communalities (and not values of 1). 4. The problem of the estimation of the communalities The exact estimation of the communalities can be performed only after factor extraction, on the other hand they are necessary for solving the fundamental theorem: this fact leads to a central problem of factor analysis, namely to the necessity of an a- priori estimation of the communalities: This can be done in different ways: As an estimated value for the communality the highest correlation coeffiecient of the variable under consideration with any other variable is used. This method has to be considered a very rough estimation, but practical applications have turned out to be quite meaningful. Another method would be to estimate the communalities iteratively with the highest correlation coefficient as the starting value. Both methods are known as Principal Axis Factoring (Hauptachsenanalyse). 5

6 No explicit estimation of the communalities is performed, but the original correlation matrix (with one s in the main diagonal) is used. It is assumed that the total variance can be explained by the common factors. This method is called Principal Component Analysis (Hauptkomponentenanalyse). In principal components analysis analysis linear combinations of the observed variables are formed. The first component is the combination that accounts for the largest ammount of variance. Succesive components explain progressively smaller portions of the total sample variance, and are all uncorrelated with each other. It is possible to compute as many principal components as there are variables. If all principal components are used, each variable can be exactly represented by them, but nothing has been gained, since there are as many factors as variables. In general, principal components analysis is a separate technique from factor analysis. That is, it can be used whenever uncorrelated linear combinations of the observed variables are desired. 5. The phase of factor extraction Several different methods can be used to obtain estimates of the common factors. These methods differ in the criterion used to define "good fit". The unweighted leastsquares method produces, for example, for a fixed 6

7 number of factors, a factor pattern matrix that minimizes the sum of the squared differences between the observed and reproduced correlation matrices (ignoring the diagonals). The generalized least squares method minimizes the same criterion; however, correlations are weighted inversely by the uniqueness of the variables. That is, correlations involving variables with high uniqueness are given less weight than correlations involving variables with low uniqueness. The second problem in factor extraction phase is to determine the number of factors needed to describe adequately the data. Similar to factor extraction different methods may be applied to that problem. Two examples are presented in detail: Kaiser Criterion: The number of factors to be extracted equals the number of factors for which the eigenvalue is greater than 1 (the eigenvalue represents the percentage of total variance explained by each factor and equals the sum of the squared factor loadings). Factors with a variance less than 1 are no better than a single variable, since each variable has a variance of 1. Although this a very commonly used criterion (also default criterion in the SPSS Factor Analysis), it is not always a good solution. 7

8 Bartlett-Test II: Checks, when k factors have already been extracted, if factor k+1 is still significant due to a Chi-Square distribution. 6. The Rotation Phase Although the factor matrix obtained in the extraction phase indicates the relation between the factors and the individual variables, it is usually difficult to identify meaningful factors based on this matrix. Often the variables and factors do not appear to be correlated in any interpretable pattern. Most factors are correlated with many variables. Since one of the goals of factor analysis is to identify factors, that are substantively meaningful (in the sense that they summarize sets of closely related variables), the rotation phase of factor analysis aims to transform the initial matrix into one that is easier to interpret. Consider the following plot with two factors and four hypothetical variables. From the factor loadings, it is difficult to interpret any of the factors, since the variables and factors are intertwined. That is, all factor loadings are quite high, and both factors explain all of the variables. But this changes dramatically, if the axes are rotated (according to the dotted line). The rotation is called orthogonal, when the axes are maintained at right angles, otherwise the rotation is called oblique. 8

9 The purpose of rotation is to achieve a simple structure. This means that we would like each fac- 9

10 tor to have nonzero loadings for only some of the variables, which helps us to interpret the factors. We would also like each variable to have nonzero loadings for only a few factors, preferebly one. This permits the factors to differ from each other. If several factors have high loadings on the same variables, it is difficult to ascertain how the factors differ. A variety of algorithms is used for orthogonal rotation to a simple structure. The most commonly used method is the varimax method, which attempts to minimize the number of variables that have high loadings on a factor. This should enhance the interpretability of the factors. The quartimax method emphasizes simple interpretation of variables, since the solution minimizes the number of factors needed to explain a variable. A quartimax rotation often results in a general factor with high-to-moderate loadings on most variables. This is one of the main shortcomings of the quartimax method. The equamax method is a combination of the varimax method, which simplifies the factors, and the quartimax method, which simplifies variables. 10

11 7. Estimation of Factor Scores Since one of the goals of factor analysis is to reduce a large number of variables to a smaller number of factors, it is often desirable to estimate factor scores for each case. The factor scores can be used in subsequent analyses to represent the values of the factors. Plots of factor scores for pairs of factors are useful for detecting unusual observations. Recall that a factor can be estimated as a linear combination of the original variables. That is, for case k, the score for the jth factor is estimated as: p F = jk W ji Xik i= 1 where X ik is the standardized value of the ith variable for case k and W ji is the factor score coefficient for the jth factor and the ith variable. There are several methods of estimating factor score coefficients. Each has different properties and results in different scores. The most common one (and the default in the SPSS-Procedure Factor Analysis) is the regression method. 11

12 Recommendations for Factor Analysis Data: The variables should be quantitative at the interval or ratio level. Categorical data (such as religion or country of origin) are not suitable for factor analysis. Data for which Pearson correlation coefficients can sensibly be calculated should be suitable for factor analysis. Assumptions: The data should have a bivariate normal distribution for each pair of variables, and observations should be independent. The factor analysis model specifies that variables are determined by common factors (the factors estimated by the model) and unique factors (which do not overlap between observed variables); the computed estimates are based on the assumption that all unique factors are uncorrelated with each other and with the common factors. Three main fields of applications of factor analysis can be identified: Initial structuring of a relatively little known new field of scientific interest (classical example of intelligence research) but also: Identification of 12

13 characteristical "constructs" (e.g economic-, family-, ethnic status) within the "Social Area Analysis". Estimation of variables which cannot be measured or observed directly. Simple data reduction (Reduction of dimensions to describe certain variables) Applying factor analysis requires a very careful selection of the variables involved. Forgetting important variables could lead to severe mistakes interpreting the results. Before an interpretation the significances of the factors have to be examined. Significant factors, which additionally approach a simple structure should be interpreted on the basis of scientific knowledge and experience. Factors which obviously represent pure statistical artefacts have to be dropped from the analysis. Applying factor analysis involves two kinds of statistical procedures: 13

14 straight forward algorithms (e.g. standardizing the variables or calculating the correlations), procedures depending on the subjective judgements of the scientist (number of factors, estimation of communalities). Especially decisions of the second type require a high ammount of personal skill and responsability. 14

15 SPSS PROCEDURES FOR FACTOR ANALYSIS 15

16 16

17 17

18 18

19 19

20 20

21 SPSS-OUTPUT FROM FACTOR- ANALYSIS 1. Principal Component Analysis Descriptive Statistics ABIPRO ARL_RATE BFZ_20EW BFZ_50EW BFZ_BEZ BFZ_LHS BFZ_NBEZ BFZ_NLHS BFZ_WIEN KKPOTIV KKPOTOV LANDP SFZ_20EW SFZ_50EW SFZ_BEZ SFZ_LHS SFZ_NBEZ SFZ_NLHS SFZ_WIEN SO WI Std. Mean Deviation Analysis N 8,8828 4, ,57E-02 1,5062E ,23 35, ,70 36, ,06 21, ,23 49, ,13 19, ,41 40, ,95 107, , , , , , , ,20 17, ,64 17, ,85 9, ,74 23, ,55 8, ,35 19, ,12 81, ,3024, ,2058,

22 Component ABIPRO ARL_RATE BFZ_20EW BFZ_50EW BFZ_BEZ BFZ_LHS BFZ_NBEZ BFZ_NLHS BFZ_WIEN KKPOTIV KKPOTOV LANDP SFZ_20EW SFZ_50EW SFZ_BEZ SFZ_LHS SFZ_NBEZ SFZ_NLHS SFZ_WIEN SO WI Communalities Initial Extraction Extraction Method: Principal Component Analysis. Total Variance Explained Initial Eigenvalues Extraction Sums of Squared Loadings Rotation Sums of Squared Loadings % of Cumulative % of Cumulative % of Cumulative Total Variance % Total Variance % Total Variance % 9,135 43,500 43,500 9,135 43,500 43,500 6,718 31,989 31,989 2,971 14,147 57,647 2,971 14,147 57,647 4,103 19,536 51,525 2,849 13,565 71,212 2,849 13,565 71,212 2,122 10,104 61,629 1,576 7,505 78,717 1,576 7,505 78,717 1,791 8,530 70,159,947 4,509 83,226,947 4,509 83,226 1,120 5,332 75,491,734 3,494 86,720,734 3,494 86,720 1,014 4,831 80,322,635 3,024 89,744,635 3,024 89,744 1,009 4,803 85,125,449 2,139 91,882,449 2,139 91,882,996 4,742 89,867,377 1,797 93,679,377 1,797 93,679,536 2,554 92,421,277 1,319 94,998,277 1,319 94,998,362 1,722 94,143,247 1,176 96,174,247 1,176 96,174,305 1,452 95,595,211 1,003 97,176,211 1,003 97,176,215 1,023 96,618,194,925 98,102,194,925 98,102,211 1,004 97,622,140,668 98,770,140,668 98,770,165,785 98,407,120,573 99,343,120,573 99,343 8,980E-02,428 98,835 5,003E-02,238 99,581 5,003E-02,238 99,581 8,960E-02,427 99,261 3,551E-02,169 99,750 3,551E-02,169 99,750 8,665E-02,413 99,674 2,446E-02,116 99,867 2,446E-02,116 99,867 2,826E-02,135 99,809 1,385E-02 6,593E-02 99,933 1,385E-02 6,593E-02 99,933 2,051E-02 9,765E-02 99, ,505E-03 3,574E-02 99,968 7,505E-03 3,574E-02 99,968 1,276E-02 6,078E-02 99, ,621E-03 3,153E ,000 6,621E-03 3,153E ,000 6,937E-03 3,303E ,000 Extraction Method: Principal Component Analysis. 22

23 10 Scree Plot Eigenvalue Component Number Component Matrix a Component ABIPRO ARL_RATE BFZ_20EW BFZ_50EW BFZ_BEZ BFZ_LHS BFZ_NBEZ BFZ_NLHS BFZ_WIEN KKPOTIV KKPOTOV LANDP SFZ_20EW SFZ_50EW SFZ_BEZ SFZ_LHS SFZ_NBEZ SFZ_NLHS SFZ_WIEN SO WI ,498,337 2,645E-02,488 4,664E-02,145 -,422,414,134-3,24E-02 8,161E-02-2,14E-02-3,49E-02 5,847E-03 1,408E-02 7,695E-03 3,082E-03-1,19E-03-9,97E-04 8,854E-04 2,105E-04,262,445-4,71E-02,176,569 -,588,103 5,361E-02 7,803E-02 6,697E-02-1,46E-02 6,979E-02-3,96E-02 1,571E-02 1,177E-02-4,54E-03 6,620E-03 3,608E-03 1,546E-03-2,80E-04 8,148E-05,867 9,643E-02 -,225-5,32E-02 -,175,127-1,59E-02-5,46E-02,221,206 5,069E-02,151 -,103-2,68E-02 2,280E-02-2,48E-02 5,761E-02-2,75E-03 4,203E-02 2,896E-02 1,209E-02,882,124 -,243-8,54E-03 3,805E-02 4,827E-02 3,755E-02-8,69E-02,158 -,221,200 3,462E-02-3,41E-03 -,110-4,52E-02-3,45E-02 5,491E-02-1,05E-02-2,37E-02-3,45E-02-1,62E-02,648 -,340,591,240 7,979E-02 4,837E-02 3,789E-02-3,54E-02-8,85E-03-2,03E-02 3,366E-02 2,908E-02 8,762E-03-5,94E-02,170,101 1,482E-02 1,870E-03 1,636E-03-2,15E-02 3,571E-02,784 3,331E-02 -,440,274 1,303E-02 5,196E-02-5,28E-02 1,067E-02 -,273 1,965E-02 5,831E-02 9,442E-02-6,65E-02-8,55E-02-1,35E-02 1,913E-03-8,12E-02 4,819E-02 4,367E-02-1,61E-02-1,26E-02,670 -,311,589,221 5,526E-02 4,171E-02 3,053E-02-1,31E-02 2,286E-03 2,198E-02 5,064E-02 5,119E-02-3,33E-02 6,911E-02 -,165,112 1,535E-02 1,783E-03-5,97E-03 1,891E-02-3,27E-02,875,112 -,368 7,176E-02-1,80E-02 6,633E-02 3,633E-03-5,27E-02 2,562E-03 -,124 8,528E-02 9,232E-02-3,65E-02,173 5,424E-02-8,07E-03-5,77E-02 1,811E-02-5,57E-02 2,700E-02 1,792E-02,386,559,368 -,539,210,190-1,05E-02 8,396E-02-6,44E-02 3,331E-03 4,027E-02 7,339E-02-3,18E-02-1,63E-02 5,479E-03 1,188E-02-5,96E-02-9,58E-02 8,786E-03-1,71E-03-1,60E-03 -,725,260-9,93E-02,279,158,220,318-1,56E-02-4,49E-02,183,265-1,93E-02,191 4,272E-02 9,064E-03-7,15E-03 2,763E-03-1,20E-04 1,975E-03 6,657E-04 3,317E-04 -,541,414-2,47E-02,397 2,775E-02,284,456 5,687E-02 6,822E-02 -,117 -,199 4,385E-02 -,156-3,10E-02-8,96E-03 3,924E-03-2,62E-04-5,07E-04-1,22E-03-2,29E-04-2,05E-04,257 -,615 -,175 -,358 -,184 -,153,331,470-3,31E-02-1,82E-02 8,331E-02 2,801E-02-2,15E-02 6,927E-04 1,279E-02 3,637E-03 7,154E-03 4,564E-03-6,60E-04 4,507E-04 2,654E-04,877,145 -,190-5,95E-02-8,73E-02 9,000E-02 1,999E-02 6,872E-02,199,281 -,135-6,40E-02 4,618E-02-3,05E-02-3,29E-03 2,512E-02-4,73E-02 1,617E-02-4,54E-02-2,88E-02-1,09E-02,884,171 -,218-1,34E-02,105 6,160E-03 7,441E-02 3,998E-02,133 -,140-2,97E-02 -,207,156 -,110-5,03E-02 3,477E-02-3,47E-02 8,497E-03 2,727E-02 3,498E-02 1,421E-02,648 -,334,603,224 8,394E-02 5,015E-02 3,868E-02 1,993E-02 4,392E-03-2,86E-03-3,00E-02-3,94E-02 3,346E-02-4,09E-02,158 -,103-1,37E-02-3,15E-03-4,65E-03 2,176E-02-3,85E-02,790 7,583E-02 -,372,270 4,333E-02 3,531E-02-4,29E-02 7,322E-02 -,340 8,439E-02-8,49E-02-4,64E-02 1,242E-02-7,12E-02-3,09E-02-9,99E-03 7,783E-02-4,78E-02-3,61E-02 1,366E-02 1,017E-02,676 -,312,588,210 6,778E-02 5,075E-02 2,937E-02 4,870E-02 1,735E-02 2,460E-02-1,88E-02-2,40E-02 2,914E-03 7,082E-02 -,158 -,110-2,01E-02-2,06E-03 1,171E-02-1,94E-02 3,539E-02,874,154 -,342 4,385E-02-6,77E-05 6,498E-02 1,847E-02 3,336E-02-1,38E-02-6,29E-02-9,20E-02-9,19E-02 5,980E-02,231 6,528E-02 1,525E-02 4,302E-02-2,05E-02 4,549E-02-2,39E-02-1,50E-02,286,584,439 -,510,216,203-2,42E-02 8,230E-02 -,121-3,12E-03-1,01E-02-3,03E-02-1,79E-02 1,093E-02 3,707E-03-1,04E-02 5,547E-02 9,669E-02-6,94E-03 2,161E-03 1,810E-03,201,661,392,134 -,456 -,184 1,961E-02 6,261E-02-3,48E-02-6,54E-02-8,02E-02,205,224-1,47E-02-1,22E-02-4,40E-03 4,393E-03 5,205E-03 8,890E-04-5,95E-04-5,92E-04,266,643,375,116 -,433 -,235 9,709E-02-4,76E-02-5,96E-02 4,383E-02,148 -,223 -,173 1,236E-02 1,713E-02 1,646E-03-9,62E-03-6,46E-03-1,26E-04-3,91E-04 6,007E-04 Extraction Method: Principal Component Analysis. a. 21 components extracted. Rotated Component Matrix a Component ABIPRO ARL_RATE BFZ_20EW BFZ_50EW BFZ_BEZ BFZ_LHS BFZ_NBEZ BFZ_NLHS BFZ_WIEN KKPOTIV KKPOTOV LANDP SFZ_20EW SFZ_50EW SFZ_BEZ SFZ_LHS SFZ_NBEZ SFZ_NLHS SFZ_WIEN SO WI ,248 -,189-9,43E-02 8,955E-02,172 3,546E-02 -,225,893 7,450E-02-2,32E-02 3,405E-03-9,60E-03-5,46E-03-6,98E-03-6,90E-04 5,879E-04 1,369E-03-3,50E-04-6,28E-04 1,439E-04 8,100E-06,215 4,948E-03,126,105 2,444E-02,957-9,82E-02 3,032E-02 1,311E-02-5,62E-04 1,111E-02 1,223E-02 1,817E-03 2,825E-03 5,432E-06 1,580E-04 5,796E-04 1,299E-04-7,57E-04 3,862E-05-3,35E-06,831,195,119,113 -,136-5,46E-02 5,938E-02 -,124-8,69E-02,363 -,112 -,143 7,831E-03,118 1,094E-02-1,40E-02 1,567E-02 4,094E-03,128 6,583E-03 9,731E-05,867,210,140 4,826E-02 -,102 8,771E-02 3,310E-02 -,128-6,80E-02-4,51E-02 -,168 9,349E-02 1,308E-02,321 7,820E-03-5,29E-03-4,64E-04 2,188E-03 3,384E-03 9,507E-03 3,215E-04,187,948 4,281E-02 4,267E-02-8,54E-02 4,005E-03 2,166E-02-8,02E-02-4,23E-02-6,99E-03-2,34E-03-1,52E-03-3,92E-03 2,061E-02-4,73E-02 -,204 1,807E-02 2,553E-03 3,129E-03 2,766E-03 4,263E-02,911,139 -,106-1,21E-02-6,66E-02 6,988E-02 1,279E-02-4,67E-03-2,91E-03-9,00E-02,237 -,110 2,863E-03 6,410E-04 9,409E-03-1,60E-02,230 3,477E-03-9,60E-04 2,315E-02 6,609E-04,206,936 6,508E-02 7,178E-02-9,83E-02 6,599E-03 3,534E-02-7,31E-02-4,49E-02 1,846E-02-4,78E-03-2,89E-02 5,242E-03 2,055E-02,220 4,409E-02 8,631E-03 1,543E-03 2,189E-03-2,83E-03-3,11E-02,951,145 5,207E-02 4,054E-02-8,61E-02 5,726E-02 3,411E-02-9,81E-02-6,40E-02-8,12E-02 -,136 -,105-6,85E-03-1,85E-02 8,267E-03 2,168E-03-9,23E-03 1,298E-02-2,65E-02-8,83E-02-1,06E-03,159 9,121E-02,950,176-4,84E-02 8,063E-02-3,19E-02-6,08E-02-3,02E-02 3,890E-02-3,70E-02-9,14E-03-1,82E-02 3,133E-02 7,391E-03-7,48E-03 1,978E-02,120 3,138E-03-4,04E-03 1,174E-04 -,401 -,366 -,102-4,15E-02,420 3,482E-02 -,170,164,677-3,66E-02 3,017E-04-1,47E-02 5,056E-03-6,87E-03-1,65E-04-1,06E-03 2,170E-03-1,82E-04-7,80E-04 6,867E-05 9,284E-06 -,245 -,255-5,59E-02,120,884 2,657E-02 -,164,167,138-2,44E-02-6,47E-03-5,26E-03-2,41E-03-5,63E-03-1,09E-03-1,36E-04-1,09E-03-4,35E-04-6,65E-04 8,011E-05-1,07E-05,120,112 -,126 -,198 -,160 -,113,911 -,210-7,21E-02 1,692E-02 5,122E-04 6,023E-03 1,199E-04 1,371E-03 6,924E-05 1,026E-03-6,24E-04 4,044E-04 2,348E-04 5,696E-05-7,96E-06,810,211,180,111 -,110 3,118E-02 9,035E-02-9,42E-02-7,60E-02,449 4,584E-03 9,538E-02-1,95E-03-7,19E-02-4,94E-03 1,348E-02-2,08E-02-6,14E-04-5,62E-02-2,38E-03-1,69E-04,843,214,186 5,472E-02-6,96E-02,163 6,566E-02 -,103-7,62E-02 4,025E-02-4,74E-02,384 2,879E-03 4,956E-02-1,10E-02 3,929E-03-2,61E-02-1,74E-03-2,31E-03 1,999E-03-2,40E-05,178,951 6,433E-02 4,309E-02-7,81E-02 6,922E-03 4,635E-02-5,91E-02-5,93E-02 2,200E-02 1,756E-02 3,645E-02 3,895E-04-1,19E-02 -,192-3,76E-02-1,13E-02-2,03E-03-1,09E-03-2,48E-03-5,07E-02,874,172-4,83E-02 2,047E-02-5,32E-02,102 1,128E-02 3,296E-03-8,08E-03-4,57E-02,429-1,66E-02 1,488E-03-5,75E-02-3,70E-03 4,495E-03 8,353E-03-2,62E-03-3,36E-03-2,71E-03-1,60E-04,209,938 8,136E-02 5,776E-02-8,74E-02 7,490E-03 6,254E-02-4,57E-02-6,48E-02 3,986E-02 1,481E-02 2,459E-02 2,381E-03-9,07E-03 3,744E-02,209-1,38E-02-1,55E-03-1,91E-03 2,957E-03 3,979E-02,932,139,105 5,528E-02-6,43E-02 7,230E-02 5,378E-02-8,06E-02-8,20E-02-1,89E-02-3,47E-02 3,900E-02-5,25E-04 -,185-1,02E-02 1,523E-02 -,174-1,02E-02-1,25E-02 6,490E-02 8,572E-04 5,310E-02 9,108E-02,959,198-1,69E-02 6,298E-02-8,41E-02-3,12E-02-2,15E-02 6,009E-04 1,898E-02 2,964E-02 1,793E-02-2,13E-02-6,63E-03 9,032E-03-2,68E-02 -,116-2,22E-03 4,059E-03-1,49E-04 7,314E-02 8,416E-02,228,895 7,310E-02 5,334E-02 -,115 9,214E-02-3,15E-02 1,315E-02-1,86E-03 1,248E-03 -,323-5,05E-03-1,60E-04-5,08E-04-1,86E-03 1,614E-03 6,873E-05-1,89E-04 2,723E-05,118,105,220,894 4,472E-02 8,897E-02 -,110 5,954E-03 8,152E-03 1,817E-02 9,700E-04 5,675E-03,325 8,664E-03 1,723E-03 1,483E-03-6,51E-04-1,46E-03 9,612E-04 2,395E-04-6,17E-05 Extraction Method: Principal Component Analysis. Rotation Method: Varimax with Kaiser Normalization. a. Rotation converged in 22 iterations. 23

24 2. Principal Axis Factoring Communalities Initial Extraction ABIPRO,446,460 ARL_RATE,304,192 BFZ_20EW,969,791 BFZ_50EW,972,835 BFZ_BEZ,977,926 BFZ_LHS,965,861 BFZ_NBEZ,974,927 BFZ_NLHS,976,921 BFZ_WIEN,948,896 KKPOTIV,682,625 KKPOTOV,581,531 LANDP,445,470 SFZ_20EW,969,809 SFZ_50EW,971,841 SFZ_BEZ,980,934 SFZ_LHS,956,804 SFZ_NBEZ,977,932 SFZ_NLHS,969,904 SFZ_WIEN,947,861 SO,661,542 WI,657,529 Extraction Method: Principal Axis Factoring. 24

25 Factor Total Variance Explained Initial Eigenvalues Extraction Sums of Squared Loadings Rotation Sums of Squared Loadings % of Cumulative % of Cumulative % of Cumulative Total Variance % Total Variance % Total Variance % 9,135 43,500 43,500 8,955 42,645 42,645 6,856 32,648 32,648 2,971 14,147 57,647 2,760 13,141 55,786 4,140 19,715 52,363 2,849 13,565 71,212 2,594 12,351 68,137 2,547 12,129 64,492 1,576 7,505 78,717 1,282 6,104 74,241 2,047 9,749 74,241,947 4,509 83,226,734 3,494 86,720,635 3,024 89,744,449 2,139 91,882,377 1,797 93,679,277 1,319 94,998,247 1,176 96,174,211 1,003 97,176,194,925 98,102,140,668 98,770,120,573 99,343 5,003E-02,238 99,581 3,551E-02,169 99,750 2,446E-02,116 99,867 1,385E-02 6,593E-02 99,933 7,505E-03 3,574E-02 99,968 6,621E-03 3,153E ,000 Extraction Method: Principal Axis Factoring. 10 Scree Plot Eigenvalue Factor Number 25

26 ABIPRO ARL_RATE BFZ_20EW BFZ_50EW BFZ_BEZ BFZ_LHS BFZ_NBEZ BFZ_NLHS BFZ_WIEN KKPOTIV KKPOTOV LANDP SFZ_20EW SFZ_50EW SFZ_BEZ SFZ_LHS SFZ_NBEZ SFZ_NLHS SFZ_WIEN SO WI Factor Matrix a Factor ,472,123,230,412,242,210,262,145,855,236-3,85E-02-4,95E-02,874,264-2,85E-02-1,24E-02,650 -,684 1,784E-02,186,780,366 -,234,254,673 -,666 4,349E-02,172,876,367 -,116 6,954E-02,385 2,533E-02,730 -,464 -,701,188,139,281 -,516,201,277,383,243 -,154 -,512 -,355,867,234 2,124E-02-5,22E-02,877,268 2,492E-02-1,22E-02,652 -,692 3,238E-02,171,782,327 -,157,247,679 -,666 4,406E-02,159,873,367-6,21E-02 4,693E-02,284-1,94E-02,779 -,416,194 3,856E-02,671,228,255 4,271E-02,647,209 Extraction Method: Principal Axis Factoring. a. 4 factors extracted. 7 iterations required. 26

27 ABIPRO ARL_RATE BFZ_20EW BFZ_50EW BFZ_BEZ BFZ_LHS BFZ_NBEZ BFZ_NLHS BFZ_WIEN KKPOTIV KKPOTOV LANDP SFZ_20EW SFZ_50EW SFZ_BEZ SFZ_LHS SFZ_NBEZ SFZ_NLHS SFZ_WIEN SO WI Rotated Factor Matrix a Factor ,279 -,205 -,140,566,302 1,127E-03,192,253,823,210,192 -,184,858,207,184 -,148,193,935 5,869E-02-9,97E-02,905,140 -,146-1,96E-02,216,929 9,211E-02-9,68E-02,939,142 7,045E-02 -,115,161 7,763E-02,930-1,82E-02 -,442 -,413 -,196,469 -,284 -,297-9,64E-02,594,120,119 -,171 -,642,823,220,244 -,155,856,208,228 -,117,185,940 7,867E-02 -,105,875,176-8,02E-02 1,164E-02,218,929,101 -,108,927,137,126 -,101 5,640E-02 8,101E-02,921 5,846E-02,134,164,468,527,187,184,472,487 Extraction Method: Principal Axis Factoring. Rotation Method: Varimax with Kaiser Normalization. a. Rotation converged in 7 iterations. The first factor could be interpreted as "peripheral". All distance variables (BFZs and SFZs take on high factor loadings; also there is little tourism). The second factor could be denominated as "intermediate". In many variables (tourism, purchasing power) it is close to the first factor, but accessibility is generally better. The third factor resembles the second factor concerning accessibility, except that the factor loadings for distances to Vienna are very high. Moreover the loadings for tourism (SO, WI) are quite high. Factor 3 could therefore be characterized as "touristic-west austrian". Finally the fourth factor is clearly the "central place" factor (negative 27

28 loadings with the distance variables; highest with purchasing power and share of graduates). In this example you can see the factor scores for some communities of the federal state of Burgenland. Obviously all the scores for factor 3 (touristic-west Austria) are negative. Looking at factor 4 the federal capital Eisenstadt takes on the highest value. 28

Chapter 7 Factor Analysis SPSS

Chapter 7 Factor Analysis SPSS Chapter 7 Factor Analysis SPSS Factor analysis attempts to identify underlying variables, or factors, that explain the pattern of correlations within a set of observed variables. Factor analysis is often

More information

Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models

Factor Analysis. Principal components factor analysis. Use of extracted factors in multivariate dependency models Factor Analysis Principal components factor analysis Use of extracted factors in multivariate dependency models 2 KEY CONCEPTS ***** Factor Analysis Interdependency technique Assumptions of factor analysis

More information

Factor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business

Factor Analysis. Advanced Financial Accounting II Åbo Akademi School of Business Factor Analysis Advanced Financial Accounting II Åbo Akademi School of Business Factor analysis A statistical method used to describe variability among observed variables in terms of fewer unobserved variables

More information

Factor Analysis. Chapter 420. Introduction

Factor Analysis. Chapter 420. Introduction Chapter 420 Introduction (FA) is an exploratory technique applied to a set of observed variables that seeks to find underlying factors (subsets of variables) from which the observed variables were generated.

More information

Exploratory Factor Analysis

Exploratory Factor Analysis Introduction Principal components: explain many variables using few new variables. Not many assumptions attached. Exploratory Factor Analysis Exploratory factor analysis: similar idea, but based on model.

More information

Common factor analysis

Common factor analysis Common factor analysis This is what people generally mean when they say "factor analysis" This family of techniques uses an estimate of common variance among the original variables to generate the factor

More information

4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as:

4. There are no dependent variables specified... Instead, the model is: VAR 1. Or, in terms of basic measurement theory, we could model it as: 1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data 2. Linearity (in the relationships among the variables--factors are linear constructions of the set of variables; the critical source

More information

2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4

2. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) F 2 X 4 U 4 1 Neuendorf Factor Analysis Assumptions: 1. Metric (interval/ratio) data. Linearity (in relationships among the variables--factors are linear constructions of the set of variables) 3. Univariate and multivariate

More information

A Brief Introduction to SPSS Factor Analysis

A Brief Introduction to SPSS Factor Analysis A Brief Introduction to SPSS Factor Analysis SPSS has a procedure that conducts exploratory factor analysis. Before launching into a step by step example of how to use this procedure, it is recommended

More information

To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method.

To do a factor analysis, we need to select an extraction method and a rotation method. Hit the Extraction button to specify your extraction method. Factor Analysis in SPSS To conduct a Factor Analysis, start from the Analyze menu. This procedure is intended to reduce the complexity in a set of data, so we choose Data Reduction from the menu. And the

More information

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red)

Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) Factor Analysis Example: SAS program (in blue) and output (in black) interleaved with comments (in red) The following DATA procedure is to read input data. This will create a SAS dataset named CORRMATR

More information

FACTOR ANALYSIS NASC

FACTOR ANALYSIS NASC FACTOR ANALYSIS NASC Factor Analysis A data reduction technique designed to represent a wide range of attributes on a smaller number of dimensions. Aim is to identify groups of variables which are relatively

More information

Principal Component Analysis

Principal Component Analysis Principal Component Analysis Principle Component Analysis: A statistical technique used to examine the interrelations among a set of variables in order to identify the underlying structure of those variables.

More information

Exploratory Factor Analysis: rotation. Psychology 588: Covariance structure and factor models

Exploratory Factor Analysis: rotation. Psychology 588: Covariance structure and factor models Exploratory Factor Analysis: rotation Psychology 588: Covariance structure and factor models Rotational indeterminacy Given an initial (orthogonal) solution (i.e., Φ = I), there exist infinite pairs of

More information

Introduction to Principal Components and FactorAnalysis

Introduction to Principal Components and FactorAnalysis Introduction to Principal Components and FactorAnalysis Multivariate Analysis often starts out with data involving a substantial number of correlated variables. Principal Component Analysis (PCA) is a

More information

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013

Notes on Orthogonal and Symmetric Matrices MENU, Winter 2013 Notes on Orthogonal and Symmetric Matrices MENU, Winter 201 These notes summarize the main properties and uses of orthogonal and symmetric matrices. We covered quite a bit of material regarding these topics,

More information

FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables.

FACTOR ANALYSIS. Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables. FACTOR ANALYSIS Introduction Factor Analysis is similar to PCA in that it is a technique for studying the interrelationships among variables Both methods differ from regression in that they don t have

More information

Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016

Exploratory Factor Analysis and Principal Components. Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 and Principal Components Pekka Malo & Anton Frantsev 30E00500 Quantitative Empirical Research Spring 2016 Agenda Brief History and Introductory Example Factor Model Factor Equation Estimation of Loadings

More information

Factor Analysis. Sample StatFolio: factor analysis.sgp

Factor Analysis. Sample StatFolio: factor analysis.sgp STATGRAPHICS Rev. 1/10/005 Factor Analysis Summary The Factor Analysis procedure is designed to extract m common factors from a set of p quantitative variables X. In many situations, a small number of

More information

PRINCIPAL COMPONENT ANALYSIS

PRINCIPAL COMPONENT ANALYSIS 1 Chapter 1 PRINCIPAL COMPONENT ANALYSIS Introduction: The Basics of Principal Component Analysis........................... 2 A Variable Reduction Procedure.......................................... 2

More information

T-test & factor analysis

T-test & factor analysis Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue

More information

Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use

Psychology 7291, Multivariate Analysis, Spring 2003. SAS PROC FACTOR: Suggestions on Use : Suggestions on Use Background: Factor analysis requires several arbitrary decisions. The choices you make are the options that you must insert in the following SAS statements: PROC FACTOR METHOD=????

More information

Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA

Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA PROC FACTOR: How to Interpret the Output of a Real-World Example Rachel J. Goldberg, Guideline Research/Atlanta, Inc., Duluth, GA ABSTRACT THE METHOD This paper summarizes a real-world example of a factor

More information

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy. Blue vs. Orange. Review Jeopardy Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

More information

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

More information

[1] Diagonal factorization

[1] Diagonal factorization 8.03 LA.6: Diagonalization and Orthogonal Matrices [ Diagonal factorization [2 Solving systems of first order differential equations [3 Symmetric and Orthonormal Matrices [ Diagonal factorization Recall:

More information

Dimensionality Reduction: Principal Components Analysis

Dimensionality Reduction: Principal Components Analysis Dimensionality Reduction: Principal Components Analysis In data mining one often encounters situations where there are a large number of variables in the database. In such situations it is very likely

More information

Exploratory Factor Analysis

Exploratory Factor Analysis Exploratory Factor Analysis Definition Exploratory factor analysis (EFA) is a procedure for learning the extent to which k observed variables might measure m abstract variables, wherein m is less than

More information

Introduction to Matrix Algebra

Introduction to Matrix Algebra Psychology 7291: Multivariate Statistics (Carey) 8/27/98 Matrix Algebra - 1 Introduction to Matrix Algebra Definitions: A matrix is a collection of numbers ordered by rows and columns. It is customary

More information

Multivariate Analysis (Slides 13)

Multivariate Analysis (Slides 13) Multivariate Analysis (Slides 13) The final topic we consider is Factor Analysis. A Factor Analysis is a mathematical approach for attempting to explain the correlation between a large set of variables

More information

Overview of Factor Analysis

Overview of Factor Analysis Overview of Factor Analysis Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone: (205) 348-4431 Fax: (205) 348-8648 August 1,

More information

Chapter 17. Orthogonal Matrices and Symmetries of Space

Chapter 17. Orthogonal Matrices and Symmetries of Space Chapter 17. Orthogonal Matrices and Symmetries of Space Take a random matrix, say 1 3 A = 4 5 6, 7 8 9 and compare the lengths of e 1 and Ae 1. The vector e 1 has length 1, while Ae 1 = (1, 4, 7) has length

More information

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written

More information

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 FA is not worth the time necessary to understand it and carry it out. -Hills, 1977 Factor analysis should not

More information

Factor Analysis. Factor Analysis

Factor Analysis. Factor Analysis Factor Analysis Principal Components Analysis, e.g. of stock price movements, sometimes suggests that several variables may be responding to a small number of underlying forces. In the factor model, we

More information

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( ) Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates

More information

DESCRIPTIVE STATISTICS. The purpose of statistics is to condense raw data to make it easier to answer specific questions; test hypotheses.

DESCRIPTIVE STATISTICS. The purpose of statistics is to condense raw data to make it easier to answer specific questions; test hypotheses. DESCRIPTIVE STATISTICS The purpose of statistics is to condense raw data to make it easier to answer specific questions; test hypotheses. DESCRIPTIVE VS. INFERENTIAL STATISTICS Descriptive To organize,

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +

More information

Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk

Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Doi:10.5901/mjss.2014.v5n20p303 Abstract Exploratory Factor Analysis of Demographic Characteristics of Antenatal Clinic Attendees and their Association with HIV Risk Wilbert Sibanda Philip D. Pretorius

More information

15.062 Data Mining: Algorithms and Applications Matrix Math Review

15.062 Data Mining: Algorithms and Applications Matrix Math Review .6 Data Mining: Algorithms and Applications Matrix Math Review The purpose of this document is to give a brief review of selected linear algebra concepts that will be useful for the course and to develop

More information

Notes on Determinant

Notes on Determinant ENGG2012B Advanced Engineering Mathematics Notes on Determinant Lecturer: Kenneth Shum Lecture 9-18/02/2013 The determinant of a system of linear equations determines whether the solution is unique, without

More information

Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain

Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain Lectures notes on orthogonal matrices (with exercises) 92.222 - Linear Algebra II - Spring 2004 by D. Klain 1. Orthogonal matrices and orthonormal sets An n n real-valued matrix A is said to be an orthogonal

More information

Topic 10: Factor Analysis

Topic 10: Factor Analysis Topic 10: Factor Analysis Introduction Factor analysis is a statistical method used to describe variability among observed variables in terms of a potentially lower number of unobserved variables called

More information

Correlation key concepts:

Correlation key concepts: CORRELATION Correlation key concepts: Types of correlation Methods of studying correlation a) Scatter diagram b) Karl pearson s coefficient of correlation c) Spearman s Rank correlation coefficient d)

More information

A Brief Introduction to Factor Analysis

A Brief Introduction to Factor Analysis 1. Introduction A Brief Introduction to Factor Analysis Factor analysis attempts to represent a set of observed variables X 1, X 2. X n in terms of a number of 'common' factors plus a factor which is unique

More information

Factor Rotations in Factor Analyses.

Factor Rotations in Factor Analyses. Factor Rotations in Factor Analyses. Hervé Abdi 1 The University of Texas at Dallas Introduction The different methods of factor analysis first extract a set a factors from a data set. These factors are

More information

Least-Squares Intersection of Lines

Least-Squares Intersection of Lines Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a

More information

Chapter 6. Orthogonality

Chapter 6. Orthogonality 6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be

More information

5.2 Customers Types for Grocery Shopping Scenario

5.2 Customers Types for Grocery Shopping Scenario ------------------------------------------------------------------------------------------------------- CHAPTER 5: RESULTS AND ANALYSIS -------------------------------------------------------------------------------------------------------

More information

Data analysis process

Data analysis process Data analysis process Data collection and preparation Collect data Prepare codebook Set up structure of data Enter data Screen data for errors Exploration of data Descriptive Statistics Graphs Analysis

More information

Factor Analysis and Structural equation modelling

Factor Analysis and Structural equation modelling Factor Analysis and Structural equation modelling Herman Adèr Previously: Department Clinical Epidemiology and Biostatistics, VU University medical center, Amsterdam Stavanger July 4 13, 2006 Herman Adèr

More information

Factor Analysis Using SPSS

Factor Analysis Using SPSS Psychology 305 p. 1 Factor Analysis Using SPSS Overview For this computer assignment, you will conduct a series of principal factor analyses to examine the factor structure of a new instrument developed

More information

Factor Analysis - SPSS

Factor Analysis - SPSS Factor Analysis - SPSS First Read Principal Components Analysis. The methods we have employed so far attempt to repackage all of the variance in the p variables into principal components. We may wish to

More information

Orthogonal Projections

Orthogonal Projections Orthogonal Projections and Reflections (with exercises) by D. Klain Version.. Corrections and comments are welcome! Orthogonal Projections Let X,..., X k be a family of linearly independent (column) vectors

More information

Factor analysis. Angela Montanari

Factor analysis. Angela Montanari Factor analysis Angela Montanari 1 Introduction Factor analysis is a statistical model that allows to explain the correlations between a large number of observed correlated variables through a small number

More information

APPRAISAL OF FINANCIAL AND ADMINISTRATIVE FUNCTIONING OF PUNJAB TECHNICAL UNIVERSITY

APPRAISAL OF FINANCIAL AND ADMINISTRATIVE FUNCTIONING OF PUNJAB TECHNICAL UNIVERSITY APPRAISAL OF FINANCIAL AND ADMINISTRATIVE FUNCTIONING OF PUNJAB TECHNICAL UNIVERSITY In the previous chapters the budgets of the university have been analyzed using various techniques to understand the

More information

MATH 551 - APPLIED MATRIX THEORY

MATH 551 - APPLIED MATRIX THEORY MATH 55 - APPLIED MATRIX THEORY FINAL TEST: SAMPLE with SOLUTIONS (25 points NAME: PROBLEM (3 points A web of 5 pages is described by a directed graph whose matrix is given by A Do the following ( points

More information

CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C.

CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES. From Exploratory Factor Analysis Ledyard R Tucker and Robert C. CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES From Exploratory Factor Analysis Ledyard R Tucker and Robert C MacCallum 1997 180 CHAPTER 8 FACTOR EXTRACTION BY MATRIX FACTORING TECHNIQUES In

More information

Descriptive statistics Statistical inference statistical inference, statistical induction and inferential statistics

Descriptive statistics Statistical inference statistical inference, statistical induction and inferential statistics Descriptive statistics is the discipline of quantitatively describing the main features of a collection of data. Descriptive statistics are distinguished from inferential statistics (or inductive statistics),

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

Module 3: Correlation and Covariance

Module 3: Correlation and Covariance Using Statistical Data to Make Decisions Module 3: Correlation and Covariance Tom Ilvento Dr. Mugdim Pašiƒ University of Delaware Sarajevo Graduate School of Business O ften our interest in data analysis

More information

with functions, expressions and equations which follow in units 3 and 4.

with functions, expressions and equations which follow in units 3 and 4. Grade 8 Overview View unit yearlong overview here The unit design was created in line with the areas of focus for grade 8 Mathematics as identified by the Common Core State Standards and the PARCC Model

More information

Data Mining for Model Creation. Presentation by Paul Below, EDS 2500 NE Plunkett Lane Poulsbo, WA USA 98370 paul.below@eds.

Data Mining for Model Creation. Presentation by Paul Below, EDS 2500 NE Plunkett Lane Poulsbo, WA USA 98370 paul.below@eds. Sept 03-23-05 22 2005 Data Mining for Model Creation Presentation by Paul Below, EDS 2500 NE Plunkett Lane Poulsbo, WA USA 98370 paul.below@eds.com page 1 Agenda Data Mining and Estimating Model Creation

More information

Statistics for Business Decision Making

Statistics for Business Decision Making Statistics for Business Decision Making Faculty of Economics University of Siena 1 / 62 You should be able to: ˆ Summarize and uncover any patterns in a set of multivariate data using the (FM) ˆ Apply

More information

Canonical Correlation Analysis

Canonical Correlation Analysis Canonical Correlation Analysis LEARNING OBJECTIVES Upon completing this chapter, you should be able to do the following: State the similarities and differences between multiple regression, factor analysis,

More information

Inner products on R n, and more

Inner products on R n, and more Inner products on R n, and more Peyam Ryan Tabrizian Friday, April 12th, 2013 1 Introduction You might be wondering: Are there inner products on R n that are not the usual dot product x y = x 1 y 1 + +

More information

Lecture Notes 2: Matrices as Systems of Linear Equations

Lecture Notes 2: Matrices as Systems of Linear Equations 2: Matrices as Systems of Linear Equations 33A Linear Algebra, Puck Rombach Last updated: April 13, 2016 Systems of Linear Equations Systems of linear equations can represent many things You have probably

More information

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

More information

Section 14 Simple Linear Regression: Introduction to Least Squares Regression

Section 14 Simple Linear Regression: Introduction to Least Squares Regression Slide 1 Section 14 Simple Linear Regression: Introduction to Least Squares Regression There are several different measures of statistical association used for understanding the quantitative relationship

More information

Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.

Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions. Chapter 1 Vocabulary identity - A statement that equates two equivalent expressions. verbal model- A word equation that represents a real-life problem. algebraic expression - An expression with variables.

More information

Lecture 1: Systems of Linear Equations

Lecture 1: Systems of Linear Equations MTH Elementary Matrix Algebra Professor Chao Huang Department of Mathematics and Statistics Wright State University Lecture 1 Systems of Linear Equations ² Systems of two linear equations with two variables

More information

Mathematics Course 111: Algebra I Part IV: Vector Spaces

Mathematics Course 111: Algebra I Part IV: Vector Spaces Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are

More information

STA 4107/5107. Chapter 3

STA 4107/5107. Chapter 3 STA 4107/5107 Chapter 3 Factor Analysis 1 Key Terms Please review and learn these terms. 2 What is Factor Analysis? Factor analysis is an interdependence technique (see chapter 1) that primarily uses metric

More information

Covariance and Correlation

Covariance and Correlation Covariance and Correlation ( c Robert J. Serfling Not for reproduction or distribution) We have seen how to summarize a data-based relative frequency distribution by measures of location and spread, such

More information

Univariate Regression

Univariate Regression Univariate Regression Correlation and Regression The regression line summarizes the linear relationship between 2 variables Correlation coefficient, r, measures strength of relationship: the closer r is

More information

UNDERSTANDING THE TWO-WAY ANOVA

UNDERSTANDING THE TWO-WAY ANOVA UNDERSTANDING THE e have seen how the one-way ANOVA can be used to compare two or more sample means in studies involving a single independent variable. This can be extended to two independent variables

More information

EXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS. sigbert@wiwi.hu-berlin.de

EXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS. sigbert@wiwi.hu-berlin.de EXPLORATORY FACTOR ANALYSIS IN MPLUS, R AND SPSS Sigbert Klinke 1,2 Andrija Mihoci 1,3 and Wolfgang Härdle 1,3 1 School of Business and Economics, Humboldt-Universität zu Berlin, Germany 2 Department of

More information

HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION

HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION HOD 2990 10 November 2010 Lecture Background This is a lightning speed summary of introductory statistical methods for senior undergraduate

More information

Course Objective This course is designed to give you a basic understanding of how to run regressions in SPSS.

Course Objective This course is designed to give you a basic understanding of how to run regressions in SPSS. SPSS Regressions Social Science Research Lab American University, Washington, D.C. Web. www.american.edu/provost/ctrl/pclabs.cfm Tel. x3862 Email. SSRL@American.edu Course Objective This course is designed

More information

Factor Analysis Using SPSS

Factor Analysis Using SPSS Factor Analysis Using SPSS The theory of factor analysis was described in your lecture, or read Field (2005) Chapter 15. Example Factor analysis is frequently used to develop questionnaires: after all

More information

Solution to Homework 2

Solution to Homework 2 Solution to Homework 2 Olena Bormashenko September 23, 2011 Section 1.4: 1(a)(b)(i)(k), 4, 5, 14; Section 1.5: 1(a)(b)(c)(d)(e)(n), 2(a)(c), 13, 16, 17, 18, 27 Section 1.4 1. Compute the following, if

More information

SAS Software to Fit the Generalized Linear Model

SAS Software to Fit the Generalized Linear Model SAS Software to Fit the Generalized Linear Model Gordon Johnston, SAS Institute Inc., Cary, NC Abstract In recent years, the class of generalized linear models has gained popularity as a statistical modeling

More information

What is Rotating in Exploratory Factor Analysis?

What is Rotating in Exploratory Factor Analysis? A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

Multivariate Analysis

Multivariate Analysis Table Of Contents Multivariate Analysis... 1 Overview... 1 Principal Components... 2 Factor Analysis... 5 Cluster Observations... 12 Cluster Variables... 17 Cluster K-Means... 20 Discriminant Analysis...

More information

Mehtap Ergüven Abstract of Ph.D. Dissertation for the degree of PhD of Engineering in Informatics

Mehtap Ergüven Abstract of Ph.D. Dissertation for the degree of PhD of Engineering in Informatics INTERNATIONAL BLACK SEA UNIVERSITY COMPUTER TECHNOLOGIES AND ENGINEERING FACULTY ELABORATION OF AN ALGORITHM OF DETECTING TESTS DIMENSIONALITY Mehtap Ergüven Abstract of Ph.D. Dissertation for the degree

More information

Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis

Factor Analysis: Statnotes, from North Carolina State University, Public Administration Program. Factor Analysis Factor Analysis Overview Factor analysis is used to uncover the latent structure (dimensions) of a set of variables. It reduces attribute space from a larger number of variables to a smaller number of

More information

Steven M. Ho!and. Department of Geology, University of Georgia, Athens, GA 30602-2501

Steven M. Ho!and. Department of Geology, University of Georgia, Athens, GA 30602-2501 PRINCIPAL COMPONENTS ANALYSIS (PCA) Steven M. Ho!and Department of Geology, University of Georgia, Athens, GA 30602-2501 May 2008 Introduction Suppose we had measured two variables, length and width, and

More information

10.2 ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS. The Jacobi Method

10.2 ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS. The Jacobi Method 578 CHAPTER 1 NUMERICAL METHODS 1. ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS As a numerical technique, Gaussian elimination is rather unusual because it is direct. That is, a solution is obtained after

More information

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B KITCHENS The equation 1 Lines in two-dimensional space (1) 2x y = 3 describes a line in two-dimensional space The coefficients of x and y in the equation

More information

Part 2: Analysis of Relationship Between Two Variables

Part 2: Analysis of Relationship Between Two Variables Part 2: Analysis of Relationship Between Two Variables Linear Regression Linear correlation Significance Tests Multiple regression Linear Regression Y = a X + b Dependent Variable Independent Variable

More information

Statistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer

Statistics in Psychosocial Research Lecture 8 Factor Analysis I. Lecturer: Elizabeth Garrett-Mayer This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

by the matrix A results in a vector which is a reflection of the given

by the matrix A results in a vector which is a reflection of the given Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

More information

CURVE FITTING LEAST SQUARES APPROXIMATION

CURVE FITTING LEAST SQUARES APPROXIMATION CURVE FITTING LEAST SQUARES APPROXIMATION Data analysis and curve fitting: Imagine that we are studying a physical system involving two quantities: x and y Also suppose that we expect a linear relationship

More information

Lecture 3: Linear methods for classification

Lecture 3: Linear methods for classification Lecture 3: Linear methods for classification Rafael A. Irizarry and Hector Corrada Bravo February, 2010 Today we describe four specific algorithms useful for classification problems: linear regression,

More information

Similarity and Diagonalization. Similar Matrices

Similarity and Diagonalization. Similar Matrices MATH022 Linear Algebra Brief lecture notes 48 Similarity and Diagonalization Similar Matrices Let A and B be n n matrices. We say that A is similar to B if there is an invertible n n matrix P such that

More information

Simple linear regression

Simple linear regression Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between

More information

Simple Linear Regression Inference

Simple Linear Regression Inference Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation

More information

Exploratory Factor Analysis

Exploratory Factor Analysis Exploratory Factor Analysis ( 探 索 的 因 子 分 析 ) Yasuyo Sawaki Waseda University JLTA2011 Workshop Momoyama Gakuin University October 28, 2011 1 Today s schedule Part 1: EFA basics Introduction to factor

More information

Nonlinear Iterative Partial Least Squares Method

Nonlinear Iterative Partial Least Squares Method Numerical Methods for Determining Principal Component Analysis Abstract Factors Béchu, S., Richard-Plouet, M., Fernandez, V., Walton, J., and Fairley, N. (2016) Developments in numerical treatments for

More information

Review of Fundamental Mathematics

Review of Fundamental Mathematics Review of Fundamental Mathematics As explained in the Preface and in Chapter 1 of your textbook, managerial economics applies microeconomic theory to business decision making. The decision-making tools

More information