The Effects of Overextraction on Factor and Component Analysis.

The effects of overextracting factors and components within and between the methods of maximum likelihood factor analysis (MLFA) and principal component analysis (PCA) were examined. Computer-simulated data sets were generated to represent a range of factor and component patterns. Saturation (aij = .8, .6 & .4), sample size (N = 75, 150,225,450), and variable-to-component (factor) ratio (p:m = 12:1,6:1, & 4:1) were conditions manipulated. In Study 1, scores based on the incorrect patterns were correlated with correct scores within each method after each overextraction. In Study 2, scores were correlated between the methods of PCAand MLFA after each overextraction. Overextraction had a negative effect, but scores based on strong component and factor patterns displayed robustness to the effects of overextraction. Low item saturation and low sample size resulted in degraded score reproduction. Degradation was strongest for patterns that combined low saturation and low sample size. Component and factor scores were highly correlated even at maximal levels of overextraction. Dissimilarity between score methods was the greatest in conditions that combined low saturation and low sample size. Some guidelines for researchers concerning the effects of overextraction are noted, as well as some cautions in the interpretation of results.

[1]  Carveth Read,et al.  INSTINCT, ESPECIALLY IN SOLITARY WASPS , 1911 .

[2]  G. Thomson.  Some points of mathematical technique in the factorial analysis of ability. , 1936 .

[3]  C. I. Mosier.  Influence of chance error on simple structure: An empirical investigation of the effect of chance error and estimated communalities on simple structure in factorial analysis , 1939 .

[4]  L. L. Thurstone,et al.  Multiple-factor analysis; a development and expansion of The Vectors of Mind. , 1947 .

[5]  Jerzy Neyman,et al.  Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability : held at the Statistical Laboratory, University of California, December, 1954, July and August, 1955 , 1958 .

[6]  Raymond B. Cattell,et al.  Extracting the Correct Number of Factors in Factor Analysis , 1958 .

[7]  H. Kaiser.  The varimax criterion for analytic rotation in factor analysis , 1958 .

[8]  H. Kaiser.  The Application of Electronic Computers to Factor Analysis , 1960 .

[9]  R. Cattell.  The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[10]  A L Comrey,et al.  Factorial stability as a function of the number of orthogonally-rotated factors. , 1966, Behavioral science.

[11]  P. Odell,et al.  A Numerical Procedure to Generate a Sample Covariance Matrix , 1966 .

[12]  E. J. Burr,et al.  A comparison of four methods of constructing factor scores , 1967 .

[13]  Chester W. Harris,et al.  On factors and factor scores , 1967 .

[14]  M. Browne.  A comparison of factor analytic techniques , 1968, Psychometrika.

[15]  Ming-Mei Wang,et al.  Some new results on factor indeterminacy , 1972 .

[16]  Richard G. Montanelli.  A Computer Program to Generate Sample Correlation and Covariance Matrices , 1975 .

[17]  W F Velicer,et al.  An Empirical Comparison Of The Similarity Of Principal Component, Image, And Factor Patterns. , 1977, Multivariate behavioral research.

[18]  W Revelle,et al.  Very Simple Structure: An Alternative Procedure For Estimating The Optimal Number Of Interpretable Factors. , 1979, Multivariate behavioral research.

[19]  D. Jackson,et al.  A Comparison Of Component And Factor Patterns: A Monte Carlo Approach. , 1982, Multivariate behavioral research.

[20]  W F Velicer,et al.  Factors Influencing Four Rules For Determining The Number Of Components To Retain. , 1982, Multivariate behavioral research.

[21]  David Rindskopf,et al.  Structural Equation Models , 1984 .

[22]  W. Velicer,et al.  Comparison of five rules for determining the number of components to retain. , 1986 .

[23]  W F Velicer,et al.  An Evaluation of the Effects of Variable Sampling On Component, Image, and Factor Analysis. , 1987, Multivariate behavioral research.

[24]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[25]  W F Velicer,et al.  Component Analysis versus Common Factor Analysis: Some issues in Selecting an Appropriate Procedure. , 1990, Multivariate behavioral research.

[26]  W. Velicer,et al.  A Comparison of Pattern Matching Indices. , 1991, Multivariate behavioral research.

[27]  W F Velicer,et al.  An Empirical Comparison of Factor, Image, Component, and Scale Scores. , 1992, Multivariate behavioral research.