Sample size and subject to item ratio in principal components analysis. - Practical Assessment, Research & Evaluation

Statisticians have wrestled with the question of sample size in exploratory factor analysis and principal component analysis for decades, some looking at total N, some at the ratio of subjects to items. Although many articles attempt to examine this issue, few examine both possibilities comprehensively enough to be definitive. This study examines a previously published data set to examine whether N or subject to item ratio is more important in predicting important outcomes in PCA. The results indicate an interaction between the two, where the best outcomes occur in analyses where large Ns and high ratios are present.

[1]  B. Price A First Course in Factor Analysis , 1993 .

[2]  Paul Kline,et al.  The observation to variable ratio in factor analysis. , 1981 .

[3]  Lloyd G. Humphreys,et al.  Capitalization on Chance in Rotation of Factors , 1969 .

[4]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[5]  Norman Cliff,et al.  The relation between sample and population characteristic vectors , 1970 .

[6]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[7]  Kristopher J Preacher,et al.  Sample Size in Factor Analysis: The Role of Model Error , 2001, Multivariate behavioral research.

[8]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[9]  Lawrence M. Aleamoni,et al.  The Relation of Sample Size to the Number of Variables in Using Factor Analysis Techniques , 1976 .

[10]  Philip Bobko,et al.  Eigenvalue Shrinkage in Principal Components Based Factor Analysis , 1984 .

[11]  R. MacCallum,et al.  THE APPLICATION OF EXPLORATORY FACTOR ANALYSIS IN APPLIED PSYCHOLOGY: A CRITICAL REVIEW AND ANALYSIS , 1986 .

[12]  J. Osborne,et al.  Sample size and subject to item ratio in principal components analysis. , 2004 .

[13]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[14]  R. MacCallum,et al.  Sample size in factor analysis. , 1999 .

[15]  C. Heckler A Step-by-Step Approach to Using the SAS™ System for Factor Analysis and Structural Equation Modeling , 1996 .

[16]  Andrew R. Baggaley,et al.  Deciding on the ratio of number of subjects to number of variables in factor analysis , 1982 .

[17]  E. Pedhazur Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .