Ordinary Least Squares Estimation of Parameters in Exploratory Factor Analysis With Ordinal Data

Exploratory factor analysis (EFA) is often conducted with ordinal data (e.g., items with 5-point responses) in the social and behavioral sciences. These ordinal variables are often treated as if they were continuous in practice. An alternative strategy is to assume that a normally distributed continuous variable underlies each ordinal variable. The EFA model is specified for these underlying continuous variables rather than the observed ordinal variables. Although these underlying continuous variables are not observed directly, their correlations can be estimated from the ordinal variables. These correlations are referred to as polychoric correlations. This article is concerned with ordinary least squares (OLS) estimation of parameters in EFA with polychoric correlations. Standard errors and confidence intervals for rotated factor loadings and factor correlations are presented. OLS estimates and the associated standard error estimates and confidence intervals are illustrated using personality trait ratings from 228 college students. Statistical properties of the proposed procedure are explored using a Monte Carlo study. The empirical illustration and the Monte Carlo study showed that (a) OLS estimation of EFA is feasible with large models, (b) point estimates of rotated factor loadings are unbiased, (c) point estimates of factor correlations are slightly negatively biased with small samples, and (d) standard error estimates and confidence intervals perform satisfactorily at moderately large samples.

[1]  K. Jöreskog,et al.  Confirmatory Factor Analysis of Ordinal Variables With Misspecified Models , 2010 .

[2]  R. Jennrich,et al.  Standard errors for rotated factor loadings , 1973 .

[3]  O. John,et al.  Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. , 2008 .

[4]  Karl G. Jöreskog,et al.  On the estimation of polychoric correlations and their asymptotic covariance matrix , 1994 .

[5]  Ulf Olsson,et al.  Maximum likelihood estimation of the polychoric correlation coefficient , 1979 .

[6]  M. Browne An Overview of Analytic Rotation in Exploratory Factor Analysis , 2001 .

[7]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[8]  P. Krishnaiah,et al.  On Covariance Structures. , 1975 .

[9]  Li Cai,et al.  HIGH-DIMENSIONAL EXPLORATORY ITEM FACTOR ANALYSIS BY A METROPOLIS–HASTINGS ROBBINS–MONRO ALGORITHM , 2010 .

[10]  E. Muraki,et al.  Full-Information Item Factor Analysis , 1988 .

[11]  Bengt Muthén,et al.  Technical aspects of Muthén's liscomp approach to estimation of latent variable relations with a comprehensive measurement model , 1995 .

[12]  Alberto Maydeu-Olivares,et al.  Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation , 2009 .

[13]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[14]  R. C. Durfee,et al.  MULTIPLE FACTOR ANALYSIS. , 1967 .

[15]  R. Cudeck,et al.  Applications of standard error estimates in unrestricted factor analysis: significance tests for factor loadings and correlations. , 1994, Psychological bulletin.

[16]  B. Muthén A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators , 1984 .

[17]  M. Browne Asymptotically distribution-free methods for the analysis of covariance structures. , 1984, The British journal of mathematical and statistical psychology.

[18]  Robert J. Mislevy,et al.  Recent Developments in the Factor Analysis of Categorical Variables , 1986 .

[19]  Li Cai High-dimensional Exploratory Item Factor Analysis by A Metropolis–Hastings Robbins–Monro Algorithm , 2010 .

[20]  Michael C. Edwards,et al.  A Markov Chain Monte Carlo Approach to Confirmatory Item Factor Analysis , 2010 .

[21]  Karl G. Jöreskog,et al.  New developments in LISREL: analysis of ordinal variables using polychoric correlations and weighted least squares , 1990 .

[22]  Anders Christoffersson,et al.  Factor analysis of dichotomized variables , 1975 .

[23]  Peter M. Bentler,et al.  Full maximum likelihood analysis of structural equation models with polytomous variables , 1990 .

[24]  Wai-Yin Poon,et al.  Maximum likelihood estimation of multivariate polyserial and polychoric correlation coefficients , 1988 .

[25]  Robert I. Jennrich,et al.  SIMPLIFIED FORMULAE FOR STANDARD ERRORS IN MAXIMUM‐LIKELIHOOD FACTOR ANALYSIS , 1974 .

[26]  Michael W. Browne,et al.  Topics in Applied Multivariate Analysis: COVARIANCE STRUCTURES , 1982 .

[27]  A. Satorra Alternative test criteria in covariance structure analysis: A unified approach , 1989 .

[28]  Guangjian Zhang,et al.  Bootstrap Confidence Intervals for Ordinary Least Squares Factor Loadings and Correlations in Exploratory Factor Analysis , 2010, Multivariate behavioral research.

[29]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[30]  Roger J Pennell ROUTINELY COMPUTABLE CONFIDENCE INTERVALS FOR FACTOR LOADINGS USING THE ‘JACK‐KNIFE’ , 1972 .

[31]  K. Yuan,et al.  A unified approach to exploratory factor analysis with missing data, nonnormal data, and in the presence of outliers , 2002 .

[32]  G. A. Ferguson,et al.  A general rotation criterion and its use in orthogonal rotation , 1970 .

[33]  Peter M. Bentler,et al.  Structural equation models with continuous and polytomous variables , 1992 .

[34]  K. Jöreskog,et al.  Factor Analysis of Ordinal Variables: A Comparison of Three Approaches , 2001, Multivariate behavioral research.

[35]  B. Muthén Contributions to factor analysis of dichotomous variables , 1978 .

[36]  Li Cai,et al.  A Two-Tier Full-Information Item Factor Analysis Model with Applications , 2010 .

[37]  M. Browne,et al.  Bootstrap Fit Testing, Confidence Intervals, and Standard Error Estimation in the Factor Analysis of Polychoric Correlation Matrices , 2006 .

[38]  Kristopher J Preacher,et al.  Item factor analysis: current approaches and future directions. , 2007, Psychological methods.

[39]  R. Jennrich Standard errors for obliquely rotated factor loadings , 1973 .

[40]  Yasuo Amemiya,et al.  Factor Analysis at 100:Historical Developments and Future Directions , 2003, Multivariate behavioral research.

[41]  T. Ferguson A Course in Large Sample Theory , 1996 .