Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis.

We evaluated whether "more is ever too much" for the number of indicators (p) per factor (p/f) in confirmatory factor analysis by varying sample size (N = 50-1000) and p/f (2-12 items per factor) in 35,000 Monte Carlo solutions. For all N's, solution behavior steadily improved (more proper solutions, more accurate parameter estimates, greater reliability) with increasing p/f. There was a compensatory relation between N and p/f: large p/f compensated for small N and large N compensated for small p/f, but large-N and large-p/f was best. A bias in the behavior of the χ(2) was also demonstrated where apparent goodness of fit declined with increasing p/f ratios even though approximating models were "true". Fit was similar for proper and improper solutions, as were parameter estimates form improper solutions not involving offending estimates. We also used the 12-p/f data to construct 2, 3, 4, or 6 parcels of items (e.g., two parcels of 6 items per factor, three parcels of 4 items per factor, etc.), but the 12-indicator (nonparceled) solutions were somewhat better behaved. At least for conditions in our simulation study, traditional "rules" implying fewer indicators should be used for smaller N may be inappropriate and researchers should consider using more indicators per factor that is evident in current practice.

[1]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[2]  O. P. V. Driel,et al.  On various causes of improper solutions in maximum likelihood factor analysis , 1978 .

[3]  H W Marsh,et al.  Overcoming Problems in Confirmatory Factor Analyses of MTMM Data: The Correlated Uniqueness Model and Factorial Invariance. , 1992, Multivariate behavioral research.

[4]  L. Harlow,et al.  Effects of estimation methods, number of indicators per factor, and improper solutions on structural equation modeling fit indices , 1995 .

[5]  Peter M. Bentler,et al.  Estimates and tests in structural equation modeling. , 1995 .

[6]  W F Velicer,et al.  Component Analysis versus Common Factor Analysis: Some issues in Selecting an Appropriate Procedure. , 1990, Multivariate behavioral research.

[7]  James C. Anderson,et al.  Monte Carlo Evaluations of Goodness of Fit Indices for Structural Equation Models , 1992 .

[8]  Robert Cudeck,et al.  Analysis of correlation matrices using covariance structure models. , 1989 .

[9]  W F Velicer,et al.  An Evaluation of the Effects of Variable Sampling On Component, Image, and Factor Analysis. , 1987, Multivariate behavioral research.

[10]  Herman Wold,et al.  Systems under indirect observation : causality, structure, prediction , 1982 .

[11]  H. Marsh,et al.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models , 1991 .

[12]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[13]  A. Comrey Factor-analytic methods of scale development in personality and clinical psychology. , 1988, Journal of consulting and clinical psychology.

[14]  R. P. McDonald,et al.  Choosing a multivariate model: Noncentrality and goodness of fit. , 1990 .

[15]  A. Boomsma Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation , 1985 .

[16]  James C. Anderson,et al.  The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis , 1984 .

[17]  William R. Dillon,et al.  Offending Estimates in Covariance Structure Analysis: Comments on the Causes of and Solutions to Heywood Cases , 1987 .

[18]  C. Eugene Walker,et al.  The Comrey Personality Scales. , 1973 .

[19]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[20]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[21]  W. Velicer,et al.  Comparison of five rules for determining the number of components to retain. , 1986 .

[22]  Herbert W. Marsh,et al.  Self Description Questionnaire III: The construct validity of multidimensional self-concept ratings by late adolescents. , 1984 .

[23]  J. S. Tanaka "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent Variables. , 1987 .

[24]  Peter M. Bentler,et al.  Gramian Matrices in Covariance Structure Models , 1994 .

[25]  Herman Rubin,et al.  Statistical Inference in Factor Analysis , 1956 .

[26]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[27]  R. Stine,et al.  Bootstrapping Goodness-of-Fit Measures in Structural Equation Models , 1992 .

[28]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[29]  Subhash Sharma,et al.  Sample Size Effects on Chi Square and Other Statistics Used in Evaluating Causal Models , 1982 .

[30]  James C. Anderson,et al.  Improper solutions in the analysis of covariance structures: Their interpretability and a comparison of alternate respecifications , 1987 .

[31]  H. Marsh Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .