Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size

This investigation examined the influence of sample size on different goodness-of-fit indices used in confirmatory factor analysis (CFA). The first two data sets were derived from large normative samples of responses to a multidimensional self-concept instrument and to a multidimensional instrument used to assess students' evaluations of teaching effectiveness. In the third set, data were simulated and generated according to the model to be tested. In the fourth, data were simulated and generated according to a three-factor model that did not have a simple structure. Twelve fit indicators were used to assess goodness-offit in all CFAs. All analyses were conducted with the LISREL V package. One-way ANOVAs and a visual inspection of graphs were used to assess the sample size effect on each index for the four data sets. Despite the inconsistency of the findings with previous claims, the results are consistent with the observation that the amount of random, unexplained variance varies inversely with sample size. Appendices include a set of computed statements, an explanation and listing of the 12 goodness-of-fit indicators, a bibliography, a table of results, and figures showing sample size effect. (Author/LMO) *********************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ***********************************************************************

[1]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[2]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[3]  H. Akaike.  A new look at the statistical model identification , 1974 .

[4]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[5]  John J. McArdle,et al.  Perspectives on Mathematical/Statistical Model Building (MASMOB) in research on aging. , 1980 .

[6]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[7]  William R. Darden,et al.  Causal Models in Marketing , 1980 .

[8]  Herman Wold,et al.  Systems under indirect observation : causality, structure, prediction , 1982 .

[9]  Subhash Sharma,et al.  Sample size effects on chi square and other statistics used in evaluating causal models. , 1982 .

[10]  C. Schriesheim.  Causal Analysis: Assumptions, Models, and Data , 1982 .

[11]  H. Marsh.  Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. , 1983 .

[12]  J. Long.  Confirmatory Factor Analysis , 1983 .

[13]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[14]  Claes Fornell,et al.  Issues in the Application of Covariance Structure Analysis: A Comment , 1983 .

[15]  Richard P. Bagozzi,et al.  "Issues in the application of covariance structure analysis": A further comment. , 1983 .

[16]  J. Hoelter.  The Analysis of Covariance Structures , 1983 .

[17]  James C. Anderson,et al.  The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis , 1984 .

[18]  H. Marsh.  Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[19]  H. Marsh,et al.  The Factorial Invariance of Student Evaluations of College Teaching , 1984 .

[20]  J. S. Tanaka,et al.  A fit index for covariance structure models under arbitrary GLS estimation , 1985 .

[21]  George W. Bohrnstedt,et al.  Use of Null Models in Evaluating the Fit of Covariance Structure Models , 1985 .

[22]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[23]  H. Marsh,et al.  Multidimensional Self-Concepts: Relations with Sex and Academic Achievement. , 1985 .

[24]  James C. Anderson,et al.  The Effects of Sampling Error and Model Characteristics on Parameter Estimation for Maximum Likelihood Confirmatory Factor Analysis. , 1985, Multivariate behavioral research.

[25]  H. Marsh.  The Structure of Masculinity/Femininity: An Application of Confirmatory Factor Analysis to Higher-Order Factor Structures and Factorial Invariance. , 1985, Multivariate behavioral research.

[26]  K. Bollen.  Sample size and bentler and Bonett's nonnormed fit index , 1986 .

[27]  J. Mcardle,et al.  Latent variable growth within behavior genetic models , 1986, Behavior genetics.

[28]  J. S. Tanaka.  "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent Variables. , 1987 .

[29]  James C. Anderson,et al.  Improper solutions in the analysis of covariance structures: Their interpretability and a comparison of alternate respecifications , 1987 .

[30]  Nancy Brandon Tuma,et al.  Sociological Methodology 1985. , 1987 .

[31]  H. Marsh.  The Factorial Invariance of Responses by Males and Females to a Multidimensional Self-Concept Instrument: Substantive and Methodological Issues. , 1987, Multivariate behavioral research.

[32]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[33]  K. Jöreskog.  Analysis of Covariance Structures , 1988 .