Information and other criteria in structural equation model selection

This article presents the results of a simulation study evaluating information criteria in conjunction with other well-known criteria for model selection in structural equation modeling (SEM). Two sets of simulation experiments were performed. In both sets, sample sizes of n = 100,400,1000,6000 were used and the performance of 18 criteria was assessed by the frequency with which each of five analytic models was selected as best by each criterion in 500 replications. In the first set of experiments correctly specified analytic models (noncentrality parameter 0) were entertained in combination with misspecified ones, while in the second set all five models were misspecified. In both sets of experiments, we found that the information criteria perform better than the other criteria overall, but that Cudeck and Browne's cross-validation index ( CVI) remains an attractive option. Within the class of information criteria, Akaike's information criterion (AIC) is found to show some overfitting tendency. We demonst...

[1]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[2]  M. Woodroofe.  On Model Selection and the ARC Sine Laws , 1982 .

[3]  R. P. McDonald,et al.  An index of goodness-of-fit based on noncentrality , 1989 .

[4]  R. J. Williamson,et al.  Span tests on cusums , 1985 .

[5]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[6]  M. Browne,et al.  Single Sample Cross-Validation Indices for Covariance Structures. , 1989, Multivariate behavioral research.

[7]  Dominique Haughton,et al.  INFORMATION CRITERIA FOR MULTIPLE DATA SETS AND RESTRICTED PARAMETERS , 1997 .

[8]  R. P. McDonald,et al.  Choosing a multivariate model: Noncentrality and goodness of fit. , 1990 .

[9]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[10]  Anthony C. Atkinson,et al.  The stalactite plot for the detection of multivariate outliers , 1993 .

[11]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[12]  R. Kass.  The Geometry of Asymptotic Inference , 1989 .

[13]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[14]  R. H. Woodward,et al.  Cumulative Sum Techniques , 1964 .

[15]  James C. Anderson,et al.  Monte Carlo Evaluations of Goodness of Fit Indices for Structural Equation Models , 1992 .

[16]  George C. Runger,et al.  A Markov Chain Model for the Multivariate Exponentially Weighted Moving Averages Control Chart , 1996 .

[17]  K. Bollen.  Sample size and bentler and Bonett's nonnormed fit index , 1986 .

[18]  R. Crosier.  Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[19]  T. P. Ryan.  Efficient Estimation of Control Chart Parameters , 1997 .

[20]  R. Nishii.  Asymptotic Properties of Criteria for Selection of Variables in Multiple Regression , 1984 .

[21]  Kenneth A. Bollen,et al.  Overall Fit in Covariance Structure Models: Two Types of Sample Size Effects , 1990 .

[22]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[23]  William H. Woodall,et al.  A Comparison of Multivariate Control Charts for Individual Observations , 1996 .

[24]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[25]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[26]  A. Erhan Mergen,et al.  IMPROVING THE PERFORMANCE OF THE T2 CONTROL CHART , 1993 .

[27]  Bishwa Nath Mukherjee,et al.  A note on distributional properties of the Jöreskog-Sörbom fit indices , 1990 .

[28]  S. Zacks.  SURVEY OF CLASSICAL AND BAYESIAN APPROACHES TO THE CHANGE-POINT PROBLEM: FIXED SAMPLE AND SEQUENTIAL PROCEDURES OF TESTING AND ESTIMATION11Research supported in part by ONR Contracts N00014-75-0725 at The George Washington University and N00014-81-K-0407 at SUNY-Binghamton. , 1983 .

[29]  M. Srivastava,et al.  Likelihood Ratio Tests for a Change in the Multivariate Normal Mean , 1986 .

[30]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[31]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[32]  Frank B. Alt.  Multivariate Quality Control , 1984 .

[33]  H. Akaike.  Factor analysis and AIC , 1987 .

[34]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[35]  Mark E. Johnson.  Multivariate Statistical Simulation: Johnson/Multivariate , 1987 .

[36]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[37]  D. Haughton.  On the Choice of a Model to Fit Data from an Exponential Family , 1988 .

[38]  S J Henly,et al.  Model selection in covariance structures analysis and the "problem" of sample size: a clarification. , 1991, Psychological bulletin.

[39]  G. C. Tiao,et al.  Use of Cumulative Sums of Squares for Retrospective Detection of Changes of Variance , 1994 .

[40]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[41]  A. Goldberger,et al.  Structural Equation Models in the Social Sciences. , 1974 .

[42]  K. Bollen.  A New Incremental Fit Index for General Structural Equation Models , 1989 .

[43]  D. Bandalos,et al.  Factors Influencing Cross-Validation of Confirmatory Factor Analysis Models. , 1993, Multivariate behavioral research.

[44]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[45]  Dominique Haughton,et al.  Information criteria and harmonic models in time series analysis , 1990 .

[46]  A. Boomsma.  On the robustness of LISREL (maximum likelihood estimation) against small sample size and non-normality. , 1984 .

[47]  Stephen Wolfram,et al.  Mathematica: a system for doing mathematics by computer (2nd ed.) , 1991 .

[48]  E. Dietz,et al.  A Nonparametric Multivariate Test for Monotone Trend with Pharmaceutical Applications , 1981 .

[49]  K. Jöreskog.  A General Method for Estimating a Linear Structural Equation System. , 1970 .

[50]  Douglas C. Montgomery,et al.  A review of multivariate control charts , 1995 .