BIC and Alternative Bayesian Information Criteria in the Selection of Structural Equation Models

Selecting between competing structural equation models is a common problem. Often selection is based on the chi-square test statistic or other fit indices. In other areas of statistical research Bayesian information criteria are commonly used, but they are less frequently used with structural equation models compared to other fit indices. This article examines several new and old information criteria (IC) that approximate Bayes factors. We compare these IC measures to common fit indices in a simulation that includes the true and false models. In moderate to large samples, the IC measures outperform the fit indices. In a second simulation we only consider the IC measures and do not include the true model. In moderate to large samples the IC measures favor approximate models that only differ from the true model by having extra parameters. Overall, SPBIC, a new IC measure, performs well relative to the other IC measures.

[1]  Adrian E. Raftery,et al.  Bayesian Model Selection in Structural Equation Models , 1992 .

[2]  Jay Magidson,et al.  Advances in factor analysis and structural equation models , 1979 .

[3]  P M Bentler,et al.  Structural equation models in medical research , 1992, Statistical methods in medical research.

[4]  M. Browne,et al.  Cross-Validation Of Covariance Structures. , 1983, Multivariate behavioral research.

[5]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[6]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[7]  John Fox,et al.  TEACHER'S CORNER: Structural Equation Modeling With the sem Package in R , 2006 .

[8]  S. Manne,et al.  The Application of SEM to Behavioral Research in Oncology: Past Accomplishments and Future Opportunities , 2004 .

[9]  J. H. Steiger.  Statistically based tests for the number of common factors , 1980 .

[10]  D. Haughton.  On the Choice of a Model to Fit Data from an Exponential Family , 1988 .

[11]  Robert C. MacCallum,et al.  Effect of Estimation Method on Incremental Fit Indexes for Covariance Structure Models , 1993 .

[12]  Tanya N. Beran,et al.  Structural equation modeling in medical research: a primer , 2010, BMC Research Notes.

[13]  J. S. Long,et al.  Tests for Structural Equation Models , 1992 .

[14]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[15]  Rangasami L. Kashyap,et al.  Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[17]  Dominique Haughton,et al.  Information and other criteria in structural equation model selection , 1997 .

[18]  K. Bollen,et al.  Autoregressive Latent Trajectory (ALT) Models A Synthesis of Two Traditions , 2004 .

[19]  Surajit Ray,et al.  A Comparison of Bayes Factor Approximation Methods Including Two New Methods , 2012 .

[20]  Christian Homburg,et al.  Cross-Validation and Information Criteria in Causal Modeling , 1991 .

[21]  Bill Shipley,et al.  Cause and Correlation in Biology: A User''s Guide to Path Analysis , 2016 .

[22]  K. Jöreskog.  A general approach to confirmatory maximum likelihood factor analysis , 1969 .

[23]  R. P. McDonald,et al.  Choosing a multivariate model: Noncentrality and goodness of fit. , 1990 .

[24]  Kenneth A. Bollen,et al.  Monte Carlo Experiments: Design and Implementation , 2001 .

[25]  A. Raftery.  Bayes Factors and BIC , 1999 .

[26]  J. Kuha.  AIC and BIC , 2004 .

[27]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[28]  Christopher Winship.  Editor's Introduction to the Special Issue on the Bayesian Information Criterion , 1999 .

[29]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[30]  R. Stine,et al.  Bootstrapping Goodness-of-Fit Measures in Structural Equation Models , 1992 .