Statistical Tests for Comparing Possibly Misspecified and Nonnested Models.

Model selection criteria (MSC) involves selecting the model with the best estimated goodness-of-fit to the data generating process. Following the method of Vuong (1989), a large sample Model Selection Test (MST), is introduced that can be used in conjunction with most existing MSC procedures to decide if the estimated goodness-of-fit for one model is significantly different from the estimated goodness-of-fit for another model. The MST extends the classical generalized likelihood ratio test, is valid in the presence of model misspecification, and is applicable to situations involving nonnested probability models. Simulation studies designed to illustrate the concept of the MST and its conservative decision rule (relative to the MSC method) are also presented. Copyright 2000 Academic Press.

[1]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[2]  Hidetoshi Shimodaira.  Assessing the Error Probability of the Model Selection Test , 1997 .

[3]  S. S. Wilks.  The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses , 1938 .

[4]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[5]  I. J. Myung,et al.  The Importance of Complexity in Model Selection. , 2000, Journal of mathematical psychology.

[6]  H. White,et al.  Information criteria for selecting possibly misspecified parametric models , 1996 .

[7]  H. Linhart.  A test whether two AIC's differ significantly , 1988 .

[8]  H. White.  Maximum Likelihood Estimation of Misspecified Models , 1982 .

[9]  Halbert White,et al.  Estimation, inference, and specification analysis , 1996 .

[10]  Bradley Efron,et al.  Comparing Non-Nested Linear Models , 1984 .

[11]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[12]  Zucchini,et al.  An Introduction to Model Selection. , 2000, Journal of mathematical psychology.

[13]  H. Bozdogan,et al.  Akaike's Information Criterion and Recent Developments in Information Complexity. , 2000, Journal of mathematical psychology.

[14]  Q. Vuong.  Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses , 1989 .

[15]  Richard M. Golden,et al.  Mathematical Methods for Neural Network Analysis and Design , 1996 .

[16]  L. Wasserman,et al.  A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion , 1995 .

[17]  Bamber,et al.  How to Assess a Model's Testability and Identifiability. , 2000, Journal of mathematical psychology.

[18]  Richard M. Golden.  Making correct statistical inferences using a wrong probability model , 1995 .

[19]  M. Forster,et al.  Key Concepts in Model Selection: Performance and Generalizability. , 2000, Journal of mathematical psychology.