Model weights and the foundations of multimodel inference.

Statistical thinking in wildlife biology and ecology has been profoundly influenced by the introduction of AIC (Akaike's information criterion) as a tool for model selection and as a basis for model averaging. In this paper, we advocate the Bayesian paradigm as a broader framework for multimodel inference, one in which model averaging and model selection are naturally linked, and in which the performance of AIC-based tools is naturally evaluated. Prior model weights implicitly associated with the use of AIC are seen to highly favor complex models: in some cases, all but the most highly parameterized models in the model set are virtually ignored a priori. We suggest the usefulness of the weighted BIC (Bayesian information criterion) as a computationally simple alternative to AIC, based on explicit selection of prior model probabilities rather than acceptance of default priors associated with AIC. We note, however, that both procedures are only approximate to the use of exact Bayes factors. We discuss and illustrate technical difficulties associated with Bayes factors, and suggest approaches to avoiding these difficulties in the context of model selection for a logistic regression. Our example highlights the predisposition of AIC weighting to favor complex models and suggests a need for caution in using the BIC for computing approximate posterior model weights.

[1]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[2]  David R. Anderson,et al.  Practical Use of the Information-Theoretic Approach , 1998 .

[3]  Shane A. Richards,et al.  TESTING ECOLOGICAL THEORY USING THE INFORMATION‐THEORETIC APPROACH: EXAMPLES AND CAUTIONARY RESULTS , 2005 .

[4]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[5]  B. Carlin,et al.  Bayesian Model Choice Via Markov Chain Monte Carlo Methods , 1995 .

[6]  N. Hjort,et al.  Frequentist Model Average Estimators , 2003 .

[7]  Brendan A. Wintle,et al.  The Use of Bayesian Model Averaging to Better Represent Uncertainty in Ecological Models , 2003 .

[8]  J. Berger,et al.  The Intrinsic Bayes Factor for Model Selection and Prediction , 1996 .

[9]  Philip A. Stephens,et al.  Information theory and hypothesis testing: a call for pluralism , 2005 .

[10]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[11]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[12]  Xiaotong Shen,et al.  Discussion: Inference and Interpretability Considerations in Frequentist Model Averaging and Selection , 2003 .

[13]  FRED S. GUTHERY,et al.  INVITED PAPER: INFORMATION THEORY IN WILDLIFE SCIENCE: CRITIQUE AND VIEWPOINT , 2005 .

[14]  N. Lazar,et al.  Methods and Criteria for Model Selection , 2004 .

[15]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[16]  N. Hjort,et al.  The Focused Information Criterion , 2003 .

[17]  David R. Anderson,et al.  Model Selection and Inference: A Practical Information-Theoretic Approach , 2001 .

[18]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[19]  C. Chatfield Model uncertainty, data mining and statistical inference , 1995 .

[20]  A. Raftery,et al.  Discussion: Performance of Bayesian Model Averaging , 2003 .

[21]  David R. Anderson,et al.  Suggestions for presenting the results of data analyses , 2001 .

[22]  G. Box Science and Statistics , 1976 .