Model-Averaged Profile Likelihood Intervals

Model-averaging is commonly used as a means of allowing for model uncertainty in parameter estimation. In the frequentist framework, a model-averaged estimate of a parameter is the weighted mean of the estimates from each of the candidate models, the weights typically being chosen using an information criterion. Current methods for calculating a model-averaged confidence interval assume approximate normality of the model-averaged estimate, i.e., they are Wald intervals. As in the single-model setting, we might improve the coverage performance of this interval by a one-to-one transformation of the parameter, obtaining a Wald interval, and then back-transforming the endpoints. However, a transformation that works in the single-model setting may not when model-averaging, due to the weighting and the need to estimate the weights. In the single-model setting, a natural alternative is to use a profile likelihood interval, which generally provides better coverage than a Wald interval. We propose a method for model-averaging a set of single-model profile likelihood intervals, making use of the link between profile likelihood intervals and Bayesian credible intervals. We illustrate its use in an example involving negative binomial regression, and perform two simulation studies to compare its coverage properties with the existing Wald intervals.

[1]  David R. Anderson,et al.  Model selection bias and Freedman’s paradox , 2010 .

[2]  Nils Lid Hjort,et al.  Model Selection and Model Averaging: Contents , 2008 .

[3]  Clifford M. Hurvich,et al.  The impact of model selection on inference in linear regression , 1990 .

[4]  William A Link,et al.  Model weights and the foundations of multimodel inference. , 2006, Ecology.

[5]  D. Madigan,et al.  Bayesian Model Averaging in Proportional Hazard Models: Assessing the Risk of a Stroke , 1997 .

[6]  N. Hjort,et al.  Frequentist Model Average Estimators , 2003 .

[7]  M. Peruggia.  Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach (2nd ed.) , 2003 .

[8]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[9]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[10]  David Fletcher,et al.  Modelling skewed data with many zeros: A simple approach combining ordinary and logistic regression , 2005, Environmental and Ecological Statistics.

[11]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[12]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[13]  Lawrence D. Brown,et al.  INTERVAL ESTIMATION IN EXPONENTIAL FAMILIES , 2003 .

[14]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[15]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[16]  David R. Anderson,et al.  Multimodel Inference , 2004 .

[17]  Thomas A. Severini,et al.  On the Relationship between Bayesian and Non-Bayesian Interval Estimates , 1991 .

[18]  C. Chatfield.  Model uncertainty, data mining and statistical inference , 1995 .