Decomposing posterior variance

We propose a decomposition of posterior variance somewhat in the spirit of an ANOVA decomposition. Terms in this decomposition come in pairs. Given a single parametric model, for instance, one term describes uncertainty arising because the parameter value is unknown while the other describes uncertainty propagated via uncertainty about which prior distribution is appropriate for the parameter. In the context of multiple candidate models and model-averaged estimates, two additional terms emerge resulting in a four-term decomposition. In the context of multiple spaces of models, six terms result. The value of the decomposition is twofold. First, it yields a fuller accounting of uncertainty than methods which condition on data-driven choices of models or model spaces. Second, it constitutes a novel approach to the study of prior influence in Bayesian analysis.

[1]  Phillip Ein-Dor,et al.  Attributes of the performance of central processing units: a relative performance prediction model , 1987, CACM.

[2]  Adrian E. Raftery,et al.  Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data , 2005, Bioinform..

[3]  David Ríos Insua,et al.  Robust Bayesian analysis , 2000 .

[4]  M. Steel,et al.  Benchmark Priors for Bayesian Model Averaging , 2001 .

[5]  R. Kohn,et al.  Nonparametric regression using Bayesian variable selection , 1996 .

[6]  Cong Han,et al.  MCMC Methods for Computing Bayes Factors: A Comparative Review , 2000 .

[7]  Ping Zhang,et al.  Inference after variable selection in linear regression models , 1992 .

[8]  P Gustafson,et al.  Case–Control Analysis with Partial Knowledge of Exposure Misclassification Probabilities , 2001, Biometrics.

[9]  R. Kohn,et al.  A Bayesian approach to nonparametric bivariate regression , 1997 .

[10]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[11]  R. Regal,et al.  The effects of model selection on confidence intervals for the size of a closed population. , 1991, Statistics in medicine.

[12]  Murray Aitkin,et al.  Simultaneous Inference and the Choice of Variable Subsets in Multiple Regression , 1974 .

[13]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo Methods for Computing Bayes Factors , 2001 .

[14]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[15]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[16]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .