Automating and evaluating reversible jump MCMC proposal distributions

The reversible jump Markov chain Monte Carlo (MCMC) sampler (Green in Biometrika 82:711–732, 1995) has become an invaluable device for Bayesian practitioners. However, the primary difficulty with the sampler lies with the efficient construction of transitions between competing models of possibly differing dimensionality and interpretation. We propose the use of a marginal density estimator to construct between-model proposal distributions. This provides both a step towards black-box simulation for reversible jump samplers, and a tool to examine the utility of common between-model mapping strategies. We compare the performance of our approach to well established alternatives in both time series and mixture model examples.

[1]  P. Green,et al.  Trans-dimensional Markov chain Monte Carlo , 2000 .

[2]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[3]  M. Clyde,et al.  Model Uncertainty , 2003 .

[4]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[5]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[6]  Scott A. Sisson,et al.  Trans-dimensional Markov chains : A decade of progress and future perspectives , 2004 .

[7]  Ajay Jasra,et al.  Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling , 2005 .

[8]  Scott A. Sisson,et al.  Transdimensional Markov Chains , 2005 .

[9]  M. Hurn,et al.  Improving the acceptance rate of reversible jump MCMC proposals , 2004 .

[10]  L. Wasserman,et al.  Computing Bayes Factors Using a Generalization of the Savage-Dickey Density Ratio , 1995 .

[11]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[12]  Peter Green,et al.  Highly Structured Stochastic Systems , 2003 .

[13]  Adrian F. M. Smith,et al.  Bayesian Analysis of Constrained Parameter and Truncated Data Problems , 1991 .

[14]  Hukushima Koji.  Recent Developments in Markov-chain Monte Carlo Method , 2010 .

[15]  S. P. Brooksy,et al.  Efficient construction of reversible jump MCMC proposal dis- tributions , 2000 .

[16]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[17]  Steve P. Brooks,et al.  Output Assessment for Monte Carlo Simulations via the Score Statistic , 2006 .

[18]  R. Ehlers.  Bayesian Analysis of Order Uncertainty in ARIMA Models , 2006 .

[19]  R. Kohn,et al.  Bayesian estimation of an autoregressive model using Markov chain Monte Carlo , 1996 .

[20]  A. Doucet,et al.  Reversible Jump Markov Chain Monte Carlo Strategies for Bayesian Model Selection in Autoregressive Processes , 2004, Journal of Time Series Analysis.

[21]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[22]  C. Holmes,et al.  MCMC and the Label Switching Problem in Bayesian Mixture Modelling 1 Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modelling , 2004 .

[23]  Ming-Hui Chen.  Importance-Weighted Marginal Bayesian Posterior Density Estimation , 1994 .

[24]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[25]  Walter Zucchini,et al.  Model Selection , 2011, International Encyclopedia of Statistical Science.

[26]  Edward I. George,et al.  The Practical Implementation of Bayesian Model Selection , 2001 .

[27]  G. Roberts,et al.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions , 2003 .

[28]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[29]  P. Green,et al.  Delayed rejection in reversible jump Metropolis–Hastings , 2001 .