Reversible jump Markov chain Monte Carlo computation and Bayesian model determination

Markov chain Monte Carlo methods for Bayesian computation have until recently been restricted to problems where the joint distribution of all variables has a density with respect to some fixed standard underlying measure. They have therefore not been available for application to Bayesian model determination, where the dimensionality of the parameter vector is typically not fixed. This paper proposes a new framework for the construction of reversible Markov chain samplers that jump between parameter subspaces of differing dimensionality, which is flexible and entirely constructive. It should therefore have wide applicability in model determination problems. The methodology is illustrated with applications to multiple change-point analysis in one and two dimensions, and to a Bayesian comparison of binomial experiments.

[1]  Barnes.  Discussion of the Paper , 1961, Public health papers and reports.

[2]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[3]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[4]  P. Peskun,et al.  Optimum Monte-Carlo sampling using Markov chains , 1973 .

[5]  C. Preston.  Spatial birth and death processes , 1975, Advances in Applied Probability.

[6]  Robin Sibson,et al.  Computing Dirichlet Tessellations in the Plane , 1978, Comput. J..

[7]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  A. Raftery,et al.  Bayesian analysis of a Poisson process with a change-point , 1986 .

[9]  E. George.  Combining Minimax Shrinkage Estimators , 1986 .

[10]  M. Newton,et al.  Bayesian inference by simulation in a stochastic model from hematology , 1992 .

[11]  J. Hartigan,et al.  Product Partition Models for Change Point Problems , 1992 .

[12]  Adrian F. M. Smith,et al.  Hierarchical Bayesian Analysis of Changepoint Problems , 1992 .

[13]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[14]  J. Hartigan,et al.  A Bayesian Analysis for Change Point Problems , 1993 .

[15]  Michael I. Miller,et al.  REPRESENTATIONS OF KNOWLEDGE IN COMPLEX SYSTEMS , 1994 .

[16]  C. Geyer,et al.  Simulation Procedures and Likelihood Inference for Spatial Point Processes , 1994 .

[17]  D. Stephens.  Bayesian Retrospective Multiple‐Changepoint Identification , 1994 .

[18]  Peter J Green,et al.  Contribution to discussion of paper by U Grenander & MI Miller , 1994 .

[19]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[20]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[21]  Kerrie Mengersen,et al.  [Bayesian Computation and Stochastic Systems]: Rejoinder , 1995 .

[22]  J. Besag,et al.  Bayesian Computation and Stochastic Systems , 1995 .

[23]  B. Carlin,et al.  Bayesian Model Choice Via Markov Chain Monte Carlo Methods , 1995 .

[24]  Guido Consonni,et al.  A Bayesian Method for Combining Results from Several Binomial Experiments , 1995 .

[25]  Walter R. Gilks,et al.  Bayesian model comparison via jump diffusions , 1995 .