Auxiliary-variable Exact Hamiltonian Monte Carlo Samplers for Binary Distributions

We present a new approach to sample from generic binary distributions, based on an exact Hamiltonian Monte Carlo algorithm applied to a piecewise continuous augmentation of the binary distribution of interest. An extension of this idea to distributions over mixtures of binary and possibly-truncated Gaussian or exponential variables allows us to sample from posteriors of linear and probit regression models with spike-and-slab priors and truncated parameters. We illustrate the advantages of these algorithms in several examples in which they outperform the Metropolis or Gibbs samplers.

[1]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[2]  James G. Scott,et al.  The horseshoe estimator for sparse signals , 2010 .

[3]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[4]  Gerard T. Barkema,et al.  Monte Carlo Methods in Statistical Physics , 1999 .

[5]  K. Murphy.  Bayesian Structure Learning for Markov Random Fields with a Spike and Slab Prior , 2012 .

[6]  Ari Pakman,et al.  Exact Hamiltonian Monte Carlo for Truncated Multivariate Gaussians , 2012, 1208.4118.

[7]  Yoshua Bengio,et al.  Spike-and-Slab Sparse Coding for Unsupervised Feature Discovery , 2012, ArXiv.

[8]  Yichuan Zhang,et al.  Continuous Relaxations for Discrete Hamiltonian Monte Carlo , 2012, NIPS.

[9]  A. Sokal.  Monte Carlo Methods in Statistical Mechanics: Foundations and New Algorithms , 1997 .

[10]  D. Landau,et al.  Efficient, multiple-range random walk algorithm to calculate the density of states. , 2000, Physical review letters.

[11]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[12]  Radford M. Neal.  MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[13]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[14]  T. J. Mitchell,et al.  Bayesian Variable Selection in Linear Regression , 1988 .

[15]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[16]  Katherine A. Heller,et al.  Bayesian and L1 Approaches to Sparse Unsupervised Learning , 2011, ICML 2012.