MCMC for Doubly-intractable Distributions

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are additional parameter-dependent normalization terms; for example, the posterior over parameters of an undirected graphical model. An ingenious auxiliary-variable scheme (Moller et al., 2004) offers a solution: exact sampling (Propp and Wilson, 1996) is used to sample from a Metropolis-Hastings proposal for which the acceptance probability is tractable. Unfortunately the acceptance probability of these expensive updates can be low. This paper provides a generalization of M0ller et al. (2004) and a new MCMC algorithm, which obtains better acceptance probabilities for the same amount of exact sampling, and removes the need to estimate model parameters before sampling begins.

[1]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[2]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[3]  Wang,et al.  Replica Monte Carlo simulation of spin glasses. , 1986, Physical review letters.

[4]  B. Carlin,et al.  Bayesian Model Choice Via Markov Chain Monte Carlo Methods , 1995 .

[5]  Radford M. Neal.  Sampling from multimodal distributions using tempered transitions , 1996, Stat. Comput..

[6]  David Bruce Wilson,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996, Random Struct. Algorithms.

[7]  Xiao-Li Meng,et al.  SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION , 1996 .

[8]  David Bruce Wilson,et al.  Annotated bibliography of perfectly random sampling with Markov chains , 1997, Microsurveys in Discrete Probability.

[9]  C. Jarzynski.  Equilibrium free-energy differences from nonequilibrium measurements: A master-equation approach , 1997, cond-mat/9707325.

[10]  Radford M. Neal.  Annealed importance sampling , 1998, Stat. Comput..

[11]  A. Childs,et al.  Exact sampling from nonattractive distributions using summary states. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Zoubin Ghahramani,et al.  Bayesian Learning in Undirected Graphical Models: Approximate MCMC Algorithms , 2004, UAI.

[13]  Radford M. Neal.  Estimating Ratios of Normalizing Constants Using Linked Importance Sampling , 2005, math/0511216.

[14]  Radford M. Neal.  Taking Bigger Metropolis Steps by Dragging Fast Variables , 2005, math/0502099.

[15]  J. Møller,et al.  An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants , 2006 .