A double Metropolis–Hastings sampler for spatial models with intractable normalizing constants

The problem of simulating from distributions with intractable normalizing constants has received much attention in recent literature. In this article, we propose an asymptotic algorithm, the so-called double Metropolis–Hastings (MH) sampler, for tackling this problem. Unlike other auxiliary variable algorithms, the double MH sampler removes the need for exact sampling, the auxiliary variables being generated using MH kernels, and thus can be applied to a wide range of problems for which exact sampling is not available. For the problems for which exact sampling is available, it can typically produce the same accurate results as the exchange algorithm, but using much less CPU time. The new method is illustrated by various spatial models.

[1]  W. Marsden.  I and J , 2012 .

[2]  R. Carroll,et al.  Stochastic Approximation in Monte Carlo Computation , 2007 .

[3]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[4]  F. Huang,et al.  Improvements of the Maximum Pseudo-Likelihood Estimators in Various Spatial Statistical Models , 1999 .

[5]  N. Balram,et al.  Noncausal Gauss Markov random fields: Parameter structure and estimation , 1993, IEEE Trans. Inf. Theory.

[6]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[7]  C. Geyer,et al.  Constrained Monte Carlo Maximum Likelihood for Dependent Data , 1992 .

[8]  Sophie Ancelet,et al.  Bayesian Clustering Using Hidden Markov Random Fields in Spatial Population Genetics , 2006, Genetics.

[9]  Håvard Rue,et al.  A Tutorial on Image Analysis , 2003 .

[10]  J. Besag,et al.  On the estimation and testing of spatial interaction in Gaussian lattice processes , 1975 .

[11]  Jun S. Liu,et al.  Covariance Structure and Convergence Rate of the Gibbs Sampler with Various Scans , 1995 .

[12]  William H. Press,et al.  Numerical recipes in C , 2002 .

[13]  David Bruce Wilson,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996, Random Struct. Algorithms.

[14]  C. Geyer.  Markov Chain Monte Carlo Maximum Likelihood , 1991 .

[15]  A. Childs,et al.  Exact sampling from nonattractive distributions using summary states. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  P. Moran,et al.  A Gaussian Markovian process on a square lattice , 1973, Journal of Applied Probability.

[17]  J. Møller,et al.  An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants , 2006 .

[18]  M. Gu,et al.  Maximum likelihood estimation for spatial models by Markov chain Monte Carlo stochastic approximation , 2001 .

[19]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[20]  F. Huang,et al.  Generalized Pseudo-Likelihood Estimates for Markov Random Fields on Lattice , 2002 .

[21]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[22]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[23]  Zoubin Ghahramani,et al.  MCMC for Doubly-intractable Distributions , 2006, UAI.

[24]  Faming Liang.  Use of sequential structure in simulation from high-dimensional systems. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Peter Muller,et al.  Alternatives to the Gibbs Sampling Scheme , 1992 .

[26]  J. L. Harrison,et al.  The Government Printing Office , 1968, American Journal of Pharmaceutical Education.

[27]  Tatiyana V. Apanasovich,et al.  On estimation in binary autologistic spatial models , 2006 .

[28]  Hulin Wu,et al.  Modelling the distribution of plant species using the autologistic regression model , 1997, Environmental and Ecological Statistics.

[29]  J.-P. Dubois,et al.  Assessing the risk of soil contamination in the Swiss Jura using indicator geostatistics , 1997, Environmental and Ecological Statistics.

[30]  F. Liang.  Continuous Contour Monte Carlo for Marginal Density Estimation With an Application to a Spatial Statistical Model , 2007 .

[31]  Wolff,et al.  Collective Monte Carlo updating for spin systems. , 1989, Physical review letters.

[32]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[33]  H. Preisler,et al.  Modelling Spatial Patterns of Trees Attacked by Bark-beetles , 1993 .

[34]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[35]  Y. Ogata,et al.  Likelihood Analysis of Spatial Point Patterns , 1984 .

[36]  P. Green,et al.  Hidden Markov Models and Disease Mapping , 2002 .

[37]  Wang,et al.  Nonuniversal critical dynamics in Monte Carlo simulations. , 1987, Physical review letters.

[38]  Luigi Ippoliti,et al.  Adjusted Maximum Likelihood and Pseudo-Likelihood Estimation for Noisy Gaussian Markov Random Fields , 2002 .