Monte Carlo dynamically weighted importance sampling for spatial models with intractable normalizing constants

The problem of simulating from distributions with intractable normalizing constants has received much attention in the recent literature. In this paper, we propose a new MCMC algorithm, the so-called Monte Carlo dynamically weighted importance sampler, for tickling this problem. The new algorithm is illustrated with the spatial autologistic models. The novelty of our algorithm is that it allows for the use of Monte Carlo estimates in MCMC simulations, while still leaving the target distribution invariant under the criterion of dynamically weighted importance sampling. Unlike the auxiliary variable MCMC algorithms, the new algorithm removes the need of perfect sampling, and thus can be applied to a wide range of problems for which perfect sampling is not available or very expensive. The new algorithm can also be used for simulating from the incomplete posterior distribution for the missing data problem.

[1]  F. Liang.  Continuous Contour Monte Carlo for Marginal Density Estimation With an Application to a Spatial Statistical Model , 2007 .

[2]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[3]  P. Grassberger.  Pruned-enriched Rosenbluth method: Simulations of θ polymers of chain length up to 1 000 000 , 1997 .

[4]  H. Preisler,et al.  Modelling Spatial Patterns of Trees Attacked by Bark-beetles , 1993 .

[5]  Håvard Rue,et al.  A Tutorial on Image Analysis , 2003 .

[6]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[7]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[8]  Sophie Ancelet,et al.  Bayesian Clustering Using Hidden Markov Random Fields in Spatial Population Genetics , 2006, Genetics.

[9]  P. Green,et al.  Hidden Markov Models and Disease Mapping , 2002 .

[10]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994 .

[11]  A. Childs,et al.  Exact sampling from nonattractive distributions using summary states. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  W H Wong,et al.  Dynamic weighting in Monte Carlo and optimization. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[13]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[14]  Tatiyana V. Apanasovich,et al.  On estimation in binary autologistic spatial models , 2006 .

[15]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[16]  Jun S. Liu,et al.  Rejection Control and Sequential Importance Sampling , 1998 .

[17]  J. Propp,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996 .

[18]  F. Liang.  Dynamically Weighted Importance Sampling in Monte Carlo Computation , 2002 .

[19]  Faming Liang,et al.  A Theory for Dynamic Weighting in Monte Carlo Computation , 2001 .

[20]  Brian D. Ripley,et al.  Stochastic Simulation , 2005 .

[21]  R. Carroll,et al.  Stochastic Approximation in Monte Carlo Computation , 2007 .

[22]  C. Geyer,et al.  Constrained Monte Carlo Maximum Likelihood for Dependent Data , 1992 .

[23]  J. Møller,et al.  An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants , 2006 .