A recursive algorithm for Markov random fields

We propose a recursive algorithm as a more useful alternative to the Brook expansion for the joint distribution of a vector of random variables when the original formulation is in terms of the corresponding full conditional distributions, as occurs for Markov random fields. Usually, in practical applications, the computational load will still be excessive but then the algorithm can be used to obtain the componentwise full conditionals of a system after marginalising over some variables or the joint distribution of subsets of the variables, conditioned on values of the remainder, which is required for block Gibbs sampling. As an illustrative example, we apply the algorithm in the simplest nontrivial setting of hidden Markov chains. More important, we demonstrate how it applies to Markov random fields on regular lattices and to perfect block Gibbs sampling for binary systems. Copyright Biometrika Trust 2002, Oxford University Press.

[1]  Mark Sweeny Monte Carlo study of weighted percolation clusters relevant to the Potts models , 1983 .

[2]  J. Besag,et al.  Bayesian Computation and Stochastic Systems , 1995 .

[3]  C. Robert,et al.  Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method , 2000 .

[4]  C. Fortuin,et al.  Correlation inequalities on some partially ordered sets , 1971 .

[5]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[6]  R. R. Bahadur Some Approximations to the Binomial Distribution Function , 1960 .

[7]  Adrian F. M. Smith,et al.  Bayesian computation via the gibbs sampler and related markov chain monte carlo methods (with discus , 1993 .

[8]  Peter Green,et al.  Spatial statistics and Bayesian computation (with discussion) , 1993 .

[9]  Gerard T. Barkema,et al.  Monte Carlo Methods in Statistical Physics , 1999 .

[10]  S. Karlin,et al.  Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions , 1980 .

[11]  D. Brook On the distinction between the conditional probability and the joint probability approaches in the specification of nearest-neighbour systems , 1964 .

[12]  Kerrie Mengersen,et al.  [Bayesian Computation and Stochastic Systems]: Rejoinder , 1995 .

[13]  J. Propp,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996 .

[14]  David Bruce Wilson,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996, Random Struct. Algorithms.

[15]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[16]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[17]  Michael I. Jordan Graphical Models , 2003 .

[18]  Lain L. MacDonald,et al.  Hidden Markov and Other Models for Discrete- valued Time Series , 1997 .