Bayesian Inference in Hidden Markov Random Fields for Binary Data Defined on Large Lattices

Hidden Markov random fields represent a complex hierarchical model, where the hidden latent process is an undirected graphical structure. Performing inference for such models is difficult primarily because the likelihood of the hidden states is often unavailable. The main contribution of this article is to present approximate methods to calculate the likelihood for large lattices based on exact methods for smaller lattices. We introduce approximate likelihood methods by relaxing some of the dependencies in the latent model, and also by extending tractable approximations to the likelihood, the so-called pseudolikelihood approximations, for a large lattice partitioned into smaller sublattices. Results are presented based on simulated data as well as inference for the temporal-spatial structure of the interaction between up- and down-regulated states within the mitochondrial chromosome of the Plasmodium falciparum organism. Supplemental material for this article is available online.

[1]  F. Liang.  Continuous Contour Monte Carlo for Marginal Density Estimation With an Application to a Spatial Statistical Model , 2007 .

[2]  C. Dormann.  Assessing the validity of autologistic regression , 2007 .

[3]  J.-P. Dubois,et al.  Assessing the risk of soil contamination in the Swiss Jura using indicator geostatistics , 1997, Environmental and Ecological Statistics.

[4]  H. Preisler,et al.  Modelling Spatial Patterns of Trees Attacked by Bark-beetles , 1993 .

[5]  John K. Goutsias.  Unilateral approximation of Gibbs random field images , 1991, CVGIP Graph. Model. Image Process..

[6]  Hongtu Zhu,et al.  Maximum likelihood from spatial random effects models via the stochastic approximation expectation maximization algorithm , 2007, Stat. Comput..

[7]  S. T. Buckland,et al.  An autologistic model for the spatial distribution of wildlife , 1996 .

[8]  Minggao Gu,et al.  Maximum likelihood estimation for spatial models , 2001 .

[9]  Anthony N. Pettitt,et al.  Likelihood Estimation and Inference for the Autologistic Model , 2004 .

[10]  Anthony N. Pettitt,et al.  Efficient calculation of the normalizing constant of the autologistic and related models on the cylinder and lattice , 2003 .

[11]  N. Cressie,et al.  Image analysis with partially ordered Markov models , 1998 .

[12]  Iain Murray.  Advances in Markov chain Monte Carlo methods , 2007 .

[13]  J. Propp,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996 .

[14]  D. Cox,et al.  A note on pseudolikelihood constructed from marginal densities , 2004 .

[15]  D. M. Titterington,et al.  Computational Bayesian Analysis of Hidden Markov Models , 1998 .

[16]  Zhiyi Chi,et al.  Approximating likelihoods for large spatial data sets , 2004 .

[17]  Zoubin Ghahramani,et al.  Bayesian Learning in Undirected Graphical Models: Approximate MCMC Algorithms , 2004, UAI.

[18]  J. Heikkinen,et al.  Fully Bayesian Approach to Image Restoration with an Application in Biogeography , 1994 .

[19]  S. L. Scott.  Bayesian Methods for Hidden Markov Models , 2002 .

[20]  Peter Guttorp,et al.  A Hidden Markov Model for Space‐Time Precipitation , 1991 .

[21]  M. Gu,et al.  Maximum likelihood estimation for spatial models by Markov chain Monte Carlo stochastic approximation , 2001 .

[22]  F. Huang,et al.  Generalized Pseudo-Likelihood Estimates for Markov Random Fields on Lattice , 2002 .

[23]  Giovanni Sebastiani,et al.  A Bayesian Method for Multispectral Image Data Classification , 2002 .

[24]  J. Møller,et al.  An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants , 2006 .

[25]  J. Besag.  Statistical Analysis of Non-Lattice Data , 1975 .

[26]  J. Derisi,et al.  The Transcriptome of the Intraerythrocytic Developmental Cycle of Plasmodium falciparum , 2003, PLoS biology.

[27]  P. Green,et al.  Hidden Markov Models and Disease Mapping , 2002 .

[28]  J. Besag,et al.  Bayesian image restoration, with two applications in spatial statistics , 1991 .

[29]  Charles C. Taylor,et al.  Bayesian texture segmentation of weed and crop images using reversible jump Markov chain Monte Carlo methods , 2003 .

[30]  Laveen N. Kanal,et al.  Classification of binary random patterns , 1965, IEEE Trans. Inf. Theory.

[31]  C. Geyer,et al.  Constrained Monte Carlo Maximum Likelihood for Dependent Data , 1992 .

[32]  Ernst Wit,et al.  Statistics for Microarrays : Design, Analysis and Inference , 2004 .

[33]  Anthony N. Pettitt,et al.  Efficient recursions for general factorisable models , 2004 .

[34]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[35]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[36]  Hulin Wu,et al.  Markov chain Monte Carlo for autologistic regression models with application to the distribution of plant species , 1998 .

[37]  Michael I. Jordan.  Graphical Models , 1998 .

[38]  David Bruce Wilson,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996, Random Struct. Algorithms.

[39]  Tatiyana V. Apanasovich,et al.  On estimation in binary autologistic spatial models , 2006 .

[40]  Hulin Wu,et al.  Modelling the distribution of plant species using the autologistic regression model , 1997, Environmental and Ecological Statistics.

[41]  S. Lele,et al.  A Composite Likelihood Approach to Binary Spatial Data , 1998 .

[42]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.