Image segmentation using an efficient rotationally invariant 3D region-based hidden Markov model

We present a novel three dimensional (3D) region-based hidden Markov model (rbHMM) for unsupervised image segmentation. Our contributions are twofold. First, our rbHMM employs a more efficient representation of the image than approaches based on a rectangular lattice or grid; thus, resulting in a faster optimization process. Second, our proposed novel tree-structured parameter estimation algorithm for the rbHMM provides a locally optimal data labeling that is invariant to object rotation. We demonstrate the advantages of our segmentation technique by validating on synthetic images of geometric shapes as well as both simulated and clinical magnetic resonance imaging (MRI) data of the brain. For the geometric shape data, we show that our method produces more accurate results in less time than a grid-based HMM framework using a similar optimization strategy. For the brain MRI data, our white and gray matter segmentation results in substantially greater accuracy than both block-based 3D HMM estimation and expectation-maximization hidden Markov random field (HMRF-EM) approaches.

[1]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[2]  Amir Averbuch,et al.  A region-based MRF model for unsupervised segmentation of moving objects in image sequences , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[4]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  A. Frost Spatio-temporal hidden Markov models for incorporating interannual variability in rainfall , 2004 .

[6]  Andrew J. Viterbi,et al.  Trellis Encoding of memoryless discrete-time sources with a fidelity criterion , 1974, IEEE Trans. Inf. Theory.

[7]  Bernard Mérialdo,et al.  Semantic Image Segmentation with a Multidimensional Hidden Markov Model , 2007, MMM.

[8]  James Llinas,et al.  Comparative analysis of alternative ground target tracking techniques , 2000, Proceedings of the Third International Conference on Information Fusion.

[9]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Ioannis Patras,et al.  Video Segmentation by MAP Labeling of Watershed Segments , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  P. Devijver PROBABILISTIC LABELING IN A HIDDEN SECOND ORDER MARKOV MESH , 1986 .

[12]  Anjan Sarkar,et al.  A simple unsupervised MRF model based image segmentation approach , 2000, IEEE Trans. Image Process..

[13]  Stan Z. Li,et al.  Markov Random Field Models in Computer Vision , 1994, ECCV.

[14]  A. Constantinides,et al.  A graph-theoretic approach to colour image segmentation and contour classification , 1992 .

[15]  James Ze Wang,et al.  A computationally efficient approach to the estimation of two- and three-dimensional hidden Markov models , 2006, IEEE Transactions on Image Processing.

[16]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.

[17]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[18]  Qionghai Dai,et al.  Region-based hidden Markov models for image categorization and retrieval , 2007, Electronic Imaging.

[19]  David A. Clausi,et al.  Gaussian MRF rotation-invariant features for image classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[21]  Paolo Frasconi,et al.  Hidden Tree Markov Models for Document Image Classification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[23]  Roberto Pieraccini,et al.  Dynamic planar warping for optical character recognition , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  John S. Boreczky,et al.  A hidden Markov model framework for video segmentation using audio and image features , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[25]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  M. Ibrahim,et al.  Hidden Markov models-based 3D MRI brain segmentation , 2006, Image Vis. Comput..

[27]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[28]  Gerhard Rigoll,et al.  Facial Expression Recognition with Pseudo-3D Hidden Markov Models , 2001, DAGM-Symposium.

[29]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[30]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[31]  James Ze Wang,et al.  Stochastic modeling of volume images with a 3-D hidden Markov model , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[32]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  J. Baker,et al.  The DRAGON system--An overview , 1975 .

[34]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[35]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[36]  S. Beucher,et al.  Watersheds of functions and picture segmentation , 1982, ICASSP.

[37]  Robert M. Gray,et al.  Image classification by a two-dimensional hidden Markov model , 2000, IEEE Trans. Signal Process..

[38]  Gerhard Rigoll,et al.  Improved Face Recognition Using Pseudo 2-D Hidden Markov Models , 1998 .

[39]  Ting Song,et al.  Homogeneity measures for multiphase level set segmentation of brain MRI , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[40]  Oscar E. Agazzi,et al.  Machine vision for keyword spotting using pseudo 2D hidden Markov models , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.