Image Segmentation Using an Efficient Rotationally Invariant 3 D Region-Based Hidden Markov Model

We present a novel three dimensional (3D) region-based hidden Markov model (rbHMM) for unsupervised image segmentation. Our contributions are twofold. First, our rbHMM employs a more efficient representation of the image than approaches based on a rectangular lattice or grid; thus, resulting in a faster optimization process. Second, our proposed novel tree-structured parameter estimation algorithm for the rbHMM provides a locally optimal data labeling that is invariant to object rotation. We demonstrate the advantages of our segmentation technique by validating on synthetic images of geometric shapes as well as both simulated and clinical magnetic resonance imaging (MRI) data of the brain. For the geometric shape data, we show that our method produces more accurate results in less time than a grid-based HMM framework using a similar optimization strategy. For the brain MRI data, our white and gray matter segmentation results in substantially greater accuracy than both block-based 3D HMM estimation and expectation-maximization hidden Markov random field (HMRF-EM) approaches.

[1]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[2]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[3]  J. Baker,et al.  The DRAGON system--An overview , 1975 .

[4]  Paolo Frasconi,et al.  Hidden Tree Markov Models for Document Image Classification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  James Ze Wang,et al.  A computationally efficient approach to the estimation of two- and three-dimensional hidden Markov models , 2006, IEEE Transactions on Image Processing.

[6]  Gerhard Rigoll,et al.  Facial Expression Recognition with Pseudo-3D Hidden Markov Models , 2001, DAGM-Symposium.

[7]  Ioannis Patras,et al.  Video Segmentation by MAP Labeling of Watershed Segments , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[10]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[11]  Gerhard Rigoll,et al.  Improved Face Recognition Using Pseudo 2-D Hidden Markov Models , 1998 .

[12]  Ting Song,et al.  Homogeneity measures for multiphase level set segmentation of brain MRI , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[13]  A. Constantinides,et al.  A graph-theoretic approach to colour image segmentation and contour classification , 1992 .

[14]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[15]  Oscar E. Agazzi,et al.  Machine vision for keyword spotting using pseudo 2D hidden Markov models , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.

[17]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[18]  Robert M. Gray,et al.  Image classification by a two-dimensional hidden Markov model , 2000, IEEE Trans. Signal Process..

[19]  Qionghai Dai,et al.  Region-based hidden Markov models for image categorization and retrieval , 2007, Electronic Imaging.

[20]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[21]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[22]  John S. Boreczky,et al.  A hidden Markov model framework for video segmentation using audio and image features , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[23]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  M. Ibrahim,et al.  Hidden Markov models-based 3D MRI brain segmentation , 2006, Image Vis. Comput..

[25]  James Llinas,et al.  Comparative analysis of alternative ground target tracking techniques , 2000, Proceedings of the Third International Conference on Information Fusion.

[26]  Bernard Mérialdo,et al.  Semantic Image Segmentation with a Multidimensional Hidden Markov Model , 2007, MMM.

[27]  David A. Clausi,et al.  Gaussian MRF rotation-invariant features for image classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Roberto Pieraccini,et al.  Dynamic planar warping for optical character recognition , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[29]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[30]  Andrew J. Viterbi,et al.  Trellis Encoding of memoryless discrete-time sources with a fidelity criterion , 1974, IEEE Trans. Inf. Theory.

[31]  Stan Z. Li,et al.  Markov Random Field Models in Computer Vision , 1994, ECCV.

[32]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  James Ze Wang,et al.  Stochastic modeling of volume images with a 3-D hidden Markov model , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[34]  S. Beucher,et al.  Watersheds of functions and picture segmentation , 1982, ICASSP.

[35]  Amir Averbuch,et al.  A region-based MRF model for unsupervised segmentation of moving objects in image sequences , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[36]  A. Frost Spatio-temporal hidden Markov models for incorporating interannual variability in rainfall , 2004 .

[37]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[38]  Anjan Sarkar,et al.  A simple unsupervised MRF model based image segmentation approach , 2000, IEEE Trans. Image Process..

[39]  P. Devijver PROBABILISTIC LABELING IN A HIDDEN SECOND ORDER MARKOV MESH , 1986 .