Image segmentation by a robust Modified Gaussian Mixture Model

The Gaussian Mixture Model (GMM) with a spatial constraint, e.g. a Hidden Markov Random Field (HMRF), has been proven effective for image segmentation. However, the determination of parameter β in the HMRF model is, in fact, noise dependent to some degree. In this paper, we propose a simple and effective algorithm to make the traditional Gaussian Mixture Model more robust to noise, with consideration of the relationship between the local spatial information and the pixel intensity value information. The conditional probability of an image pixel is influenced by the probabilities of pixels in its immediate neighborhood to incorporate the spatial and intensity information. In this case, the parameter β can be assigned to a small value to preserve image sharpness and detail in non-noise images. At the same time, the neighborhood window is used to tolerate the noise for heavy-noised images. Thus, the parameter β is independent of image noise degree in our model. Finally, our algorithm is not limited to GMM-it is general enough so that it can be applied to other distributions based on the construction of the Finite Mixture Model (FMM) technique.

[1]  Sotirios Chatzis,et al.  A Fuzzy Clustering Approach Toward Hidden Markov Random Field Models for Enhanced Spatially Constrained Image Segmentation , 2008, IEEE Transactions on Fuzzy Systems.

[2]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[3]  D. Titterington,et al.  Parameter estimation for hidden Markov chains , 2002 .

[4]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[5]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[6]  Q. M. Jonathan Wu,et al.  An Extension of the Standard Mixture Model for Image Segmentation , 2010, IEEE Transactions on Neural Networks.

[7]  M. N. M. van Lieshout,et al.  Markovianity in space and time , 2006, math/0608242.

[8]  J. Besag Statistical Analysis of Non-Lattice Data , 1975 .

[9]  Daoqiang Zhang,et al.  Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation , 2007, Pattern Recognit..

[10]  Jun Zhang,et al.  Maximum-likelihood parameter estimation for unsupervised stochastic model-based image segmentation , 1994, IEEE Trans. Image Process..

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Martial Hebert,et al.  Measures of Similarity , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[13]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[14]  P. Deb Finite Mixture Models , 2008 .

[15]  Q. M. Jonathan Wu,et al.  Gaussian-Mixture-Model-Based Spatial Neighborhood Relationships for Pixel Labeling Problem , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Jun Zhang,et al.  The mean field theory in EM procedures for blind Markov random field image restoration , 1993, IEEE Trans. Image Process..

[17]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[18]  W. Qian,et al.  Estimation of parameters in hidden Markov models , 1991, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[19]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[20]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[21]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Peter Clifford,et al.  Markov Random Fields in Statistics , 2012 .

[23]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[25]  ForbesFlorence,et al.  Hidden Markov Random Field Model Selection Criteria Based on Mean Field-Like Approximations , 2003 .

[26]  Zhenyu Zhou,et al.  Approximate maximum likelihood hyperparameter estimation for Gibbs priors , 1995, Proceedings., International Conference on Image Processing.

[27]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.