A Fuzzy Clustering Approach Toward Hidden Markov Random Field Models for Enhanced Spatially Constrained Image Segmentation

Hidden Markov random field (HMRF) models have been widely used for image segmentation, as they appear naturally in problems where a spatially constrained clustering scheme, taking into account the mutual influences of neighboring sites, is asked for. Fuzzy c-means (FCM) clustering has also been successfully applied in several image segmentation applications. In this paper, we combine the benefits of these two approaches, by proposing a novel treatment of HMRF models, formulated on the basis of a fuzzy clustering principle. We approach the HMRF model treatment problem as an FCM-type clustering problem, effected by introducing the explicit assumptions of the HMRF model into the fuzzy clustering procedure. Our approach utilizes a fuzzy objective function regularized by Kullback--Leibler divergence information, and is facilitated by application of a mean-field-like approximation of the MRF prior. We experimentally demonstrate the superiority of the proposed approach over competing methodologies, considering a series of synthetic and real-world image segmentation applications.

[1]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[2]  James C. Bezdek,et al.  Generalized fuzzy c-means clustering strategies using Lp norm distances , 2000, IEEE Trans. Fuzzy Syst..

[3]  Dzung L. Pham,et al.  Fuzzy clustering with spatial constraints , 2002, Proceedings. International Conference on Image Processing.

[4]  Adrian E. Raftery,et al.  Fast automatic unsupervised image segmentation and curve detection in spatial point patterns , 1999 .

[5]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[6]  Jun Zhang,et al.  The Mean Field Theory In EM Procedures For Markov Random Fields , 1991, Proceedings of the Seventh Workshop on Multidimensional Signal Processing.

[7]  Jacek Łęski,et al.  An ε-insensitive approach to fuzzy clustering , 2001 .

[8]  Gerhard Winkler,et al.  Image Analysis, Random Fields and Markov Chain Monte Carlo Methods: A Mathematical Introduction , 2002 .

[9]  Sadaaki Miyamoto,et al.  Fuzzy c-means as a regularization and maximum entropy approach , 1997 .

[10]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Uzay Kaymak,et al.  A New Fuzzy Set Merging Technique Using Inclusion-Based Fuzzy Clustering , 2008, IEEE Transactions on Fuzzy Systems.

[12]  Geir Storvik,et al.  A Simulation Study of Some Contextual Classification Methods For Remotely Sensed Data , 1987, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Florence Forbes,et al.  Hidden Markov Random Field Model Selection Criteria Based on Mean Field-Like Approximations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hong Yan,et al.  Image segmentation based on adaptive cluster prototype estimation , 2005, IEEE Transactions on Fuzzy Systems.

[15]  Martial Hebert,et al.  A Measure for Objective Evaluation of Image Segmentation Algorithms , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[16]  Sotirios Chatzis,et al.  Factor Analysis Latent Subspace Modeling and Robust Fuzzy Clustering Using $t$-Distributions , 2009, IEEE Transactions on Fuzzy Systems.

[17]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[18]  D. M. Titterington,et al.  Parameter estimation in latent profile models , 1998 .

[19]  Nikolas P. Galatsanos,et al.  A Class-Adaptive Spatially Variant Mixture Model for Image Segmentation , 2007, IEEE Transactions on Image Processing.

[20]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[21]  W. Qian,et al.  Parameter estimation for hidden Gibbs chains , 1990 .

[22]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Jian Yu,et al.  A Generalized Fuzzy Clustering Regularization Model With Optimality Tests and Model Complexity Analysis , 2007, IEEE Transactions on Fuzzy Systems.

[24]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[25]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[26]  Bernard Chalmond,et al.  An iterative Gibbsian technique for reconstruction of m-ary images , 1989, Pattern Recognit..

[27]  Tomaso Poggio,et al.  Probabilistic Solution of Ill-Posed Problems in Computational Vision , 1987 .

[28]  J. Besag Statistical Analysis of Non-Lattice Data , 1975 .

[29]  Stuart Geman,et al.  Markov Random Field Image Models and Their Applications to Computer Vision , 2010 .

[30]  Jacek M. Leski,et al.  Towards a robust fuzzy clustering , 2003, Fuzzy Sets Syst..

[31]  D. Chandler,et al.  Introduction To Modern Statistical Mechanics , 1987 .

[32]  Martial Hebert,et al.  Measures of Similarity , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[33]  Hidetomo Ichihashi,et al.  Fuzzy c-means clustering with regularization by K-L information , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[34]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[35]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[36]  Gilles Celeux,et al.  EM procedures using mean field-like approximations for Markov model-based image segmentation , 2003, Pattern Recognit..

[37]  Jun Zhang,et al.  The mean field theory in EM procedures for blind Markov random field image restoration , 1993, IEEE Trans. Image Process..

[38]  W. Qian,et al.  Estimation of parameters in hidden Markov models , 1991, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[39]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[40]  Yannis A. Tolias,et al.  Image segmentation by a fuzzy clustering algorithm using adaptive spatially constrained membership functions , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[41]  Francesco Masulli,et al.  Soft transition from probabilistic to possibilistic fuzzy clustering , 2006, IEEE Transactions on Fuzzy Systems.