Image segmentation by generalized hierarchical fuzzy C-means algorithm

Fuzzy c-means (FCM) has been considered as an effective algorithm for image segmentation. However, it still suffers from two problems: one is insufficient robustness to image noise, and the other is the Euclidean distance in FCM, which is sensitive to outliers. In this paper, we propose two new algorithms, generalized FCM (GFCM) and hierarchical FCM (HFCM), to solve these two problems. Traditional FCM can be considered as a linear combination of membership and distance from the expression of its mathematical formula. GFCM is generated by applying generalized mean on these two items. We impose generalized mean on membership to incorporate local spatial information and cluster information, and on distance function to incorporate local spatial information and image intensity value. Thus, our GFCM is more robust to image noise with the spatial constraints: the generalized mean. To solve the second problem caused by Euclidean distance (l2 norm), we introduce a more flexibility function which considers the distance function itself as a sub-FCM. Furthermore, the sub-FCM distance function in HFCM is general and flexible enough to deal with non-Euclidean data. Finally, we combine these two algorithms to introduce a new generalized hierarchical FCM (GHFCM). Experimental results demonstrate the improved robustness and effectiveness of the proposed algorithm.

[1]  Sotirios Chatzis,et al.  A Fuzzy Clustering Approach Toward Hidden Markov Random Field Models for Enhanced Spatially Constrained Image Segmentation , 2008, IEEE Transactions on Fuzzy Systems.

[2]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[3]  James C. Bezdek,et al.  Generalized fuzzy c-means clustering strategies using Lp norm distances , 2000, IEEE Trans. Fuzzy Syst..

[4]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[5]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[6]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Miin-Shen Yang On a class of fuzzy classification maximum likelihood procedures , 1993 .

[8]  Yueh-Min Huang,et al.  Two novel fuzzy clustering methods for solving data clustering problems , 2014, J. Intell. Fuzzy Syst..

[9]  J. Bezdek,et al.  c-means clustering with the l/sub l/ and l/sub infinity / norms , 1991 .

[10]  Usman Qamar,et al.  A dissimilarity measure based Fuzzy c-means (FCM) clustering algorithm , 2014, J. Intell. Fuzzy Syst..

[11]  Paul R. Kersten,et al.  Fuzzy order statistics and their application to fuzzy clustering , 1999, IEEE Trans. Fuzzy Syst..

[12]  Jian Yu,et al.  General C-Means Clustering Model , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[14]  Chin-Shyurng Fahn,et al.  The multisynapse neural network and its application to fuzzy clustering , 2002, IEEE Trans. Neural Networks.

[15]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Witold Pedrycz,et al.  Conditional fuzzy clustering in the design of radial basis function neural networks , 1998, IEEE Trans. Neural Networks.

[17]  Aristidis Likas,et al.  Mixture of Experts Classification Using a Hierarchical Mixture Model , 2002, Neural Computation.

[18]  Daoqiang Zhang,et al.  Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation , 2007, Pattern Recognit..

[19]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[20]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[21]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[22]  N. B. Karayiannis,et al.  Weighted fuzzy learning vector quantization and weighted generalized fuzzy c-means algorithms , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[23]  Marco Di Zio,et al.  A mixture of mixture models for a classification problem: The unity measure error , 2007, Comput. Stat. Data Anal..

[24]  Joachim M. Buhmann,et al.  SAR images as mixtures of Gaussian mixtures , 2005, IEEE International Conference on Image Processing 2005.

[25]  Frank Klawonn,et al.  Fuzzy Clustering Based on Modified Distance Measures , 1999, IDA.

[26]  J. Bezdek,et al.  e-Means Clustering with the I1 and I, Norms , 1991 .

[27]  Peter Clifford,et al.  Markov Random Fields in Statistics , 2012 .

[28]  Martial Hebert,et al.  Measures of Similarity , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[29]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.