Total Bregman divergence-based fuzzy local information C-means clustering for robust image segmentation

Abstract The fuzzy local information C-means clustering algorithm (FLICM) is an important robust fuzzy clustering segmentation method, which has attracted considerable attention over the years. However, it lacks certain robustness to high noise or severe outliers. To improve the accuracy and robustness of the FLICM algorithm for images corrupted by high noise, a novel fuzzy local information c-means clustering utilizing total Bregman divergence (TFLICM) is proposed in this paper. The total Bregman divergence is modified by the local neighborhood information of sample to further enhance the ability to suppress noise, and then modified total Bregman divergence is introduced into the FLICM to construct a new objective function of robust fuzzy clustering, and the iterative clustering algorithm with high robustness is obtained through optimization theory. The convergence of the TFLICM algorithm is proved by the Zangwill theorem. In addition, the validity of the TFLICM algorithm applied in noise image segmentation is explained by means of sample weighting fuzzy clustering. Meanwhile, the generalized total Bregman divergence unifies the Bregman divergence with the total Bregman divergence and enhances the universality of the TFLICM algorithm applied in segmenting complex medical and remote sensing images. Some experimental results show that the TFLICM algorithm can obtain better segmentation quality and stronger anti-noise robustness than the existing FLICM algorithm.

[1]  Xin Yang,et al.  Image segmentation and proto-objects detection based visual tracking , 2017 .

[2]  Swagatam Das,et al.  Axiomatic generalization of the membership degree weighting function for fuzzy C means clustering: Theoretical development and convergence analysis , 2017, Inf. Sci..

[3]  Gang Wang,et al.  Improved fuzzy clustering algorithm with non-local information for image segmentation , 2017, Multimedia Tools and Applications.

[4]  Tao Tang,et al.  A Kernel Clustering Algorithm With Fuzzy Factor: Application to SAR Image Segmentation , 2014, IEEE Geoscience and Remote Sensing Letters.

[5]  Frank Nielsen,et al.  Total Bregman divergence and its applications to shape retrieval , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  S.M. Szilagyi,et al.  MR brain image segmentation using an enhanced fuzzy C-means algorithm , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[7]  Daoqiang Zhang,et al.  Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation , 2007, Pattern Recognit..

[8]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[9]  Nenghai Yu,et al.  Learning Bregman Distance Functions for Semi-Supervised Clustering , 2012, IEEE Transactions on Knowledge and Data Engineering.

[10]  Ling Li,et al.  A novel level set approach for image segmentation with landmark constraints , 2019, Optik.

[11]  J. Bezdek.  Cluster Validity with Fuzzy Sets , 1973 .

[12]  Jun Luo,et al.  Automatic Image Segmentation of Grape Based on Computer Vision , 2016 .

[13]  Rongchun Zhao,et al.  Image segmentation by clustering of spatial patterns , 2007, Pattern Recognit. Lett..

[14]  Wang Cong,et al.  A Fuzzy C-means Clustering Algorithm for Image Segmentation Using Nonlinear Weighted Local Information , 2017, J. Inf. Hiding Multim. Signal Process..

[15]  Chao Li,et al.  Threshold segmentation algorithm for automatic extraction of cerebral vessels from brain magnetic resonance angiography images , 2015, Journal of Neuroscience Methods.

[16]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[17]  Frank Nielsen,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Total Bregman Divergence and its Applications to DTI Analysis , 2022 .

[18]  Dominik Olszewski,et al.  Asymmetric clustering using the alpha-beta divergence , 2014, Pattern Recognit..

[19]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Yu Zhang,et al.  Infrared Ship Target Segmentation Based on Spatial Information Improved FCM , 2016, IEEE Transactions on Cybernetics.

[21]  Alvaro R. De Pierro,et al.  Re-examination of Bregman functions and new properties of their divergences , 2018, Optimization.

[22]  Yan Wang,et al.  Ship recognition method combined with image segmentation and deep learning feature extraction in video surveillance , 2019, Multimedia Tools and Applications.

[23]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[24]  Xi Chen,et al.  A Spatial Clustering Method With Edge Weighting for Image Segmentation , 2013, IEEE Geoscience and Remote Sensing Letters.

[25]  Hongqiang Wang,et al.  Information Geometry for Covariance Estimation in Heterogeneous Clutter with Total Bregman Divergence , 2018, Entropy.

[26]  C. L. Philip Chen,et al.  Ensemble fuzzy c-means clustering algorithms based on KL-Divergence for medical image segmentation , 2013, 2013 IEEE International Conference on Bioinformatics and Biomedicine.

[27]  J Tabor,et al.  Cross-entropy clustering , 2012, Pattern Recognit..

[28]  Fangyan Nie.  Tsallis cross-entropy based framework for image segmentation with histogram thresholding , 2015, J. Electronic Imaging.

[29]  Jacob Scharcanski,et al.  A simple weighted thresholding method for the segmentation of pigmented skin lesions in macroscopic images , 2017, Pattern Recognit..

[30]  Iván Durán-Díaz,et al.  Centroid-Based Clustering with αβ-Divergences , 2019, Entropy.

[31]  Jian Yu,et al.  Sample-weighted clustering methods , 2011, Comput. Math. Appl..

[32]  A. K. Shukla,et al.  Fuzzy Similarity Measure Based Spectral Clustering Framework for Noisy Image Segmentation , 2017, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[33]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[34]  Hwee Kuan Lee,et al.  Comments on “A Robust Fuzzy Local Information C-Means Clustering Algorithm” , 2013, IEEE Transactions on Image Processing.

[35]  Hua Wang,et al.  Improving image segmentation based on patch-weighted distance and fuzzy clustering , 2019, Multimedia Tools and Applications.

[36]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[37]  Alain Trémeau,et al.  Model-based hierarchical clustering with Bregman divergences and Fishers mixture model: application to depth image analysis , 2016, Stat. Comput..

[38]  S Bhagyalakshmi,et al.  Image Segmentation using Kernel Metric and Modified Weighted Fuzzy Factor , 2015 .

[39]  Frank Nielsen,et al.  Total Jensen divergences: Definition, Properties and k-Means++ Clustering , 2013, ArXiv.

[40]  Swagatam Das,et al.  Geometric divergence based fuzzy clustering with strong resilience to noise features , 2016, Pattern Recognit. Lett..

[41]  G.B. Coleman,et al.  Image segmentation by clustering , 1979, Proceedings of the IEEE.

[42]  Richard J. Hathaway,et al.  Density-Weighted Fuzzy c-Means Clustering , 2009, IEEE Transactions on Fuzzy Systems.

[43]  Jianbo Yang,et al.  Automatic microarray image segmentation with clustering-based algorithms , 2019, PloS one.

[44]  Chun Yuan,et al.  Carotid artery segmentation using level set method with double adaptive threshold (DATLS) on TOF-MRA images. , 2019, Magnetic resonance imaging.

[45]  Edwin R. Hancock,et al.  Tensor-based total bregman divergences between graphs , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[46]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[47]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Feng Zhao,et al.  A multi-objective interval valued fuzzy clustering algorithm with spatial information for noisy image segmentation , 2019, J. Intell. Fuzzy Syst..

[49]  Sudipta Roy,et al.  Comparative Study of Combination of Swarm Intelligence and Fuzzy C Means Clustering for Medical Image Segmentation , 2019, Smart Computational Strategies: Theoretical and Practical Aspects.

[50]  E. M. L. Beale,et al.  Nonlinear Programming: A Unified Approach. , 1970 .

[51]  Baba C. Vemuri,et al.  Total bregman divergence, a robust divergence measure, and its applications , 2011 .

[52]  Frank Nielsen,et al.  Shape Retrieval Using Hierarchical Total Bregman Soft Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Shailesh Tiwari,et al.  Model Order Reduction Using Fuzzy C-Means Clustering and Particle Swarm Optimization , 2019 .

[55]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[56]  Swagatam Das,et al.  Stronger Convergence Results for the Center-Based Fuzzy Clustering With Convex Divergence Measure , 2019, IEEE Transactions on Cybernetics.

[57]  Witold Pedrycz,et al.  Fuzzy C-Means clustering through SSIM and patch for image segmentation , 2020, Appl. Soft Comput..

[58]  Wojciech Pieczynski,et al.  Estimation of Generalized Multisensor Hidden Markov Chains and Unsupervised Image Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Maoguo Gong,et al.  Fuzzy C-Means Clustering With Local Information and Kernel Metric for Image Segmentation , 2013, IEEE Transactions on Image Processing.

[60]  Li Guo,et al.  KL Divergence-Based Fuzzy Cluster Ensemble for Image Segmentation , 2018, Entropy.

[61]  Dong-Ho Lee,et al.  Generalised kernel weighted fuzzy C-means clustering algorithm with local information , 2018, Fuzzy Sets Syst..

[62]  Hongqiang Wang,et al.  Geometric target detection based on total Bregman divergence , 2018, Digit. Signal Process..

[63]  Victor-Emil Neagoe,et al.  A Pulse-Coupled Neural Network approach for image segmentation and its pattern recognition application , 2016, 2016 International Conference on Communications (COMM).

[64]  Feng Zhao,et al.  Noise Robust Multiobjective Evolutionary Clustering Image Segmentation Motivated by the Intuitionistic Fuzzy Information , 2019, IEEE Transactions on Fuzzy Systems.

[65]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[66]  Frank Nielsen,et al.  Bregman Voronoi Diagrams , 2007, Discret. Comput. Geom..

[67]  Erik Cuevas,et al.  Locust Search Algorithm Applied to Multi-threshold Segmentation , 2019, Intelligent Systems Reference Library.