Cutset-type possibilistic c-means clustering algorithm

Abstract The possibilistic c-means (PCM) clustering algorithm was introduced to avoid the sensitivity of the fuzzy c-means (FCM) clustering algorithm to outliers by relaxing the column sum constraint of the membership matrix of the FCM, namely the between-class relationships. The membership value is then interpreted as the typicality value of a data point in the PCM which reflects the absolute distance of data point to one cluster well. However, the PCM has a significant defect of coincident clustering problem because of relaxing the relations of clusters. In this paper, a novel cutset-type possibilistic clustering (C-PCM) algorithm is proposed. The C-PCM firstly generates a cluster core resulting from a β-cutset for each cluster and searches for data points located inside the cluster core. Then, the typicalities of these points to other clusters are modified, thus introducing the between-class relationships and avoiding coincident clusters. Simultaneously an adaptive determination method is also given for the parameter β in the C-PCM. Moreover, a novel segmentation method for images corrupted by salt-and-pepper noise is proposed by taking advantage of the strong robustness of the C-PCM to outliers. Several experiments are done on synthetic data-sets, high dimensional data sets, noisy images, which demonstrate the good performance of the proposed algorithm.

[1]  Bo Song,et al.  Stability analysis of Hopfield neural networks perturbed by Poisson noises , 2016, Neurocomputing.

[2]  Lale Akarun,et al.  A fuzzy algorithm for color quantization of images , 2002, Pattern Recognit..

[3]  James C. Bezdek,et al.  A mixed c-means clustering model , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[4]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[5]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[6]  Korris Fu-Lai Chung,et al.  An enhanced possibilistic C-Means clustering algorithm EPCM , 2008, Soft Comput..

[7]  Po-Whei Huang,et al.  A size-insensitive integrity-based fuzzy c-means method for data clustering , 2014, Pattern Recognit..

[8]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..

[9]  László Szilágyi,et al.  Fuzzy-Possibilistic Product Partition: A Novel Robust Approach to c-Means Clustering , 2011, MDAI.

[10]  Sina Khanmohammadi,et al.  An improved overlapping k-means clustering method for medical applications , 2017, Expert Syst. Appl..

[11]  Jian Yu,et al.  A novel fuzzy clustering algorithm based on a fuzzy scatter matrix with optimality tests , 2005, Pattern Recognit. Lett..

[12]  Miin-Shen Yang,et al.  Self-organizing map for symbolic data , 2012, Fuzzy Sets Syst..

[13]  Jiawei Han,et al.  Efficient and Effective Clustering Methods for Spatial Data Mining , 1994, VLDB.

[14]  Konstantinos Koutroumbas,et al.  Sparse adaptive possibilistic clustering , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Juan Ramón Rico-Juan,et al.  Improving kNN multi-label classification in Prototype Selection scenarios using class proposals , 2015, Pattern Recognit..

[16]  Jiu-lun Fan,et al.  Image segmentation based on weak fuzzy partition entropy , 2015, Neurocomputing.

[17]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[18]  Swagatam Das,et al.  A Fuzzy Entropy Based Multi-Level Image Thresholding Using Differential Evolution , 2014, SEMCCO.

[19]  Mauro Barni,et al.  Comments on "A possibilistic approach to clustering" , 1996, IEEE Trans. Fuzzy Syst..

[20]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[21]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[22]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[23]  Santiago Aja-Fernández,et al.  A local fuzzy thresholding methodology for multiregion image segmentation , 2015, Knowl. Based Syst..

[24]  Kuo-Lung Wu,et al.  Unsupervised possibilistic clustering , 2006, Pattern Recognit..

[25]  Sami Ekici,et al.  Support Vector Machines for classification and locating faults on transmission lines , 2012, Appl. Soft Comput..

[26]  Athanasios A. Rontogiannis,et al.  A Novel Adaptive Possibilistic Clustering Algorithm , 2014, IEEE Transactions on Fuzzy Systems.

[27]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Yukihiro Hamasuna,et al.  Sequential Extraction by Using Two Types of Crisp Possibilistic Clustering , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[29]  Qingmao Hu,et al.  Segmentation of Brain Tissues from Magnetic Resonance Images Using Adaptively Regularized Kernel-Based Fuzzy C-Means Clustering , 2015, Comput. Math. Methods Medicine.

[30]  Junichi Hori,et al.  Classification of silent speech using support vector machine and relevance vector machine , 2014, Appl. Soft Comput..

[31]  Ondrej Krejcar,et al.  Modified frequency-based term weighting schemes for text classification , 2017, Appl. Soft Comput..

[32]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[33]  Mohammad Hossein Fazel Zarandi,et al.  Relative entropy collaborative fuzzy clustering method , 2015, Pattern Recognit..

[34]  R. Kruse,et al.  An extension to possibilistic fuzzy cluster analysis , 2004, Fuzzy Sets Syst..

[35]  Sudipto Guha,et al.  CURE: an efficient clustering algorithm for large databases , 1998, SIGMOD '98.

[36]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[37]  S. Archana,et al.  Survey of Classification Techniques in Data Mining , 2014 .

[38]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[39]  Athanasios A. Rontogiannis,et al.  Sparsity-Aware Possibilistic Clustering Algorithms , 2015, IEEE Transactions on Fuzzy Systems.

[40]  Yating Hu,et al.  An Improved Possibilistic Clustering Based on Differential Algorithm , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.