Possibilistic fuzzy clustering with high-density viewpoint

Abstract Fuzzy clustering algorithms are usually data-driven. Recently, knowledge has been introduced into these methods to form knowledge-driven and data-driven fuzzy clustering algorithms. However, these algorithms still have the problems of sensitivity to clustering center initialization and a lack of robustness, in general. There is a genuine need for a sound acquisition of viewpoints. In this study, a new fuzzy clustering algorithm driven by data and knowledge named Density Viewpoint-induced Possibilistic Fuzzy C-Means (DVPFCM) is put forward. To begin with, we propose a new method to calculate the density radius, which determines the density range of each data point. Based on this, we establish a Hypersphere Density-based Clustering Center Initialization method (HDCCI), which can obtain the initial clustering centers located in the denser region of the dataset. Furthermore, the high density point obtained by the HDCCI method is taken as a new viewpoint and integrated into the clustering algorithm. The new viewpoint helps to speed up the convergence of the algorithm. It can also guide the clustering algorithm to discover the data structure. Finally, on the basis of the HDCCI method, the idea of high-density viewpoint is introduced, and the advantages of FCM (Fuzzy C-Means) and PFCM (Possibilistic Fuzzy C-Means) are combined, and then the DVPFCM algorithm is proposed. Through experimental studies including some comparative analyses, it is demonstrated that the DVPFCM algorithm is better in several different ways in terms of initializing clustering centers and values of some performance indexes. It also exhibits better performance in determining the distance between the computed clustering centers and the reference centers.

[1]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Witold Pedrycz,et al.  Fuzzy Wavelet Polynomial Neural Networks: Analysis and Design , 2017, IEEE Transactions on Fuzzy Systems.

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  Hidetomo Ichihashi,et al.  Linear fuzzy clustering techniques with missing values and their application to local principal component analysis , 2004, IEEE Transactions on Fuzzy Systems.

[5]  D. S. Yeung,et al.  Improving Performance of Similarity-Based Clustering by Feature Weight Learning , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Athanasios A. Rontogiannis,et al.  A Novel Adaptive Possibilistic Clustering Algorithm , 2014, IEEE Transactions on Fuzzy Systems.

[7]  Xian Fu,et al.  Kernel-based fuzzy c-means clustering algorithm based on genetic algorithm , 2016, Neurocomputing.

[8]  Kuo-Lung Wu,et al.  Unsupervised possibilistic clustering , 2006, Pattern Recognit..

[9]  Xuelong Li,et al.  Harmonious Genetic Clustering , 2018, IEEE Transactions on Cybernetics.

[10]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[11]  Jian-Ping Mei,et al.  A Fuzzy Approach for Multitype Relational Data Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[12]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[13]  Paulo Fazendeiro,et al.  Observer-Biased Fuzzy Clustering , 2015, IEEE Transactions on Fuzzy Systems.

[14]  Jiang-She Zhang,et al.  Improved possibilistic C-means clustering algorithms , 2004, IEEE Trans. Fuzzy Syst..

[15]  Witold Pedrycz,et al.  Fuzzy Clustering With Viewpoints , 2010, IEEE Transactions on Fuzzy Systems.

[16]  Witold Pedrycz,et al.  Fuzzy Clustering With Partial Supervision in Organization and Classification of Digital Images , 2008, IEEE Transactions on Fuzzy Systems.

[17]  F. Chung-Hoon Rhee Uncertain Fuzzy Clustering: Insights and Recommendations , 2007 .

[18]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Witold Pedrycz,et al.  Granular Data Description: Designing Ellipsoidal Information Granules , 2017, IEEE Transactions on Cybernetics.

[20]  Masao Mukaidono,et al.  Gaussian clustering method based on maximum-fuzzy-entropy interpretation , 1999, Fuzzy Sets Syst..

[21]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Anil K. Jain,et al.  Clustering Millions of Faces by Identity , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ricardo J. G. B. Campello,et al.  A fuzzy extension of the Rand index and other related indexes for clustering and classification assessment , 2007, Pattern Recognit. Lett..

[24]  C. L. Philip Chen,et al.  A Multiple-Kernel Fuzzy C-Means Algorithm for Image Segmentation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Mauro Barni,et al.  Comments on "A possibilistic approach to clustering" , 1996, IEEE Trans. Fuzzy Syst..

[26]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[27]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[28]  Mohammad Hossein Fazel Zarandi,et al.  Generalized entropy based possibilistic fuzzy C-Means for clustering noisy data and its convergence proof , 2017, Neurocomputing.

[29]  HaiYan Yu,et al.  Cutset-type possibilistic c-means clustering algorithm , 2018, Appl. Soft Comput..

[30]  Xiaoping Liu,et al.  NRDSP: A novel assessment of SAR image despeckling , 2017, Neurocomputing.

[31]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..

[32]  Michael K. Ng,et al.  Automated variable weighting in k-means type clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Witold Pedrycz,et al.  Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study , 2010, Fuzzy Sets Syst..

[34]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[35]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[36]  Rui-Ping Li,et al.  A maximum-entropy approach to fuzzy clustering , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..