An evidential clustering algorithm by finding belief-peaks and disjoint neighborhoods

Abstract In this paper, we introduce a new evidential clustering algorithm based on finding the belief-peaks and disjoint neighborhoods, called BPDNEC. The basic idea of BPDNEC is that each cluster center has the highest possibility of becoming a cluster center among its neighborhood and neighborhoods of those cluster centers are disjoint in vector space. Such possibility is measured by the belief notion in framework of evidence theory. By solving an equation related to neighborhood size, the size of such disjoint neighborhoods is determined and those objects having highest belief among their neighborhoods are automatically detected as cluster centers. Finally, a credal partition is created by minimizing an objective function concerning dissimilarity matrix of data objects. Experimental results show that BPDNEC can automatically detect cluster centers and derive an appropriate credal partition for both object data and proximity data. Simulations on synthetic and real-world datasets validate the conclusions.

[1]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[2]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[3]  Naiming Qi,et al.  Density peak clustering based on relative density relationship , 2020, Pattern Recognit..

[4]  Songsak Sriboonchitta,et al.  Evaluating and Comparing Soft Partitions: An Approach Based on Dempster–Shafer Theory , 2018, IEEE Transactions on Fuzzy Systems.

[5]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[6]  Thierry Denoeux,et al.  EK-NNclus: A clustering procedure based on the evidential K-nearest neighbor rule , 2015, Knowl. Based Syst..

[7]  James C. Bezdek,et al.  Relational duals of the c-means clustering algorithms , 1989, Pattern Recognit..

[8]  Thierry Denoeux,et al.  ECM: An evidential version of the fuzzy c , 2008, Pattern Recognit..

[9]  S. Sen,et al.  Clustering of relational data containing noise and outliers , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[10]  L. Hubert,et al.  Comparing partitions , 1985 .

[11]  James C. Bezdek,et al.  Nerf c-means: Non-Euclidean relational fuzzy clustering , 1994, Pattern Recognit..

[12]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[13]  Qianni Zhang,et al.  LSI: Latent semantic inference for natural image segmentation , 2016, Pattern Recognit..

[14]  Dit-Yan Yeung,et al.  Robust path-based spectral clustering , 2008, Pattern Recognit..

[15]  Philippe Smets,et al.  The Transferable Belief Model , 1994, Artif. Intell..

[16]  Swagatam Das,et al.  Entropy Weighted Power k-Means Clustering , 2020, AISTATS.

[17]  Hongjie Jia,et al.  Study on density peaks clustering based on k-nearest neighbors and principal component analysis , 2016, Knowl. Based Syst..

[18]  Zhengming Ma,et al.  Adaptive density peak clustering based on K-nearest neighbors with aggregating strategy , 2017, Knowl. Based Syst..

[19]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[20]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[21]  Thierry Denźux 40 years of Dempster-Shafer theory , 2016 .

[22]  Kenneth Lange,et al.  Power k-Means Clustering , 2019, ICML.

[23]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[24]  Pasi Fränti,et al.  Iterative shrinking method for clustering problems , 2006, Pattern Recognit..

[25]  M. P. Windham Numerical classification of proximity data with assignment measures , 1985 .

[26]  Klaus Obermayer,et al.  Classi cation on Pairwise Proximity , 2007 .

[27]  Robert Tibshirani,et al.  A Framework for Feature Selection in Clustering , 2010, Journal of the American Statistical Association.

[28]  Shenfang Yuan,et al.  Adaptive core fusion-based density peak clustering for complex data with arbitrary shapes and densities , 2020, Pattern Recognit..

[29]  Thierry Denoeux,et al.  BPEC: Belief-Peaks Evidential Clustering , 2019, IEEE Transactions on Fuzzy Systems.

[30]  Pawan Lingras,et al.  Applying Rough Set Concepts to Clustering , 2012 .

[31]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[32]  Thierry Denoeux,et al.  EVCLUS: evidential clustering of proximity data , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Vladlen Koltun,et al.  Robust continuous clustering , 2017, Proceedings of the National Academy of Sciences.

[34]  Parham Moradi,et al.  Density peaks clustering based on density backbone and fuzzy neighborhood , 2020, Pattern Recognit..

[35]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[36]  Weixin Xie,et al.  Robust clustering by detecting density peaks and assigning points based on fuzzy weighted K-nearest neighbors , 2016, Inf. Sci..

[37]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[38]  Chin-Teng Lin,et al.  A review of clustering techniques and developments , 2017, Neurocomputing.

[39]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.