Swarm ascending: Swarm intelligence-based exemplar group detection for robust clustering

Abstract An exemplar is a representative observation for each cluster. Exemplar-based clustering algorithms, which find the exemplars and assign data points to the nearest exemplar, have exhibited promising performance. However, the single- and multi-exemplar methods become inadequate for clustering data points with nonlinear and local patterns because one exemplar (or a set of sparse exemplars for a nonlinear cluster) is insufficient to represent the cluster. In this paper, we propose a swarm intelligence-based exemplar group detection method that ascends data points to local high-density points and groups the merged points. The proposed method is robust to nonlinear and local patterns because it detects the intrinsic structure of each cluster more sufficiently than sparse exemplars. We use simulation and real-world data to demonstrate the usefulness of the proposed method by comparing it to existing methods in terms of clustering accuracy. The comparison results demonstrate that the proposed method outperforms the alternatives.

[1]  Bofeng Zhang,et al.  Rigidly Self-Expressive Sparse Subspace Clustering , 2016, PAKDD Workshops.

[2]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[3]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vipin Kumar,et al.  Chameleon: Hierarchical Clustering Using Dynamic Modeling , 1999, Computer.

[5]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[6]  S. Ramaswamy,et al.  Systematic identification of genomic markers of drug sensitivity in cancer cells , 2012, Nature.

[7]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[8]  Korris Fu-Lai Chung,et al.  A novel image thresholding method based on Parzen window estimate , 2008, Pattern Recognit..

[9]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[10]  Nur Evin Özdemirel,et al.  Swarm Intelligence-Based Clustering Algorithms: A Survey , 2016 .

[11]  Lawrence Hubert,et al.  The comparison and fitting of given classification schemes , 1977 .

[12]  Jaewook Lee,et al.  Learning representative exemplars using one-class Gaussian process regression , 2018, Pattern Recognit..

[13]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[14]  Mu-Chun Su,et al.  A swarm-inspired projection algorithm , 2009, Pattern Recognit..

[15]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[16]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[17]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[18]  Shiqian Ma,et al.  Sparse Subspace Clustering for Incomplete Images , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[19]  V. Raykar,et al.  Fast Computation of Kernel Estimators , 2010 .

[20]  Pasi Fränti,et al.  Iterative shrinking method for clustering problems , 2006, Pattern Recognit..

[21]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[22]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[23]  Xin Jin,et al.  K-Medoids Clustering , 2010, Encyclopedia of Machine Learning.

[24]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Wei Liu,et al.  Knowledge transfer for spectral clustering , 2018, Pattern Recognit..

[26]  Chang-Dong Wang,et al.  Multi-Exemplar Affinity Propagation , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  André L. V. Coelho,et al.  Clustering ensembles: A hedonic game theoretical approach , 2018, Pattern Recognit..

[28]  Sarajane Marques Peres,et al.  Gesture phase segmentation using support vector machines , 2016, Expert Syst. Appl..

[29]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[30]  Yangtao Wang,et al.  K-MEAP: Multiple Exemplars Affinity Propagation With Specified $K$ Clusters , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Lin Sun,et al.  An Affinity Propagation Clustering Method Using Hybrid Kernel Function With LLE , 2018, IEEE Access.

[32]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  L. Hubert,et al.  Comparing partitions , 1985 .

[34]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.