Automatic clustering based on density peak detection using generalized extreme value distribution

Density peaks clustering (DPC) algorithm is able to get a satisfactory result with the help of artificial selecting the clustering centers, but such selection can be hard for a large amount of clustering tasks or the data set with a complex decision diagram. The purpose of this paper is to propose an automatic clustering approach without human intervention. Inspired by the visual selection rule of DPC, the judgment index which equals the lower value within density and distance (after normalization) is proposed for selecting the clustering centers. The judgment index approximately follows the generalized extreme value (GEV) distribution, and each clustering center’s judgment index is much higher. Hence, it is reasonable that the points are selected as clustering centers if their judgment indices are larger than the upper quantile of GEV. This proposed method is called density peaks clustering based on generalized extreme value distribution (DPC-GEV). Furthermore, taking the computational complexity into account, an alternative method based on density peak detection using Chebyshev inequality (DPC-CI) is also given. Experiments on both synthetic and real-world data sets show that DPC-GEV and DPC-CI can achieve the same accuracy as DPC on most data sets but consume much less time.

[1]  Guoyin Wang,et al.  DenPEHC: Density peak based efficient hierarchical clustering , 2016, Inf. Sci..

[2]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[3]  Limin Fu,et al.  FLAME, a novel fuzzy clustering method for the analysis of DNA microarray data , 2007, BMC Bioinformatics.

[4]  Takvor H. Soukissian,et al.  The effect of the generalized extreme value distribution parameter estimation methods in extreme wind speed prediction , 2015, Natural Hazards.

[5]  O. Dikshit,et al.  Comparative study on projected clustering methods for hyperspectral imagery classification , 2016 .

[6]  Wan Cong Adaptive Threshold Background Modeling Algorithm Based on Chebyshev Inequality , 2013 .

[7]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Yifan Xu,et al.  Fast clustering using adaptive density peak detection , 2015, Statistical methods in medical research.

[9]  Ning Wang,et al.  Cooperative bare-bone particle swarm optimization for data clustering , 2014, Soft Comput..

[10]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[11]  James E. Gentle,et al.  Finding Groups in Data: An Introduction to Cluster Analysis. , 1991 .

[12]  Jie Zhang,et al.  Finding Communities by Their Centers , 2016, Scientific Reports.

[13]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[14]  Peng Liu,et al.  Model-based clustering for RNA-seq data , 2014, Bioinform..

[15]  A. Raftery,et al.  Model-based Gaussian and non-Gaussian clustering , 1993 .

[16]  Erwie Zahara,et al.  A hybridized approach to data clustering , 2008, Expert Syst. Appl..

[17]  Jure Leskovec,et al.  Higher-order organization of complex networks , 2016, Science.

[18]  Zhexue Huang,et al.  CLUSTERING LARGE DATA SETS WITH MIXED NUMERIC AND CATEGORICAL VALUES , 1997 .

[19]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[20]  Damien McParland,et al.  Model based clustering for mixed data: clustMD , 2015, Advances in Data Analysis and Classification.

[21]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[22]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[23]  Yu-Jun Zheng,et al.  A Hybrid Neuro-Fuzzy Network Based on Differential Biogeography-Based Optimization for Online Population Classification in Earthquakes , 2015, IEEE Transactions on Fuzzy Systems.

[24]  Patrick Bosc,et al.  SQLf: a relational database language for fuzzy querying , 1995, IEEE Trans. Fuzzy Syst..

[25]  Yu-Jun Zheng,et al.  Population Classification in Fire Evacuation: A Multiobjective Particle Swarm Optimization Approach , 2014, IEEE Transactions on Evolutionary Computation.

[26]  C. Sandoval,et al.  Trivariate generalized extreme value distribution in flood frequency analysis , 2008 .

[27]  Yujun Zheng,et al.  Emergency transportation planning in disaster relief supply chain management: a cooperative fuzzy optimization approach , 2013, Soft Comput..

[28]  Weixin Xie,et al.  Robust clustering by detecting density peaks and assigning points based on fuzzy weighted K-nearest neighbors , 2016, Inf. Sci..

[29]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[30]  Silvia Angela Osmetti,et al.  A comparative analysis of the UK and Italian small businesses using Generalised Extreme Value models , 2014, Eur. J. Oper. Res..

[31]  Ze-Chun Hu,et al.  Chebyshev's inequality for Banach-space-valued random elements , 2011 .

[32]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[33]  Dit-Yan Yeung,et al.  Robust path-based spectral clustering , 2008, Pattern Recognit..

[34]  James Bailey,et al.  Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance , 2010, J. Mach. Learn. Res..

[35]  S. Nadarajah,et al.  Extreme Value Distributions: Theory and Applications , 2000 .

[36]  Lior Rokach,et al.  A survey of Clustering Algorithms , 2010, Data Mining and Knowledge Discovery Handbook.

[37]  Tran Manh Tuan,et al.  A cooperative semi-supervised fuzzy clustering framework for dental X-ray image segmentation , 2016, Expert Syst. Appl..

[38]  Fionn Murtagh,et al.  Cluster Dissection and Analysis: Theory, Fortran Programs, Examples. , 1986 .

[39]  Ge Yu,et al.  Efficient Distributed Density Peaks for Clustering Large Data Sets in MapReduce , 2016, IEEE Trans. Knowl. Data Eng..

[40]  Fionn Murtagh,et al.  Algorithms for hierarchical clustering: an overview , 2012, WIREs Data Mining Knowl. Discov..

[41]  Aristides Gionis,et al.  Clustering aggregation , 2005, 21st International Conference on Data Engineering (ICDE'05).

[42]  Hongjie Jia,et al.  Study on density peaks clustering based on k-nearest neighbors and principal component analysis , 2016, Knowl. Based Syst..

[43]  Tao Chen,et al.  Gene expression changes induced by the tumorigenic pyrrolizidine alkaloid riddelliine in liver of Big Blue rats , 2007, BMC Bioinformatics.

[44]  Ming Zhang,et al.  Comparing sequences without using alignments: application to HIV/SIV subtyping , 2007, BMC Bioinformatics.