Co-spectral clustering based density peak

Spectral clustering employs spectral-graph structure of a similarity matrix to partition data into disjoint meaningful groups, because of its well-defined mathematical framework, good performance and simplicity, spectral clustering has gained considerable attentions in the recent past. Despite these virtues, it suffers from several drawbacks, such as it is unable to determine a reasonable cluster number, sensitive to initial condition and not robust to outliers. In this paper, we present a new approach named density peak spectral clustering (DPSC) which combines spectral clustering with density peak clustering algorithm (DPCA) into a unified framework to solve these problems. Since multi-view data is common in clustering problem, to further bootstrap the clustering performance by using complementary information from different view, then we propose co-trained density peak spectral clustering (Co-DPSC), which is an extension of DPSC to multi-views based on the co-training idea. Experimental comparisons with a number of baselines on a toy and three real-world datasets show the effectiveness of our proposed DPSC and Co-DPSC algorithm.

[1]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[3]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[4]  Xuelong Li,et al.  Geometric Mean for Subspace Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[7]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[9]  Vipin Kumar,et al.  Chameleon: Hierarchical Clustering Using Dynamic Modeling , 1999, Computer.

[10]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[11]  Dacheng Tao,et al.  Large-Margin Multi-ViewInformation Bottleneck , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Edwin R. Hancock,et al.  A probabilistic spectral framework for grouping and segmentation , 2004, Pattern Recognit..

[13]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[14]  Meng Wang,et al.  Image-Based Three-Dimensional Human Pose Recovery by Multiview Locality-Sensitive Sparse Retrieval , 2015, IEEE Transactions on Industrial Electronics.

[15]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[16]  Mubarak Shah,et al.  Macro-class Selection for Hierarchical k-NN Classification of Inertial Sensor Data , 2012, PECCS.

[17]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yang Li,et al.  A general framework for co-training and its applications , 2015, Neurocomputing.

[19]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[20]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[21]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[22]  Jun Yu,et al.  Multi-view ensemble manifold regularization for 3D object recognition , 2015, Inf. Sci..

[23]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[24]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.