Weighted Multi-View Spectral Clustering Based on Spectral Perturbation

Considering the diversity of the views, assigning the multiviews with different weights is important to multi-view clustering. Several multi-view clustering algorithms have been proposed to assign different weights to the views. However, the existing weighting schemes do not simultaneously consider the characteristic of multi-view clustering and the characteristic of related single-view clustering. In this paper, based on the spectral perturbation theory of spectral clustering, we propose a weighted multi-view spectral clustering algorithm which employs the spectral perturbation to model the weights of the views. The proposed weighting scheme follows the two basic principles: 1) the clustering results on each view should be close to the consensus clustering result, and 2) views with similar clustering results should be assigned similar weights. According to spectral perturbation theory, the largest canonical angle is used to measure the difference between spectral clustering results. In this way, the weighting scheme can be formulated into a standard quadratic programming problem. Experimental results demonstrate the superiority of the proposed algorithm.

[1]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[2]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[3]  Jing-Yu Yang,et al.  Multiple kernel clustering based on centered kernel alignment , 2014, Pattern Recognit..

[4]  Xianchao Zhang,et al.  Sampling for Nyström Extension-Based Spectral Clustering , 2016, ACM Trans. Knowl. Discov. Data.

[5]  Lei Du,et al.  Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition , 2014, AAAI.

[6]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[7]  Ying Cui,et al.  Multiple Kernel Learning Based Multi-view Spectral Clustering , 2014, 2014 22nd International Conference on Pattern Recognition.

[8]  Tyng-Luh Liu,et al.  Guided co-training for multi-view spectral clustering , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[9]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[10]  Shenglan Liu,et al.  Multi-view spectral clustering via robust local subspace learning , 2017, Soft Comput..

[11]  Lei Shi,et al.  Robust Multiple Kernel K-means Using L21-Norm , 2015, IJCAI.

[12]  W. Kahan,et al.  The Rotation of Eigenvectors by a Perturbation. III , 1970 .

[13]  Yung-Yu Chuang,et al.  Affinity aggregation for spectral clustering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Mehmet Gönen,et al.  Localized Data Fusion for Kernel k-Means Clustering with Application to Cancer Biology , 2014, NIPS.

[15]  V. D. Sa.  Spectral Clustering with Two Views , 2007 .

[16]  Shuicheng Yan,et al.  Convex Sparse Spectral Clustering: Single-View to Multi-View , 2015, IEEE Transactions on Image Processing.

[17]  Johan A. K. Suykens,et al.  Optimized Data Fusion for Kernel k-Means Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Charu C. Aggarwal,et al.  GIN: A Clustering Model for Capturing Dual Heterogeneity in Networked Data , 2015, SDM.

[19]  Hal Daumé,et al.  A Co-training Approach for Multi-view Spectral Clustering , 2011, ICML.

[20]  Thomas Strohmer,et al.  Performance Analysis of Spectral Clustering on Compressed, Incomplete and Inaccurate Measurements , 2010, ArXiv.

[21]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[22]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[23]  Lei Wang,et al.  Late Fusion Multiple Kernel Clustering With Local Kernel Alignment Maximization , 2023, IEEE Transactions on Multimedia.

[24]  Aristidis Likas,et al.  Kernel-Based Weighted Multi-view Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining.

[25]  Christopher J. C. Burges,et al.  Spectral clustering and transductive learning with multiple views , 2007, ICML '07.

[26]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[27]  Lei Wang,et al.  Multiple Kernel k-Means Clustering with Matrix-Induced Regularization , 2016, AAAI.

[28]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[29]  Xin Liu,et al.  Document clustering based on non-negative matrix factorization , 2003, SIGIR.

[30]  Hong Yu,et al.  Local linear neighbor reconstruction for multi-view data , 2016, Pattern Recognit. Lett..