Deep Multi-View Subspace Clustering with Anchor Graph

Deep multi-view subspace clustering (DMVSC) has recently attracted increasing attention due to its promising performance. However, existing DMVSC methods still have two issues: (1) they mainly focus on using autoencoders to nonlinearly embed the data, while the embedding may be suboptimal for clustering because the clustering objective is rarely considered in autoencoders, and (2) existing methods typically have a quadratic or even cubic complexity, which makes it challenging to deal with large-scale data. To address these issues, in this paper we propose a novel deep multi-view subspace clustering method with anchor graph (DMCAG). To be specific, DMCAG firstly learns the embedded features for each view independently, which are used to obtain the subspace representations. To significantly reduce the complexity, we construct an anchor graph with small size for each view. Then, spectral clustering is performed on an integrated anchor graph to obtain pseudo-labels. To overcome the negative impact caused by suboptimal embedded features, we use pseudo-labels to refine the embedding process to make it more suitable for the clustering task. Pseudo-labels and embedded features are updated alternately. Furthermore, we design a strategy to keep the consistency of the labels based on contrastive learning to enhance the clustering performance. Empirical studies on real-world datasets show that our method achieves superior clustering performance over other state-of-the-art methods.

[1]  Philip S. Yu,et al.  Deep Clustering: A Comprehensive Survey , 2022, IEEE transactions on neural networks and learning systems.

[2]  Suyuan Liu,et al.  Efficient One-Pass Multi-View Subspace Clustering with Consensus Anchors , 2022, AAAI.

[3]  Xinzhong Zhu,et al.  Align then Fusion: Generalized Large-scale Multi-view Clustering with Anchor Matching Correspondences , 2022, NeurIPS.

[4]  Yazhou Ren,et al.  Deep Embedded Multi-View Clustering via Jointly Learning Latent Representations and Graphs , 2022, ArXiv.

[5]  Y. Fu,et al.  Self-Guided Deep Multiview Subspace Clustering via Consensus Affinity Regularization , 2021, IEEE Transactions on Cybernetics.

[6]  Yazhou Ren,et al.  Self-Supervised Discriminative Feature Learning for Deep Multi-View Clustering , 2021, IEEE Transactions on Knowledge and Data Engineering.

[7]  En Zhu,et al.  Scalable Multi-view Subspace Clustering with Unified Anchors , 2021, ACM Multimedia.

[8]  Yazhou Ren,et al.  Multi-VAE: Learning Disentangled View-common and View-peculiar Visual Representations for Multi-view Clustering , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Xiaolan Liu,et al.  Multi-view subspace clustering with adaptive locally consistent graph regularization , 2021, Neural Computing and Applications.

[10]  Zenglin Xu,et al.  Deep Embedded Multi-view Clustering with Collaborative Training , 2020, Inf. Sci..

[11]  Licheng Jiao,et al.  Deep Multi-View Subspace Clustering With Unified and Discriminative Learning , 2021, IEEE Transactions on Multimedia.

[12]  Qianqian Wang,et al.  Multi-View Attribute Graph Convolution Networks for Clustering , 2020, IJCAI.

[13]  Zenglin Xu,et al.  Self-paced and auto-weighted multi-view clustering , 2020, Neurocomputing.

[14]  Farhad Kamangar,et al.  Multi-Level Representation Learning for Deep Subspace Clustering , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[15]  Zenglin Xu,et al.  Large-scale Multi-view Subspace Clustering in Linear Time , 2019, AAAI.

[16]  Chen Min,et al.  Self-Supervised Deep Multi-View Subspace Clustering , 2019, ACML.

[17]  Changqing Zhang,et al.  Multi-view Deep Subspace Clustering Networks , 2019, ArXiv.

[18]  Changqing Zhang,et al.  Flexible Multi-View Representation Learning for Subspace Clustering , 2019, IJCAI.

[19]  Jiancheng Lv,et al.  COMIC: Multi-view Clustering Without Parameter Selection , 2019, ICML.

[20]  Stan Z. Li,et al.  Multi-view subspace clustering with intactness-aware similarity , 2019, Pattern Recognit..

[21]  Shanmin Pang,et al.  Feature Concatenation Multiview Subspace Clustering , 2019 .

[22]  Wei Zhang,et al.  Consistent and Specific Multi-View Subspace Clustering , 2018, AAAI.

[23]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[24]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[25]  Xiaochun Cao,et al.  Low-Rank Tensor Constrained Multiview Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[27]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Chris H. Q. Ding,et al.  Joint stage recognition and anatomical annotation of drosophila gene expression patterns , 2012, Bioinform..

[29]  Xinlei Chen,et al.  Large Scale Spectral Clustering with Landmark-Based Representation , 2011, AAAI.

[30]  Pierre Rochus,et al.  Hu, Luojia , Estimation of a censored dynamic panel data model,Econometrica. Journal of the Econometric Society , 2002 .

[31]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[32]  R. Hecht-Nielsen,et al.  Neurocomputing , 1990, NATO ASI Series.

[33]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[34]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[35]  P. Wolfe THE SIMPLEX METHOD FOR QUADRATIC PROGRAMMING , 1959 .

[36]  Xiao-jie Zhao,et al.  Consistent and diverse multi-View subspace clustering with structure constraint , 2022, Pattern Recognit..

[37]  Qinghua Hu,et al.  Latent Multiview Subspace Clustering , 2022 .