Let the Data Choose: Flexible and Diverse Anchor Graph Fusion for Scalable Multi-View Clustering

In the past few years, numerous multi-view graph clustering algorithms have been proposed to enhance the clustering performance by exploring information from multiple views. Despite the superior performance, the high time and space expenditures limit their scalability. Accordingly, anchor graph learning has been introduced to alleviate the computational complexity. However, existing approaches can be further improved by the following considerations: (i) Existing anchor-based methods share the same number of anchors across views. This strategy violates the diversity and flexibility of multi-view data distribution. (ii) Searching for the optimal anchor number within hyper-parameters takes much extra tuning time, which makes existing methods impractical. (iii) How to flexibly fuse multi-view anchor graphs of diverse sizes has not been well explored in existing literature. To address the above issues, we propose a novel anchor-based method termed Flexible and Diverse Anchor Graph Fusion for Scalable Multi-view Clustering (FDAGF) in this paper. Instead of manually tuning optimal anchor with massive hyper-parameters, we propose to optimize the contribution weights of a group of pre-defined anchor numbers to avoid extra time expenditure among views. Most importantly, we propose a novel hybrid fusion strategy for multi-size anchor graphs with theoretical proof, which allows flexible and diverse anchor graph fusion. Then, an efficient linear optimization algorithm is proposed to solve the resultant problem. Comprehensive experimental results demonstrate the effectiveness and efficiency of our proposed framework. The source code is available at https://github.com/Jeaninezpp/FDAGF.

[1]  Sihang Zhou,et al.  Efficient Anchor Learning-based Multi-view Clustering -- A Late Fusion Method , 2022, ACM Multimedia.

[2]  Siwei Wang,et al.  Multiple Kernel Clustering with Dual Noise Minimization , 2022, ACM Multimedia.

[3]  Kuan-Ching Li,et al.  Local Sample-weighted Multiple Kernel Clustering with Consensus Discriminative Graph , 2022, IEEE transactions on neural networks and learning systems.

[4]  Suyuan Liu,et al.  Efficient One-Pass Multi-View Subspace Clustering with Consensus Anchors , 2022, AAAI.

[5]  Siwei Wang,et al.  Simple Contrastive Graph Clustering , 2022, IEEE transactions on neural networks and learning systems.

[6]  Changdong Wang,et al.  Fast Multi-View Clustering Via Ensembles: Towards Scalability, Superiority, and Simplicity , 2022, IEEE Transactions on Knowledge and Data Engineering.

[7]  En Zhu,et al.  Interpolation-based Contrastive Learning for Few-Label Semi-Supervised Learning , 2022, IEEE transactions on neural networks and learning systems.

[8]  Xuelong Li,et al.  Multiview Clustering: A Scalable and Parameter-Free Bipartite Graph Fusion Method , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xinzhong Zhu,et al.  Fast Parameter-Free Multi-View Subspace Clustering With Consensus Anchor Guidance , 2021, IEEE Transactions on Image Processing.

[10]  En Zhu,et al.  Scalable Multi-view Subspace Clustering with Unified Anchors , 2021, ACM Multimedia.

[11]  En Zhu,et al.  Multi-view Clustering via Deep Matrix Factorization and Partition Alignment , 2021, ACM Multimedia.

[12]  Feiping Nie,et al.  Fast Multi-View Clustering via Nonnegative and Orthogonal Factorization , 2020, IEEE Transactions on Image Processing.

[13]  Xinwang Liu,et al.  Consensus One-Step Multi-View Subspace Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[14]  Zenglin Xu,et al.  Large-scale Multi-view Subspace Clustering in Linear Time , 2019, AAAI.

[15]  Zenglin Xu,et al.  Partition level multiview subspace clustering , 2019, Neural Networks.

[16]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Changqing Zhang,et al.  Flexible Multi-View Representation Learning for Subspace Clustering , 2019, IJCAI.

[18]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Mohamed Nadif,et al.  Spectral Clustering via Ensemble Deep Autoencoder Learning (SC-EDAE) , 2019, Pattern Recognit..

[20]  Hao Wang,et al.  Multi-view clustering: A survey , 2018, Big Data Min. Anal..

[21]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[22]  Xuelong Li,et al.  Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours , 2017, AAAI.

[23]  Xuelong Li,et al.  Parameter-Free Auto-Weighted Multiple Graph Learning: A Framework for Multiview Clustering and Semi-Supervised Classification , 2016, IJCAI.

[24]  Xiaochun Cao,et al.  Diversity-induced Multi-view Subspace Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[26]  Feiping Nie,et al.  Clustering and projected clustering with adaptive neighbors , 2014, KDD.

[27]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[28]  Wei Liu,et al.  Large Graph Construction for Scalable Semi-Supervised Learning , 2010, ICML.

[29]  Nebojsa Jojic,et al.  LOCUS: learning object classes with unsupervised segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[30]  James C. Bezdek,et al.  Convergence of Alternating Optimization , 2003, Neural Parallel Sci. Comput..

[31]  Lei Wang,et al.  Multiple Kernel Clustering with Local Kernel Alignment Maximization , 2016, IJCAI.

[32]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.