Reinforcement Graph Clustering with Unknown Cluster Number

Deep graph clustering, which aims to group nodes into disjoint clusters by neural networks in an unsupervised manner, has attracted great attention in recent years. Although the performance has been largely improved, the excellent performance of the existing methods heavily relies on an accurately predefined cluster number, which is not always available in the real-world scenario. To enable the deep graph clustering algorithms to work without the guidance of the predefined cluster number, we propose a new deep graph clustering method termed Reinforcement Graph Clustering (RGC). In our proposed method, cluster number determination and unsupervised representation learning are unified into a uniform framework by the reinforcement learning mechanism. Concretely, the discriminative node representations are first learned with the contrastive pretext task. Then, to capture the clustering state accurately with both local and global information in the graph, both node and cluster states are considered. Subsequently, at each state, the qualities of different cluster numbers are evaluated by the quality network, and the greedy action is executed to determine the cluster number. In order to conduct feedback actions, the clustering-oriented reward function is proposed to enhance the cohesion of the same clusters and separate the different clusters. Extensive experiments demonstrate the effectiveness and efficiency of our proposed method. The source code of RGC is shared at https://github.com/yueliu1999/RGC and a collection (papers, codes and, datasets) of deep graph clustering is shared at https://github.com/yueliu1999/Awesome-Deep-Graph-Clustering on Github.

[1]  Siwei Wang,et al.  Unpaired Multi-View Graph Clustering with Cross-View Structure Matching , 2023, IEEE transactions on neural networks and learning systems.

[2]  Yue Liu,et al.  arXiv4TGC: Large-Scale Datasets for Temporal Graph Clustering , 2023, ArXiv.

[3]  Stan Z. Li,et al.  Dink-Net: Neural Clustering on Large Graphs , 2023, ICML.

[4]  Yue Liu,et al.  Message Intercommunication for Inductive Relation Reasoning , 2023, ArXiv.

[5]  Yue Liu,et al.  Deep Temporal Graph Clustering , 2023, ICLR.

[6]  Siwei Wang,et al.  Deep Incomplete Multi-View Clustering with Cross-View Partial Sample and Prototype Alignment , 2023, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Wei Dong,et al.  MulCS: Towards a Unified Deep Representation for Multilingual Code Search , 2023, 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER).

[8]  Xiaolei Huang,et al.  ABSLearn: a GNN-based framework for aliasing and buffer-size information retrieval , 2023, Pattern Analysis and Applications.

[9]  Yue Liu,et al.  Cluster-guided Contrastive Graph Clustering Network , 2023, AAAI.

[10]  Yue Liu,et al.  Hard Sample Aware Network for Contrastive Deep Graph Clustering , 2022, AAAI.

[11]  Yue Liu,et al.  A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal. , 2022, IEEE transactions on pattern analysis and machine intelligence.

[12]  Yue Liu,et al.  Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented View , 2022, AAAI.

[13]  Huan Jin,et al.  GADMSL: Graph Anomaly Detection on Attributed Networks via Multi-scale Substructure Learning , 2022, ArXiv.

[14]  Stan Z. Li,et al.  A Survey of Deep Graph Clustering: Taxonomy, Challenge, and Application , 2022, ArXiv.

[15]  Xifeng Guo,et al.  Auxiliary Graph for Attribute Graph Clustering , 2022, Entropy.

[16]  Xifeng Guo,et al.  Deep graph clustering with multi-level subspace fusion , 2022, Pattern Recognit..

[17]  Dong Li,et al.  Coarse-to-Fine Knowledge-Enhanced Multi-Interest Learning Framework for Multi-Behavior Recommendation , 2022, ACM Trans. Inf. Syst..

[18]  Lele Fu,et al.  Multi-View Deep Matrix Factorization with Consensual Solution from Multiple Paths , 2022, 2022 IEEE International Conference on Multimedia and Expo (ICME).

[19]  Siwei Wang,et al.  Multiple Kernel Clustering with Dual Noise Minimization , 2022, ACM Multimedia.

[20]  Kuan-Ching Li,et al.  Local Sample-weighted Multiple Kernel Clustering with Consensus Discriminative Graph , 2022, IEEE transactions on neural networks and learning systems.

[21]  Sihang Zhou,et al.  Attributed Graph Clustering with Dual Redundancy Reduction , 2022, IJCAI.

[22]  Jicong Fan,et al.  Unsupervised Deep Discriminant Analysis Based Clustering , 2022, ArXiv.

[23]  Yue Liu,et al.  Mixed Graph Contrastive Network for Semi-Supervised Node Classification , 2022, ACM Transactions on Knowledge Discovery from Data.

[24]  Zhao Zhang,et al.  Efficient Deep Embedded Subspace Clustering , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Siwei Wang,et al.  Simple Contrastive Graph Clustering , 2022, IEEE transactions on neural networks and learning systems.

[26]  Nesreen K. Ahmed,et al.  CGC: Contrastive Graph Clustering forCommunity Detection and Tracking , 2022, WWW.

[27]  Shahaf E. Finder,et al.  DeepDPM: Deep Clustering With an Unknown Number of Clusters , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Yue Liu,et al.  Improved Dual Correlation Reduction Network , 2022, ArXiv.

[29]  En Zhu,et al.  Interpolation-based Contrastive Learning for Few-Label Semi-Supervised Learning , 2022, IEEE transactions on neural networks and learning systems.

[30]  Hao Peng,et al.  Towards Unsupervised Deep Graph Structure Learning , 2022, WWW.

[31]  En Zhu,et al.  Deep Graph Clustering via Dual Correlation Reduction , 2021, AAAI.

[32]  Chanyoung Park,et al.  Augmentation-Free Self-Supervised Learning on Graphs , 2021, AAAI.

[33]  Zhao Kang,et al.  Multi-view Contrastive Graph Clustering , 2021, NeurIPS.

[34]  Xinbo Gao,et al.  Self-supervised Contrastive Attributed Graph Clustering , 2021, ArXiv.

[35]  Stan Z. Li,et al.  ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning , 2021, ICML.

[36]  Wenzhong Guo,et al.  Unsupervised deep clustering via contractive feature representation and focal loss , 2021, Pattern Recognit..

[37]  Hui Liu,et al.  Attention-driven Graph Clustering Network , 2021, ACM Multimedia.

[38]  Han Zhao,et al.  Graph Debiased Contrastive Learning with Joint Representation Clustering , 2021, IJCAI.

[39]  Riadh Ksantini,et al.  Rethinking Graph Auto-Encoder Models for Attributed Graph Clustering , 2021, IEEE Transactions on Knowledge and Data Engineering.

[40]  Meng Liu,et al.  Inductive Representation Learning in Temporal Networks via Mining Neighborhood and Community Influences , 2021, SIGIR.

[41]  Xinbo Gao,et al.  Self-Supervised Graph Convolutional Network for Multi-View Clustering , 2021, IEEE Transactions on Multimedia.

[42]  Xiaorui Liu,et al.  Automated Self-Supervised Learning for Graphs , 2021, ICLR.

[43]  Jian Pei,et al.  Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendation , 2021, AAAI.

[44]  Jieren Cheng,et al.  Deep Fusion Clustering Network , 2020, AAAI.

[45]  Qiang Liu,et al.  Graph Contrastive Learning with Adaptive Augmentation , 2020, WWW.

[46]  Jie Zhou,et al.  Adaptive Graph Encoder for Attributed Graph Embedding , 2020, KDD.

[47]  Qianqian Wang,et al.  Multi-View Attribute Graph Convolution Networks for Clustering , 2020, IJCAI.

[48]  Kaveh Hassani,et al.  Contrastive Multi-View Representation Learning on Graphs , 2020, ICML.

[49]  Xuelong Li,et al.  Adaptive Graph Auto-Encoder for General Data Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Xiao Wang,et al.  Structural Deep Clustering Network , 2020, WWW.

[51]  Hyung Jin Chang,et al.  Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[52]  Yun Fu,et al.  Adversarial Graph Embedding for Ensemble Clustering , 2019, IJCAI.

[53]  Xiaotong Zhang,et al.  Attributed Graph Clustering via Adaptive Graph Convolution , 2019, IJCAI.

[54]  Jing Jiang,et al.  Attributed Graph Clustering: A Deep Attentional Embedding Approach , 2019, IJCAI.

[55]  Chengqi Zhang,et al.  Learning Graph Embedding With Adversarial Training Methods , 2019, IEEE Transactions on Cybernetics.

[56]  Chun Wang,et al.  MGAE: Marginalized Graph Autoencoder for Graph Clustering , 2017, CIKM.

[57]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[58]  Jianping Yin,et al.  Improved Deep Embedded Clustering with Local Structure Preservation , 2017, IJCAI.

[59]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[60]  Bo Yang,et al.  Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering , 2016, ICML.

[61]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[62]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[63]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[64]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[65]  Stan Z. Li,et al.  Mole-BERT: Rethinking Pre-training Graph Neural Networks for Molecules , 2023, ICLR.

[66]  Kenli Li,et al.  Multi-View Bipartite Graph Clustering With Coupled Noisy Feature Filter , 2023, IEEE Transactions on Knowledge and Data Engineering.

[67]  Xin Xu,et al.  Patch-Mixing Contrastive Regularization for Few-Label Semi-Supervised Learning , 2023, IEEE Transactions on Artificial Intelligence.

[68]  Lele Fu,et al.  Learnable Multi-View Matrix Factorization With Graph Embedding and Flexible Loss , 2023, IEEE Transactions on Multimedia.

[69]  Trupti M. Kodinariya,et al.  Review on determining number of Cluster in K-Means Clustering , 2013 .

[70]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[71]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .