Consistent Multiple Graph Embedding for Multi-View Clustering

Graph-based multi-view clustering aiming to obtain a partition of data across multiple views, has received considerable attention in recent years. Although great efforts have been made for graph-based multi-view clustering, it is still challenging to fuse characteristics from various views to learn a common representation for clustering. In this paper, we propose a novel Consistent Multiple Graph Embedding Clustering framework (CMGEC). Specifically, a multiple graph auto-encoder (M-GAE) is designed to flexibly encode the complementary information of multi-view data using a multi-graph attention fusion encoder. To guide the learned common representation maintaining the similarity of the neighboring characteristics in each view, a Multi-view Mutual Information Maximization module (MMIM) is introduced. Furthermore, a graph fusion network (GFN) is devised to explore the relationship among graphs from different views and provide a common consensus graph needed in M-GAE. By jointly training these models, the common representation can be obtained, which encodes more complementary information from multiple views and depicts data more comprehensively. Experiments on three types of multi-view datasets demonstrate CMGEC outperforms the state-of-the-art clustering methods.

[1]  Yoshua Bengio,et al.  Mutual Information Neural Estimation , 2018, ICML.

[2]  Jeong Woo Son,et al.  Spectral Clustering with Brainstorming Process for Multi-View Data , 2017, AAAI.

[3]  Feiping Nie,et al.  Multiview Consensus Graph Clustering , 2019, IEEE Transactions on Image Processing.

[4]  Lin Wu,et al.  Robust Subspace Clustering for Multi-View Data by Exploiting Correlation Consensus , 2015, IEEE Transactions on Image Processing.

[5]  Luc Van Gool,et al.  Learning Where to Classify in Multi-view Semantic Segmentation , 2014, ECCV.

[6]  Xuelong Li,et al.  Self-weighted Multiview Clustering with Multiple Graphs , 2017, IJCAI.

[7]  Prabir Kumar Biswas,et al.  Rotation and scale invariant texture features using discrete wavelet packet transform , 2003, Pattern Recognit. Lett..

[8]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[9]  Huazhu Fu,et al.  AE2-Nets: Autoencoder in Autoencoder Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Qinghua Hu,et al.  Generalized Latent Multi-View Subspace Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[13]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[14]  Jinbo Bi,et al.  Multi-view cluster analysis with incomplete data to understand treatment effects , 2019, Inf. Sci..

[15]  Nacim Fateh Chikhi,et al.  Multi-view clustering via spectral partitioning and local refinement , 2016, Inf. Process. Manag..

[16]  Kun Zhan,et al.  Graph Learning for Multiview Clustering , 2018, IEEE Transactions on Cybernetics.

[17]  Hao Wang,et al.  GMC: Graph-Based Multi-View Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[18]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[19]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[20]  Andreas Krause,et al.  Discriminative Clustering by Regularized Information Maximization , 2010, NIPS.

[21]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[22]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Zenglin Xu,et al.  Partition level multiview subspace clustering , 2019, Neural Networks.

[24]  Jaewoo Kang,et al.  Graph Transformer Networks , 2019, NeurIPS.

[25]  Lunke Fei,et al.  Low-Rank Preserving Projection Via Graph Regularized Reconstruction , 2019, IEEE Transactions on Cybernetics.

[26]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[27]  Junbin Gao,et al.  Multiview Subspace Clustering via Tensorial t-Product Representation , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Yicong Zhou,et al.  Jointly Learning Kernel Representation Tensor and Affinity Matrix for Multi-View Clustering , 2020, IEEE Transactions on Multimedia.

[29]  Xiao Wang,et al.  One2Multi Graph Autoencoder for Multi-view Graph Clustering , 2020, WWW.

[30]  Shou-De Lin,et al.  Social Flocks: Simulating Crowds to Discover the Connection Between Spatial-Temporal Movements of People and Social Structure , 2018, IEEE Transactions on Computational Social Systems.

[31]  D. Sculley,et al.  Web-scale k-means clustering , 2010, WWW '10.

[32]  Meng Wang,et al.  Topic driven multimodal similarity learning with multi-view voted convolutional features , 2018, Pattern Recognit..

[33]  R Devon Hjelm,et al.  Learning Representations by Maximizing Mutual Information Across Views , 2019, NeurIPS.

[34]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[35]  Ray A. Jarvis,et al.  Clustering Using a Similarity Measure Based on Shared Near Neighbors , 1973, IEEE Transactions on Computers.

[36]  Wei Liu,et al.  Knowledge transfer for spectral clustering , 2018, Pattern Recognit..

[37]  Yangdong Ye,et al.  Deep Mutual Information Maximin for Cross-Modal Clustering , 2021, AAAI.

[38]  En Zhu,et al.  Multi-view Clustering via Late Fusion Alignment Maximization , 2019, IJCAI.

[39]  Bob Zhang,et al.  Adaptive Graph Completion Based Incomplete Multi-View Clustering , 2020, IEEE Transactions on Multimedia.

[40]  Yu Zheng,et al.  Methodologies for Cross-Domain Data Fusion: An Overview , 2015, IEEE Transactions on Big Data.

[41]  Huazhu Fu,et al.  Reciprocal Multi-Layer Subspace Learning for Multi-View Clustering , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[42]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Pietro Perona,et al.  Caltech-UCSD Birds 200 , 2010 .

[44]  Shengjin Wang,et al.  Linkage Based Face Clustering via Graph Convolution Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Zenglin Xu,et al.  Multi-graph Fusion for Multi-view Spectral Clustering , 2019, Knowl. Based Syst..

[46]  Feiping Nie,et al.  Graph Structure Fusion for Multiview Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[47]  Yun Fu,et al.  Adversarial Graph Embedding for Ensemble Clustering , 2019, IJCAI.

[48]  Jing Jiang,et al.  Attributed Graph Clustering: A Deep Attentional Embedding Approach , 2019, IJCAI.

[49]  Yoshua Bengio,et al.  Learning deep representations by mutual information estimation and maximization , 2018, ICLR.

[50]  Xiao Wang,et al.  Structural Deep Clustering Network , 2020, WWW.

[51]  En Zhu,et al.  Projective Multiple Kernel Subspace Clustering , 2022, IEEE transactions on multimedia.

[52]  Yuichi Matsumoto,et al.  Shrink boost for selecting multi-LBP histogram features in object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Shiliang Sun,et al.  A Survey on Multiview Clustering , 2017, IEEE Transactions on Artificial Intelligence.