MV-GCN: Multi-View Graph Convolutional Networks for Link Prediction

Link prediction is a demanding task in real-world scenarios, such as recommender systems, which targets to predict the unobservable links between different objects by learning network-structured data. In this paper, we propose a novel multi-view graph convolutional neural network (MV-GCN) model to solve this problem based on Matrix Completion method by simultaneously exploiting the interactive relationship and the content information of different objects. Unlike existing approaches directly concatenate the interactive and content information as a single view, the proposed MV-GCN improves the accuracy of the predictions by restricting the consistencies on the graph embedding from multiple views. Experimental results on six primary benchmark datasets, including two homogeneous datasets and four heterogeneous datasets, both show that MV-GCN outperforms the recent state-of-the-art methods.

[1]  Jiawei Han,et al.  LINKREC: a unified framework for link recommendation with user attributes and graph structure , 2010, WWW '10.

[2]  Manel Slokom,et al.  A New Social Recommender System Based on Link Prediction Across Heterogeneous Networks , 2017, KES-IDT.

[3]  Zhi-Hua Zhou,et al.  Multi-View Matrix Completion for Clustering with Side Information , 2017, PAKDD.

[4]  Yun Fu,et al.  Coupled Marginalized Auto-Encoders for Cross-Domain Multi-View Learning , 2016, IJCAI.

[5]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[6]  Jing Jiang,et al.  Attributed Graph Clustering: A Deep Attentional Embedding Approach , 2019, IJCAI.

[7]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Shiguang Shan,et al.  Cross-view Graph Embedding , 2012, ACCV.

[9]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[10]  Dacheng Tao,et al.  A Survey on Multi-view Learning , 2013, ArXiv.

[11]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[12]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[13]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[14]  C. Lee Giles,et al.  Autonomous citation matching , 1999, AGENTS '99.

[15]  Yifan Yang,et al.  Unsupervised Multi-view Nonlinear Graph Embedding , 2018, UAI.

[16]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Inderjit S. Dhillon,et al.  Provable Inductive Matrix Completion , 2013, ArXiv.

[18]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[19]  Vittorio Loreto,et al.  Folksonomies, the semantic web, and movie recommendation , 2007 .

[20]  Yiming Yang,et al.  Graph Convolutional Matrix Completion for Bipartite Edge Prediction , 2018, KDIR.

[21]  Zhoujun Li,et al.  SSDMV: Semi-Supervised Deep Social Spammer Detection by Multi-view Data Fusion , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[22]  Feiping Nie,et al.  Large-Scale Multi-View Spectral Clustering via Bipartite Graph , 2015, AAAI.

[23]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[24]  Chuan Zhou,et al.  Low-Bit Quantization for Attributed Network Representation Learning , 2019, IJCAI.

[25]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[26]  Alper Ozcan,et al.  Link prediction in evolving heterogeneous networks using the NARX neural networks , 2018, Knowledge and Information Systems.

[27]  Pradeep Ravikumar,et al.  Collaborative Filtering with Graph Information: Consistency and Scalable Methods , 2015, NIPS.

[28]  Alper Ozcan,et al.  Multivariate Time Series Link Prediction for Evolving Heterogeneous Network , 2019, Int. J. Inf. Technol. Decis. Mak..

[29]  Yixin Chen,et al.  An End-to-End Deep Learning Architecture for Graph Classification , 2018, AAAI.

[30]  Wenwu Zhu,et al.  Deep Learning on Graphs: A Survey , 2018, IEEE Transactions on Knowledge and Data Engineering.

[31]  Lei Yu,et al.  A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems , 2017, AAAI.

[32]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[35]  Jeff A. Bilmes,et al.  On Deep Multi-View Representation Learning , 2015, ICML.

[36]  Dinggang Shen,et al.  Collaborative Multi-View Denoising , 2016, KDD.

[37]  Jiajun Bu,et al.  ANRL: Attributed Network Representation Learning via Deep Neural Networks , 2018, IJCAI.

[38]  Chengqi Zhang,et al.  Multi-Graph-View Learning for Complicated Object Classification , 2015, IJCAI.

[39]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[40]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[41]  Chengqi Zhang,et al.  Multi-graph-view Learning for Graph Classification , 2014, 2014 IEEE International Conference on Data Mining.

[42]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[43]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[44]  Xin Yin,et al.  Online Bayesian Max-Margin Subspace Multi-View Learning , 2016, IJCAI.

[45]  Jing Jiang,et al.  Graph WaveNet for Deep Spatial-Temporal Graph Modeling , 2019, IJCAI.

[46]  Max Welling,et al.  Graph Convolutional Matrix Completion , 2017, ArXiv.

[47]  Miao Xu,et al.  Speedup Matrix Completion with Side Information: Application to Multi-Label Learning , 2013, NIPS.

[48]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[49]  Feiping Nie,et al.  Multi-View Unsupervised Feature Selection with Adaptive Similarity and View Weight , 2017, IEEE Transactions on Knowledge and Data Engineering.

[50]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[51]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[52]  Sahin Albayrak,et al.  The Link Prediction Problem in Bipartite Networks , 2010, IPMU.

[53]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[54]  Xavier Bresson,et al.  Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks , 2017, NIPS.

[55]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[56]  Hanning Zhou,et al.  A Neural Autoregressive Approach to Collaborative Filtering , 2016, ICML.

[57]  Yiming Yang,et al.  Bipartite Edge Prediction via Transductive Learning over Product Graphs , 2015, ICML.

[58]  Ming Yang,et al.  A Survey of Multi-View Representation Learning , 2019, IEEE Transactions on Knowledge and Data Engineering.

[59]  Jie Tang,et al.  Representation Learning for Attributed Multiplex Heterogeneous Network , 2019, KDD.

[60]  Christopher J. C. Burges,et al.  Spectral clustering and transductive learning with multiple views , 2007, ICML '07.

[61]  Renzhi Cao,et al.  Integrated protein function prediction by mining function associations, sequences, and protein-protein and gene-gene interaction networks. , 2016, Methods.

[62]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[63]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[64]  Srikanta J. Bedathur,et al.  Towards time-aware link prediction in evolving social networks , 2009, SNA-KDD '09.

[65]  Philip S. Yu,et al.  Multiple Structure-View Learning for Graph Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[66]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.