Graph Neural Networks in Recommender Systems: A Survey

With the explosive growth of online information, recommender systems play a key role to alleviate such information overload. Due to the important application value of recommender system, there have always been emerging works in this field. In recent years, graph neural network (GNN) techniques have gained considerable interests which can naturally integrate node information and topological structure. Owing to the outperformance of GNN in learning on graph data, GNN methods have been widely applied in many fields. In recommender systems, the main challenge is to learn the efficient user/item embeddings from their interactions and side information if available. Since most of the information essentially has graph structure and GNNs have superiority in representation learning, the field of utilizing graph neural network in recommender systems is flourishing. This article aims to provide a comprehensive review of recent research efforts on graph neural network based recommender systems. Specifically, we provide a taxonomy of graph neural network based recommendation models and state new perspectives pertaining to the development of this field.

[1]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[2]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[3]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[4]  Le Wu,et al.  A Neural Influence Diffusion Model for Social Recommendation , 2019, SIGIR.

[5]  Yanchi Liu,et al.  Graph Contextualized Self-Attention Network for Session-based Recommendation , 2019, IJCAI.

[6]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[7]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[8]  Mengqi Zhang,et al.  Personalizing Graph Neural Networks with Attention Mechanism for Session-based Recommendation , 2019, ArXiv.

[9]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Xu Chen,et al.  Learning over Knowledge-Base Embeddings for Recommendation , 2018, ArXiv.

[11]  Alessandro Bozzon,et al.  Recurrent knowledge graph embedding for effective recommendation , 2018, RecSys.

[12]  Yi Tay,et al.  Deep Learning based Recommender System: A Survey and New Perspectives , 2018 .

[13]  Minyi Guo,et al.  Knowledge Graph Convolutional Networks for Recommender Systems , 2019, WWW.

[14]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[15]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[16]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[17]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[18]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[19]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[20]  Philip S. Yu,et al.  Heterogeneous Information Network Embedding for Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[21]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[22]  Neil Yorke-Smith,et al.  TrustSVD: Collaborative Filtering with Both the Explicit and Implicit Influence of User Trust and of Item Ratings , 2015, AAAI.

[23]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[24]  Xing Xie,et al.  A Survey on Knowledge Graph-Based Recommender Systems , 2020, IEEE Transactions on Knowledge and Data Engineering.

[25]  Qing Guo,et al.  Research Commentary on Recommendations with Side Information: A Survey and Research Directions , 2019, Electron. Commer. Res. Appl..

[26]  Xavier Bresson,et al.  Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks , 2017, NIPS.

[27]  Gholamreza Haffari,et al.  Graph-to-Sequence Learning using Gated Graph Neural Networks , 2018, ACL.

[28]  Max Welling,et al.  Graph Convolutional Matrix Completion , 2017, ArXiv.

[29]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[30]  Yuji Matsumoto,et al.  Knowledge Transfer for Out-of-Knowledge-Base Entities: A Graph Neural Network Approach , 2017, ArXiv.

[31]  Michael R. Lyu,et al.  Learning to recommend with social trust ensemble , 2009, SIGIR.

[32]  Deng Cai,et al.  What to Do Next: Modeling User Behaviors by Time-LSTM , 2017, IJCAI.

[33]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[34]  Yong Ge,et al.  Binarized Collaborative Filtering with Distilling Graph Convolutional Networks , 2019, IJCAI.

[35]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[36]  Le Song,et al.  2 Common Formulation for Greedy Algorithms on Graphs , 2018 .

[37]  Michael R. Lyu,et al.  SoRec: social recommendation using probabilistic matrix factorization , 2008, CIKM '08.

[38]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[39]  Yongdong Zhang,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[40]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[41]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[42]  Yizhou Sun,et al.  Recommendation in heterogeneous information networks with implicit user feedback , 2013, RecSys.

[43]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[44]  Bin Shen,et al.  Collaborative Memory Network for Recommendation Systems , 2018, SIGIR.

[45]  Hsinchun Chen,et al.  Recommendation as link prediction in bipartite graphs: A graph kernel-based machine learning approach , 2013, Decis. Support Syst..

[46]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[47]  Amine Dadoun,et al.  Location Embeddings for Next Trip Recommendation , 2019, WWW.

[48]  Jie Zhang,et al.  Attentive Knowledge Graph Embedding for Personalized Recommendation , 2019, ArXiv.

[49]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[50]  Peijie Sun,et al.  DiffNet++: A Neural Influence and Interest Diffusion Network for Social Recommendation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[51]  Diksha Garg,et al.  NISER: Normalized Item and Session Representations with Graph Neural Networks , 2019, ArXiv.

[52]  Yixin Chen,et al.  Inductive Graph Pattern Learning for Recommender Systems Based on a Graph Neural Network , 2019, ArXiv.

[53]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[54]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[55]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[56]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[57]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[58]  Raia Hadsell,et al.  Graph networks as learnable physics engines for inference and control , 2018, ICML.

[59]  Hongyuan Zha,et al.  Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Prediction , 2020, WWW.

[60]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[61]  Jure Leskovec,et al.  Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems , 2019, KDD.

[62]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[63]  Jun Zhao,et al.  IntentGC: A Scalable Graph Convolution Framework Fusing Heterogeneous Information for Recommendation , 2019, KDD.

[64]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[65]  Lei Zheng,et al.  Spectral collaborative filtering , 2018, RecSys.

[66]  Xiao Wang,et al.  Multi-Component Graph Convolutional Collaborative Filtering , 2019, AAAI.

[67]  Meng Wang,et al.  Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach , 2020, AAAI.

[68]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[69]  Hongxia Yang,et al.  Hierarchical Representation Learning for Bipartite Graphs , 2019, IJCAI.

[70]  Jian Tang,et al.  Session-Based Social Recommendation via Dynamic Graph Attention Networks , 2019, WSDM.

[71]  Zi Huang,et al.  Rethinking the Item Order in Session-based Recommendation with Graph Neural Networks , 2019, CIKM.

[72]  Irwin King,et al.  STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systems , 2019, IJCAI.

[73]  Xing Zhao,et al.  Learning to Hash with Graph Neural Networks for Recommender Systems , 2020, WWW.

[74]  Huan Liu,et al.  Exploiting Local and Global Social Context for Recommendation , 2013, IJCAI.

[75]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[76]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[77]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[78]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[79]  Alex Fout,et al.  Protein Interface Prediction using Graph Convolutional Networks , 2017, NIPS.

[80]  Guihai Chen,et al.  Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systems , 2019, WWW.

[81]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[82]  Mark Coates,et al.  Memory Augmented Graph Neural Networks for Sequential Recommendation , 2019, AAAI.