A deeper graph neural network for recommender systems

Abstract Interaction data in recommender systems are usually represented by a bipartite user–item graph whose edges represent interaction behavior between users and items. The data sparsity problem, which is common in recommender systems, is the result of insufficient interaction data in the link prediction on graphs. The data sparsity problem can be alleviated by extracting more interaction behavior from the bipartite graph, however, stacking multiple layers will lead to over-smoothing, in which case, all nodes will converge to the same value. To address this issue, we propose a deeper graph neural network in this paper that can predict links on a bipartite user–item graph using information propagation. An attention mechanism is introduced to our method to address the problem that variable size inputs for each node on a bipartite graph. Our experimental results demonstrate that our proposed method outperforms five baselines, suggesting that the interactions extracted help to alleviate the data sparsity problem and improve recommendation accuracy.

[1]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[2]  Qian Zhang,et al.  A cross-domain recommender system with consistent information transfer , 2017, Decis. Support Syst..

[3]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[4]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[5]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[6]  Jie Lu,et al.  Multirelational Social Recommendations via Multigraph Ranking , 2017, IEEE Transactions on Cybernetics.

[7]  Yehuda Koren,et al.  The BellKor Solution to the Netflix Grand Prize , 2009 .

[8]  Weinan Zhang,et al.  LambdaFM: Learning Optimal Ranking with Factorization Machines Using Lambda Surrogates , 2016, CIKM.

[9]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[10]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[11]  Capers Jones,et al.  Embedded Software: Facts, Figures, and Future , 2009, Computer.

[12]  F. Scarselli,et al.  A new model for learning in graph domains , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[13]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[14]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[15]  Jie Lu,et al.  A Fuzzy Preference Tree-Based Recommender System for Personalized Business-to-Business E-Services , 2015, IEEE Transactions on Fuzzy Systems.

[16]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[17]  Xavier Bresson,et al.  Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks , 2017, NIPS.

[18]  Wei Wang,et al.  Member contribution-based group recommender system , 2016, Decis. Support Syst..

[19]  Panagiotis Symeonidis Matrix and Tensor Decomposition in Recommender Systems , 2016, RecSys.

[20]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[21]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[22]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[23]  Steffen Rendle,et al.  Improving pairwise learning for item recommendation from implicit feedback , 2014, WSDM.

[24]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.