Multi-Behavior Graph Neural Networks for Recommender System

Recommender systems have been demonstrated to be effective to meet user's personalized interests for many online services (e.g., E-commerce and online advertising platforms). Recent years have witnessed the emerging success of many deep-learning-based recommendation models for augmenting collaborative filtering (CF) architectures with various neural network architectures, such as multilayer perceptron and autoencoder. However, the majority of them model the user-item relationship with single type of interaction, while overlooking the diversity of user behaviors on interacting with items, which can be click, add-to-cart, tag-as-favorite, and purchase. Such various types of interaction behaviors have great potential in providing rich information for understanding the user preferences. In this article, we pay special attention on user-item relationships with the exploration of multityped user behaviors. Technically, we contribute a new multi-behavior graph neural network (), which specially accounts for diverse interaction patterns and the underlying cross-type behavior interdependencies. In the framework, we develop a graph-structured learning framework to perform expressive modeling of high-order connectivity in behavior-aware user-item interaction graph. After that, a mutual relationship encoder is proposed to adaptively uncover complex relational structures and make aggregations across layer-specific behavior representations. Through comprehensive evaluation on real-world datasets, the advantages of our method have been validated under different experimental settings. Further analysis verifies the positive effects of incorporating the multi-behavioral context into the recommendation paradigm. In addition, the conducted case studies offer insights into the interpretability of user multi-behavior representations. We release our model implementation at https://github.com/akaxlh/MBRec.

[1]  YU Peng,et al.  Multiplex Heterogeneous Graph Convolutional Network , 2022, KDD.

[2]  Chenliang Li,et al.  Knowledge Graph Contrastive Learning for Recommendation , 2022, SIGIR.

[3]  Jiashu Zhao,et al.  Contrastive Meta Learning with Behavior Multiplicity for Recommendation , 2022, WSDM.

[4]  Heng-Shiou Sheu,et al.  Knowledge-Guided Article Embedding Refinement for Session-Based News Recommendation , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[5]  De-fu Zhang,et al.  Neural Embedding Singular Value Decomposition for Collaborative Filtering , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[6]  P. Heng,et al.  Item Relationship Graph Neural Networks for E-Commerce , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Zhaoli Zhang,et al.  Learning Knowledge Graph Embedding With Heterogeneous Relation Attention Networks , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Peijie Sun,et al.  DiffNet++: A Neural Influence and Interest Diffusion Network for Social Recommendation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[9]  Jinhui Tang,et al.  Coherence Constrained Graph LSTM for Group Activity Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Hongxu Chen,et al.  Hyperbolic Hypergraphs for Sequential Recommendation , 2021, CIKM.

[11]  Chao Huang,et al.  Graph Meta Network for Multi-Behavior Recommendation , 2021, SIGIR.

[12]  Xiangji Huang,et al.  Graph-Enhanced Multi-Task Learning of Multi-Level Transition Dynamics for Session-based Recommendation , 2021, AAAI.

[13]  Chao Huang,et al.  Multi-Behavior Enhanced Recommendation with Cross-Interaction Collaborative Relation Modeling , 2021, 2021 IEEE 37th International Conference on Data Engineering (ICDE).

[14]  Hongzhi Yin,et al.  Temporal Meta-path Guided Explainable Recommendation , 2021, WSDM.

[15]  Hanxiong Chen,et al.  Neural Collaborative Reasoning , 2020, WWW.

[16]  Philip S. Yu,et al.  Deep Collaborative Filtering with Multi-Aspect Information in Heterogeneous Networks , 2019, IEEE Transactions on Knowledge and Data Engineering.

[17]  Chen Gao,et al.  Learning to Recommend With Multiple Cascading Behaviors , 2018, IEEE Transactions on Knowledge and Data Engineering.

[18]  Congfu Xu,et al.  Multiplex Graph Neural Networks for Multi-behavior Recommendation , 2020, CIKM.

[19]  Junhua Chen,et al.  Revisiting Alternative Experimental Settings for Evaluating Top-N Item Recommendation Algorithms , 2020, CIKM.

[20]  Chao Huang,et al.  Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network , 2020, SIGIR.

[21]  Depeng Jin,et al.  Multi-behavior Recommendation with Graph Convolutional Networks , 2020, SIGIR.

[22]  Raymond Chi-Wing Wong,et al.  Handling Information Loss of Graph Neural Networks for Session-based Recommendation , 2020, KDD.

[23]  Xiao Wang,et al.  AM-GCN: Adaptive Multi-channel Graph Convolutional Networks , 2020, KDD.

[24]  Yizhou Sun,et al.  Heterogeneous Graph Transformer , 2020, WWW.

[25]  Lei Zheng,et al.  Adaptive Deep Modeling of Users and Items Using Side Information for Recommendation , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Jaewoo Kang,et al.  Graph Transformer Networks , 2019, NeurIPS.

[27]  Shuo Cheng,et al.  CosRec: 2D Convolutional Neural Networks for Sequential Recommendation , 2019, CIKM.

[28]  Long Guo,et al.  Buying or Browsing?: Predicting Real-time Purchasing Intent using Attention-based Deep Network with Multiple Behavior , 2019, KDD.

[29]  Pengfei Wang,et al.  Unified Collaborative Filtering over Graph Embeddings , 2019, SIGIR.

[30]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[31]  Jie Tang,et al.  Representation Learning for Attributed Multiplex Heterogeneous Network , 2019, KDD.

[32]  Irwin King,et al.  STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systems , 2019, IJCAI.

[33]  Yongfeng Zhang,et al.  Relational Collaborative Filtering: Modeling Multiple Item Relations for Recommendation , 2019, SIGIR.

[34]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[35]  Guihai Chen,et al.  Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systems , 2019, WWW.

[36]  George Karypis,et al.  RecWalk: Nearly Uncoupled Random Walks for Top-N Recommendation , 2019, WSDM.

[37]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[38]  Chen Gao,et al.  Neural Multi-task Recommendation from Multi-behavior Data , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[39]  Philip S. Yu,et al.  Heterogeneous Information Network Embedding for Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[40]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Lei Zheng,et al.  Spectral collaborative filtering , 2018, RecSys.

[42]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[43]  Yong Yu,et al.  Learning Multi-touch Conversion Attribution with Dual-attention Mechanisms for Online Advertising , 2018, CIKM.

[44]  Zi Huang,et al.  Neural Memory Streaming Recommender Networks with Adversarial Training , 2018, KDD.

[45]  Huan Liu,et al.  Turning Clicks into Purchases: Revenue Optimization for Product Search in E-Commerce , 2018, SIGIR.

[46]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[47]  Liang Zhang,et al.  Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning , 2018, KDD.

[48]  Stephen Bonner,et al.  Causal embeddings for recommendation , 2017, RecSys.

[49]  Hanning Zhou,et al.  Collaborative Filtering with User-Item Co-Autoregressive Models , 2016, AAAI.

[50]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[51]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[52]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[53]  Liang Tang,et al.  An Empirical Study on Recommendation with Multiple Types of Feedback , 2016, KDD.

[54]  Hanning Zhou,et al.  A Neural Autoregressive Approach to Collaborative Filtering , 2016, ICML.

[55]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[56]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[57]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[58]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[59]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.