Enhancing User Interest Modeling with Knowledge-Enriched Itemsets for Sequential Recommendation

Sequential recommendation which aims to predict a user's next interaction based on his/her previous behaviors, has attracted great attention. Recent studies mainly employ deep recurrent neural networks or self-attention networks to capture dynamic user preferences. However, existing methods merely focus on modeling users' clear interests in interacted items. We argue that for an interaction, the user may also have ambiguous interests in items that are semantically related to the interacted one. For comprehensively capturing user preferences, it is beneficial to discover potential interests from historical interactions at a broader itemset level. Therefore, in this paper, we propose a knowledge graph enhanced sequential recommendation model namely KGIE, which focuses on enhancing user interest modeling with knowledge-enriched itemsets by incorporating the knowledge graph. Specifically, in addition to item-level interest modeling with interacted items, we further construct knowledge-enriched itemsets that are extracted via high-order knowledge associations with the interacted items. For capturing personalized itemset-level interests, we design an attentive aggregation unit to combine item embeddings considering both inherent and contextual personalization signals. Furthermore, to balance the contributions of both two levels of interest modeling, we adaptively learn high-level preference representations with a gating fusion unit. Extensive experiments on three real-world datasets demonstrate the superior performance beyond state-of-the-art methods and recommendation interpretability of our model.

[1]  Guangyan Lin,et al.  CKAN: Collaborative Knowledge-aware Attentive Network for Recommender Systems , 2020, SIGIR.

[2]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[3]  James Caverlee,et al.  Next-item Recommendation with Sequential Hypergraphs , 2020, SIGIR.

[4]  Deqing Wang,et al.  Feature-level Deeper Self-Attention Network for Sequential Recommendation , 2019, IJCAI.

[5]  Markus Schedl,et al.  The LFM-1b Dataset for Music Retrieval and Recommendation , 2016, ICMR.

[6]  Yanmin Zhu,et al.  Modeling Inter-station Relationships with Attentive Temporal Graph Convolutional Network for Air Quality Prediction , 2021, WSDM.

[7]  Haibin Cai,et al.  Jointly Modeling Individual Student Behaviors and Social Influence for Prediction Tasks , 2020, CIKM.

[8]  Jiadi Yu,et al.  Jointly Modeling Spatio–Temporal Dependencies and Daily Flow Correlations for Crowd Flow Prediction , 2021, ACM Trans. Knowl. Discov. Data.

[9]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[10]  Xing Xie,et al.  A Survey on Knowledge Graph-Based Recommender Systems , 2020, IEEE Transactions on Knowledge and Data Engineering.

[11]  Ji-Rong Wen,et al.  Mining Implicit Entity Preference from User-Item Interaction Data for Knowledge Graph Completion via Adversarial Learning , 2020, WWW.

[12]  Changsheng Xu,et al.  CSAN: Contextual Self-Attention Network for User Sequential Recommendation , 2018, ACM Multimedia.

[13]  Minglu Li,et al.  L3: Sensing driving conditions for vehicle lane-level localization on highways , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[14]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[15]  Yujie Wang,et al.  Time Interval Aware Self-Attention for Sequential Recommendation , 2020, WSDM.

[16]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[17]  Philip S. Yu,et al.  Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model , 2018, KDD.

[18]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[19]  Ji-Rong Wen,et al.  KB4Rec: A Data Set for Linking Knowledge Bases with Recommender Systems , 2018, Data Intelligence.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Jure Leskovec,et al.  Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems , 2019, KDD.

[22]  Jing Lin,et al.  FISSA: Fusing Item Similarity Models with Self-Attention Networks for Sequential Recommendation , 2020, RecSys.

[23]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[24]  Ziqiang Cheng,et al.  How Powerful are Interest Diffusion on Purchasing Prediction: A Case Study of Taocode , 2021, SIGIR.

[25]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[26]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[27]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[28]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[29]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[30]  Alessandro Bozzon,et al.  Recurrent knowledge graph embedding for effective recommendation , 2018, RecSys.

[31]  Jianhua Liu,et al.  Energy-Efficient Two-Layer Cooperative Defense Scheme to Secure Sensor-Clouds , 2018, IEEE Transactions on Information Forensics and Security.

[32]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[33]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[34]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[35]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[36]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[37]  Minyi Guo,et al.  Knowledge Graph Convolutional Networks for Recommender Systems , 2019, WWW.

[38]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[39]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[40]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[41]  Jitao Sang,et al.  Explainable Interaction-driven User Modeling over Knowledge Graph for Sequential Recommendation , 2019, ACM Multimedia.

[42]  Xiaofei Zhou,et al.  A Knowledge-Aware Attentional Reasoning Network for Recommendation , 2020, AAAI.

[43]  Yanchi Liu,et al.  Graph Contextualized Self-Attention Network for Session-based Recommendation , 2019, IJCAI.

[44]  Hongwei Wang,et al.  RippleNet , 2018, Proceedings of the 27th ACM International Conference on Information and Knowledge Management.

[45]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[46]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[47]  CSAN , 2018, Proceedings of the 26th ACM international conference on Multimedia.

[48]  Jia Li,et al.  Latent Cross: Making Use of Context in Recurrent Recommender Systems , 2018, WSDM.

[49]  Sung Min Cho,et al.  MEANTIME: Mixture of Attention Mechanisms with Multi-temporal Embeddings for Sequential Recommendation , 2020, RecSys.