Preference-aware Graph Attention Networks for Cross-Domain Recommendations with Collaborative Knowledge Graph

Knowledge graphs (KGs) can provide users with semantic information and relations among numerous entities and nodes, which can greatly facilitate the performance of recommender systems. However, existing KG-based approaches still suffer from severe data sparsity and may not be effective in capturing the preference features of similar entities across domains. Therefore, in this article, we propose a Preference-aware Graph Attention network model with Collaborative Knowledge Graph (PGACKG) for cross-domain recommendations. Preference-aware entity embeddings with some collaborative signals are first obtained by exploiting the graph-embedding model, which can transform entities and items in the collaborative knowledge graph into semantic preference spaces. To better learn user preference features, we devise a preference-aware graph attention network framework that aggregates the preference features of similar entities within domains and across domains. In this framework, multi-hop reasoning is employed to assist in the generation of preference features within domains, and the node random walk based on frequency visits is proposed to gather similar preferences across domains for target entities. Then, the final preference features of entities are fused, while a novel Cross-domain Bayesian Personalized Ranking (CBPR) is proposed to improve cross-domain recommendation accuracy. Extensive empirical experiments on four real-world datasets demonstrate that our proposed approach consistently outperforms state-of-the-art baselines. Furthermore, our PGACKG achieves strong performance in different ablation scenarios, and the interaction sparsity experiments also demonstrate that our proposed approach can significantly alleviate the data sparsity issue.

[1]  Yan Wang,et al.  A Unified Framework for Cross-Domain and Cross-System Recommendations , 2021, IEEE Transactions on Knowledge and Data Engineering.

[2]  Alexander Tuzhilin,et al.  Dual Metric Learning for Effective and Efficient Cross-Domain Recommendations , 2021, IEEE Transactions on Knowledge and Data Engineering.

[3]  Chunyan Miao,et al.  Contextualized Graph Attention Network for Recommendation With Item Knowledge Graph , 2020, IEEE Transactions on Knowledge and Data Engineering.

[4]  Fei Cai,et al.  Graph Co-Attentive Session-based Recommendation , 2021, ACM Trans. Inf. Syst..

[5]  Fuzhen Zhuang,et al.  Personalized Transfer of User Preferences for Cross-domain Recommendation , 2021, WSDM.

[6]  Wei Liu,et al.  GAIN: Graph Attention & Interaction Network for Inductive Semi-Supervised Learning Over Large-Scale Graphs , 2020, IEEE Transactions on Knowledge and Data Engineering.

[7]  Xing Xie,et al.  A Survey on Knowledge Graph-Based Recommender Systems , 2020, IEEE Transactions on Knowledge and Data Engineering.

[8]  Ziqi Liu,et al.  Learning Representations of Inactive Users: A Cross Domain Approach with Graph Neural Networks , 2021, CIKM.

[9]  U. Kang,et al.  Learning to Walk across Time for Interpretable Temporal Knowledge Graph Completion , 2021, KDD.

[10]  Jiadong Ren,et al.  Deep sparse autoencoder prediction model based on adversarial learning for cross-domain recommendations , 2021, Knowl. Based Syst..

[11]  Guanfeng Liu,et al.  Cross-Domain Recommendation: Challenges, Progress, and Prospects , 2021, IJCAI.

[12]  Min Xu,et al.  Knowledge graph enhanced neural collaborative recommendation , 2021, Expert Syst. Appl..

[13]  Fuzheng Zhang,et al.  Multi-modal Knowledge Graphs for Recommender Systems , 2020, CIKM.

[14]  Yu Fan,et al.  KERL: A Knowledge-Guided Reinforcement Learning Model for Sequential Recommendation , 2020, SIGIR.

[15]  Xing Xie,et al.  Leveraging Demonstrations for Reinforcement Recommendation Reasoning over Knowledge Graphs , 2020, SIGIR.

[16]  Xiangliang Zhang,et al.  Graph Factorization Machines for Cross-Domain Recommendation , 2020, ArXiv.

[17]  Walid Krichene,et al.  On Sampled Metrics for Item Recommendation , 2020, KDD.

[18]  Weinan Zhang,et al.  Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning , 2020, SIGIR.

[19]  Hongbo Deng,et al.  CATN: Cross-Domain Recommendation for Cold-Start Users via Aspect Transfer Network , 2020, SIGIR.

[20]  Yixin Cao,et al.  Reinforced Negative Sampling over Knowledge Graph for Recommendation , 2020, WWW.

[21]  Dongrui Wu,et al.  Optimize TSK Fuzzy Systems for Classification Problems: Minibatch Gradient Descent With Uniform Regularization and Batch Normalization , 2020, IEEE Transactions on Fuzzy Systems.

[22]  Ao Tang,et al.  Deep Transfer Collaborative Filtering for Recommender Systems , 2019, PRICAI.

[23]  Wei Liu,et al.  Cross-Domain Recommendation via Coupled Factorization Machines , 2019, AAAI.

[24]  Yang Xu,et al.  Deeply Fusing Reviews and Contents for Cold Start Users in Cross-Domain Recommendation Systems , 2019, AAAI.

[25]  Guangquan Zhang,et al.  Cross-domain Recommendation with Semantic Correlation in Tagging Systems , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[26]  Guangquan Zhang,et al.  A Cross-Domain Recommender System With Kernel-Induced Knowledge Transfer for Overlapping Entities , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Yongfeng Zhang,et al.  Reinforcement Knowledge Graph Reasoning for Explainable Recommendation , 2019, SIGIR.

[28]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[29]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[30]  Yixin Cao,et al.  Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences , 2019, WWW.

[31]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[32]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[33]  Taiji Suzuki,et al.  Cross-domain Recommendation via Deep Domain Adaptation , 2018, ECIR.

[34]  Philip S. Yu,et al.  Heterogeneous Information Network Embedding for Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[35]  Xavier Bresson,et al.  CayleyNets: Graph Convolutional Neural Networks With Complex Rational Spectral Filters , 2017, IEEE Transactions on Signal Processing.

[36]  Qian Zhang,et al.  Cross-domain Recommendation with Probabilistic Knowledge Transfer , 2018, ICONIP.

[37]  Alessandro Bozzon,et al.  Recurrent knowledge graph embedding for effective recommendation , 2018, RecSys.

[38]  Cao Xiao,et al.  Constrained Generation of Semantically Valid Graphs via Regularizing Variational Autoencoders , 2018, NeurIPS.

[39]  Richard Socher,et al.  Multi-Hop Knowledge Graph Reasoning with Reward Shaping , 2018, EMNLP.

[40]  Philip S. Yu,et al.  Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model , 2018, KDD.

[41]  Zhengyang Wang,et al.  Large-Scale Learnable Graph Convolutional Networks , 2018, KDD.

[42]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[43]  Stephan Günnemann,et al.  NetGAN: Generating Graphs via Random Walks , 2018, ICML.

[44]  Jure Leskovec,et al.  GraphRNN: A Deep Generative Model for Graphs , 2018, ICML 2018.

[45]  Dustin Tran,et al.  Image Transformer , 2018, ICML.

[46]  Razvan Pascanu,et al.  Learning Deep Generative Models of Graphs , 2018, ICLR 2018.

[47]  Kaisheng Yao,et al.  Robust Transfer Learning for Cross-domain Collaborative Filtering Using Multiple Rating Patterns Approximation , 2018, WSDM.

[48]  Anuja Arora,et al.  Cross domain recommendation using multidimensional tensor factorization , 2018, Expert Syst. Appl..

[49]  Qiang Yang,et al.  MTNet: A Neural Approach for Cross-Domain Recommendation with Unstructured Text , 2018 .

[50]  Yang Sok Kim,et al.  An empirical study on the effect of data sparsity and data overlap on cross domain collaborative filtering performance , 2017, Expert Syst. Appl..

[51]  Shampa Chakraverty,et al.  Review based emotion profiles for cross domain recommendation , 2017, Multimedia Tools and Applications.

[52]  Zhendong Mao,et al.  Knowledge Graph Embedding: A Survey of Approaches and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[53]  Xiaolong Jin,et al.  Cross-Domain Recommendation: An Embedding and Mapping Approach , 2017, IJCAI.

[54]  Dik Lun Lee,et al.  Meta-Graph Based Recommendation Fusion over Heterogeneous Information Networks , 2017, KDD.

[55]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[56]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[57]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[58]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[59]  Conor Hayes,et al.  SemStim: Exploiting Knowledge Graphs for Cross-Domain Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[60]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[61]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[62]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[63]  Philip S. Yu,et al.  Semantic Path based Personalized Recommendation on Weighted Heterogeneous Information Networks , 2015, CIKM.

[64]  Jun Zhao,et al.  Knowledge Graph Embedding via Dynamic Mapping Matrix , 2015, ACL.

[65]  Chun Chen,et al.  Cross domain recommendation based on multi-type media fusion , 2014, Neurocomputing.

[66]  Yizhou Sun,et al.  Personalized entity recommendation: a heterogeneous information network approach , 2014, WSDM.

[67]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[68]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[69]  Shaghayegh Sahebi,et al.  Content-Based Cross-Domain Recommendations Using Segmented Models , 2014, CBRecSys@RecSys.

[70]  Roberto Turrin,et al.  Cross-Domain Recommender Systems , 2015, Recommender Systems Handbook.

[71]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.