Tiger: Transferable Interest Graph Embedding for Domain-Level Zero-Shot Recommendation

Recommender systems play a significant role in online services and have attracted wide attention from both academia and industry. In this paper, we focus on an important, practical, but often overlooked task: domain-level zero-shot recommendation (DZSR). The challenge of DZSR mainly lies in the absence of collaborative behaviors in the target domain, which may be caused by various reasons, such as the domain being newly launched without existing user-item interactions, or users' behaviors being too sensitive to collect for training. To address this challenge, we propose a Transferable Interest Graph Embedding technique for Recommendations (Tiger). The key idea is to connect isolated collaborative filtering datasets with a knowledge graph tailored to recommendations, then propagate collaborative signals from public domains to the zero-shot target domain. The backbone of Tiger is the transferable interest extractor, which is a simple yet effective graph convolutional network (GCN) aggregating multiple hops of neighbors on a shared interest graph. We find that the bottom layers of GCN preserve more domain-specific information while the upper layers represent universal interest better. Thus, in Tiger, we discard the bottom layers of GCN to reconstruct user interest so that collaborative signals can be successfully propagated to other domains, and retain the bottom layers of GCN to include domain-specific information for items. Extensive experiments with four public datasets demonstrate that Tiger can effectively make recommendations for a zero-shot domain and outperform several alternative baselines.

[1]  Jianxun Lian,et al.  Reinforced Anchor Knowledge Graph Generation for News Recommendation Reasoning , 2021, KDD.

[2]  Zhenjing Zheng,et al.  Multi-view Denoising Graph Auto-Encoders on Heterogeneous Information Networks for Cold-start Recommendation , 2021, KDD.

[3]  Liqiang Nie,et al.  Contrastive Learning for Cold-Start Recommendation , 2021, ACM Multimedia.

[4]  Shu Wu,et al.  Cold-start Sequential Recommendation via Meta Learner , 2020, AAAI.

[5]  Wei Wang,et al.  Fast Adaptation for Cold-start Collaborative Filtering with Meta-learning , 2020, 2020 IEEE International Conference on Data Mining (ICDM).

[6]  Heng-Tze Cheng,et al.  Zero-Shot Heterogeneous Transfer Learning from Recommender Systems to Cold-Start Search Retrieval , 2020, CIKM.

[7]  James Caverlee,et al.  Recommendation for New Users and New Items via Randomized Training and Mixture-of-Experts Transformation , 2020, SIGIR.

[8]  Xing Xie,et al.  Leveraging Demonstrations for Reinforcement Recommendation Reasoning over Knowledge Graphs , 2020, SIGIR.

[9]  Xing Xie,et al.  Octopus: Comprehensive and Elastic User Representation for the Generation of Recommendation Candidates , 2020, SIGIR.

[10]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[11]  Yan Wang,et al.  DTCDR: A Framework for Dual-Target Cross-Domain Recommendation , 2019, CIKM.

[12]  Dongha Lee,et al.  Semi-Supervised Learning for Cross-Domain Recommendation to Cold-Start Users , 2019, CIKM.

[13]  Xing Xie,et al.  KRED: Knowledge-Aware Document Representation for News Recommendations , 2019, RecSys.

[14]  G. Karypis,et al.  Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks. , 2019 .

[15]  Iryna Gurevych,et al.  Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks , 2019, EMNLP.

[16]  Yongfeng Zhang,et al.  Reinforcement Knowledge Graph Reasoning for Explainable Recommendation , 2019, SIGIR.

[17]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[18]  Qing He,et al.  Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddings , 2019, SIGIR.

[19]  Wei Li,et al.  Multi-Interest Network with Dynamic Routing for Recommendation at Tmall , 2019, CIKM.

[20]  Minyi Guo,et al.  Knowledge Graph Convolutional Networks for Recommender Systems , 2019, WWW.

[21]  Yixin Cao,et al.  Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences , 2019, WWW.

[22]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[23]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[24]  Yiqun Liu,et al.  Attention-based Adaptive Model to Unify Warm and Cold Starts Recommendation , 2018, CIKM.

[25]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[26]  Ji-Rong Wen,et al.  KB4Rec: A Data Set for Linking Knowledge Bases with Recommender Systems , 2018, Data Intelligence.

[27]  Yu Zhang,et al.  CoNet: Collaborative Cross Networks for Cross-Domain Recommendation , 2018, UMCit@KDD.

[28]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[29]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[30]  Xiaolong Jin,et al.  Cross-Domain Recommendation: An Embedding and Mapping Approach , 2017, IJCAI.

[31]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[32]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[33]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[34]  Conor Hayes,et al.  SemStim: Exploiting Knowledge Graphs for Cross-Domain Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[35]  Oren Barkan,et al.  CB2CF: a neural multiview content-to-collaborative filtering model for completely cold item recommendations , 2016, RecSys.

[36]  Nicholas Jing Yuan,et al.  Little Is Much: Bridging Cross-Platform Behaviors through Overlapped Crowds , 2016, AAAI.

[37]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[38]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[39]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[40]  Chun Chen,et al.  Cross domain recommendation based on multi-type media fusion , 2014, Neurocomputing.

[41]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[42]  John C. Duchi,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011 .

[43]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[44]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[45]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[46]  Tsvi Kuflik,et al.  Cross-Domain Mediation in Collaborative Filtering , 2007, User Modeling.

[47]  James Y. Zou,et al.  Language Models as Recommender Systems: Evaluations and Limitations , 2021 .

[48]  Qing Zhang,et al.  HeroGRAPH: A Heterogeneous Graph Framework for Multi-Target Cross-Domain Recommendation , 2020, ORSUM@RecSys.

[49]  Maksims Volkovs,et al.  DropoutNet: Addressing Cold Start in Recommender Systems , 2017, NIPS.

[50]  Iván Cantador,et al.  Exploiting Social Tags in Matrix Factorization Models for Cross-domain Collaborative Filtering , 2014, CBRecSys@RecSys.