Efficient Heterogeneous Collaborative Filtering without Negative Sampling for Recommendation

Recent studies on recommendation have largely focused on exploring state-of-the-art neural networks to improve the expressiveness of models, while typically apply the Negative Sampling (NS) strategy for efficient learning. Despite effectiveness, two important issues have not been well-considered in existing methods: 1) NS suffers from dramatic fluctuation, making sampling-based methods difficult to achieve the optimal ranking performance in practical applications; 2) although heterogeneous feedback (e.g., view, click, and purchase) is widespread in many online systems, most existing methods leverage only one primary type of user feedback such as purchase. In this work, we propose a novel non-sampling transfer learning solution, named Efficient Heterogeneous Collaborative Filtering (EHCF) for Top-N recommendation. It can not only model fine-grained user-item relations, but also efficiently learn model parameters from the whole heterogeneous data (including all unlabeled data) with a rather low time complexity. Extensive experiments on three real-world datasets show that EHCF significantly outperforms state-of-the-art recommendation methods in both traditional (single-behavior) and heterogeneous scenarios. Moreover, EHCF shows significant improvements in training efficiency, making it more applicable to real-world large-scale systems. Our implementation has been released 1 to facilitate further developments on efficient whole-data based neural methods.

[1]  Maksims Volkovs,et al.  DropoutNet: Addressing Cold Start in Recommender Systems , 2017, NIPS.

[2]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[3]  Joemon M. Jose,et al.  Batch IS NOT Heavy: Learning Word Representations From All Samples , 2018, ACL.

[4]  Zhe Zhao,et al.  Improving User Topic Interest Profiles by Behavior Factorization , 2015, WWW.

[5]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[6]  Dietmar Jannach,et al.  Are we really making much progress? A worrying analysis of recent neural recommendation approaches , 2019, RecSys.

[7]  Yiqun Liu,et al.  An Efficient Adaptive Transfer Neural Network for Social-aware Recommendation , 2019, SIGIR.

[8]  Yiqun Liu,et al.  Social Attentional Memory Network: Modeling Aspect- and Friend-Level Differences in Recommendation , 2019, WSDM.

[9]  Kun Zhang,et al.  Modeling Dynamic Missingness of Implicit Feedback for Recommendation , 2018, NeurIPS.

[10]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[11]  Yiqun Liu,et al.  Neural Attentional Rating Regression with Review-level Explanations , 2018, WWW.

[12]  Yiqun Liu,et al.  Missing Data Modeling with User Activity and Item Popularity in Recommendation , 2018, AIRS.

[13]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[14]  Domonkos Tikk,et al.  Fast als-based matrix factorization for explicit and implicit feedback datasets , 2010, RecSys '10.

[15]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[16]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[17]  Qiang Yang,et al.  One-Class Collaborative Filtering , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[18]  Tat-Seng Chua,et al.  fBGD: Learning Embeddings From Positive Unlabeled Data with BGD , 2018, UAI.

[19]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[20]  David M. Blei,et al.  Modeling User Exposure in Recommendation , 2015, WWW.

[21]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[22]  Lars Schmidt-Thieme,et al.  Multi-relational matrix factorization using bayesian personalized ranking for social network data , 2012, WSDM '12.

[23]  Yun Liu,et al.  BPRH: Bayesian personalized ranking for heterogeneous implicit feedback , 2018, Inf. Sci..

[24]  Chen Gao,et al.  Neural Multi-task Recommendation from Multi-behavior Data , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[25]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[26]  Martha Larson,et al.  Bayesian Personalized Ranking with Multi-Channel User Feedback , 2016, RecSys.

[27]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[28]  Kun Gai,et al.  Learning Tree-based Deep Model for Recommender Systems , 2018, KDD.

[29]  Tat-Seng Chua,et al.  Improving Implicit Recommender Systems with View Data , 2018, IJCAI.

[30]  Liang Tang,et al.  An Empirical Study on Recommendation with Multiple Types of Feedback , 2016, KDD.

[31]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..