Deep attention user-based collaborative filtering for recommendation

Abstract The user-based collaborative filtering (UCF) model has been widely used in industry for recommender systems. UCF predicts a user’s interest in an item based on rating information from similar user profiles. A neural network UCF model can learn effectively the high-order relations between users and items, but it cannot distinguish the importance of users in learning process. To mine the complex relationships between users and items, we incorporate a Deep+Shadow pattern to improve learning features effectively, namely as DeepUCF. Firstly, we define historical users, that is, users from the historical data of interactions with an item. The target user and historical users are calculated to capture complex process of user’s interacted item. Secondly, we integrate a shallow linear model to effectively solve single pair interaction problems. Finally, DeepUCF construct of a pair of user relations (interactive users with a history of items) for the input, and joint linear and nonlinear models to build relationships between users. More importantly, DeepUCF+a add an attention network to distinguish the historical user importance of items, which make DeepUCF more expressive. Experiments on real datasets show that DeepUCF and DeepUCF+a can effectively capture users’ complex high-order relationships, and achieve better performance.

[1]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  MengChu Zhou,et al.  An Incremental-and-Static-Combined Scheme for Matrix-Factorization-Based Collaborative Filtering , 2016, IEEE Transactions on Automation Science and Engineering.

[4]  Meng Wang,et al.  A Relaxed Ranking-Based Factor Model for Recommender System from Implicit Feedback , 2016, IJCAI.

[5]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[6]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[7]  Yalou Huang,et al.  Personalized Paper Recommendation Based on User Historical Behavior , 2012 .

[8]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[9]  Donghyun Kim,et al.  Convolutional Matrix Factorization for Document Context-Aware Recommendation , 2016, RecSys.

[10]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[11]  MengChu Zhou,et al.  A Nonnegative Latent Factor Model for Large-Scale Sparse Matrices in Recommender Systems via Alternating Direction Method , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[13]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[14]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[15]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[16]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[17]  Neil Yorke-Smith,et al.  A Novel Recommendation Model Regularized with User Trust and Item Ratings , 2016, IEEE Transactions on Knowledge and Data Engineering.

[18]  MengChu Zhou,et al.  An Inherently Nonnegative Latent Factor Model for High-Dimensional and Sparse Matrices from Industrial Applications , 2018, IEEE Transactions on Industrial Informatics.

[19]  Xiangnan He,et al.  NAIS: Neural Attentive Item Similarity Model for Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[20]  Xiaodong Yu,et al.  Learning Bidirectional Temporal Cues for Video-Based Person Re-Identification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Dan Frankowski,et al.  Collaborative Filtering Recommender Systems , 2007, The Adaptive Web.

[22]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[23]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[24]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[25]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[26]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[27]  Xiangnan He,et al.  A Generic Coordinate Descent Framework for Learning from Implicit Feedback , 2016, WWW.

[28]  Lior Rokach,et al.  Recommender Systems: Introduction and Challenges , 2015, Recommender Systems Handbook.

[29]  Longbing Cao,et al.  CoupledCF: Learning Explicit and Implicit User-item Couplings in Recommendation for Deep Collaborative Filtering , 2018, IJCAI.

[30]  John Riedl,et al.  Collaborative Filtering Recommender Systems , 2011, Found. Trends Hum. Comput. Interact..

[31]  Linpeng Huang,et al.  DELF: A Dual-Embedding based Deep Latent Factor Model for Recommendation , 2018, IJCAI.