ADCF: Attentive representation learning and deep collaborative filtering model

Abstract In this paper, we propose a deep collaborative filtering recommendation model, which consists of an attention-based representation learning component and a multi-input matching function learning component. This model takes interaction matrix based on implicit feedback as data source to construct representations of long-term user preferences and item latent features. In the representation learning, a time-aware attention network is used, which uses the embedding vectors of the predicted item, recent historical interaction items, and the interaction time of recent historical interaction items to estimate the weights of different historical interaction items to short-term user preferences modeling. Then, the dynamic user preference representation can be obtained by combining short-term preferences with long-term preferences. In the matching function learning, a multi-input deep learning model is used. Its input includes not only the dynamic user preference representation and the item latent feature representation, but also the linear interaction between the two representations, so that the model has more powerful feature interactions learning ability. Experimental results on four datasets from different domains show that our method is largely superior to the state-of-the-art collaborative filtering methods, and the novel techniques we propose in this paper are effective in improving recommendation performance.

[1]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[2]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[3]  Zibin Zheng,et al.  Heterogeneous Neural Attentive Factorization Machine for Rating Prediction , 2018, CIKM.

[4]  Zi Huang,et al.  Restricted Boltzmann Machine Based Active Learning for Sparse Recommendation , 2018, DASFAA.

[5]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[6]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[7]  Dietmar Jannach,et al.  Contextual Hybrid Session-Based News Recommendation With Recurrent Neural Networks , 2019, IEEE Access.

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[10]  Chengfu Huo,et al.  Deep Match to Rank Model for Personalized Click-Through Rate Prediction , 2020, AAAI.

[11]  Xiaoyu Du,et al.  Outer Product-based Neural Collaborative Filtering , 2018, IJCAI.

[12]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[13]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[14]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[15]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[16]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[17]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[18]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[19]  Philip S. Yu,et al.  DeepCF: A Unified Framework of Representation Learning and Matching Function Learning in Recommender System , 2019, AAAI.

[20]  Xiangnan He,et al.  NAIS: Neural Attentive Item Similarity Model for Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[21]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[22]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[23]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[24]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[25]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[26]  Jun Wang,et al.  Unifying user-based and item-based collaborative filtering approaches by similarity fusion , 2006, SIGIR.

[27]  Nikhil S. Ketkar.  Stochastic Gradient Descent , 2017 .

[28]  Hugues Bersini,et al.  Long and Short-Term Recommendations with Recurrent Neural Networks , 2017, UMAP.

[29]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[30]  Chih-Jen Lin,et al.  Field-aware Factorization Machines for CTR Prediction , 2016, RecSys.

[31]  Zhongmin Yan,et al.  Recommended System: Attentive Neural Collaborative Filtering , 2020, IEEE Access.