Gated recurrent units based neural network for time heterogeneous feedback recommendation

Nowadays, recommender systems face the problem of time heterogeneous feedback recommendation, in which items are recommended according to several kinds of user feedback with time stamps. Previously proposed recurrent neural network based recommendation method (RNNRec) cannot analyze feedback sequences on multiple time scales, and gradient vanishing may occur when the model is trained through back propagation through time (BPTT) algorithm. To address these issues, we propose a gated recurrent units (GRU) based neural network to predict which items users will access in the future. The GRU layer in the model can analyze feedback sequences on multiple time scales and can avoid gradient vanishing during training. The proposed approach is verified on three large-scale real-life datasets, and the comparison indicates that the proposed approach outperforms several state-of-the-art methods.

[1]  Yi Xiong,et al.  List-wise probabilistic matrix factorization for recommendation , 2014, Inf. Sci..

[2]  Enrique Herrera-Viedma,et al.  A quality based recommender system to disseminate information in a university digital library , 2014, Inf. Sci..

[3]  Chen Lin,et al.  Personalized news recommendation via implicit social experts , 2014, Inf. Sci..

[4]  Guillermo Sapiro,et al.  Kernelized Probabilistic Matrix Factorization: Exploiting Graphs and Side Information , 2012, SDM.

[5]  Tommi S. Jaakkola,et al.  Maximum-Margin Matrix Factorization , 2004, NIPS.

[6]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[7]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[8]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[9]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[10]  Enrique Herrera-Viedma,et al.  A model to represent users trust in recommender systems using ontologies and fuzzy linguistic modeling , 2015, Inf. Sci..

[11]  Yee Whye Teh,et al.  Variational Bayesian Approach to Movie Rating Prediction , 2007, KDD 2007.

[12]  Le Wu,et al.  Leveraging tagging for neighborhood-aware probabilistic matrix factorization , 2012, CIKM.

[13]  Martha Larson,et al.  CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering , 2012, RecSys.

[14]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[15]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[16]  Wei Zeng,et al.  Heterogeneous data fusion via matrix factorization for augmenting item, group and friend recommendations , 2013, SAC '13.

[17]  Li Chen,et al.  Factorization vs. regularization: fusing heterogeneous social relationships in top-n recommendation , 2011, RecSys '11.

[18]  Xin Wang,et al.  Friend recommendation with content spread enhancement in social networks , 2015, Inf. Sci..

[19]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[20]  Martin Ester,et al.  A Transitivity Aware Matrix Factorization Model for Recommendation in Social Networks , 2011, IJCAI.

[21]  SmolaAlex,et al.  Improving maximum margin matrix factorization , 2008 .

[22]  Tsvi Kuflik,et al.  Workshop on information heterogeneity and fusion in recommender systems (HetRec 2010) , 2010, RecSys '10.

[23]  Lars Schmidt-Thieme,et al.  Bayesian Personalized Ranking for Non-Uniformly Sampled Items , 2011 .

[24]  Juntao Liu,et al.  Conditional preference in recommender systems , 2015, Expert Syst. Appl..

[25]  José Angel Olivas,et al.  Hiperion: A fuzzy approach for recommending educational activities based on the acquisition of competences , 2013, Inf. Sci..

[26]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[27]  Qiang Yang,et al.  General Functional Matrix Factorization Using Gradient Boosting , 2013, ICML.

[28]  Juntao Liu,et al.  Bayesian Probabilistic Matrix Factorization with Social Relations and Item Contents for recommendation , 2013, Decis. Support Syst..

[29]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[30]  Lars Schmidt-Thieme,et al.  MyMediaLite: a free recommender system library , 2011, RecSys '11.

[31]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[32]  Heng Cai,et al.  A Distributional Representation Model For Collaborative Filtering , 2015, ArXiv.

[33]  Chun Chen,et al.  Social Recommendation Using Low-Rank Semidefinite Program , 2011, AAAI.

[34]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[35]  Enrique Herrera-Viedma,et al.  A google wave-based fuzzy recommender system to disseminate information in University Digital Libraries 2.0 , 2011, Inf. Sci..

[36]  Michael R. Lyu,et al.  Improving Recommender Systems by Incorporating Social Contextual Information , 2011, TOIS.

[37]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[38]  Enrique Herrera-Viedma,et al.  Dealing with incomplete information in a fuzzy linguistic recommender system to disseminate information in university digital libraries , 2010, Knowl. Based Syst..

[39]  Duen-Ren Liu,et al.  Recommending blog articles based on popular event trend analysis , 2015, Inf. Sci..

[40]  Arindam Banerjee,et al.  Generalized Probabilistic Matrix Factorizations for Collaborative Filtering , 2010, 2010 IEEE International Conference on Data Mining.

[41]  Elias Oliveira,et al.  Achieving a compromise between performance and complexity of structure: An incremental approach , 2015, Inf. Sci..

[42]  Junwei Wang,et al.  Recurrent neural network based recommendation for time heterogeneous feedback , 2016, Knowl. Based Syst..

[43]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[44]  Geoffrey J. Gordon,et al.  A Bayesian Matrix Factorization Model for Relational Data , 2010, UAI.

[45]  Alexander J. Smola,et al.  Improving Maximum Margin Matrix Factorization , 2008, ECML/PKDD.

[46]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[47]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[48]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[49]  Junwei Wang,et al.  Representing conditional preference by boosted regression trees for recommendation , 2016, Inf. Sci..

[50]  Congfu Xu,et al.  Adaptive Bayesian personalized ranking for heterogeneous implicit feedbacks , 2015, Knowl. Based Syst..