Time-weighted Attentional Session-Aware Recommender System

Session-based Recurrent Neural Networks (RNNs) are gaining increasing popularity for recommendation task, due to the high autocorrelation of user's behavior on the latest session and the effectiveness of RNN to capture the sequence order information. However, most existing session-based RNN recommender systems still solely focus on the short-term interactions within a single session and completely discard all the other long-term data across different sessions. While traditional Collaborative Filtering (CF) methods have many advanced research works on exploring long-term dependency, which show great value to be explored and exploited in deep learning models. Therefore, in this paper, we propose ASARS, a novel framework that effectively imports the temporal dynamics methodology in CF into session-based RNN system in DL, such that the temporal info can act as scalable weights by a parallel attentional network. Specifically, we first conduct an extensive data analysis to show the distribution and importance of such temporal interactions data both within sessions and across sessions. And then, our ASARS framework promotes two novel models: (1) an inter-session temporal dynamic model that captures the long-term user interaction for RNN recommender system. We integrate the time changes in session RNN and add user preferences as model drifting; and (2) a novel triangle parallel attention network that enhances the original RNN model by incorporating time information. Such triangle parallel network is also specially designed for realizing data argumentation in sequence-to-scalar RNN architecture, and thus it can be trained very efficiently. Our extensive experiments on four real datasets from different domains demonstrate the effectiveness and large improvement of ASARS for personalized recommendation.

[1]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[2]  Yehuda Koren,et al.  Factor in the neighbors: Scalable and accurate collaborative filtering , 2010, TKDD.

[3]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[4]  Jia Li,et al.  Latent Cross: Making Use of Context in Recurrent Recommender Systems , 2018, WSDM.

[5]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[6]  Hugo Larochelle,et al.  A Meta-Learning Perspective on Cold-Start Recommendations for Items , 2017, NIPS.

[7]  Dietmar Jannach,et al.  Adaptation and Evaluation of Recommendations for Short-term Shopping Goals , 2015, RecSys.

[8]  James Bennett,et al.  The Netflix Prize , 2007 .

[9]  Brian M. Sadler,et al.  Mining Entity Synonyms with Efficient Neural Set Generation , 2018, AAAI.

[10]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[11]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[12]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[13]  Sasank Reddy,et al.  Lifetrak: music in tune with your life , 2006, HCM '06.

[14]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[15]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[16]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[17]  Ed H. Chi,et al.  Towards Neural Mixture Recommender for Long Range Dependent User Sequences , 2019, WWW.

[18]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[19]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[20]  Le Song,et al.  Dirichlet-Hawkes Processes with Applications to Clustering Continuous-Time Document Streams , 2015, KDD.

[21]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[22]  Johan Koolwaaij,et al.  Context-Aware Recommendations in the Mobile Tourist Application COMPASS , 2004, AH.

[23]  Luo Si,et al.  Session-aware Information Embedding for E-commerce Product Recommendation , 2017, CIKM.

[24]  Utkarsh Upadhyay,et al.  Recurrent Marked Temporal Point Processes: Embedding Event History to Vector , 2016, KDD.

[25]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[26]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[27]  Deng Cai,et al.  What to Do Next: Modeling User Behaviors by Time-LSTM , 2017, IJCAI.

[28]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[29]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[30]  Iván Cantador,et al.  Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols , 2013, User Modeling and User-Adapted Interaction.

[31]  Sung-Bae Cho,et al.  Location-Based Recommendation System Using Bayesian User's Preference Model in Mobile Devices , 2007, UIC.

[32]  Zhen Qin,et al.  Multi-Task Learning for Email Search Ranking with Auxiliary Query Clustering , 2018, CIKM.

[33]  Hugues Bersini,et al.  Long and Short-Term Recommendations with Recurrent Neural Networks , 2017, UMAP.

[34]  Dietmar Jannach,et al.  Efficient optimization of multiple recommendation quality factors according to individual user tendencies , 2017, Expert Syst. Appl..

[35]  Philippe Preux,et al.  Recurrent Neural Networks for Long and Short-Term Sequential Recommendation , 2018, ArXiv.

[36]  D. W. Scott On optimal and data based histograms , 1979 .

[37]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[38]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[39]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[40]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[41]  Alexandros Nanopoulos,et al.  Repeat Consumption Recommendation Based on Users Preference Dynamics and Side Information , 2015, WWW.

[42]  Mehrbakhsh Nilashi,et al.  Collaborative filtering recommender systems , 2013 .

[43]  David A. McAllester,et al.  Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence , 2009, UAI 2009.

[44]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[45]  James Caverlee,et al.  TAPER: A Contextual Tensor-Based Approach for Personalized Expert Recommendation , 2016, RecSys.

[46]  Jiawei Han,et al.  Weakly-Supervised Hierarchical Text Classification , 2018, AAAI.

[47]  Alexander J. Smola,et al.  Neural Survival Recommender , 2017, WSDM.

[48]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[49]  Hanqing Lu,et al.  Personalized Recommendation Meets Your Next Favorite , 2015, CIKM.

[50]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[51]  Kai Hu,et al.  Purchase Behavior Prediction in M-Commerce with an Optimized Sampling Methods , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[52]  Andreas Hotho,et al.  Improving Session Recommendation with Recurrent Neural Networks by Exploiting Dwell Time , 2017, ArXiv.

[53]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[54]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[55]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[56]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[57]  Le Song,et al.  Recurrent Coevolutionary Latent Feature Processes for Continuous-Time Recommendation , 2016, DLRS@RecSys.

[58]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[59]  Lior Rokach,et al.  RecSys Challenge 2015 and the YOOCHOOSE Dataset , 2015, RecSys.

[60]  Gang Fu,et al.  Deep & Cross Network for Ad Click Predictions , 2017, ADKDD@KDD.