An Attention-Based Recommender System to Predict Contextual Intent Based on Choice Histories across and within Sessions

Recent years have witnessed the growth of recommender systems, with the help of deep learning techniques. Recurrent Neural Networks (RNNs) play an increasingly vital role in various session-based recommender systems, since they use the user’s sequential history to build a comprehensive user profile, which helps improve the recommendation. However, a problem arises regarding how to be aware of the variation in the user’s contextual preference, especially the short-term intent in the near future, and make the best use of it to produce a precise recommendation at the start of a session. We propose a novel approach named Attention-based Short-term and Long-term Model (ASLM), to improve the next-item recommendation, by using an attention-based RNNs integrating both the user’s short-term intent and the long-term preference at the same time with a two-layer network. The experimental study on three real-world datasets and two sub-datasets demonstrates that, compared with other state-of-the-art methods, the proposed approach can significantly improve the next-item recommendation, especially at the start of sessions. As a result, our proposed approach is capable of coping with the cold-start problem at the beginning of each session.

[1]  Fernando Ortega,et al.  A framework for collaborative filtering recommender systems , 2011, Expert Syst. Appl..

[2]  Kin Keung Lai,et al.  A Neural Network and Web-Based Decision Support System for Forex Forecasting and Trading , 2004, CASDMKM.

[3]  Tassos Tagaris,et al.  CxCaDSS: A Web-Based Clinical Decision Support System for Cervical Cancer , 2015 .

[4]  Stefan Feuerriegel,et al.  Decision support from financial disclosures with deep neural networks and transfer learning , 2017, Decis. Support Syst..

[5]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[6]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[7]  Jesús Bobadilla,et al.  The Effect of Sparsity on Collaborative Filtering Metrics , 2009, ADC.

[8]  Siu Cheung Hui,et al.  Multi-Pointer Co-Attention Networks for Recommendation , 2018, KDD.

[9]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[10]  Fernando Ortega,et al.  A collaborative filtering approach to mitigate the new user cold start problem , 2012, Knowl. Based Syst..

[11]  Anand Paul,et al.  Deep Learning Innovations and Their Convergence With Big Data , 2017 .

[12]  David Maxwell Chickering,et al.  Using Temporal Data for Making Recommendations , 2001, UAI.

[13]  Boi Faltings,et al.  Offline and online evaluation of news recommender systems at swissinfo.ch , 2014, RecSys '14.

[14]  George Forman,et al.  A Live Comparison of Methods for Personalized Article Recommendation at Forbes.com , 2012, ECML/PKDD.

[15]  Longbing Cao,et al.  Attention-Based Transactional Context Embedding for Next-Item Recommendation , 2018, AAAI.

[16]  Tie-Yan Liu,et al.  Word-Entity Duet Representations for Document Ranking , 2017, SIGIR.

[17]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[18]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[19]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[20]  Alexander J. Smola,et al.  Neural Survival Recommender , 2017, WSDM.

[21]  Abdulmotaleb El-Saddik,et al.  Collaborative error-reflected models for cold-start recommender systems , 2011, Decis. Support Syst..

[22]  Hugues Bersini,et al.  Collaborative Filtering with Recurrent Neural Networks , 2016, ArXiv.

[23]  Arun Kumar Sangaiah,et al.  TRSDL: Tag-Aware Recommender System Based on Deep Learning–Intelligent Computing Systems , 2018 .

[24]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[25]  Dietmar Jannach,et al.  When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation , 2017, RecSys.

[26]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[27]  D. Jannach,et al.  On the Value of Reminders within E-Commerce Recommendations , 2016, UMAP.

[28]  Guandong Xu,et al.  Diversifying Personalized Recommendation with User-session Context , 2017, IJCAI.

[29]  Qingsheng Zhu,et al.  Incremental Collaborative Filtering recommender based on Regularized Matrix Factorization , 2012, Knowl. Based Syst..

[30]  Tao Luo,et al.  Using sequential and non-sequential patterns in predictive Web usage mining tasks , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[31]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[32]  Dietmar Jannach,et al.  Evaluation of session-based recommendation algorithms , 2018, User Modeling and User-Adapted Interaction.

[33]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[34]  Dan Frankowski,et al.  Collaborative Filtering Recommender Systems , 2007, The Adaptive Web.

[35]  Mohan S. Kankanhalli,et al.  A^3NCF: An Adaptive Aspect Attention Model for Rating Prediction , 2018, IJCAI.

[36]  CARLOS A. GOMEZ-URIBE,et al.  The Netflix Recommender System , 2015, ACM Trans. Manag. Inf. Syst..

[37]  Helge Langseth,et al.  Inter-Session Modeling for Session-Based Recommendation , 2017, DLRS@RecSys.

[38]  Thorsten Joachims,et al.  Taste Over Time: The Temporal Dynamics of User Preferences , 2013, ISMIR.

[39]  Dietmar Jannach,et al.  A case study on the effectiveness of recommendations in the mobile internet , 2009, RecSys '09.

[40]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[41]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[42]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[43]  Yan Wang,et al.  Recurrent Collaborative Filtering for Unifying General and Sequential Recommender , 2018, IJCAI.

[44]  Sang-goo Lee,et al.  Session-Based Collaborative Filtering for Predicting the Next Song , 2011, 2011 First ACIS/JNU International Conference on Computers, Networks, Systems and Industrial Engineering.

[45]  Franca Garzotto,et al.  Investigating the Persuasion Potential of Recommender Systems from a Quality Perspective: An Empirical Study , 2012, TIIS.

[46]  Tat-Seng Chua,et al.  SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[48]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[49]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[50]  Edmundas Kazimieras Zavadskas,et al.  Multiple criteria decision support web‐based system for building refurbishment , 2004 .

[51]  Tat-Seng Chua,et al.  Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks , 2017, IJCAI.