Deep Learning for Sequential Recommendation

In the field of sequential recommendation, deep learning (DL)-based methods have received a lot of attention in the past few years and surpassed traditional models such as Markov chain-based and factorization-based ones. However, there is little systematic study on DL-based methods, especially regarding to how to design an effective DL model for sequential recommendation. In this view, this survey focuses on DL-based sequential recommender systems by taking the aforementioned issues into consideration. Specifically,we illustrate the concept of sequential recommendation, propose a categorization of existing algorithms in terms of three types of behavioral sequence, summarize the key factors affecting the performance of DL-based models, and conduct corresponding evaluations to demonstrate the effects of these factors. We conclude this survey by systematically outlining future directions and challenges in this field.

[1]  Yoshua Bengio,et al.  A Neural Probabilistic Language Model , 2003, J. Mach. Learn. Res..

[2]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[3]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[4]  Bamshad Mobasher,et al.  Towards Trustworthy Recommender Systems : An Analysis of Attack Models and Algorithm Robustness , 2007 .

[5]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[6]  Vladimir Vapnik,et al.  A new learning paradigm: Learning using privileged information , 2009, Neural Networks.

[7]  Nava Tintarev,et al.  Rate it again: increasing recommendation accuracy by user re-rating , 2009, RecSys '09.

[8]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[9]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[10]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[11]  Yu He,et al.  The YouTube video recommendation system , 2010, RecSys '10.

[12]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[13]  Roberto Turrin,et al.  Cross-Domain Recommender Systems , 2015, Recommender Systems Handbook.

[14]  Lars Schmidt-Thieme,et al.  Multi-relational matrix factorization using bayesian personalized ranking for social network data , 2012, WSDM '12.

[15]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[16]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[17]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[18]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[19]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[20]  Sergei Vassilvitskii,et al.  The dynamics of repeat consumption , 2014, WWW.

[21]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[22]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[23]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[24]  Pengfei Wang,et al.  Learning Hierarchical Representation Model for NextBasket Recommendation , 2015, SIGIR.

[25]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[26]  Zhe Zhao,et al.  Improving User Topic Interest Profiles by Behavior Factorization , 2015, WWW.

[27]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[28]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[29]  Chen Fang,et al.  Vista: A Visually, Socially, and Temporally-aware Model for Artistic Recommendation , 2016, RecSys.

[30]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[31]  Dit-Yan Yeung,et al.  Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks , 2016, NIPS.

[32]  Mohan S. Kankanhalli,et al.  ConTagNet: Exploiting User Context for Image Tag Recommendation , 2016, ACM Multimedia.

[33]  Yi-Hsuan Yang,et al.  Neural Network Based Next-Song Recommendation , 2016, ArXiv.

[34]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[35]  Bartłomiej Twardowski,et al.  Modelling Contextual Information in Session-Aware Recommender Systems with Neural Networks , 2016, RecSys.

[36]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[37]  Andrew McCallum,et al.  Ask the GRU: Multi-task Learning for Deep Text Recommendations , 2016, RecSys.

[38]  Alexandros Karatzoglou,et al.  Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations , 2016, RecSys.

[39]  Oren Barkan,et al.  ITEM2VEC: Neural item embedding for collaborative filtering , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[40]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[41]  Liang Wang,et al.  Context-Aware Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[42]  Kai Chen,et al.  Collaborative Filtering and Deep Learning Based Hybrid Recommendation for Cold Start Problem , 2016, 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[43]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[44]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[45]  D. Jannach,et al.  On the Value of Reminders within E-Commerce Recommendations , 2016, UMAP.

[46]  Percy Liang,et al.  Understanding Black-box Predictions via Influence Functions , 2017, ICML.

[47]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[48]  Tsvi Kuflik,et al.  Incorporating Dwell Time in Session-Based Recommendations with Recurrent Neural Networks , 2017, RecTemp@RecSys.

[49]  Ayush Singhal,et al.  Use of Deep Learning in Modern Recommendation System: A Summary of Recent Works , 2017, ArXiv.

[50]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[51]  Liang Wang,et al.  Multi-Behavioral Sequential Prediction with Recurrent Log-Bilinear Model , 2016, IEEE Transactions on Knowledge and Data Engineering.

[52]  Helge Langseth,et al.  Inter-Session Modeling for Session-Based Recommendation , 2017, DLRS@RecSys.

[53]  Xing Xie,et al.  Sequential Transfer Learning: Cross-domain Novelty Seeking Trait Mining for Recommendation , 2017, WWW.

[54]  Jing Ma,et al.  Resolving data sparsity by multi-type auxiliary implicit feedback for recommender systems , 2017, Knowl. Based Syst..

[55]  Dietmar Jannach,et al.  When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation , 2017, RecSys.

[56]  Chen Liu,et al.  Modeling User Session and Intent with an Attention-based Encoder-Decoder Architecture , 2017, RecSys.

[57]  Andreas Hotho,et al.  Improving Session Recommendation with Recurrent Neural Networks by Exploiting Dwell Time , 2017, ArXiv.

[58]  Deborah Estrin,et al.  Yum-Me: A Personalized Nutrient-Based Meal Recommender System , 2016, ACM Trans. Inf. Syst..

[59]  Jürgen Ziegler,et al.  Sequential User-based Recurrent Neural Network Recommendations , 2017, RecSys.

[60]  Tu Minh Phuong,et al.  3D Convolutional Networks for Session-based Recommendation with Content Features , 2017, RecSys.

[61]  Elena Smirnova,et al.  Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks , 2017, DLRS@RecSys.

[62]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[63]  Lior Rokach,et al.  Session-Based Recommendations Using Item Embedding , 2017, IUI.

[64]  Hugues Bersini,et al.  Long and Short-Term Recommendations with Recurrent Neural Networks , 2017, UMAP.

[65]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[66]  Xuanjing Huang,et al.  Hashtag Recommendation for Multimodal Microblog Using Co-Attention Network , 2017, IJCAI.

[67]  Scott Sanner,et al.  Deep Sequential Recommendation for Personalized Adaptive User Interfaces , 2017, IUI.

[68]  Julian J. McAuley,et al.  Translation-based Recommendation , 2017, RecSys.

[69]  Lars Schmidt-Thieme,et al.  Personalized Deep Learning for Tag Recommendation , 2017, PAKDD.

[70]  Luo Si,et al.  Session-aware Information Embedding for E-commerce Product Recommendation , 2017, CIKM.

[71]  Vikram Pudi,et al.  Attentive neural architecture incorporating song features for music recommendation , 2018, RecSys.

[72]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[73]  Hui Xiong,et al.  Sequential Recommender System based on Hierarchical Attention Networks , 2018, IJCAI.

[74]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[75]  Cihan Kaleli,et al.  A review on deep learning for recommender systems: challenges and remedies , 2018, Artificial Intelligence Review.

[76]  S. C. Hui,et al.  Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking , 2017, WWW.

[77]  Shun-Yao Shih,et al.  Automatic, Personalized, and Flexible Playlist Generation using Reinforcement Learning , 2018, ISMIR.

[78]  Enhong Chen,et al.  Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviors , 2018, KDD.

[79]  Xing Shi,et al.  A Sequential Embedding Approach for Item Recommendation with Heterogeneous Attributes , 2018, ArXiv.

[80]  Longbing Cao,et al.  Attention-Based Transactional Context Embedding for Next-Item Recommendation , 2018, AAAI.

[81]  Panagiotis Symeonidis,et al.  Session-based News Recommendations , 2018, WWW.

[82]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[83]  Apostol Natsev,et al.  Collaborative Deep Metric Learning for Video Understanding , 2018, KDD.

[84]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[85]  Homanga Bharadhwaj,et al.  Explanations for Temporal Recommendations , 2018, KI - Künstliche Intelligenz.

[86]  Dietmar Jannach,et al.  Evaluation of session-based recommendation algorithms , 2018, User Modeling and User-Adapted Interaction.

[87]  Jie Liu,et al.  Representing and Recommending Shopping Baskets with Complementarity, Compatibility and Loyalty , 2018, CIKM.

[88]  Xiaoyu Du,et al.  Adversarial Personalized Ranking for Recommendation , 2018, SIGIR.

[89]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[90]  Cong Xu,et al.  The Graph-based Broad Behavior-Aware Recommendation System for Interactive News , 2018, ArXiv.

[91]  Wojciech Samek,et al.  Methods for interpreting and understanding deep neural networks , 2017, Digit. Signal Process..

[92]  Tat-Seng Chua,et al.  Improving Implicit Recommender Systems with View Data , 2018, IJCAI.

[93]  Yuan Fang,et al.  Modeling Contemporaneous Basket Sequences with Twin Networks for Next-Item Recommendation , 2018, IJCAI.

[94]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[95]  Yun Liu,et al.  BPRH: Bayesian personalized ranking for heterogeneous implicit feedback , 2018, Inf. Sci..

[96]  Changsheng Xu,et al.  CSAN: Contextual Self-Attention Network for User Sequential Recommendation , 2018, ACM Multimedia.

[97]  Jun Wang,et al.  Explanation Mining: Post Hoc Interpretability of Latent Factor Models for Recommendation Systems , 2018, KDD.

[98]  Jae-Gil Lee,et al.  Augmenting Recurrent Neural Networks with High-Order User-Contextual Preference for Session-Based Recommendation , 2018, ArXiv.

[99]  Ji-Rong Wen,et al.  An Attribute-aware Neural Attentive Model for Next Basket Recommendation , 2018, SIGIR.

[100]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[101]  Peng Jiang,et al.  Modeling Consumer Buying Decision for Recommendation Based on Multi-Task Deep Learning , 2018, CIKM.

[102]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[103]  Quan Z. Sheng,et al.  Modeling Multi-Purpose Sessions for Next-Item Recommendations via Mixture-Channel Purpose Routing Networks , 2019, IJCAI.

[104]  Xiangliang Zhang,et al.  Multi-Order Attentive Ranking Model for Sequential Recommendation , 2019, AAAI.

[105]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[106]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[107]  Pengfei Wang,et al.  Unified Collaborative Filtering over Graph Embeddings , 2019, SIGIR.

[108]  Xu Chen,et al.  Adversarial Distillation for Efficient Recommendation with External Knowledge , 2018, ACM Trans. Inf. Syst..

[109]  Zemei Dai,et al.  Self-Attention Network for Session-Based Recommendation With Streaming Data Input , 2019, IEEE Access.

[110]  Fei Sun,et al.  SDM: Sequential Deep Matching Model for Online Large-scale Recommender System , 2019, CIKM.

[111]  Mingge Zhang,et al.  GACOforRec: Session-Based Graph Convolutional Neural Networks Recommendation Model , 2019, IEEE Access.

[112]  Joemon M. Jose,et al.  A Simple Convolutional Generative Network for Next Item Recommendation , 2018, WSDM.

[113]  Qing Guo,et al.  Research Commentary on Recommendations with Side Information: A Survey and Research Directions , 2019, Electron. Commer. Res. Appl..

[114]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[115]  Xiaowei Wang,et al.  Sequential Scenario-Specific Meta Learner for Online Recommendation , 2019, KDD.

[116]  Chen Ma,et al.  Hierarchical Gating Networks for Sequential Recommendation , 2019, KDD.

[117]  Yong Ge,et al.  Binarized Collaborative Filtering with Distilling Graph Convolutional Networks , 2019, IJCAI.

[118]  Jian Tang,et al.  Session-Based Social Recommendation via Dynamic Graph Attention Networks , 2019, WSDM.

[119]  Lei Zheng,et al.  Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction , 2019, SIGIR.

[120]  Jure Leskovec,et al.  Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systems , 2019, WWW.

[121]  Yiqun Liu,et al.  Modeling Item-Specific Temporal Dynamics of Repeat Consumption for Recommender Systems , 2019, WWW.

[122]  Dietmar Jannach,et al.  Are we really making much progress? A worrying analysis of recent neural recommendation approaches , 2019, RecSys.

[123]  Vikram Pudi,et al.  Sequential Variational Autoencoders for Collaborative Filtering , 2018, WSDM.

[124]  Lina Yao,et al.  Adversarial Collaborative Neural Network for Robust Recommendation , 2019, SIGIR.

[125]  M. de Rijke,et al.  RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendation , 2018, AAAI.

[126]  Quan Z. Sheng,et al.  Sequential Recommender Systems: Challenges, Progress and Prospects , 2019, IJCAI.

[127]  Guihai Chen,et al.  Dual Sequential Prediction Models Linking Sequential Recommendation and Information Dissemination , 2019, KDD.

[128]  Vipin Kumar,et al.  Towards Robust and Discriminative Sequential Data Learning: When and How to Perform Adversarial Training? , 2019, KDD.

[129]  M. de Rijke,et al.  Improving End-to-End Sequential Recommendations with Intent-aware Diversification , 2019, CIKM.

[130]  D. Tao,et al.  Distilling Knowledge From Graph Convolutional Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[131]  G. Guo,et al.  Future Data Helps Training: Modeling Future Contexts for Session-based Recommendation , 2019, WWW.

[132]  Xiangnan He,et al.  How to Retrain Recommender System?: A Sequential Meta-Learning Method , 2020, SIGIR.

[133]  Xu Chen,et al.  Explainable Recommendation: A Survey and New Perspectives , 2018, Found. Trends Inf. Retr..

[134]  Lionel M. Ni,et al.  Generalizing from a Few Examples , 2020, ACM Comput. Surv..

[135]  Chang Zhou,et al.  Understanding Negative Sampling in Graph Representation Learning , 2020, KDD.

[136]  Jie Yang,et al.  Are We Evaluating Rigorously? Benchmarking Recommendation for Reproducible Evaluation and Fair Comparison , 2020, RecSys.

[137]  Yanghua Xiao,et al.  Incorporating User Micro-behaviors and Item Knowledge into Multi-task Learning for Session-based Recommendation , 2020, SIGIR.

[138]  Yujie Wang,et al.  Time Interval Aware Self-Attention for Sequential Recommendation , 2020, WSDM.

[139]  Yixin Cao,et al.  Reinforced Negative Sampling over Knowledge Graph for Recommendation , 2020, WWW.

[140]  Xiangnan He,et al.  Modeling Personalized Item Frequency Information for Next-basket Recommendation , 2020, SIGIR.

[141]  Wei Wei,et al.  Global Context Enhanced Graph Neural Networks for Session-based Recommendation , 2020, SIGIR.

[142]  Qi Tian,et al.  Adversarial Training Towards Robust Multimedia Recommender System , 2018, IEEE Transactions on Knowledge and Data Engineering.

[143]  Min Yang,et al.  Leveraging Long and Short-Term Information in Content-Aware Movie Recommendation via Adversarial Training , 2017, IEEE Transactions on Cybernetics.

[144]  Shinichi Nakajima,et al.  XAI for Graphs: Explaining Graph Neural Network Predictions by Identifying Relevant Walks , 2020, ArXiv.

[145]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[146]  Chen Gao,et al.  Learning to Recommend With Multiple Cascading Behaviors , 2018, IEEE Transactions on Knowledge and Data Engineering.

[147]  Tat-Seng Chua,et al.  Denoising Implicit Feedback for Recommendation , 2020, WSDM.

[148]  Naren Ramakrishnan,et al.  Neural Abstractive Text Summarization with Sequence-to-Sequence Models , 2018, Trans. Data Sci..

[149]  Hui Li,et al.  Multi-Task Learning for Recommendation Over Heterogeneous Information Network , 2020, IEEE Transactions on Knowledge and Data Engineering.

[150]  Quan Z. Sheng,et al.  A Survey on Session-based Recommender Systems , 2019, ArXiv.