Deep Learning for Sequential Recommendation

In the field of sequential recommendation, deep learning--(DL) based methods have received a lot of attention in the past few years and surpassed traditional models such as Markov chain-based and factorization-based ones. However, there is little systematic study on DL-based methods, especially regarding how to design an effective DL model for sequential recommendation. In this view, this survey focuses on DL-based sequential recommender systems by taking the aforementioned issues into consideration. Specifically, we illustrate the concept of sequential recommendation, propose a categorization of existing algorithms in terms of three types of behavioral sequences, summarize the key factors affecting the performance of DL-based models, and conduct corresponding evaluations to showcase and demonstrate the effects of these factors. We conclude this survey by systematically outlining future directions and challenges in this field.

[1]  Peng Jiang,et al.  Modeling Consumer Buying Decision for Recommendation Based on Multi-Task Deep Learning , 2018, CIKM.

[2]  Sergei Vassilvitskii,et al.  The dynamics of repeat consumption , 2014, WWW.

[3]  Liang Wang,et al.  Context-Aware Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[4]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[5]  Joemon M. Jose,et al.  A Simple Convolutional Generative Network for Next Item Recommendation , 2018, WSDM.

[6]  Dietmar Jannach,et al.  Are we really making much progress? A worrying analysis of recent neural recommendation approaches , 2019, RecSys.

[7]  Deborah Estrin,et al.  Yum-Me: A Personalized Nutrient-Based Meal Recommender System , 2016, ACM Trans. Inf. Syst..

[8]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[9]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[10]  Xing Xie,et al.  Sequential Transfer Learning: Cross-domain Novelty Seeking Trait Mining for Recommendation , 2017, WWW.

[11]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[12]  Pengfei Wang,et al.  Unified Collaborative Filtering over Graph Embeddings , 2019, SIGIR.

[13]  Shun-Yao Shih,et al.  Automatic, Personalized, and Flexible Playlist Generation using Reinforcement Learning , 2018, ISMIR.

[14]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[15]  Mingge Zhang,et al.  GACOforRec: Session-Based Graph Convolutional Neural Networks Recommendation Model , 2019, IEEE Access.

[16]  Andrew McCallum,et al.  Ask the GRU: Multi-task Learning for Deep Text Recommendations , 2016, RecSys.

[17]  Chang Zhou,et al.  Understanding Negative Sampling in Graph Representation Learning , 2020, KDD.

[18]  Naren Ramakrishnan,et al.  Neural Abstractive Text Summarization with Sequence-to-Sequence Models , 2018, Trans. Data Sci..

[19]  Yi Tay,et al.  Deep Learning based Recommender System: A Survey and New Perspectives , 2018 .

[20]  James T. Kwok,et al.  Generalizing from a Few Examples , 2019, ACM Comput. Surv..

[21]  Roberto Turrin,et al.  Cross-Domain Recommender Systems , 2015, Recommender Systems Handbook.

[22]  D. Jannach,et al.  On the Value of Reminders within E-Commerce Recommendations , 2016, UMAP.

[23]  Changsheng Xu,et al.  CSAN: Contextual Self-Attention Network for User Sequential Recommendation , 2018, ACM Multimedia.

[24]  Vladimir Vapnik,et al.  A new learning paradigm: Learning using privileged information , 2009, Neural Networks.

[25]  Yong Ge,et al.  Binarized Collaborative Filtering with Distilling Graph Convolutional Networks , 2019, IJCAI.

[26]  Martha Larson,et al.  Bayesian Personalized Ranking with Multi-Channel User Feedback , 2016, RecSys.

[27]  Tat-Seng Chua,et al.  Improving Implicit Recommender Systems with View Data , 2018, IJCAI.

[28]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[29]  Ayush Singhal,et al.  Use of Deep Learning in Modern Recommendation System: A Summary of Recent Works , 2017, ArXiv.

[30]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[31]  Chen Gao,et al.  Learning to Recommend With Multiple Cascading Behaviors , 2018, IEEE Transactions on Knowledge and Data Engineering.

[32]  Alex Lobzhanidze,et al.  Buy It Again: Modeling Repeat Purchase Recommendations , 2018, KDD.

[33]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[34]  Xing Shi,et al.  A Sequential Embedding Approach for Item Recommendation with Heterogeneous Attributes , 2018, ArXiv.

[35]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[36]  Apostol Natsev,et al.  Collaborative Deep Metric Learning for Video Understanding , 2018, KDD.

[37]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[38]  Cihan Kaleli,et al.  A review on deep learning for recommender systems: challenges and remedies , 2018, Artificial Intelligence Review.

[39]  Pengfei Wang,et al.  Learning Hierarchical Representation Model for NextBasket Recommendation , 2015, SIGIR.

[40]  Vikram Pudi,et al.  Attentive neural architecture incorporating song features for music recommendation , 2018, RecSys.

[41]  Hui Li,et al.  Multi-Task Learning for Recommendation Over Heterogeneous Information Network , 2020, IEEE Transactions on Knowledge and Data Engineering.

[42]  Deborah Estrin,et al.  Collaborative Metric Learning , 2017, WWW.

[43]  M. de Rijke,et al.  π-Net: A Parallel Information-sharing Network for Shared-account Cross-domain Sequential Recommendations , 2019, SIGIR.

[44]  Xiaowei Wang,et al.  Sequential Scenario-Specific Meta Learner for Online Recommendation , 2019, KDD.

[45]  Wojciech Samek,et al.  Methods for interpreting and understanding deep neural networks , 2017, Digit. Signal Process..

[46]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[47]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[48]  Lars Schmidt-Thieme,et al.  Personalized Deep Learning for Tag Recommendation , 2017, PAKDD.

[49]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[50]  Jing Ma,et al.  Resolving data sparsity by multi-type auxiliary implicit feedback for recommender systems , 2017, Knowl. Based Syst..

[51]  Lina Yao,et al.  Next Item Recommendation with Self-Attentive Metric Learning , 2018 .

[52]  Pengfei Wang,et al.  Next Basket Recommendation with Neural Networks , 2015, RecSys Posters.

[53]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[54]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[55]  Xiangnan He,et al.  How to Retrain Recommender System?: A Sequential Meta-Learning Method , 2020, SIGIR.

[56]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[57]  Dietmar Jannach,et al.  Evaluation of session-based recommendation algorithms , 2018, User Modeling and User-Adapted Interaction.

[58]  Dacheng Tao,et al.  Distilling Knowledge From Graph Convolutional Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Edward Y. Chang,et al.  Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks , 2018, SIGIR.

[60]  Xu Chen,et al.  Explainable Recommendation: A Survey and New Perspectives , 2018, Found. Trends Inf. Retr..

[61]  Lina Yao,et al.  Adversarial Collaborative Neural Network for Robust Recommendation , 2019, SIGIR.

[62]  Xiangliang Zhang,et al.  Multi-Order Attentive Ranking Model for Sequential Recommendation , 2019, AAAI.

[63]  Hugues Bersini,et al.  Long and Short-Term Recommendations with Recurrent Neural Networks , 2017, UMAP.

[64]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[65]  Xiaoyu Du,et al.  Adversarial Personalized Ranking for Recommendation , 2018, SIGIR.

[66]  Min Yang,et al.  Leveraging Long and Short-Term Information in Content-Aware Movie Recommendation via Adversarial Training , 2017, IEEE Transactions on Cybernetics.

[67]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[68]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[69]  Tsvi Kuflik,et al.  Incorporating Dwell Time in Session-Based Recommendations with Recurrent Neural Networks , 2017, RecTemp@RecSys.

[70]  Wei Wei,et al.  Global Context Enhanced Graph Neural Networks for Session-based Recommendation , 2020, SIGIR.

[71]  Cong Xu,et al.  The Graph-based Broad Behavior-Aware Recommendation System for Interactive News , 2018, ArXiv.

[72]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[73]  Quan Z. Sheng,et al.  A Survey on Session-based Recommender Systems , 2019, ArXiv.

[74]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[75]  Elena Smirnova,et al.  Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks , 2017, DLRS@RecSys.

[76]  Yu He,et al.  The YouTube video recommendation system , 2010, RecSys '10.

[77]  Jae-Gil Lee,et al.  Augmenting Recurrent Neural Networks with High-Order User-Contextual Preference for Session-Based Recommendation , 2018, ArXiv.

[78]  Xiangnan He,et al.  Future Data Helps Training: Modeling Future Contexts for Session-based Recommendation , 2020, WWW.

[79]  Helge Langseth,et al.  Inter-Session Modeling for Session-Based Recommendation , 2017, DLRS@RecSys.

[80]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[81]  Luo Si,et al.  Session-aware Information Embedding for E-commerce Product Recommendation , 2017, CIKM.

[82]  Yanghua Xiao,et al.  Incorporating User Micro-behaviors and Item Knowledge into Multi-task Learning for Session-based Recommendation , 2020, SIGIR.

[83]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[84]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[85]  Vikram Pudi,et al.  Sequential Variational Autoencoders for Collaborative Filtering , 2018, WSDM.

[86]  Dit-Yan Yeung,et al.  Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks , 2016, NIPS.

[87]  Julian J. McAuley,et al.  Translation-based Recommendation , 2017, RecSys.

[88]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[89]  Oren Barkan,et al.  ITEM2VEC: Neural item embedding for collaborative filtering , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[90]  Hui Xiong,et al.  Sequential Recommender System based on Hierarchical Attention Networks , 2018, IJCAI.

[91]  Quan Z. Sheng,et al.  Modeling Multi-Purpose Sessions for Next-Item Recommendations via Mixture-Channel Purpose Routing Networks , 2019, IJCAI.

[92]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[93]  Mohan S. Kankanhalli,et al.  ConTagNet: Exploiting User Context for Image Tag Recommendation , 2016, ACM Multimedia.

[94]  Xiangnan He,et al.  Modeling Personalized Item Frequency Information for Next-basket Recommendation , 2020, SIGIR.

[95]  Zhe Zhao,et al.  Improving User Topic Interest Profiles by Behavior Factorization , 2015, WWW.

[96]  Homanga Bharadhwaj,et al.  Explanations for Temporal Recommendations , 2018, KI - Künstliche Intelligenz.

[97]  Yujie Wang,et al.  Time Interval Aware Self-Attention for Sequential Recommendation , 2020, WSDM.

[98]  Percy Liang,et al.  Understanding Black-box Predictions via Influence Functions , 2017, ICML.

[99]  S. C. Hui,et al.  Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking , 2017, WWW.

[100]  Jie Yang,et al.  Are We Evaluating Rigorously? Benchmarking Recommendation for Reproducible Evaluation and Fair Comparison , 2020, RecSys.

[101]  Longbing Cao,et al.  Attention-Based Transactional Context Embedding for Next-Item Recommendation , 2018, AAAI.

[102]  Vipin Kumar,et al.  Towards Robust and Discriminative Sequential Data Learning: When and How to Perform Adversarial Training? , 2019, KDD.

[103]  Alexandros Karatzoglou,et al.  Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations , 2016, RecSys.

[104]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[105]  Quan Z. Sheng,et al.  Sequential Recommender Systems: Challenges, Progress and Prospects , 2019, IJCAI.

[106]  Shinichi Nakajima,et al.  XAI for Graphs: Explaining Graph Neural Network Predictions by Identifying Relevant Walks , 2020, ArXiv.

[107]  Lior Rokach,et al.  Session-Based Recommendations Using Item Embedding , 2017, IUI.

[108]  Chen Fang,et al.  Vista: A Visually, Socially, and Temporally-aware Model for Artistic Recommendation , 2016, RecSys.

[109]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[110]  Liang Wang,et al.  Multi-Behavioral Sequential Prediction with Recurrent Log-Bilinear Model , 2016, IEEE Transactions on Knowledge and Data Engineering.

[111]  Guihai Chen,et al.  Dual Sequential Prediction Models Linking Sequential Recommendation and Information Dissemination , 2019, KDD.

[112]  Jürgen Ziegler,et al.  Sequential User-based Recurrent Neural Network Recommendations , 2017, RecSys.

[113]  Chen Ma,et al.  Hierarchical Gating Networks for Sequential Recommendation , 2019, KDD.

[114]  Scott Sanner,et al.  Deep Sequential Recommendation for Personalized Adaptive User Interfaces , 2017, IUI.

[115]  Nava Tintarev,et al.  Rate it again: increasing recommendation accuracy by user re-rating , 2009, RecSys '09.

[116]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[117]  Panagiotis Symeonidis,et al.  Session-based News Recommendations , 2018, WWW.

[118]  Yixin Cao,et al.  Reinforced Negative Sampling over Knowledge Graph for Recommendation , 2020, WWW.

[119]  Chen Liu,et al.  Modeling User Session and Intent with an Attention-based Encoder-Decoder Architecture , 2017, RecSys.

[120]  Jure Leskovec,et al.  Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systems , 2019, WWW.

[121]  M. de Rijke,et al.  Improving End-to-End Sequential Recommendations with Intent-aware Diversification , 2019, CIKM.

[122]  Tu Minh Phuong,et al.  3D Convolutional Networks for Session-based Recommendation with Content Features , 2017, RecSys.

[123]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[124]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[125]  Jie Liu,et al.  Representing and Recommending Shopping Baskets with Complementarity, Compatibility and Loyalty , 2018, CIKM.

[126]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[127]  Qi Tian,et al.  Adversarial Training Towards Robust Multimedia Recommender System , 2018, IEEE Transactions on Knowledge and Data Engineering.

[128]  Ji-Rong Wen,et al.  An Attribute-aware Neural Attentive Model for Next Basket Recommendation , 2018, SIGIR.

[129]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[130]  Bamshad Mobasher,et al.  Towards Trustworthy Recommender Systems : An Analysis of Attack Models and Algorithm Robustness , 2007 .

[131]  Zemei Dai,et al.  Self-Attention Network for Session-Based Recommendation With Streaming Data Input , 2019, IEEE Access.

[132]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[133]  M. de Rijke,et al.  RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendation , 2018, AAAI.

[134]  Yiqun Liu,et al.  Modeling Item-Specific Temporal Dynamics of Repeat Consumption for Recommender Systems , 2019, WWW.

[135]  Wilfred Ng,et al.  SDM: Sequential Deep Matching Model for Online Large-scale Recommender System , 2019, CIKM.

[136]  Jian Tang,et al.  Session-Based Social Recommendation via Dynamic Graph Attention Networks , 2019, WSDM.

[137]  Enhong Chen,et al.  Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviors , 2018, KDD.

[138]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[139]  Yuan Fang,et al.  Modeling Contemporaneous Basket Sequences with Twin Networks for Next-Item Recommendation , 2018, IJCAI.

[140]  Yinhao Li,et al.  Orchestrating the Development Lifecycle of Machine Learning-based IoT Applications , 2019, ACM Comput. Surv..

[141]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[142]  Andreas Hotho,et al.  Improving Session Recommendation with Recurrent Neural Networks by Exploiting Dwell Time , 2017, ArXiv.

[143]  Lars Schmidt-Thieme,et al.  Multi-relational matrix factorization using bayesian personalized ranking for social network data , 2012, WSDM '12.

[144]  Yun Liu,et al.  BPRH: Bayesian personalized ranking for heterogeneous implicit feedback , 2018, Inf. Sci..

[145]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[146]  Lei Zheng,et al.  Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction , 2019, SIGIR.

[147]  Kai Chen,et al.  Collaborative Filtering and Deep Learning Based Hybrid Recommendation for Cold Start Problem , 2016, 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[148]  Dietmar Jannach,et al.  When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation , 2017, RecSys.

[149]  Jun Wang,et al.  Explanation Mining: Post Hoc Interpretability of Latent Factor Models for Recommendation Systems , 2018, KDD.

[150]  Qing Guo,et al.  Research Commentary on Recommendations with Side Information: A Survey and Research Directions , 2019, Electron. Commer. Res. Appl..

[151]  Bartłomiej Twardowski,et al.  Modelling Contextual Information in Session-Aware Recommender Systems with Neural Networks , 2016, RecSys.

[152]  Xu Chen,et al.  Adversarial Distillation for Efficient Recommendation with External Knowledge , 2018, ACM Trans. Inf. Syst..

[153]  Xuanjing Huang,et al.  Hashtag Recommendation for Multimodal Microblog Using Co-Attention Network , 2017, IJCAI.