Improving End-to-End Sequential Recommendations with Intent-aware Diversification

Sequential recommenders that capture users' dynamic intents by modeling sequential behavior, are able to accurately recommend items to users. Previous studies on sequential recommendations (SRs) mostly focus on optimizing the recommendation accuracy, thus ignoring the diversity of recommended items. Many existing methods for improving the diversity of recommended items are not applicable to SRs because they assume that user intents are static and rely on post-processing the list of recommended items to promote diversity. We consider both accuracy and diversity by reformulating SRs as a list generation task, and propose an integrated approach with an end-to-end neural model, called intent-aware diversified sequential recommendation (IDSR). Specifically, we introduce an implicit intent mining (IIM) module for SR to capture multiple user intents reflected in sequences of user behavior. We design an intent-aware diversity promoting (IDP) loss function to supervise the learning of the IIM module and guide the model to take diversity into account during training. Extensive experiments on four datasets show that IDSR significantly outperforms state-of-the-art methods in terms of recommendation diversity while yielding comparable or superior recommendation accuracy.

[1]  Hui Xiong,et al.  Sequential Recommender System based on Hierarchical Attention Networks , 2018, IJCAI.

[2]  Quan Z. Sheng,et al.  Modeling Multi-Purpose Sessions for Next-Item Recommendations via Mixture-Channel Purpose Routing Networks , 2019, IJCAI.

[3]  Mi Zhang,et al.  Avoiding monotony: improving the diversity of recommendation lists , 2008, RecSys '08.

[4]  Junyu Niu,et al.  A Framework for Recommending Relevant and Diverse Items , 2016, IJCAI.

[5]  Qiao Liu,et al.  STAMP: Short-Term Attention/Memory Priority Model for Session-based Recommendation , 2018, KDD.

[6]  Qiong Wu,et al.  Recent Advances in Diversified Recommendation , 2019, ArXiv.

[7]  Vaibhav Rajan,et al.  Context-Aware Sequential Recommendations withStacked Recurrent Neural Networks , 2019, WWW.

[8]  Xiangnan He,et al.  NAIS: Neural Attentive Item Similarity Model for Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[9]  Kwangseob Kim,et al.  Sequential and Diverse Recommendation with Long Tail , 2019, IJCAI.

[10]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[11]  Jade Goldstein-Stewart,et al.  The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries , 1998, SIGIR Forum.

[12]  Paolo Tomeo,et al.  Adaptive multi-attribute diversity for recommender systems , 2017, Inf. Sci..

[13]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[14]  Farooq Ahmad,et al.  A survey on search results diversification techniques , 2015, Neural Computing and Applications.

[15]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[18]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[19]  Zheng Wen,et al.  Optimal Greedy Diversity for Recommendation , 2015, IJCAI.

[20]  M. de Rijke,et al.  RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendation , 2018, AAAI.

[21]  M. de Rijke,et al.  A Collaborative Session-based Recommendation Approach with Parallel Memory Modules , 2019, SIGIR.

[22]  Xiao Zhang,et al.  Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy , 2016, Pattern Recognit..

[23]  Laming Chen,et al.  Fast Greedy MAP Inference for Determinantal Point Process to Improve Recommendation Diversity , 2017, NeurIPS.

[24]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[25]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[26]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[27]  Dietmar Jannach Keynote: Session-Based Recommendation - Challenges and Recent Advances , 2018, KI.

[28]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[29]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[30]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[31]  Craig MacDonald,et al.  Explicit Diversification of Event Aspects for Temporal Summarization , 2018, TOIS.

[32]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[33]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[34]  Sotirios Chatzis,et al.  Recurrent Latent Variable Networks for Session-Based Recommendation , 2017, DLRS@RecSys.

[35]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[36]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[37]  Matevz Kunaver,et al.  Diversity in recommender systems - A survey , 2017, Knowl. Based Syst..

[38]  Bernabe Batchakui,et al.  Deep Learning Methods on Recommender System: A Survey of State-of-the-art , 2017 .

[39]  Hui Xiong,et al.  Learning to Recommend Accurate and Diverse Items , 2017, WWW.

[40]  Cheng-Te Li,et al.  Identifying Users behind Shared Accounts in Online Streaming Services , 2018, SIGIR.

[41]  ChenDegang,et al.  Feature selection in mixed data , 2016 .

[42]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[43]  Sreenivas Gollapudi,et al.  Diversifying search results , 2009, WSDM '09.

[44]  Ben Taskar,et al.  Determinantal Point Processes for Machine Learning , 2012, Found. Trends Mach. Learn..

[45]  Julian J. McAuley,et al.  Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[46]  David Maxwell Chickering,et al.  Using Temporal Data for Making Recommendations , 2001, UAI.

[47]  Ting Yu,et al.  Recommendation with diversity: An adaptive trust-aware model , 2019, Decis. Support Syst..

[48]  Hui Xiong,et al.  Recurrent Convolutional Neural Network for Sequential Recommendation , 2019, WWW.

[49]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[50]  M. de Rijke,et al.  π-Net: A Parallel Information-sharing Network for Shared-account Cross-domain Sequential Recommendations , 2019, SIGIR.

[51]  M. de Rijke,et al.  Search Result Diversification in Short Text Streams , 2017, ACM Trans. Inf. Syst..

[52]  Feng Yu,et al.  A Dynamic Recurrent Model for Next Basket Recommendation , 2016, SIGIR.

[53]  Xiaoyan Zhu,et al.  Promoting Diversity in Recommendation by Entropy Regularizer , 2013, IJCAI.

[54]  Jian Li,et al.  Multi-Head Attention with Disagreement Regularization , 2018, EMNLP.

[55]  Ling Shao,et al.  Extracting Privileged Information for Enhancing Classifier Learning , 2019, IEEE Transactions on Image Processing.