Diversified Interactive Recommendation with Implicit Feedback

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attention. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually ignore the diversity of the recommendation results, thus usually results in unsatisfying user experiences. In this paper, we propose a novel diversified recommendation model, named Diversified Contextual Combinatorial Bandit (DC2B), for interactive recommendation with users' implicit feedback. Specifically, DC2B employs determinantal point process in the recommendation procedure to promote diversity of the recommendation results. To learn the model parameters, a Thompson sampling-type algorithm based on variational Bayesian inference is proposed. In addition, theoretical regret analysis is also provided to guarantee the performance of DC2B. Extensive experiments on real datasets are performed to demonstrate the effectiveness of the proposed method in balancing the recommendation accuracy and diversity.

[1]  Longbing Cao,et al.  Attention-Based Transactional Context Embedding for Next-Item Recommendation , 2018, AAAI.

[2]  Quan Z. Sheng,et al.  Sequential Recommender Systems: Challenges, Progress and Prospects , 2019, IJCAI.

[3]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[4]  Xin Wang,et al.  Interactive Social Recommendation , 2017, CIKM.

[5]  Wei Chu,et al.  A contextual-bandit approach to personalized news article recommendation , 2010, WWW '10.

[6]  Benjamin Van Roy,et al.  Learning to Optimize via Posterior Sampling , 2013, Math. Oper. Res..

[7]  Xin Liu,et al.  Learning User Dependencies for Recommendation , 2017, IJCAI.

[8]  Mi Zhang,et al.  Avoiding monotony: improving the diversity of recommendation lists , 2008, RecSys '08.

[9]  Maosong Sun,et al.  Bandit Learning with Implicit Feedback , 2018, NeurIPS.

[10]  Qiong Wu,et al.  Recent Advances in Diversified Recommendation , 2019, ArXiv.

[11]  Xiaoyan Zhu,et al.  Promoting Diversity in Recommendation by Entropy Regularizer , 2013, IJCAI.

[12]  Xin Gao,et al.  Robust Cost-Sensitive Learning for Recommendation with Implicit Feedback , 2017, SDM.

[13]  Huazheng Wang,et al.  Factorization Bandits for Interactive Recommendation , 2017, AAAI.

[14]  Chunyan Miao,et al.  PD-GAN: Adversarial Learning for Personalized Diversity-Promoting Recommendation , 2019, IJCAI.

[15]  Harald Steck,et al.  Interactive Recommender Systems: Tutorial , 2015, RecSys.

[16]  Hui Xiong,et al.  Learning to Recommend Accurate and Diverse Items , 2017, WWW.

[17]  Peng Gao,et al.  Dynamic Bayesian Logistic Matrix Factorization for Recommendation with Implicit Feedback , 2018, IJCAI.

[18]  Xiaoyan Zhu,et al.  Contextual Combinatorial Bandit and its Application on Diversified Online Recommendation , 2014, SDM.

[19]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[20]  Junyu Niu,et al.  A Framework for Recommending Relevant and Diverse Items , 2016, IJCAI.

[21]  Ajith Ramanathan,et al.  Practical Diversified Recommendations on YouTube with Determinantal Point Processes , 2018, CIKM.

[22]  Wei Chu,et al.  Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms , 2010, WSDM '11.

[23]  Ben Taskar,et al.  Determinantal Point Processes for Machine Learning , 2012, Found. Trends Mach. Learn..

[24]  Michael I. Jordan,et al.  A Variational Approach to Bayesian Logistic Regression Models and their Extensions , 1997, AISTATS.

[25]  R. Ravi,et al.  Post Processing Recommender Systems for Diversity , 2017, KDD.

[26]  Liang Tang,et al.  Personalized Recommendation via Parameter-Free Contextual Bandits , 2015, SIGIR.

[27]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[28]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[29]  Jun Wang,et al.  Interactive collaborative filtering , 2013, CIKM.

[30]  David M. Blei,et al.  Modeling User Exposure in Recommendation , 2015, WWW.

[31]  Laming Chen,et al.  Fast Greedy MAP Inference for Determinantal Point Process to Improve Recommendation Diversity , 2017, NeurIPS.

[32]  Yi-Cheng Zhang,et al.  Solving the apparent diversity-accuracy dilemma of recommender systems , 2008, Proceedings of the National Academy of Sciences.

[33]  Matevz Kunaver,et al.  Diversity in recommender systems - A survey , 2017, Knowl. Based Syst..

[34]  Gediminas Adomavicius,et al.  Improving Aggregate Recommendation Diversity Using Ranking-Based Techniques , 2012, IEEE Transactions on Knowledge and Data Engineering.