RecSys 2021 Tutorial on Conversational Recommendation: Formulation, Methods, and Evaluation

Recommender systems have demonstrated great success in information seeking. However, traditional recommender systems work in a static way, estimating user preferences on items from past interaction history. This prevents recommender systems from capturing dynamic and fine-grained preferences of users. Conversational recommender systems bring a revolution to existing recommender systems. They are able to communicate with users through natural language, which enables them to explicitly elicit user preferences by asking whether a user likes an attribute or item or not. Based on information shared through users’ responses, a recommender system can produce more accurate and personalized recommendations. We identify five emerging trends in the general area of conversational recommender systems: (1) Question-based user preference elicitation; (2) Multi-turn conversational recommendation strategies; (3) Dialogue understanding and generation; (4) Exploitation-exploration trade-offs; and (5) Evaluation and user simulation. This tutorial covers these five directions, providing a review of existing approaches and progress on each topic. By presenting the emerging and promising topic of conversational recommender systems, we aim to provide take-aways to practitioners to build their own systems. We also want to stimulate more ideas and discussions with audiences on core problems of this topic such as task formalization, dataset collection, algorithm development, and evaluation, with the ambition of facilitating the development of conversational recommender systems.

[1]  M. de Rijke,et al.  A Human-machine Collaborative Framework for Evaluating Malevolence in Dialogues , 2021, ACL.

[2]  M. de Rijke,et al.  Initiative-Aware Self-Supervised Learning for Knowledge-Grounded Conversations , 2021, SIGIR.

[3]  Jianfeng Gao,et al.  Guided Dialog Policy Learning without Adversarial Learning in the Loop , 2020, EMNLP.

[4]  M. de Rijke,et al.  Keeping Dataset Biases out of the Simulation: A Debiased Simulator for Reinforcement Learning based Recommender Systems , 2020, RecSys.

[5]  M. de Rijke,et al.  Leveraging Context for Neural Question Generation in Open-domain Dialogue Systems , 2020, WWW.

[6]  M. Mehdi Afsar,et al.  Reinforcement learning based recommender systems: A survey , 2021, ArXiv.

[7]  Konstantina Christakopoulou,et al.  Q&R: A Two-Stage Approach toward Interactive Recommendation , 2018, KDD.

[8]  Xiangnan He,et al.  Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems , 2020, WSDM.

[9]  Maarten de Rijke,et al.  A Large-scale Analysis of Mixed Initiative in Information-Seeking Dialogues for Conversational Search , 2021, ACM Trans. Inf. Syst..

[10]  M. de Rijke,et al.  Detecting and Classifying Malevolent Dialogue Responses: Taxonomy, Data and Methodology , 2020, ArXiv.

[11]  M. de Rijke,et al.  Accelerated Convergence for Counterfactual Learning to Rank , 2020, SIGIR.

[12]  Xu Chen,et al.  Towards Conversational Search and Recommendation: System Ask, User Respond , 2018, CIKM.

[13]  M. de Rijke,et al.  Conversations with Documents: An Exploration of Document-Centered Assistance , 2020, CHIIR.

[14]  Minlie Huang,et al.  Bridging the Gap between Conversational Reasoning and Interactive Recommendation , 2020, ArXiv.

[15]  Hongxia Yang,et al.  Towards Knowledge-Based Recommender Dialog System , 2019, EMNLP.

[16]  M. de Rijke,et al.  To Model or to Intervene: A Comparison of Counterfactual and Online Learning to Rank from User Interactions , 2019, SIGIR.

[17]  M. de Rijke,et al.  Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems , 2021, SIGIR.

[18]  Zheng-Yu Niu,et al.  Towards Conversational Recommendation over Multi-Type Dialogs , 2020, ACL.

[19]  Filip Radlinski,et al.  Preference elicitation as an optimization problem , 2018, RecSys.

[20]  M. de Rijke,et al.  When People Change their Mind: Off-Policy Evaluation in Non-stationary Recommendation Environments , 2019, WSDM.

[21]  M. de Rijke,et al.  A Cooperative Memory Network for Personalized Task-oriented Dialogue Systems with Incomplete User Profiles , 2021, WWW.

[22]  M. de Rijke,et al.  RefNet: A Reference-aware Network for Background Based Conversation , 2019, AAAI.

[23]  M. de Rijke,et al.  Advances and Challenges in Conversational Recommender Systems: A Survey , 2021, AI Open.

[24]  Xiangnan He,et al.  Interactive Path Reasoning on Graph for Conversational Recommendation , 2020, KDD.

[25]  M. de Rijke,et al.  Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems , 2020, FINDINGS.

[26]  M. de Rijke,et al.  DukeNet: A Dual Knowledge Interaction Network for Knowledge-Grounded Conversation , 2020, SIGIR.

[27]  M. de Rijke,et al.  Learning to Ask Conversational Questions by Optimizing Levenshtein Distance , 2021, ACL.

[28]  Miao Fan,et al.  Semi-Supervised Variational Reasoning for Medical Dialogue Generation , 2021, SIGIR.

[29]  Ji-Rong Wen,et al.  Adapting User Preference to Online Feedback in Multi-round Conversational Recommendation , 2021, WSDM.

[30]  M. de Rijke,et al.  Conversations Powered by Cross-Lingual Knowledge , 2021, SIGIR.

[31]  Kun Zhou,et al.  Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion , 2020, KDD.

[32]  Xiangnan He,et al.  Seamlessly Unifying Attributes and Items: Conversational Recommendation for Cold-Start Users , 2020, ArXiv.

[33]  Unifying Online and Counterfactual Learning to Rank , 2021 .

[34]  M. de Rijke,et al.  Wizard of Search Engine: Access to Information Through Conversations with Search Engines , 2021, SIGIR.

[35]  Jianfeng Gao,et al.  Neural Approaches to Conversational AI: Question Answering, Task-oriented Dialogues and Social Chatbots , 2019 .

[36]  M. de Rijke,et al.  Query Resolution for Conversational Search with Limited Supervision , 2020, SIGIR.

[37]  M. de Rijke,et al.  Improving Response Quality with Backward Reasoning in Open-domain Dialogue Systems , 2021, SIGIR.

[38]  Maarten de Rijke,et al.  Robust Generalization and Safe Query-Specializationin Counterfactual Learning to Rank , 2021, WWW.