Improving Conversational Recommender Systems via Transformer-based Sequential Modelling

In Conversational Recommender Systems (CRSs), conversations usually involve a set of related items and entities e.g., attributes of items. These items and entities are mentioned in order following the development of a dialogue. In other words, potential sequential dependencies exist in conversations. However, most of the existing CRSs neglect these potential sequential dependencies. In this paper, we propose a Transformer-based sequential conversational recommendation method, named TSCR, which models the sequential dependencies in the conversations to improve CRS. We represent conversations by items and entities, and construct user sequences to discover user preferences by considering both mentioned items and entities. Based on the constructed sequences, we deploy a Cloze task to predict the recommended items along a sequence. Experimental results demonstrate that our TSCR model significantly outperforms state-of-the-art baselines.

[1]  M. de Rijke,et al.  Variational Reasoning about User Preferences for Conversational Recommendation , 2022, SIGIR.

[2]  Yu Li,et al.  Improving Conversational Recommendation Systems' Quality with Context-Aware Item Meta Information , 2021, NAACL-HLT.

[3]  E. Chng,et al.  An Embarrassingly Simple Model for Dialogue Relation Extraction , 2020, ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Keyu Chen,et al.  Knowledge-Based Conversational Recommender Systems Enhanced by Dialogue Policy Learning , 2021, IJCKG.

[5]  Jie Zou Improving search and recommendation by asking clarifying questions , 2021, SIGIR Forum.

[6]  Xiaoyi Wang,et al.  Conversation Recommender System Based on Knowledge Graph and Time-series Feature , 2021, CSAE.

[7]  Kam-Fai Wong,et al.  Finetuning Large-Scale Pre-trained Language Models for Conversational Recommendation with Knowledge Graph , 2021, ArXiv.

[8]  D. Jannach,et al.  Generation-based vs. Retrieval-based Conversational Recommendation: A User-Centric Comparison , 2021, RecSys.

[9]  Xipeng Qiu,et al.  A Unified Generative Framework for Aspect-based Sentiment Analysis , 2021, ACL.

[10]  Shuguang Cui,et al.  RevCore: Review-Augmented Conversational Recommendation , 2021, FINDINGS.

[11]  Chunyan Miao,et al.  KECRS: Towards Knowledge-Enriched Conversational Recommendation System , 2021, ArXiv.

[12]  Minlie Huang,et al.  CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation , 2020, EMNLP.

[13]  Ruifang He,et al.  CRFR: Improving Conversational Recommender Systems via Flexible Fragments Reasoning on Knowledge Graphs , 2021, EMNLP.

[14]  Mihael Arcan,et al.  Suggest me a movie for tonight: Leveraging Knowledge Graphs for Conversational Recommendation , 2020, COLING.

[15]  Wayne Xin Zhao,et al.  Towards Topic-Guided Conversational Recommender System , 2020, COLING.

[16]  Fuzheng Zhang,et al.  Leveraging Historical Interaction Data for Improving Conversational Recommender System , 2020, CIKM.

[17]  Evangelos Kanoulas,et al.  An Empirical Study on Clarifying Question-Based Systems , 2020, CIKM.

[18]  Kun Zhou,et al.  Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion , 2020, KDD.

[19]  Xiangnan He,et al.  Interactive Path Reasoning on Graph for Conversational Recommendation , 2020, KDD.

[20]  Evangelos Kanoulas,et al.  Towards Question-based Recommender Systems , 2020, SIGIR.

[21]  KanoulasEvangelos,et al.  Towards Question-based High-recall Information Retrieval: Locating the Last Few Relevant Documents for Technology-assisted Reviews , 2020 .

[22]  Evangelos Kanoulas,et al.  Towards Question-based High-recall Information Retrieval , 2020, ACM Trans. Inf. Syst..

[23]  Xiangnan He,et al.  Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems , 2020, WSDM.

[24]  Dietmar Jannach,et al.  End-to-End Learning for Conversational Recommendation: A Long Way to Go? , 2020, IntRS@RecSys.

[25]  Evangelos Kanoulas,et al.  Learning to Ask: Question-based Sequential Bayesian Product Search , 2019, CIKM.

[26]  Hongxia Yang,et al.  Towards Knowledge-Based Recommender Dialog System , 2019, EMNLP.

[27]  Peng Jiang,et al.  BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer , 2019, CIKM.

[28]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[29]  Christopher Joseph Pal,et al.  Towards Deep Conversational Recommendations , 2018, NeurIPS.

[30]  Xu Chen,et al.  Towards Conversational Search and Recommendation: System Ask, User Respond , 2018, CIKM.

[31]  Yi Zhang,et al.  Conversational Recommender System , 2018, SIGIR.

[32]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[33]  Kevin Gimpel,et al.  Bridging Nonlinearities and Stochastic Regularizers with Gaussian Error Linear Units , 2016, ArXiv.

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[36]  Wilson L. Taylor,et al.  “Cloze Procedure”: A New Tool for Measuring Readability , 1953 .