Learning Personalized End-to-End Task-Oriented Dialogue Generation

Building personalized task-oriented dialogue system is an important but challenging task. Significant success has been achieved by selecting the responses from the pre-defined template. However, preparing massive response template is time-consuming and human-labor intensive. In this paper, we propose an end-to-end framework based on the memory networks for responses generation in the personalized task-oriented dialog system. The static attention mechanism is used to encode the user-conversation relationship to form a global vector representation, and the dynamic attention mechanism is used to obtain import local information during the decoding phase. In addition, we propose a gating mechanism to incorporate user information into the network to enhance the personalized ability of the response. Experiments on the benchmark dataset show that our model achieves better performance than the strong baseline methods in personalized task-oriented dialogue generation.

[1]  Jianfeng Gao,et al.  A Persona-Based Neural Conversation Model , 2016, ACL.

[2]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[3]  Matthew D. Zeiler.  ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[4]  Boi Faltings,et al.  Personalization in Goal-Oriented Dialog , 2017, ArXiv.

[5]  Xu Sun,et al.  Learning Personalized End-to-End Goal-Oriented Dialog , 2018, AAAI.

[6]  Christopher D. Manning,et al.  A Copy-Augmented Sequence-to-Sequence Architecture Gives Good Performance on Task-Oriented Dialogue , 2017, EACL.

[7]  Yu Zhang,et al.  Personalizing a Dialogue System With Transfer Reinforcement Learning , 2016, AAAI.

[8]  Pascale Fung,et al.  End-to-End Recurrent Entity Network for Entity-Value Independent Goal-Oriented Dialog Learning , 2017 .

[9]  David Konopnicki,et al.  Neural Response Generation for Customer Service based on Personality Traits , 2017, INLG.

[10]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[11]  Taro Watanabe,et al.  Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , 2017, IJCNLP.

[12]  Bowen Zhou,et al.  Pointing the Unknown Words , 2016, ACL.

[13]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[14]  Yu Zhang,et al.  Personalizing a Dialogue System with Transfer Learning , 2016, ArXiv.

[15]  Julien Perez,et al.  Gated End-to-End Memory Networks , 2016, EACL.

[16]  Jason Weston,et al.  Learning End-to-End Goal-Oriented Dialog , 2016, ICLR.

[17]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[18]  Richard Socher,et al.  Global-to-local Memory Pointer Networks for Task-Oriented Dialogue , 2019, ICLR.

[19]  Min Yang,et al.  Personalized response generation by Dual-learning based domain adaptation , 2018, Neural Networks.

[20]  Jianfeng Gao,et al.  Multi-Task Learning for Speaker-Role Adaptation in Neural Conversation Models , 2017, IJCNLP.

[21]  Pascale Fung,et al.  Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems , 2018, ACL.

[22]  David Vandyke,et al.  A Network-based End-to-End Trainable Task-oriented Dialogue System , 2016, EACL.

[23]  Jiliang Tang,et al.  A Survey on Dialogue Systems: Recent Advances and New Frontiers , 2017, SKDD.

[24]  Min Yang,et al.  Investigating Deep Reinforcement Learning Techniques in Personalized Dialogue Generation , 2018, SDM.

[25]  Pascale Fung,et al.  End-to-End Dynamic Query Memory Network for Entity-Value Independent Task-Oriented Dialog , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Min-Yen Kan,et al.  Sequicity: Simplifying Task-oriented Dialogue Systems with Single Sequence-to-Sequence Architectures , 2018, ACL.

[27]  Jason Weston,et al.  Personalizing Dialogue Agents: I have a dog, do you have pets too? , 2018, ACL.