Automatically Select Emotion for Response via Personality-affected Emotion Transition

To provide consistent emotional interaction with users, dialog systems should be capable to automatically select appropriate emotions for responses like humans. However, most existing works focus on rendering specified emotions in responses or empathetically respond to the emotion of users, yet the individual difference in emotion expression is overlooked. This may lead to inconsistent emotional expressions and disinterest users. To tackle this issue, we propose to equip the dialog system with personality and enable it to automatically select emotions in responses by simulating the emotion transition of humans in conversation. In detail, the emotion of the dialog system is transitioned from its preceding emotion in context. The transition is triggered by the preceding dialog context and affected by the specified personality trait. To achieve this, we first model the emotion transition in the dialog system as the variation between the preceding emotion and the response emotion in the Valence-Arousal-Dominance (VAD) emotion space. Then, we design neural networks to encode the preceding dialog context and the specified personality traits to compose the variation. Finally, the emotion for response is selected from the sum of the preceding emotion and the variation. We construct a dialog dataset with emotion and personality labels and conduct emotion prediction tasks for evaluation. Experimental results validate the effectiveness of the personality-affected emotion transition.1.

[1]  Jinho D. Choi,et al.  Automatic Text-based Personality Recognition on Monologues and Multiparty Dialogues Using Attentive Networks and Contextual Embeddings , 2019, AAAI.

[2]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[3]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[4]  B. Silverman,et al.  How Emotions and Personality Effect the Utility of Alternative Decisions: A Terrorist Target Selection Case Study , 2001 .

[5]  Xiaoyu Shen,et al.  DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset , 2017, IJCNLP.

[6]  Jesse Hoey,et al.  Affective Neural Response Generation , 2017, ECIR.

[7]  Rada Mihalcea,et al.  MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations , 2018, ACL.

[8]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .

[9]  Chu Kiong Loo,et al.  Personality affected robotic emotional model with associative memory for human-robot interaction , 2018, Neurocomputing.

[10]  Rada Mihalcea,et al.  COSMIC: COmmonSense knowledge for eMotion Identification in Conversations , 2020, FINDINGS.

[11]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[12]  Pan Zhou,et al.  Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction , 2019, CIKM.

[13]  Danqi Chen,et al.  of the Association for Computational Linguistics: , 2001 .

[14]  Peng Xu,et al.  MoEL: Mixture of Empathetic Listeners , 2019, EMNLP.

[15]  Kai-Tai Song,et al.  Robotic Emotional Expression Generation Based on Mood Transition and Personality Model , 2013, IEEE Transactions on Cybernetics.

[16]  Diana I Tamir,et al.  Mental models accurately predict emotion transitions , 2017, Proceedings of the National Academy of Sciences.

[17]  Mohammad H. Mahoor,et al.  EmpTransfo: A Multi-head Transformer Architecture for Creating Empathetic Dialog Systems , 2020, FLAIRS.

[18]  Xiaoyan Zhu,et al.  Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory , 2017, AAAI.

[19]  R. Gunderman,et al.  Emotional intelligence. , 2011, Journal of the American College of Radiology : JACR.

[20]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jianfeng Gao,et al.  A Persona-Based Neural Conversation Model , 2016, ACL.

[22]  Carlos Busso,et al.  IEMOCAP: interactive emotional dyadic motion capture database , 2008, Lang. Resour. Evaluation.

[23]  Alexander Gelbukh,et al.  DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation , 2019, EMNLP.

[24]  A. Mehrabian Analysis of the Big‐five Personality Factors in Terms of the PAD Temperament Model , 1996 .

[25]  Hao Wang,et al.  Endowing Empathetic Conversational Models with Personas , 2020 .

[26]  Karin Ackermann,et al.  The Nature Of Emotion Fundamental Questions , 2016 .

[27]  Harry Shum,et al.  The Design and Implementation of XiaoIce, an Empathetic Social Chatbot , 2018, CL.

[28]  Jinho D. Choi,et al.  Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-based Question Answering , 2020, ACL.

[29]  Jinho D. Choi,et al.  Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networks , 2017, AAAI Workshops.

[30]  P. Costa,et al.  Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. , 1992 .

[31]  K. Colby Artificial paranoia; a computer simulation of paranoid processes , 1975 .

[32]  Saif Mohammad,et al.  Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words , 2018, ACL.

[33]  Kai Zou,et al.  EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks , 2019, EMNLP.

[34]  Xiao Sun,et al.  Reinforcement Learning Based Emotional Editing Constraint Conversation Generation , 2019, ArXiv.

[35]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[36]  Xiao Sun,et al.  Emotional Human Machine Conversation Generation Based on SeqGAN , 2018, 2018 First Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia).

[37]  Rada Mihalcea,et al.  DialogueRNN: An Attentive RNN for Emotion Detection in Conversations , 2018, AAAI.

[38]  Neural (cid:39) ialogue (cid:54) ystem with (cid:40) motion (cid:40) mbeddings , 2022 .

[39]  James Kennedy,et al.  Affect-Driven Dialog Generation , 2019, NAACL.