Overview of the NLPCC 2017 Shared Task: Emotion Generation Challenge

It has been a long-term goal for AI to perceive and express emotions. Inspired by Emotional Chatting Machine [1], we propose a challenge task to investigate how well a chatting machine can express emotion by generating a textual response to an input post. The task is defined as follows: given a post and a pre-specified emotion class of the generated response, the task is to generate a response that is appropriate in both topic and emotion. This challenge has attracted more 40 teams registered, and finally there are 10 teams who submitted results. In this overview paper, we will report the details of this challenge, including task definition, data preparation, annotation schema, submission statistics, and evaluation results.

[1]  Ming Li,et al.  Neural Contextual Conversation Learning with Labeled Question-Answering Pairs , 2016, ArXiv.

[2]  Denny Britz,et al.  Generating Long and Diverse Responses with Neural Conversation Models , 2017, ArXiv.

[3]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[4]  Jianfeng Gao,et al.  A Neural Network Approach to Context-Sensitive Generation of Conversational Responses , 2015, NAACL.

[5]  Xiaoyan Zhu,et al.  Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory , 2017, AAAI.

[6]  Wei-Ying Ma,et al.  Topic Aware Neural Response Generation , 2016, AAAI.

[7]  Jianfeng Gao,et al.  A Persona-Based Neural Conversation Model , 2016, ACL.

[8]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[9]  Hang Li,et al.  Neural Responding Machine for Short-Text Conversation , 2015, ACL.

[10]  Joelle Pineau,et al.  Hierarchical Neural Network Generative Models for Movie Dialogues , 2015, ArXiv.

[11]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[12]  Daniel Jurafsky,et al.  A Simple, Fast Diverse Decoding Algorithm for Neural Generation , 2016, ArXiv.

[13]  Xiang Li,et al.  Two are Better than One: An Ensemble of Retrieval- and Generation-Based Dialog Systems , 2016, ArXiv.

[14]  Rui Yan,et al.  Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation , 2016, COLING.

[15]  Jianfeng Gao,et al.  A Diversity-Promoting Objective Function for Neural Conversation Models , 2015, NAACL.

[16]  Tetsuya Sakai,et al.  Overview of the NTCIR-12 Short Text Conversation Task , 2016, NTCIR.