Emotion Analysis for the Upcoming Response in Open-Domain Human-Computer Conversation

Emotion analysis is one of the most active domains, hence attracts lots of attention of researchers in the natural language processing field. However, most of existed works are involved in classification tasks of the current sentence, lack of analysis of upcoming sentences. On the other hand, with the development of automatic human-computer dialogue systems, a response given by the computer side should become increasingly like human beings, for instance, the ability of expressing sentiment or emotion. The challenges lies in how to predict the emotion of a nonexistent sentence currently, which make this problem quite different from traditional sentiment or emotion analysis. In this paper, for the scenarios of open-domain conversation, we propose an architecture based on deep neural networks to predict the emotion before giving the response. In particular, we use a bidirectional recurrent neural network to get the embedding of the current utterance, and joint the representations of its retrieval results, to obtain the best emotion classification of the upcoming response. Experiments based on an annotation dataset demonstrate the effectiveness of our proposed approach better than traditional methods in terms of accuracy, precision, recall, and F-measure evaluation metrics. Then the following is some analysis of the results and future works.

[1]  JianHua Yuan,et al.  Babbling - The HIT-SCIR System for Emotional Conversation Generation , 2017, NLPCC.

[2]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[3]  Steve J. Young,et al.  Stochastic Language Generation in Dialogue using Factored Language Models , 2014, Computational Linguistics.

[4]  Tie-Yan Liu,et al.  Learning to rank for information retrieval , 2009, SIGIR.

[5]  Long Chen,et al.  Learning Bilingual Sentiment Word Embeddings for Cross-language Sentiment Classification , 2015, ACL.

[6]  Stefan Wermter,et al.  Dialogue-Based Neural Learning to Estimate the Sentiment of a Next Upcoming Utterance , 2017, ICANN.

[7]  Wei Wu,et al.  Learning bilinear model for matching queries and documents , 2013, J. Mach. Learn. Res..

[8]  Lei Huang,et al.  Sentence-level Emotion Classification with Label and Context Dependence , 2015, ACL.

[9]  Xiaojun Wan,et al.  Emotion Classification in Microblog Texts Using Class Sequential Rules , 2014, AAAI.

[10]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[11]  Rui Yan,et al.  Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System , 2016, SIGIR.

[12]  Ming Zhou,et al.  Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification , 2014, ACL.

[13]  Fausto Giunchiglia,et al.  Semantic Matching: Algorithms and Implementation , 2007, J. Data Semant..

[14]  Rui Yan,et al.  Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation , 2016, COLING.

[15]  Yue Zhang,et al.  Improving Twitter Sentiment Classification Using Topic-Enriched Multi-Prototype Word Embeddings , 2016, AAAI.

[16]  Stephan Vogel,et al.  Evaluating a dialog language generation system: comparing the mountain system to other NLG approaches , 2010, INTERSPEECH.

[17]  Gao Cong,et al.  Coarse-to-fine review selection via supervised joint aspect and sentiment model , 2014, SIGIR.

[18]  Alan Ritter,et al.  Data-Driven Response Generation in Social Media , 2011, EMNLP.

[19]  Patrik Lambert Aspect-Level Cross-lingual Sentiment Classification with Constrained SMT , 2015, ACL.

[20]  Ryuichiro Higashinaka,et al.  Open-domain Utterance Generation for Conversational Dialogue Systems using Web-scale Dependency Structures , 2013, SIGDIAL Conference.

[21]  Xiaolong Wang,et al.  Topic sentiment analysis in twitter: a graph-based hashtag sentiment classification approach , 2011, CIKM '11.

[22]  Ryuichiro Higashinaka,et al.  Syntactic Filtering and Content-Based Retrieval of Twitter Sentences for the Generation of System Utterances in Dialogue Systems , 2016 .

[23]  Roberto Basili,et al.  A context-based model for Sentiment Analysis in Twitter , 2014, COLING.

[24]  Xiaoyong Du,et al.  Distributed Text Representation with Weighting Scheme Guidance for Sentiment Analysis , 2016, APWeb.

[25]  Yue Zhang,et al.  Context-Sensitive Twitter Sentiment Classification Using Neural Network , 2016, AAAI.

[26]  Maite Taboada,et al.  Lexicon-Based Methods for Sentiment Analysis , 2011, CL.

[27]  Yue Zhang,et al.  Gated Neural Networks for Targeted Sentiment Analysis , 2016, AAAI.

[28]  Xiang Li,et al.  Joint Emoji Classification and Embedding Learning , 2017, APWeb/WAIM.

[29]  Rui Zhang,et al.  Building Emotional Conversation Systems Using Multi-task Seq2Seq Learning , 2017, NLPCC.

[30]  Xiang Li,et al.  StalemateBreaker: A Proactive Content-Introducing Approach to Automatic Human-Computer Conversation , 2016, IJCAI.

[31]  K. P. Chow,et al.  A Topic Model for Building Fine-grained Domain-specific Emotion Lexicon , 2014, ACL.

[32]  Hang Li,et al.  Neural Responding Machine for Short-Text Conversation , 2015, ACL.

[33]  Hao Wang,et al.  A Dataset for Research on Short-Text Conversations , 2013, EMNLP.

[34]  Anton Leuski,et al.  NPCEditor: Creating Virtual Human Dialogue Using Information Retrieval Techniques , 2011, AI Mag..

[35]  Ming Zhou,et al.  Building Large-Scale Twitter-Specific Sentiment Lexicon : A Representation Learning Approach , 2014, COLING.

[36]  Peter D. Turney Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[37]  Changhua Yang,et al.  Emotion Classification Using Web Blog Corpora , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[38]  Chunyan Miao,et al.  Analyzing Sentiments in One Go: A Supervised Joint Topic Modeling Approach , 2017, IEEE Transactions on Knowledge and Data Engineering.

[39]  Jianfeng Gao,et al.  A Neural Network Approach to Context-Sensitive Generation of Conversational Responses , 2015, NAACL.

[40]  Shady Shehata,et al.  Enhancing Search Engine Quality Using Concept-based Text Retrieval , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[41]  Ming Zhou,et al.  Adaptive Multi-Compositionality for Recursive Neural Models with Applications to Sentiment Analysis , 2014, AAAI.