Context-aware emotion cause analysis with multi-attention-based neural network

Abstract Emotion cause analysis has elicited wide interest in both academia and industry, and aims to identify the reasons behind certain emotions expressed in text. Most of the current studies on emotion cause analysis do not consider two types of information: i) the context of the emotional word, which can provide rich emotional details, and ii) the interaction between the candidate clause and the emotional clause (containing the emotional word). The above information is able to provide important clues in emotion cause analysis. In this paper, we propose a multi-attention-based neural network model to address this issue. First, our model encodes the clause via bidirectional long short-term memory, which can incorporate the contextual information of the word. Second, a multi-attention mechanism is designed to capture the mutual influences between the emotion clause and each candidate clause, and then generate the representations for the above two clauses separately. With this design, our model creates better-distributed representations of the emotion expressions and clauses. Finally, these representations are fed into a convolutional neural network to model the emotion cause clause. The experimental results show that our proposed approach outperforms the state-of-the-art baseline methods by a significant margin.

[1]  M. Bradley,et al.  Remembering pictures: pleasure and arousal in memory. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[2]  D. Keltner,et al.  The voice conveys emotion in ten globalized cultures and one remote village in Bhutan. , 2016, Emotion.

[3]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[4]  Hang Li,et al.  Neural Responding Machine for Short-Text Conversation , 2015, ACL.

[5]  Zhiyuan Liu,et al.  Relation Classification via Multi-Level Attention CNNs , 2016, ACL.

[6]  Yu Zhou,et al.  Emotion Cause Detection with Linguistic Construction in Chinese Weibo Text , 2014, NLPCC.

[7]  Wen Qu,et al.  CTROF: A Collaborative Tweet Ranking Framework for Online Personalized Recommendation , 2014, PAKDD.

[8]  Chu-Ren Huang,et al.  Emotion Cause Detection with Linguistic Constructions , 2010, COLING.

[9]  Yue Gao,et al.  Predicting Personalized Image Emotion Perceptions in Social Networks , 2018, IEEE Transactions on Affective Computing.

[10]  Qin Lu,et al.  A Question Answering Approach for Emotion Cause Extraction , 2017, EMNLP.

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[13]  Jiasen Lu,et al.  Hierarchical Question-Image Co-Attention for Visual Question Answering , 2016, NIPS.

[14]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[15]  Yue Gao,et al.  Approximating Discrete Probability Distribution of Image Emotions by Multi-Modal Features Fusion , 2017, IJCAI.

[16]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[17]  J. Russell A circumplex model of affect. , 1980 .

[18]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[19]  J. Koenderink Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[20]  P. Ekman An argument for basic emotions , 1992 .

[21]  Yuxin Peng,et al.  The application of two-level attention models in deep convolutional neural network for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Lidia S. Chao,et al.  Bilingual recursive neural network based data selection for statistical machine translation , 2016, Knowl. Based Syst..

[23]  Asim Kadav,et al.  A Context-aware Attention Network for Interactive Question Answering , 2016, KDD.

[24]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[25]  Zhang Xiong,et al.  Multiple Level Hierarchical Network-Based Clause Selection for Emotion Cause Extraction , 2019, IEEE Access.

[26]  Chengxia Liu,et al.  The Study and Implementation of Web User Mining System Based on the Similarity of Words , 2013 .

[27]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[28]  Robert Plutchik,et al.  A psychoevolutionary theory of emotions , 1982 .

[29]  Jian-Yun Nie,et al.  Event causality extraction based on connectives analysis , 2016, Neurocomputing.

[30]  Bowen Zhou,et al.  LSTM-based Deep Learning Models for non-factoid answer selection , 2015, ArXiv.

[31]  Zhiguo Wang,et al.  Bilateral Multi-Perspective Matching for Natural Language Sentences , 2017, IJCAI.

[32]  Chu-Ren Huang,et al.  Joint learning on sentiment and emotion classification , 2013, CIKM.

[33]  Xu Ruifen A New Emotion Dictionary based on the Distinguish of Emotion Expression and Emotion Cognition , 2013 .

[34]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[35]  Yu Zhou,et al.  Event-Driven Emotion Cause Extraction with Corpus Construction , 2016, EMNLP.

[36]  Wenpeng Yin,et al.  Convolutional Neural Network for Paraphrase Identification , 2015, NAACL.

[37]  Phil Blunsom,et al.  Reasoning about Entailment with Neural Attention , 2015, ICLR.

[38]  Yue Gao,et al.  Continuous Probability Distribution Prediction of Image Emotions via Multitask Shared Sparse Regression , 2017, IEEE Transactions on Multimedia.

[39]  Yang Liu,et al.  Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention , 2016, ArXiv.

[40]  Yue Zhang,et al.  A Bilingual Attention Network for Code-switched Emotion Prediction , 2016, COLING.

[41]  Kostas Karpouzis,et al.  Emotion Analysis in Man-Machine Interaction Systems , 2004, MLMI.

[42]  Hua Xu,et al.  A rule-based approach to emotion cause detection for Chinese micro-blogs , 2015, Expert Syst. Appl..

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  M. de Rijke,et al.  Leveraging Contextual Sentence Relations for Extractive Summarization Using a Neural Attention Model , 2017, SIGIR.

[45]  Erik Cambria,et al.  A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks , 2016, COLING.

[46]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[47]  Qinmin Hu,et al.  Enhancing Recurrent Neural Networks with Positional Attention for Question Answering , 2017, SIGIR.

[48]  Hua Xu,et al.  Text-based emotion classification using emotion cause extraction , 2014, Expert Syst. Appl..

[49]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[50]  Di Wang,et al.  A Long Short-Term Memory Model for Answer Sentence Selection in Question Answering , 2015, ACL.

[51]  Matti Pietikäinen,et al.  Multi-modal emotion analysis from facial expressions and electroencephalogram , 2016, Comput. Vis. Image Underst..

[52]  Hua Xu,et al.  Emotion Cause Detection for Chinese Micro-Blogs Based on ECOCC Model , 2015, PAKDD.

[53]  Irene Russo,et al.  EMOCause: an easy-adaptable approach to emotion cause contexts , 2011 .

[54]  Diana Inkpen,et al.  Detecting Emotion Stimuli in Emotion-Bearing Sentences , 2015, CICLing.

[55]  H. Lövheim A new three-dimensional model for emotions and monoamine neurotransmitters. , 2012, Medical hypotheses.

[56]  Phil Blunsom,et al.  Teaching Machines to Read and Comprehend , 2015, NIPS.

[57]  Kurt Keutzer,et al.  EmotionGAN: Unsupervised Domain Adaptation for Learning Discrete Probability Distributions of Image Emotions , 2018, ACM Multimedia.

[58]  Mahira Kirmani,et al.  Emotion analysis: A survey , 2017, 2017 International Conference on Computer, Communications and Electronics (Comptelix).

[59]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[60]  Kavita Bala,et al.  Learning visual similarity for product design with convolutional neural networks , 2015, ACM Trans. Graph..

[61]  Yung-Chun Chang,et al.  Linguistic Template Extraction for Recognizing Reader-Emotion and Emotional Resonance Writing Assistance , 2015, ACL.

[62]  Furu Wei,et al.  AttSum: Joint Learning of Focusing and Summarization with Neural Attention , 2016, COLING.

[63]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[64]  A. Mehrabian Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[65]  Chu-Ren Huang,et al.  A Text-driven Rule-based System for Emotion Cause Detection , 2010, HLT-NAACL 2010.

[66]  Daling Wang,et al.  Detecting Multiple Coexisting Emotions in Microblogs with Convolutional Neural Networks , 2017, Cognitive Computation.

[67]  Hsin-Hsi Chen,et al.  Emotion Classification Using Web Blog Corpora , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[68]  Yu Zhou,et al.  Emotion Cause Extraction, A Challenging Task with Corpus Construction , 2016, SMP.