Order-guided deep neural network for emotion-cause pair prediction

Abstract Emotion-Cause Pair Extraction (ECPE) is a prediction task aiming to extract the emotions and their corresponding causes in a target document. The existing methods for this problem mainly focus on modeling the dependence between emotion clauses and related cause clauses and the interaction among emotion-cause pairs. However, these methods ignore the order information between emotion clauses and their cause clauses, which can be proved useful for the ECPE task. In this paper, we propose an order-guided deep predictive model, which integrates different orders between emotion clauses and their cause clauses into an end-to-end framework to tackle this task. Specifically, we build an order-guided clause encoder with a three-level long-short term memory (LSTM) network to learn the different orders from forward LSTM, backward LSTM and Bi-LSTM, respectively. In this way, the deep networks with different directions can effectively capture different orders, and therefore improve the performance of our model in this prediction task. Additionally, the previous methods use only a shared word encoder to capture word-level emotion and cause information, resulting in paying more attention to emotion information and lacking the ability to capture cause information. In order to overcome this deficiency, we design both an emotion-aware word encoder and a cause-aware word encoder to enhance the ability to capture the emotion and cause information. The experiment results illustrate that our method outperforms the other baselines on two real-world datasets, and demonstrate the effectiveness of the proposed method.

[1]  Rui Xia,et al.  Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Texts , 2019, ACL.

[2]  Qin Lu,et al.  A Question Answering Approach for Emotion Cause Extraction , 2017, EMNLP.

[3]  Chu-Ren Huang,et al.  Emotion Cause Detection with Linguistic Constructions , 2010, COLING.

[4]  Jianfei Yu,et al.  End-to-End Emotion-Cause Pair Extraction Based on Sliding Window Multi-Label Learning , 2020, EMNLP.

[5]  Yu Zhou,et al.  Event-Driven Emotion Cause Extraction with Corpus Construction , 2016, EMNLP.

[6]  Zhang Xiong,et al.  Multiple Level Hierarchical Network-Based Clause Selection for Emotion Cause Extraction , 2019, IEEE Access.

[7]  Guangming Lu,et al.  FSS-GCN: A graph convolutional networks with fusion of semantic and structure for emotion cause analysis , 2020, Knowl. Based Syst..

[8]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[9]  Qin Lu,et al.  An ensemble approach for emotion cause detection with event extraction and multi-kernel SVMs , 2017, Tsinghua Science and Technology.

[10]  Jianfei Yu,et al.  ECPE-2D: Emotion-Cause Pair Extraction based on Joint Two-Dimensional Representation, Interaction and Prediction , 2020, ACL.

[11]  Donghong Ji,et al.  Joint multi-level attentional model for emotion detection and emotion-cause pair extraction , 2020, Neurocomputing.

[12]  Ruifeng Xu,et al.  Emotion-Cause Pair Extraction as Sequence Labeling Based on a Novel Tagging Scheme , 2020, EMNLP.

[13]  Ruifeng Xu,et al.  Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction , 2020, ACL.

[14]  Yafeng Yin,et al.  A Symmetric Local Search Network for Emotion-Cause Pair Extraction , 2020, COLING.

[15]  Irene Russo,et al.  EMOCause: an easy-adaptable approach to emotion cause contexts , 2011 .

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Shoushan Li,et al.  End-to-End Emotion-Cause Pair Extraction with Graph Convolutional Network , 2020, COLING.

[18]  Yongfeng Huang,et al.  A Multi-Task Learning Neural Network for Emotion-Cause Pair Extraction , 2020, ECAI.

[19]  Masaki Aono,et al.  Extracting Causes of Emotions from Text , 2013, IJCNLP.

[20]  Chu-Ren Huang,et al.  A Text-driven Rule-based System for Emotion Cause Detection , 2010, HLT-NAACL 2010.

[21]  Daling Wang,et al.  A Co-Attention Neural Network Model for Emotion Cause Analysis with Emotional Context Awareness , 2018, EMNLP.

[22]  Ashutosh Modi,et al.  An End-to-End Network for Emotion-Cause Pair Extraction , 2021, WASSA.

[23]  Ying Chen,et al.  An Emotion Cause Corpus for Chinese Microblogs with Multiple-User Structures , 2017, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Jiahao Zhao,et al.  Effective Inter-Clause Modeling for End-to-End Emotion-Cause Pair Extraction , 2020, ACL.

[26]  Rui Xia,et al.  RTHN: A RNN-Transformer Hierarchical Network for Emotion Cause Extraction , 2019, IJCAI.

[27]  Philip S. Yu,et al.  Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classification , 2019, IEEE Transactions on Knowledge and Data Engineering.

[28]  Leila Aloui,et al.  Socio-emotional competencies, socio-economic factors, and the employability process of female graduates in the Kingdom of Saudi Arabia , 2020 .

[29]  Rui Xia,et al.  From Independent Prediction to Re-ordered Prediction: Integrating Relative Position and Global Label Information to Emotion Cause Identification , 2019, AAAI.

[30]  Moloud Abdar,et al.  The effect of aggregation methods on sentiment classification in Persian reviews , 2020, Enterp. Inf. Syst..

[31]  Jianping Wang,et al.  A Unified Sequence Labeling Model for Emotion Cause Pair Extraction , 2020, COLING.

[32]  Yao Meng,et al.  Detecting Concept-level Emotion Cause in Microblogging , 2015, WWW.