An end-to-end multi-task learning to link framework for emotion-cause pair extraction

Emotion-cause pair extraction (ECPE), as an emergent natural language processing task, aims at jointly investigating emotions and their underlying causes in documents. It extends the previous emotion cause extraction (ECE) task, yet without requiring a set of pre-given emotion clauses as in ECE. Existing approaches to ECPE generally adopt a two-stage method, i.e., (1) emotion and cause detection, and then (2) pairing the detected emotions and causes. Such pipeline method, while intuitive, suffers from two critical issues, including error propagation across stages that may hinder the effectiveness, and high computational cost that would limit the practical application of the method. To tackle these issues, we propose a multi-task learning model that can extract emotions, causes and emotion-cause pairs simultaneously in an end-to-end manner. Specifically, our model regards pair extraction as a link prediction task, and learns to link from emotion clauses to cause clauses, i.e., the links are directional. Emotion extraction and cause extraction are incorporated into the model as auxiliary tasks, which further boost the pair extraction. Experiments are conducted on an ECPE benchmarking dataset. The results show that our proposed model outperforms a range of state-of-the-art approaches.

[1]  Yu Zhou,et al.  Event-Driven Emotion Cause Extraction with Corpus Construction , 2016, EMNLP.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Rui Xia,et al.  RTHN: A RNN-Transformer Hierarchical Network for Emotion Cause Extraction , 2019, IJCAI.

[4]  Chu-Ren Huang,et al.  Emotion Cause Detection with Linguistic Constructions , 2010, COLING.

[5]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[6]  Yu Zhou,et al.  Emotion Cause Detection with Linguistic Construction in Chinese Weibo Text , 2014, NLPCC.

[7]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[8]  Rui Xia,et al.  Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Texts , 2019, ACL.

[9]  Ruifeng Xu,et al.  Emotion-Cause Pair Extraction as Sequence Labeling Based on a Novel Tagging Scheme , 2020, EMNLP.

[10]  Dawei Song,et al.  Syntax-Aware Aspect-Level Sentiment Classification with Proximity-Weighted Convolution Network , 2019, SIGIR.

[11]  Qin Lu,et al.  A Question Answering Approach for Emotion Cause Extraction , 2017, EMNLP.

[12]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[13]  Yafeng Yin,et al.  A Symmetric Local Search Network for Emotion-Cause Pair Extraction , 2020, COLING.

[14]  Shoushan Li,et al.  End-to-End Emotion-Cause Pair Extraction with Graph Convolutional Network , 2020, COLING.

[15]  Ying Chen,et al.  An Emotion Cause Corpus for Chinese Microblogs with Multiple-User Structures , 2017, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[16]  Ying Chen,et al.  Joint Learning for Emotion Classification and Emotion Cause Detection , 2018, EMNLP.

[17]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Timothy Dozat,et al.  Deep Biaffine Attention for Neural Dependency Parsing , 2016, ICLR.

[19]  Chu-Ren Huang,et al.  A Text-driven Rule-based System for Emotion Cause Detection , 2010, HLT-NAACL 2010.

[20]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[21]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[22]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[23]  Ruifeng Xu,et al.  Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction , 2020, ACL.

[24]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[25]  Jianfei Yu,et al.  ECPE-2D: Emotion-Cause Pair Extraction based on Joint Two-Dimensional Representation, Interaction and Prediction , 2020, ACL.

[26]  Chu-Ren Huang,et al.  DETECTING EMOTION CAUSES WITH A LINGUISTIC RULE‐BASED APPROACH 1 , 2013, Comput. Intell..

[27]  Yoshua Bengio,et al.  A Neural Probabilistic Language Model , 2003, J. Mach. Learn. Res..

[28]  Daling Wang,et al.  A Co-Attention Neural Network Model for Emotion Cause Analysis with Emotional Context Awareness , 2018, EMNLP.

[29]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[30]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.