Pair-Based Joint Encoding with Relational Graph Convolutional Networks for Emotion-Cause Pair Extraction

Emotion-cause pair extraction (ECPE) aims to extract emotion clauses and corresponding cause clauses, which have recently received growing attention. Previous methods sequentially encode features with a specified order. They first encode the emotion and cause features for clause extraction and then combine them for pair extraction. This lead to an imbalance in inter-task feature interaction where features extracted later have no direct contact with the former. To address this issue, we propose a novel **P**air-**B**ased **J**oint **E**ncoding (**PBJE**) network, which generates pairs and clauses features simultaneously in a joint feature encoding manner to model the causal relationship in clauses. PBJE can balance the information flow among emotion clauses, cause clauses and pairs. From a multi-relational perspective, we construct a heterogeneous undirected graph and apply the Relational Graph Convolutional Network (RGCN) to capture the multiplex relationship between clauses and the relationship between pairs and clauses. Experimental results show that PBJE achieves state-of-the-art performance on the Chinese benchmark corpus.

[1]  Hieu Hanh Le,et al.  Towards Effective Multi-Task Interaction for Entity-Relation Extraction: A Unified Framework with Selection Recurrent Network , 2022, ArXiv.

[2]  Qi Zhang,et al.  A Partition Filter Network for Joint Entity and Relation Extraction , 2021, EMNLP.

[3]  Quan Hung Tran,et al.  Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference , 2021, ACL.

[4]  Ashutosh Modi,et al.  An End-to-End Network for Emotion-Cause Pair Extraction , 2021, WASSA.

[5]  Jianping Wang,et al.  A Unified Sequence Labeling Model for Emotion Cause Pair Extraction , 2020, COLING.

[6]  Yafeng Yin,et al.  A Symmetric Local Search Network for Emotion-Cause Pair Extraction , 2020, COLING.

[7]  Shoushan Li,et al.  End-to-End Emotion-Cause Pair Extraction with Graph Convolutional Network , 2020, COLING.

[8]  Jianping Wang,et al.  Conditional Causal Relationships between Emotions and Causes in Texts , 2020, EMNLP.

[9]  Ruifeng Xu,et al.  Emotion-Cause Pair Extraction as Sequence Labeling Based on a Novel Tagging Scheme , 2020, EMNLP.

[10]  Jianfei Yu,et al.  End-to-End Emotion-Cause Pair Extraction Based on Sliding Window Multi-Label Learning , 2020, EMNLP.

[11]  Hongsong Zhu,et al.  TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking , 2020, COLING.

[12]  Jue Wang,et al.  Two Are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders , 2020, EMNLP.

[13]  Mayank Kejriwal,et al.  An Experimental Study of The Effects of Position Bias on Emotion CauseExtraction , 2020, ArXiv.

[14]  Ruifeng Xu,et al.  Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction , 2020, ACL.

[15]  Jiahao Zhao,et al.  Effective Inter-Clause Modeling for End-to-End Emotion-Cause Pair Extraction , 2020, ACL.

[16]  Jianfei Yu,et al.  ECPE-2D: Emotion-Cause Pair Extraction based on Joint Two-Dimensional Representation, Interaction and Prediction , 2020, ACL.

[17]  Bryan Hooi,et al.  Understanding and Resolving Performance Degradation in Deep Graph Convolutional Networks , 2020, CIKM.

[18]  R'emi Louf,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[19]  Xu Sun,et al.  Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View , 2019, AAAI.

[20]  Junzhou Huang,et al.  DropEdge: Towards Deep Graph Convolutional Networks on Node Classification , 2019, ICLR.

[21]  Wei-Yun Ma,et al.  GraphRel: Modeling Text as Relational Graphs for Joint Entity and Relation Extraction , 2019, ACL.

[22]  Rui Xia,et al.  Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Texts , 2019, ACL.

[23]  Rui Xia,et al.  RTHN: A RNN-Transformer Hierarchical Network for Emotion Cause Extraction , 2019, IJCAI.

[24]  Rui Xia,et al.  From Independent Prediction to Re-ordered Prediction: Integrating Relative Position and Global Label Information to Emotion Cause Identification , 2019, AAAI.

[25]  Daling Wang,et al.  Context-aware emotion cause analysis with multi-attention-based neural network , 2019, Knowl. Based Syst..

[26]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[27]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[28]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[29]  Qin Lu,et al.  A Question Answering Approach for Emotion Cause Extraction , 2017, EMNLP.

[30]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[31]  Chu-Ren Huang,et al.  A Text-driven Rule-based System for Emotion Cause Detection , 2010, HLT-NAACL 2010.

[32]  Guimin Hu,et al.  Bidirectional Hierarchical Attention Networks based on Document-level Context for Emotion Cause Extraction , 2021, EMNLP.

[33]  Yafeng Yin,et al.  A Unified Target-Oriented Sequence-to-Sequence Model for Emotion-Cause Pair Extraction , 2021, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[34]  Lin Gui,et al.  Multi-Task Sequence Tagging for Emotion-Cause Pair Extraction Via Tag Distribution Refinement , 2021, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[35]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[36]  Daling Wang,et al.  A Co-Attention Neural Network Model for Emotion Cause Analysis with Emotional Context Awareness , 2018, EMNLP.

[37]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[38]  Ji-Rong Wen,et al.  Semi-Supervised Learning , 2014 .