Explicit Interaction Network for Aspect Sentiment Triplet Extraction

Aspect Sentiment Triplet Extraction (ASTE) aims to recognize targets, their sentiment polarities and opinions explaining the sentiment from a sentence. ASTE could be naturally divided into 3 atom subtasks, namely target detection, opinion detection and sentiment classification. We argue that the proper subtask combination, compositional feature extraction for targetopinion pairs, and interaction between subtasks would be the key to success. Prior work, however, may fail on ‘one-to-many’ or ‘many-to-one’ situations, or derive non-existent sentiment triplets due to defective subtask formulation, sub-optimal feature representation or the lack of subtask interaction. In this paper, we divide ASTE into target-opinion joint detection and sentiment classification subtasks, which is in line with human cognition, and correspondingly propose sequence encoder and table encoder. Table encoder extracts sentiment at token-pair level, so that the compositional feature between targets and opinions can be easily captured. To establish explicit interaction between subtasks, we utilize the table representation to guide the sequence encoding, and inject the sequence features back into the table encoder. Experiments show that our model outperforms state-of-the-art methods on six popular ASTE datasets.

[1]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[2]  Jürgen Schmidhuber,et al.  Multi-dimensional Recurrent Neural Networks , 2007, ICANN.

[3]  Hinrich Schütze,et al.  Table Filling Multi-Task Recurrent Neural Network for Joint Entity and Relation Extraction , 2016, COLING.

[4]  Hai Jin,et al.  Semantic and Syntactic Enhanced Aspect Sentiment Triplet Extraction , 2021, FINDINGS.

[5]  Houfeng Wang,et al.  First Target and Opinion then Polarity: Enhancing Target-opinion Correlation for Aspect Sentiment Triplet Extraction , 2021, ArXiv.

[6]  Jun Zhao,et al.  Joint Entity and Relation Extraction with Set Prediction Networks , 2020, IEEE transactions on neural networks and learning systems.

[7]  Houfeng Wang,et al.  Interactive Attention Networks for Aspect-Level Sentiment Classification , 2017, IJCAI.

[8]  Ming Zhou,et al.  Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification , 2014, ACL.

[9]  Xiaokui Xiao,et al.  Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms , 2017, AAAI.

[10]  Jue Wang,et al.  Two Are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders , 2020, EMNLP.

[11]  Heng Yang,et al.  A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extraction , 2021, Neurocomputing.

[12]  Omer Levy,et al.  BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension , 2019, ACL.

[13]  Aspect Sentiment Classification with Aspect-Specific Opinion Spans , 2020, EMNLP.

[14]  Hwee Tou Ng,et al.  Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation Extraction , 2019, AAAI.

[15]  Tao Jiang,et al.  Attentional Encoder Network for Targeted Sentiment Classification , 2019, ICANN.

[16]  Xinyu Dai,et al.  Grid Tagging Scheme for End-to-End Fine-grained Opinion Extraction , 2020, FINDINGS.

[17]  Lidong Bing,et al.  Recurrent Attention Network on Memory for Aspect Sentiment Analysis , 2017, EMNLP.

[18]  Yi Shen,et al.  A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis , 2021, AAAI.

[19]  Xiaoyong Du,et al.  Learning Document Embeddings by Predicting N-grams for Sentiment Classification of Long Movie Reviews , 2015, ArXiv.

[20]  Lu Xu,et al.  Position-Aware Tagging for Aspect Sentiment Triplet Extraction , 2020, EMNLP.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Tanasanee Phienthrakul,et al.  Sentiment Classification Using Document Embeddings Trained with Cosine Similarity , 2019, ACL.

[23]  Dawei Song,et al.  A Multi-task Learning Framework for Opinion Triplet Extraction , 2020, FINDINGS.

[24]  Houfeng Wang,et al.  Joint Learning for Targeted Sentiment Analysis , 2018, EMNLP.

[25]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[26]  Xipeng Qiu,et al.  A Unified Generative Framework for Aspect-based Sentiment Analysis , 2021, ACL.

[27]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[28]  Yangqiu Song,et al.  Neural Aspect and Opinion Term Extraction with Mined Rules as Weak Supervision , 2019, ACL.

[29]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[30]  Owen Rambow,et al.  Sentiment Analysis of Twitter Data , 2011 .

[31]  Yu Wang,et al.  Bidirectional Machine Reading Comprehension for Aspect Sentiment Triplet Extraction , 2021, AAAI.

[32]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[33]  Ekin Ekinci,et al.  An Aspect-Sentiment Pair Extraction Approach Based on Latent Dirichlet Allocation , 2018 .

[34]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[35]  Yue Zhang,et al.  End-to-End Neural Relation Extraction with Global Optimization , 2017, EMNLP.

[36]  Timothy Dozat,et al.  Deep Biaffine Attention for Neural Dependency Parsing , 2016, ICLR.

[37]  Sebastian Stabinger,et al.  Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification , 2020, LREC.

[38]  Siu Cheung Hui,et al.  Modularized Interaction Network for Named Entity Recognition , 2021, ACL.

[39]  Xin Li,et al.  A Unified Model for Opinion Target Extraction and Target Sentiment Prediction , 2018, AAAI.

[40]  Luo Si,et al.  Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysis , 2019, AAAI.

[41]  Danqi Chen,et al.  A Frustratingly Easy Approach for Joint Entity and Relation Extraction , 2020, ArXiv.

[42]  Justin Zhijun Zhan,et al.  Sentiment analysis using product review data , 2015, Journal of Big Data.

[43]  Claire Cardie,et al.  Extracting Opinion Expressions with semi-Markov Conditional Random Fields , 2012, EMNLP.

[44]  Xin Li,et al.  Aspect Term Extraction with History Attention and Selective Transformation , 2018, IJCAI.

[45]  Meina Song,et al.  A Text-Generated Method to Joint Extraction of Entities and Relations , 2019, Applied Sciences.