Aspect Sentiment Quad Prediction as Paraphrase Generation

Aspect-based sentiment analysis (ABSA) has been extensively studied in recent years, which typically involves four fundamental sentiment elements, including the aspect category, aspect term, opinion term, and sentiment polarity. Existing studies usually consider the detection of partial sentiment elements, instead of predicting the four elements in one shot. In this work, we introduce the Aspect Sentiment Quad Prediction (ASQP) task, aiming to jointly detect all sentiment elements in quads for a given opinionated sentence, which can reveal a more comprehensive and complete aspect-level sentiment structure. We further propose a novel PARAPHRASE modeling paradigm to cast the ASQP task to a paraphrase generation process. On one hand, the generation formulation allows solving ASQP in an end-to-end manner, alleviating the potential error propagation in the pipeline solution. On the other hand, the semantics of the sentiment elements can be fully exploited by learning to generate them in the natural language form. Extensive experiments on benchmark datasets show the superiority of our proposed method and the capacity of crosstask transfer with the proposed unified PARAPHRASE modeling framework.

[1]  Suresh Manandhar,et al.  SemEval-2015 Task 12: Aspect Based Sentiment Analysis , 2015, *SEMEVAL.

[2]  Hui Xue,et al.  SpanMlt: A Span-based Multi-Task Learning Framework for Pair-wise Aspect and Opinion Terms Extraction , 2020, ACL.

[3]  Bing Xiang,et al.  Augmented Natural Language for Generative Sequence Labeling , 2020, EMNLP.

[4]  Yi Shen,et al.  A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis , 2021, AAAI.

[5]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[6]  Xinyu Dai,et al.  Grid Tagging Scheme for End-to-End Fine-grained Opinion Extraction , 2020, FINDINGS.

[7]  Jianfeng Du,et al.  Target-Aspect-Sentiment Joint Detection for Aspect-Based Sentiment Analysis , 2020, AAAI.

[8]  Haris Papageorgiou,et al.  SemEval-2016 Task 5: Aspect Based Sentiment Analysis , 2016, *SEMEVAL.

[9]  Xing Xie,et al.  Exploring Sequence-to-Sequence Learning in Aspect Term Extraction , 2019, ACL.

[10]  Tieyun Qian,et al.  Relation-Aware Collaborative Learning for Unified Aspect-Based Sentiment Analysis , 2020, ACL.

[11]  Xiaowei Shen,et al.  CAN: Constrained Attention Networks for Multi-Aspect Sentiment Analysis , 2018, EMNLP.

[12]  Xiaokui Xiao,et al.  Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms , 2017, AAAI.

[13]  Yu Wang,et al.  Synchronous Double-channel Recurrent Network for Aspect-Opinion Pair Extraction , 2020, ACL.

[14]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[15]  Luyao Huang,et al.  Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence , 2019, NAACL.

[16]  Stefano Soatto,et al.  Structured Prediction as Translation between Augmented Natural Languages , 2021, ICLR.

[17]  Xiaojun Wan,et al.  Representation Learning for Aspect Category Detection in Online Reviews , 2015, AAAI.

[18]  Shafiq R. Joty,et al.  Fine-grained Opinion Mining with Recurrent Neural Networks and Word Embeddings , 2015, EMNLP.

[19]  Ming Zhou,et al.  Unsupervised Word and Dependency Path Embeddings for Aspect Term Extraction , 2016, IJCAI.

[20]  Colin Raffel,et al.  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer , 2019, J. Mach. Learn. Res..

[21]  Fuzheng Zhang,et al.  ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Prediction , 2021, NAACL.

[22]  Kathleen M. Carley,et al.  Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classification , 2019, EMNLP.

[23]  Lu Xu,et al.  Position-Aware Tagging for Aspect Sentiment Triplet Extraction , 2020, EMNLP.

[24]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[25]  Xipeng Qiu,et al.  A Unified Generative Framework for Aspect-based Sentiment Analysis , 2021, ACL.

[26]  Houfeng Wang,et al.  First Target and Opinion then Polarity: Enhancing Target-opinion Correlation for Aspect Sentiment Triplet Extraction , 2021, ArXiv.

[27]  Zhen Huang,et al.  Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classification , 2019, ACL.

[28]  Xin Li,et al.  A Unified Model for Opinion Target Extraction and Target Sentiment Prediction , 2018, AAAI.

[29]  Mi Zhang,et al.  Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis , 2020, EMNLP.

[30]  Lidong Bing,et al.  Exploiting BERT for End-to-End Aspect-based Sentiment Analysis , 2019, EMNLP.

[31]  Bing Liu,et al.  DOER: Dual Cross-Shared RNN for Aspect Term-Polarity Co-Extraction , 2019, ACL.

[32]  Yu Wang,et al.  Bidirectional Machine Reading Comprehension for Aspect Sentiment Triplet Extraction , 2021, AAAI.

[33]  Hwee Tou Ng,et al.  An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis , 2019, ACL.

[34]  Philip S. Yu,et al.  Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction , 2018, ACL.

[35]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[36]  Caroline Brun,et al.  Aspect Based Sentiment Analysis into the Wild , 2018, WASSA@EMNLP.

[37]  Luo Si,et al.  Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysis , 2019, AAAI.

[38]  Zhengxiao Du,et al.  GPT Understands, Too , 2021, AI Open.

[39]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[40]  Jianfei Yu,et al.  Aspect-Category based Sentiment Analysis with Hierarchical Graph Convolutional Network , 2020, COLING.

[41]  John G. Breslin,et al.  A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis , 2016, EMNLP.