Enhancing Aspect-level Sentiment Analysis with Word Dependencies

Aspect-level sentiment analysis (ASA) has received much attention in recent years. Most existing approaches tried to leverage syntactic information, such as the dependency parsing results of the input text, to improve sentiment analysis on different aspects. Although these approaches achieved satisfying results, their main focus is to leverage the dependency arcs among words where the dependency type information is omitted; and they model different dependencies equally where the noisy dependency results may hurt model performance. In this paper, we propose an approach to enhance aspect-level sentiment analysis with word dependencies, where the type information is modeled by key-value memory networks and different dependency results are selectively leveraged. Experimental results on five benchmark datasets demonstrate the effectiveness of our approach, where it outperforms baseline models on all datasets and achieves state-of-the-art performance on three of them.

[1]  Erik Cambria,et al.  Modeling Inter-Aspect Dependencies for Aspect-Based Sentiment Analysis , 2018, NAACL.

[2]  Yonggang Wang,et al.  Improving Chinese Word Segmentation with Wordhood Memory Networks , 2020, ACL.

[3]  Houfeng Wang,et al.  Interactive Attention Networks for Aspect-Level Sentiment Classification , 2017, IJCAI.

[4]  Yan Song,et al.  Transliteration of Name Entity via Improved Statistical Translation on Character Sequences , 2009, NEWS@IJCNLP.

[5]  Ming Zhou,et al.  Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification , 2014, ACL.

[6]  Xiaowei Shen,et al.  CAN: Constrained Attention Networks for Multi-Aspect Sentiment Analysis , 2018, EMNLP.

[7]  Xin Li,et al.  Transformation Networks for Target-Oriented Sentiment Classification , 2018, ACL.

[8]  Tieyun Qian,et al.  Transfer Capsule Network for Aspect Level Sentiment Classification , 2019, ACL.

[9]  Shuming Shi,et al.  Complementary Learning of Word Embeddings , 2018, IJCAI.

[10]  Jan Hajic,et al.  Neural Architectures for Nested NER through Linearization , 2019, ACL.

[11]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[12]  Tao Li,et al.  Aspect Based Sentiment Analysis with Gated Convolutional Networks , 2018, ACL.

[13]  Chengqing Zong,et al.  Document-level Multi-aspect Sentiment Classification by Jointly Modeling Users, Aspects, and Overall Ratings , 2018, COLING.

[14]  Kai Wang,et al.  Relational Graph Attention Network for Aspect-based Sentiment Analysis , 2020, ACL.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Aijun An,et al.  A Comprehensive Analysis of Preprocessing for Word Representation Learning in Affective Tasks , 2020, ACL.

[17]  Yan Song,et al.  Entropy-based Training Data Selection for Domain Adaptation , 2012, COLING.

[18]  Yonggang Wang,et al.  Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-way Attentions of Auto-analyzed Knowledge , 2020, ACL.

[19]  Philip S. Yu,et al.  BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis , 2019, NAACL.

[20]  Senzhang Wang,et al.  Aspect-Based Sentiment Classification with Attentive Neural Turing Machines , 2019, IJCAI.

[21]  Ming Liu,et al.  Capsule Network with Interactive Attention for Aspect-Level Sentiment Classification , 2019, EMNLP.

[22]  Dongyan Zhao,et al.  Multi-grained Attention Network for Aspect-Level Sentiment Classification , 2018, EMNLP.

[23]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[24]  Fei Xia,et al.  Improving biomedical named entity recognition with syntactic information , 2020, BMC Bioinform..

[25]  Jeffrey Ling,et al.  Matching the Blanks: Distributional Similarity for Relation Learning , 2019, ACL.

[26]  Hwee Tou Ng,et al.  Exploiting Document Knowledge for Aspect-level Sentiment Classification , 2018, ACL.

[27]  Yan Song,et al.  A Common Case of Jekyll and Hyde: The Synergistic Effect of Using Divided Source Training Data for Feature Augmentation , 2013, IJCNLP.

[28]  Fei Xia,et al.  Joint Chinese Word Segmentation and Part-of-speech Tagging via Multi-channel Attention of Character N-grams , 2020, COLING.

[29]  Xiang Ao,et al.  A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis , 2019, EMNLP.

[30]  Jing Li,et al.  Directional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings , 2018, NAACL.

[31]  Fei Xia,et al.  Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks , 2020, EMNLP.

[32]  Jiebo Luo,et al.  Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis , 2019, ACL.

[33]  Tieyun Qian,et al.  Enhanced Aspect Level Sentiment Classification with Auxiliary Memory , 2018, COLING.

[34]  Chenliang Li,et al.  Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment Classification , 2020, ACL.

[35]  Kathleen M. Carley,et al.  Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks , 2019, EMNLP.

[36]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[37]  Gerhard Weikum,et al.  A Study of the Importance of External Knowledge in the Named Entity Recognition Task , 2018, ACL.

[38]  Shuai Wang,et al.  Target-Sensitive Memory Networks for Aspect Sentiment Classification , 2018, ACL.

[39]  Ting Liu,et al.  Aspect Level Sentiment Classification with Deep Memory Network , 2016, EMNLP.

[40]  Yi Cai,et al.  Recognizing Conflict Opinions in Aspect-level Sentiment Classification with Dual Attention Networks , 2019, EMNLP/IJCNLP.

[41]  Yuexian Hou,et al.  A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis , 2018, COLING.

[42]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[43]  Kathleen M. Carley,et al.  Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classification , 2019, EMNLP.

[44]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[45]  Jason Weston,et al.  Key-Value Memory Networks for Directly Reading Documents , 2016, EMNLP.

[46]  Yan Song,et al.  Learning Word Representations with Regularization from Prior Knowledge , 2017, CoNLL.

[47]  Richong Zhang,et al.  Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree , 2019, EMNLP.

[48]  Haris Papageorgiou,et al.  SemEval-2016 Task 5: Aspect Based Sentiment Analysis , 2016, *SEMEVAL.

[49]  Tong Zhang,et al.  ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations , 2019, FINDINGS.

[50]  Tong Zhang,et al.  Improving Constituency Parsing with Span Attention , 2020, FINDINGS.

[51]  Lidong Bing,et al.  Recurrent Attention Network on Memory for Aspect Sentiment Analysis , 2017, EMNLP.

[52]  Hai Zhao,et al.  Semantic Role Labeling with Associated Memory Network , 2019, NAACL-HLT.

[53]  Hwee Tou Ng,et al.  Effective Attention Modeling for Aspect-Level Sentiment Classification , 2018, COLING.

[54]  Erik Cambria,et al.  Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM , 2018, AAAI.

[55]  Suresh Manandhar,et al.  SemEval-2015 Task 12: Aspect Based Sentiment Analysis , 2015, *SEMEVAL.

[56]  Yan Song,et al.  Joint Aspect Extraction and Sentiment Analysis with Directional Graph Convolutional Networks , 2020, COLING.

[57]  Xiang Wan,et al.  Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information , 2020, FINDINGS.

[58]  Tiejun Zhao,et al.  Target-dependent Twitter Sentiment Classification , 2011, ACL.

[59]  Ruifeng Xu,et al.  Context-aware Embedding for Targeted Aspect-based Sentiment Analysis , 2019, ACL.

[60]  Xiaocheng Feng,et al.  Effective LSTMs for Target-Dependent Sentiment Classification , 2015, COLING.

[61]  Yan Song,et al.  Chinese Word Segmentation Based on an Approach of Maximum Entropy Modeling , 2006, SIGHAN@COLING/ACL.

[62]  Fei Xia,et al.  Summarizing Medical Conversations via Identifying Important Utterances , 2020, COLING.

[63]  Tao Jiang,et al.  Attentional Encoder Network for Targeted Sentiment Classification , 2019, ICANN.

[64]  Yan Song,et al.  Using a Goodness Measurement for Domain Adaptation: A Case Study on Chinese Word Segmentation , 2012, LREC.