MemNetAR: Memory Network with Adversative Relation for Target-Level Sentiment Classification

Target-level sentiment classification aims to identify the sentiment of multiple targets in a sentence. Although existing approaches based on neural network have achieved good performance in this task, we find that many approaches tend to give the same predictions for instances that have multiple targets, and this tendency can make a low accuracy for those instances that have different classes for different targets. Based on this observation, we propose MemNetAR, a memory network which can explicitly leverage the adversative relation among multiple targets in a sentence. Specifically, we add an adversative loss to the cross-entropy loss when there are adversative words between targets. The experimental results on public laptop and restaurant datasets prove that our model can improve 0.84% and 0.8% on total test dataset, and improve 2.97% and 2.68% on the dataset consisting of those instances with multiple targets but different classes by leveraging this new adversative information.

[1]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[2]  Bing Liu,et al.  Mining Opinion Features in Customer Reviews , 2004, AAAI.

[3]  Ting Liu,et al.  Aspect Level Sentiment Classification with Deep Memory Network , 2016, EMNLP.

[4]  Lidong Bing,et al.  Recurrent Attention Network on Memory for Aspect Sentiment Analysis , 2017, EMNLP.

[5]  Xiaocheng Feng,et al.  Effective LSTMs for Target-Dependent Sentiment Classification , 2015, COLING.

[6]  Arun Kumar Sangaiah,et al.  Feature-based Compositing Memory Networks for Aspect-based Sentiment Classification in Social Internet of Things , 2017, Future Gener. Comput. Syst..

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[9]  Min Yang,et al.  Feature-enhanced attention network for target-dependent sentiment classification , 2018, Neurocomputing.

[10]  Houfeng Wang,et al.  Interactive Attention Networks for Aspect-Level Sentiment Classification , 2017, IJCAI.

[11]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[12]  John G. Breslin,et al.  A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis , 2016, EMNLP.

[13]  Yue Zhang,et al.  Attention Modeling for Targeted Sentiment , 2017, EACL.

[14]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[17]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[18]  Siu Cheung Hui,et al.  Dyadic Memory Networks for Aspect-based Sentiment Analysis , 2017, CIKM.

[19]  Tiejun Zhao,et al.  Target-dependent Twitter Sentiment Classification , 2011, ACL.

[20]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[21]  Saif Mohammad,et al.  NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews , 2014, *SEMEVAL.

[22]  Ming Zhou,et al.  Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification , 2014, ACL.