Identifying Implicit Polarity of Events by Using an Attention-Based Neural Network Model

Sentiment analysis has attracted extensive attention in recent years. Existing work mainly focuses on sentiment classification task in which a text or sentence usually contains sentiment word to express subjective feeling. However, little research is proposed for identifying implicit polarity of a text. Here, implicit polarity of a text means that the text does not contain sentiment words but still express a positive or negative sentiment. To address this issue, we propose an attention-based neural network model to identify implicit polarity of events. In particular, the model first learns the sentence representation by recurrent neural network with gated recurrent unit. Then multiple hops attention mechanism is used for capturing multiple aspects closely related to sentiment polarity and the event type. Experimental results on SemEval 2015 dataset show the effectiveness of the proposed model, outperforming the previous systems and strong neural baselines.

[1]  Hsin-Hsi Chen,et al.  Implicit Polarity and Implicit Aspect Recognition in Opinion Mining , 2016, ACL.

[2]  Janyce Wiebe,et al.  Benefactive/Malefactive Event and Writer Attitude Annotation , 2013, ACL.

[3]  RenYafeng,et al.  A topic-enhanced word embedding for Twitter sentiment classification , 2016 .

[4]  Ming Zhou,et al.  Building Large-Scale Twitter-Specific Sentiment Lexicon : A Representation Learning Approach , 2014, COLING.

[5]  Maite Taboada,et al.  Lexicon-Based Methods for Sentiment Analysis , 2011, CL.

[6]  Dong-Hong Ji,et al.  A topic-enhanced word embedding for Twitter sentiment classification , 2016, Inf. Sci..

[7]  Kim Schouten,et al.  Implicit feature detection for sentiment analysis , 2014, WWW '14 Companion.

[8]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[12]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[13]  Alexander J. Smola,et al.  Stacked Attention Networks for Image Question Answering , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  TaboadaMaite,et al.  Lexicon-based methods for sentiment analysis , 2011 .

[15]  Alessandro Moschitti,et al.  UNITN: Training Deep Convolutional Neural Network for Twitter Sentiment Classification , 2015, *SEMEVAL.

[16]  Yue Zhang,et al.  Attention Modeling for Targeted Sentiment , 2017, EACL.

[17]  Ying Peng,et al.  Chinese metaphor sentiment analysis based on attention-based LSTM , 2018, 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI).

[18]  Noah A. Smith,et al.  What Do Recurrent Neural Network Grammars Learn About Syntax? , 2016, EACL.

[19]  Tommaso Caselli,et al.  SemEval-2015 Task 9: CLIPEval Implicit Polarity of Events , 2015, *SEMEVAL.

[20]  Yutaka Matsuo,et al.  IIIDYT at IEST 2018: Implicit Emotion Classification With Deep Contextualized Word Representations , 2018, WASSA@EMNLP.

[21]  Véronique Hoste,et al.  The good, the bad and the implicit: a comprehensive approach to annotating explicit and implicit sentiment , 2015, Lang. Resour. Evaluation.

[22]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[23]  Xiaocheng Feng,et al.  Effective LSTMs for Target-Dependent Sentiment Classification , 2015, COLING.

[24]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[25]  Will Lowe,et al.  Multilingual Sentiment Analysis: A New Approach to Measuring Conflict in Legislative Speeches , 2018, Legislative Studies Quarterly.

[26]  Ramón Fernández Astudillo,et al.  Not All Contexts Are Created Equal: Better Word Representations with Variable Attention , 2015, EMNLP.

[27]  Sanjida Akter,et al.  Sentiment analysis on facebook group using lexicon based approach , 2016, 2016 3rd International Conference on Electrical Engineering and Information Communication Technology (ICEEICT).

[28]  Benjamin Van Durme,et al.  Open Domain Targeted Sentiment , 2013, EMNLP.

[29]  Benjamin Van Durme,et al.  Annotated Gigaword , 2012, AKBC-WEKEX@NAACL-HLT.

[30]  Zhiyong Luo,et al.  Combination of Convolutional and Recurrent Neural Network for Sentiment Analysis of Short Texts , 2016, COLING.

[31]  Ari Rappoport,et al.  Enhanced Sentiment Learning Using Twitter Hashtags and Smileys , 2010, COLING.

[32]  Jian Su,et al.  Supervised and Traditional Term Weighting Methods for Automatic Text Categorization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Xuanjing Huang,et al.  Adversarial Multi-task Learning for Text Classification , 2017, ACL.

[34]  Vijayalakshmi Atluri,et al.  Web-based application for sentiment analysis of live tweets , 2018, DG.O.

[35]  Lidong Bing,et al.  Recurrent Attention Network on Memory for Aspect Sentiment Analysis , 2017, EMNLP.

[36]  Hongwei Wang,et al.  Sentimental feature selection for sentiment analysis of Chinese online reviews , 2015, International Journal of Machine Learning and Cybernetics.

[37]  Iryna Gurevych,et al.  Sentence and Expression Level Annotation of Opinions in User-Generated Discourse , 2010, ACL.

[38]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[39]  Xiaocheng Feng,et al.  Target-Dependent Sentiment Classification with Long Short Term Memory , 2015, ArXiv.

[40]  P. Lewinsohn,et al.  The Pleasant Events Schedule: Studies on Reliability, Validity, and Scale Intercorrelation. , 1982 .

[41]  Kiyoaki Shirai,et al.  PhraseRNN: Phrase Recursive Neural Network for Aspect-based Sentiment Analysis , 2015, EMNLP.

[42]  Laizhong Cui,et al.  Combine HowNet lexicon to train phrase recursive autoencoder for sentence-level sentiment analysis , 2017, Neurocomputing.

[43]  Dong-Hong Ji,et al.  A short text sentiment-topic model for product reviews , 2018, Neurocomputing.

[44]  Yue Zhang,et al.  Target-Dependent Twitter Sentiment Classification with Rich Automatic Features , 2015, IJCAI.

[45]  P. Lewinsohn,et al.  Some relations between pleasant and unpleasant mood-related events and depression. , 1978, Journal of abnormal psychology.