Using Deep Neural Networks for Extracting Sentiment Targets in Arabic Tweets

In this paper, we investigate the problem of recognizing entities which are targeted by text sentiment in Arabic tweets. To do so, we train a bidirectional LSTM deep neural network with conditional random fields as a classification layer on top of the network to discover the features of this specific set of entities and extract them from Arabic tweets. We’ve evaluated the network performance against a baseline method which makes use of a regular named entity recognizer and a sentiment analyzer. The deep neural network has shown a noticeable advantage in extracting sentiment target entities from Arabic tweets.

[1]  Benjamin Van Durme,et al.  Open Domain Targeted Sentiment , 2013, EMNLP.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Min Zhang,et al.  Variational Neural Machine Translation , 2016, EMNLP.

[4]  Samhaa R. El-Beltagy,et al.  A Hybrid Approach for Extracting Arabic Persons' Names and Resolving Their Ambiguity from Twitter , 2015, NLDB.

[5]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[6]  Samhaa R. El-Beltagy,et al.  NileTMRG at SemEval-2016 Task 5: Deep Convolutional Neural Networks for Aspect Category and Sentiment Extraction , 2016, *SEMEVAL.

[7]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[8]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[9]  Omnia Zayed,et al.  Named Entity Recognition of Persons' Names in Arabic Tweets , 2015, RANLP.

[10]  Yue Zhang,et al.  Gated Neural Networks for Targeted Sentiment Analysis , 2016, AAAI.

[11]  Haris Papageorgiou,et al.  SemEval-2016 Task 5: Aspect Based Sentiment Analysis , 2016, *SEMEVAL.

[12]  Wei Xu,et al.  Bidirectional LSTM-CRF Models for Sequence Tagging , 2015, ArXiv.

[13]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[14]  Wei Xu,et al.  Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN) , 2014, ICLR.

[15]  Samhaa R. El-Beltagy,et al.  NileULex: A Phrase and Word Level Sentiment Lexicon for Egyptian and Modern Standard Arabic , 2016, LREC.

[16]  Guillaume Lample,et al.  Neural Architectures for Named Entity Recognition , 2016, NAACL.

[17]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[18]  Deyi Xiong,et al.  Recurrent Neural Machine Translation , 2016, ArXiv.

[19]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[20]  Samhaa R. El-Beltagy,et al.  Combining Lexical Features and a Supervised Learning Approach for Arabic Sentiment Analysis , 2016, CICLing.