Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels' reviews

Abstract In this research, state-of-the-art approaches based on supervised machine learning are presented to address the challenges of aspect-based sentiment analysis (ABSA) of Arabic Hotels’ reviews. Two approaches of deep recurrent neural network (RNN) and support vector machine (SVM) are implemented and trained along with lexical, word, syntactic, morphological, and semantic features. The proposed approaches are evaluated using a reference dataset of Arabic Hotels’ reviews. Evaluation results show that the SVM approach outperforms the other deep RNN approach in the research investigated tasks (T1: aspect category identification, T2: aspect opinion target expression (OTE) extraction, and T3: aspect sentiment polarity identification). Whereas, when focusing on the execution time required for training and testing the models, the deep RNN execution time was faster, especially for the second task.

[1]  Saif Mohammad,et al.  NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets , 2013, *SEMEVAL.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Muhammad Abdul-Mageed,et al.  SAMAR: Subjectivity and sentiment analysis for Arabic social media , 2014, Comput. Speech Lang..

[4]  Nizar Habash,et al.  MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic , 2014, LREC.

[5]  Khurshid Ahmad,et al.  Multi-lingual Sentiment Analysis of Financial News Streams , 2007 .

[6]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[7]  Claire Cardie,et al.  OpinionFinder: A System for Subjectivity Analysis , 2005, HLT.

[8]  Eric Chang,et al.  Red Opal: product-feature scoring from reviews , 2007, EC '07.

[9]  Muhannad Quwaider,et al.  Human Annotated Arabic Dataset of Book Reviews for Aspect Based Sentiment Analysis , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[10]  Preslav Nakov,et al.  SemEval-2014 Task 9: Sentiment Analysis in Twitter , 2014, *SEMEVAL.

[11]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[12]  R. M. Chandrasekaran,et al.  A sampling based sentiment mining approach for e-commerce applications , 2017, Inf. Process. Manag..

[13]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[14]  Cheng-Yuan Liou,et al.  Modeling word perception using the Elman network , 2008, Neurocomputing.

[15]  Alexander Clark,et al.  Combining Distributional and Morphological Information for Part of Speech Induction , 2003, EACL.

[16]  Muhammad Abdul-Mageed,et al.  Subjectivity and Sentiment Annotation of Modern Standard Arabic Newswire , 2011, Linguistic Annotation Workshop.

[17]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[18]  Pengfei Duan,et al.  Word Embeddings and Convolutional Neural Network for Arabic Sentiment Classification , 2016, COLING.

[19]  Haris Papageorgiou,et al.  SemEval-2016 Task 5: Aspect Based Sentiment Analysis , 2016, *SEMEVAL.

[20]  Mahmoud Al-Ayyoub,et al.  Using Enhanced Lexicon-Based Approaches for the Determination of Aspect Categories and Their Polarities in Arabic Reviews , 2016, Int. J. Inf. Technol. Web Eng..

[21]  Ming Zhou,et al.  Coooolll: A Deep Learning System for Twitter Sentiment Classification , 2014, *SEMEVAL.

[22]  Muhammad Abdul-Mageed,et al.  AWATIF: A Multi-Genre Corpus for Modern Standard Arabic Subjectivity and Sentiment Analysis , 2012, LREC.

[23]  Muhammad Abdul-Mageed,et al.  Subjectivity and Sentiment Analysis of Arabic: A Survey , 2012, AMLTA.

[24]  Finn Årup Nielsen,et al.  A New ANEW: Evaluation of a Word List for Sentiment Analysis in Microblogs , 2011, #MSM.

[25]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[26]  Nizar Habash,et al.  Introduction to Arabic Natural Language Processing , 2010, Introduction to Arabic Natural Language Processing.

[27]  L. Hamandi,et al.  Classifying sentiment in arabic social networks: Naïve search versus Naïve bayes , 2012, 2012 2nd International Conference on Advances in Computational Tools for Engineering Applications (ACTEA).

[28]  Mahmoud Al-Ayyoub,et al.  Using Aspect-Based Sentiment Analysis to Evaluate Arabic News Affect on Readers , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[29]  Ales Tamchyna,et al.  UFAL at SemEval-2016 Task 5: Recurrent Neural Networks for Sentence Classification , 2016, *SEMEVAL.

[30]  José Saias,et al.  Sentiue: Target and Aspect based Sentiment Analysis in SemEval-2015 Task 12 , 2015, *SEMEVAL.

[31]  Hazem M. Hajj,et al.  Sentence-Level and Document-Level Sentiment Mining for Arabic Texts , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[32]  Patricio Martínez-Barco,et al.  Subjectivity and sentiment analysis: An overview of the current state of the area and envisaged developments , 2012, Decis. Support Syst..

[33]  Oren Etzioni,et al.  Extracting Product Features and Opinions from Reviews , 2005, HLT.

[34]  Udo Kruschwitz,et al.  AraNLP: a Java-based Library for the Processing of Arabic Text , 2014, LREC.

[35]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[36]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[37]  Peter D. Turney,et al.  Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon , 2010, HLT-NAACL 2010.

[38]  Saif Mohammad,et al.  Sentiment Analysis of Short Informal Texts , 2014, J. Artif. Intell. Res..

[39]  Amir F. Atiya,et al.  LABR: A Large Scale Arabic Book Reviews Dataset , 2013, ACL.

[40]  Mahmoud Al-Ayyoub,et al.  Enhancing the determination of aspect categories and their polarities in Arabic reviews using lexicon-based approaches , 2015, 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[41]  Suresh Manandhar,et al.  SemEval-2015 Task 12: Aspect Based Sentiment Analysis , 2015, *SEMEVAL.

[42]  Mahmoud Al-Ayyoub,et al.  An Aspect-Based Sentiment Analysis Approach to Evaluating Arabic News Affect on Readers , 2016, J. Univers. Comput. Sci..

[43]  Luis Alfonso Ureña López,et al.  OCA: Opinion corpus for Arabic , 2011, J. Assoc. Inf. Sci. Technol..

[44]  Verena Rieser,et al.  An Arabic Twitter Corpus for Subjectivity and Sentiment Analysis , 2014, LREC.

[45]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[46]  Mohamed G. Elfeky,et al.  Mining Arabic Business Reviews , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[47]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[48]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[49]  Alaa M. El-Halees,et al.  Arabic Opinion Mining Using Combined Classification Approach , 2011 .

[50]  Edward A. Fox,et al.  Automated arabic text classification with P‐Stemmer, machine learning, and a tailored news article taxonomy , 2016, J. Assoc. Inf. Sci. Technol..

[51]  Rodrigo Agerri,et al.  EliXa: A Modular and Flexible ABSA Platform , 2015, *SEMEVAL.

[52]  Jian Su,et al.  NLANGP: Supervised Machine Learning System for Aspect Category Classification and Opinion Target Extraction , 2015, *SEMEVAL.

[53]  Kyung Hyan Yoo,et al.  What Motivates Consumers to Write Online Travel Reviews? , 2008, J. Inf. Technol. Tour..

[54]  Aqil M. Azmi,et al.  Arabic tweets sentiment analysis – a hybrid scheme , 2016, J. Inf. Sci..

[55]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[56]  John G. Breslin,et al.  INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis , 2016, *SEMEVAL.

[57]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[58]  Tomas Mikolov,et al.  Bag of Tricks for Efficient Text Classification , 2016, EACL.

[59]  Mahmoud Al-Ayyoub,et al.  An enhanced framework for aspect-based sentiment analysis of Hotels' reviews: Arabic reviews case study , 2016, 2016 11th International Conference for Internet Technology and Secured Transactions (ICITST).

[60]  Erik F. Tjong Kim Sang,et al.  Representing Text Chunks , 1999, EACL.

[61]  Petr Sojka,et al.  Software Framework for Topic Modelling with Large Corpora , 2010 .

[62]  Muhammad Abdul-Mageed,et al.  Subjectivity and Sentiment Analysis of Modern Standard Arabic , 2011, ACL.

[63]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[64]  Christopher Potts,et al.  Learning Word Vectors for Sentiment Analysis , 2011, ACL.

[65]  Zhihua Zhang,et al.  ECNU: Extracting Effective Features from Multiple Sequential Sentences for Target-dependent Sentiment Analysis in Reviews , 2015, *SEMEVAL.