Sentiment Analysis of Saudi Dialect Using Deep Learning Techniques

Nowadays Twitter and Facebook are the most popular social media platforms to express opinions about various topics. Sentiment analysis (SA) aims to extract the opinions from tweets, reviews and comments. Almost all prior research has used machine learning algorithms to classify the Arabic text into positive, negative or neutral. Recently, the deep learning techniques have shown promising accuracy for SA on English, Thai, Persian, and Tamil. Motivated by the results, we propose the first study applying deep learning to classify sentiments of Saudi dialect texts. We have collected a dataset of 32063 tweets and then applied two deep learning techniques to perform SA: Long short-term memory (LSTM) and bidirectional long short-term memory (Bi-LSTM). For the sake of comparison, we have also applied the well-known support vector machine (SVM) algorithm to classify the sentiments of the collected data. The results show that the deep learning techniques outperform the SVM algorithm. The experimental result of Bi-LSTM is 94% outperforming that of the LSTM (92%), while the SVM has the lowest performance of 86.4%.

[1]  Bo Xu,et al.  Recursive Deep Learning for Sentiment Analysis over Social Data , 2014, 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  Tiranee Achalakul,et al.  Deep Belief Networks with Feature Selection for Sentiment Classification , 2016, 2016 7th International Conference on Intelligent Systems, Modelling and Simulation (ISMS).

[4]  Ting Liu,et al.  Deep learning for sentiment analysis: successful approaches and future challenges , 2015, WIREs Data Mining Knowl. Discov..

[5]  Babar Hayat,et al.  Sentiment Analysis Using Deep Learning Techniques: A Review , 2017, International Journal of Advanced Computer Science and Applications.

[6]  Mohammad Rahmati,et al.  Sentiment analysis using deep learning on Persian texts , 2017, 2017 Iranian Conference on Electrical Engineering (ICEE).

[7]  Hidekazu Yanagimoto,et al.  Document similarity estimation for sentiment analysis using neural network , 2013, 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS).

[8]  R. M. Duwairi,et al.  Sentiment Analysis in Arabic tweets , 2014, 2014 5th International Conference on Information and Communication Systems (ICICS).

[9]  Arafat Awajan,et al.  Sentiment classification techniques for Arabic language: A survey , 2016, 2016 7th International Conference on Information and Communication Systems (ICICS).

[10]  Hazem M. Hajj,et al.  Deep Learning Models for Sentiment Analysis in Arabic , 2015, ANLP@ACL.

[11]  Joseph D. Prusa,et al.  Designing a Better Data Representation for Deep Neural Networks and Text Classification , 2016, 2016 IEEE 17th International Conference on Information Reuse and Integration (IRI).

[12]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[13]  Hazem M. Hajj,et al.  Sentence-Level and Document-Level Sentiment Mining for Arabic Texts , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[14]  Claire Cardie,et al.  Deep Recursive Neural Networks for Compositionality in Language , 2014, NIPS.

[15]  Hong Soon Goo,et al.  Twitter sentiment analysis using deep learning methods , 2017, 2017 7th International Annual Engineering Seminar (InAES).

[16]  Wojciech Zaremba,et al.  Recurrent Neural Network Regularization , 2014, ArXiv.

[17]  Luis Alfonso Ureña López,et al.  OCA: Opinion corpus for Arabic , 2011, J. Assoc. Inf. Sci. Technol..

[18]  Nizar Habash,et al.  A Sentiment Treebank and Morphologically Enriched Recursive Deep Models for Effective Sentiment Analysis in Arabic , 2017, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[19]  Peerapon Vateekul,et al.  A study of sentiment analysis using deep learning techniques on Thai Twitter data , 2016, 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[20]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[21]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[22]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[23]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[24]  Hai Zhao,et al.  A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding , 2015, ArXiv.

[25]  Bashar Al Shboul,et al.  Multi-way sentiment classification of Arabic reviews , 2015, 2015 6th International Conference on Information and Communication Systems (ICICS).

[26]  Min Zhang,et al.  Network Public Comments Sentiment Analysis Based on Multilayer Convolutional Neural Network , 2016, 2016 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[27]  Petr Sojka,et al.  Software Framework for Topic Modelling with Large Corpora , 2010 .

[28]  V. Prema,et al.  Sentiment analysis of online Tamil contents using recursive neural network models approach for Tamil language , 2017, 2017 IEEE International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM).

[29]  Hazem M. Hajj,et al.  AROMA: A Recursive Deep Learning Model for Opinion Mining in Arabic as a Low Resource Language , 2017, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[30]  Kumar Ravi,et al.  A novel deep learning architecture for sentiment classification , 2016, 2016 3rd International Conference on Recent Advances in Information Technology (RAIT).

[31]  Aqil M. Azmi,et al.  Arabic tweets sentiment analysis – a hybrid scheme , 2016, J. Inf. Sci..

[32]  Peng Li,et al.  Sentiment Lexical-Augmented Convolutional Neural Networks for Sentiment Analysis , 2017, 2017 IEEE Second International Conference on Data Science in Cyberspace (DSC).

[33]  Samy Bengio,et al.  Guest Editors' Introduction: Special Section on Learning Deep Architectures , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Ahmed Emam,et al.  Towards enhancement of a lexicon-based approach for Saudi dialect sentiment analysis , 2018, J. Inf. Sci..