Sentiment Analysis of Persian Movie Reviews Using Deep Learning

Sentiment analysis aims to automatically classify the subject’s sentiment (e.g., positive, negative, or neutral) towards a particular aspect such as a topic, product, movie, news, etc. Deep learning has recently emerged as a powerful machine learning technique to tackle the growing demand for accurate sentiment analysis. However, the majority of research efforts are devoted to English-language only, while information of great importance is also available in other languages. This paper presents a novel, context-aware, deep-learning-driven, Persian sentiment analysis approach. Specifically, the proposed deep-learning-driven automated feature-engineering approach classifies Persian movie reviews as having positive or negative sentiments. Two deep learning algorithms, convolutional neural networks (CNN) and long-short-term memory (LSTM), are applied and compared with our previously proposed manual-feature-engineering-driven, SVM-based approach. Simulation results demonstrate that LSTM obtained a better performance as compared to multilayer perceptron (MLP), autoencoder, support vector machine (SVM), logistic regression and CNN algorithms.

[1]  Kai Shuang,et al.  Combining Word Order and CNN-LSTM for Sentence Sentiment Classification , 2017, ICSEB 2017.

[2]  Pengfei Duan,et al.  Word Embeddings and Convolutional Neural Network for Arabic Sentiment Classification , 2016, COLING.

[3]  Lingfeng Niu,et al.  Feature Selection of Network Data VIA ℓ2, p Regularization , 2020, Cogn. Comput..

[4]  Syed Aziz Shah,et al.  An Intelligent Non-Invasive Real-Time Human Activity Recognition System for Next-Generation Healthcare , 2020, Sensors.

[5]  Qiang Zhou,et al.  PerSent: A Freely Available Persian Sentiment Lexicon , 2016, BICS.

[6]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[7]  Yue Liu,et al.  Aspect-Specific Sentimental Word Embedding for Sentiment Analysis of Online Reviews , 2016, WWW.

[8]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[9]  Rodrigo C. Barros,et al.  A character-based convolutional neural network for language-agnostic Twitter sentiment analysis , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[10]  Hadi Larijani,et al.  A Survey on the Role of Wireless Sensor Networks and IoT in Disaster Management , 2018, Springer Natural Hazards.

[11]  Xiaojie Zhao,et al.  Mixture Kernel Density Estimation and Remedied Correlation Matrix on the EEG-Based Copula Model for the Assessment of Visual Discomfort , 2020, Cognitive Computation.

[12]  Ahmad Y. A. Hawalah,et al.  Novel Deep Convolutional Neural Network-Based Contextual Recognition of Arabic Handwritten Scripts , 2021, Entropy.

[13]  Tiago A. Almeida,et al.  Text normalization and semantic indexing to enhance Instant Messaging and SMS spam filtering , 2016, Knowl. Based Syst..

[14]  Ashkan Hafezalkotob,et al.  A New Risk-Based Fuzzy Cognitive Model and Its Application to Decision-Making , 2019, Cognitive Computation.

[15]  Amir Hussain,et al.  Real-Time Lightweight Chaotic Encryption for 5G IoT Enabled Lip-Reading Driven Secure Hearing-Aid , 2018, ArXiv.

[16]  Muhammad Ali Imran,et al.  Travelers-Tracing and Mobility Profiling Using Machine Learning in Railway Systems , 2020, 2020 International Conference on UK-China Emerging Technologies (UCET).

[17]  Tunga Güngör,et al.  Part-of-Speech Tagging , 2005 .

[18]  Alimardani Saeedeh,et al.  OPINION MINING IN PERSIAN LANGUAGE USING SUPERVISED ALGORITHMS , 2015 .

[19]  Mario Andrés Paredes-Valverde,et al.  Sentiment Analysis in Spanish for Improvement of Products and Services: A Deep Learning Approach , 2017, Sci. Program..

[20]  Heri Ramampiaro,et al.  Effective hate-speech detection in Twitter data using recurrent neural networks , 2018, Applied Intelligence.

[21]  Chuandong Li,et al.  Neural Network-Based Event-Triggered Adaptive Control Algorithms for Uncertain Nonlinear Systems with Actuator Failures , 2020, Cogn. Comput..

[22]  Julie Beth Lovins,et al.  Development of a stemming algorithm , 1968, Mech. Transl. Comput. Linguistics.

[23]  Zixue Cheng,et al.  CNN for situations understanding based on sentiment analysis of twitter data , 2017 .

[24]  Lijun Liu,et al.  Sentiment Analysis Using Convolutional Neural Network , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[25]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[26]  Amir Hussain,et al.  Deep Neural Network Driven Binaural Audio Visual Speech Separation , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[27]  Erik Cambria,et al.  SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings , 2018, AAAI.

[28]  Jingpeng Li,et al.  Robust Visual Saliency Optimization Based on Bidirectional Markov Chains , 2020, Cognitive Computation.

[29]  Nehal Mohamed Ali,et al.  SENTIMENT ANALYSIS FOR MOVIES REVIEWS DATASET USING DEEP LEARNING MODELS , 2019, International Journal of Data Mining & Knowledge Management Process.

[30]  Saeedeh Momtazi,et al.  Deep Persian sentiment analysis: Cross-lingual training for low-resource languages , 2020, J. Inf. Sci..

[31]  Naeem Ramzan,et al.  Detection of Atrial Fibrillation Using a Machine Learning Approach , 2020, Inf..

[32]  Kaizhu Huang,et al.  Random Features and Random Neurons for Brain-Inspired Big Data Analytics , 2019, 2019 International Conference on Data Mining Workshops (ICDMW).

[33]  Amir Hussain,et al.  Visual Speech In Real Noisy Environments (VISION): A Novel Benchmark Dataset and Deep Learning-Based Baseline System , 2020, INTERSPEECH.

[34]  Jingpeng Li,et al.  A Hybrid Persian Sentiment Analysis Framework: Integrating Dependency Grammar Based Rules and Deep Neural Networks , 2019, Neurocomputing.

[35]  Qammer H. Abbasi,et al.  Energy and Performance Trade-Off Optimization in Heterogeneous Computing via Reinforcement Learning , 2020 .

[36]  Zain U. Hussain,et al.  Artificial intelligence-enabled analysis of UK and US public attitudes on Facebook and Twitter towards COVID-19 vaccinations , 2020, medRxiv.

[37]  Mohammad Ehsan Basiri,et al.  Sentence-level sentiment analysis in Persian , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[38]  Mohammad Ehsan Basiri,et al.  A Framework for Sentiment Analysis in Persian , 2014 .

[39]  Ausif Mahmood,et al.  Deep Learning approach for sentiment analysis of short texts , 2017, 2017 3rd International Conference on Control, Automation and Robotics (ICCAR).

[40]  Tariq S. Durrani,et al.  A Comparative Study of Persian Sentiment Analysis Based on Different Feature Combinations , 2017, CSPS.

[41]  A. Hussain,et al.  Towards Next-Generation Lip-Reading Driven Hearing-Aids : A preliminary Prototype Demo , 2017 .

[42]  Gholamreza Ghassem-Sani,et al.  LexiPers: An ontology based sentiment lexicon for Persian , 2016, GCAI.

[43]  Alexander F. Gelbukh,et al.  Adaptation of Sentiment Analysis Techniques to Persian Language , 2017, CICLing.

[44]  Maryam Hourali,et al.  A Context-Based Disambiguation Model for Sentiment Concepts Using a Bag-of-Concepts Approach , 2020, Cognitive Computation.

[45]  Amir Hussain,et al.  A novel brain-inspired compression-based optimised multimodal fusion for emotion recognition , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[46]  Francesco Carlo Morabito,et al.  Information Theoretic-Based Interpretation of a Deep Neural Network Approach in Diagnosing Psychogenic Non-Epileptic Seizures , 2018, Entropy.

[47]  Amir Hussain,et al.  Deep learning driven multimodal fusion for automated deception detection , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[48]  Kaizhu Huang,et al.  Offline Arabic Handwriting Recognition Using Deep Machine Learning: A Review of Recent Advances , 2019, BICS.

[49]  Fatemeh Amiri,et al.  Lexicon-based Sentiment Analysis for Persian Text , 2015, RANLP.

[50]  Amir Hussain,et al.  Complex-valued computational model of hippocampal CA3 recurrent collaterals , 2017, 2017 IEEE 16th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[51]  Behnam Sabeti,et al.  Optimizing Annotation Effort Using Active Learning Strategies: A Sentiment Analysis Case Study in Persian , 2020, LREC.

[52]  Daniel Zappala,et al.  Analyzing the Political Sentiment of Tweets in Farsi , 2016, ICWSM.

[53]  Walaa Medhat,et al.  Sentiment analysis algorithms and applications: A survey , 2014 .

[54]  Jun Wu,et al.  Chinese text sentiment analysis based on improved Convolutional Neural Networks , 2016, 2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[55]  Amir Hussain,et al.  A Survey on Deep Learning for the Routing Layer of Computer Network , 2019, 2019 UK/ China Emerging Technologies (UCET).

[56]  Q. Abbasi,et al.  A Review on Wearable and Contactless Sensing for COVID-19 With Policy Challenges , 2021, Frontiers in Communications and Networks.

[57]  Hadi Larijani,et al.  Statistical Analysis Driven Optimized Deep Learning System for Intrusion Detection , 2018, BICS.

[58]  Neda Abdolvand,et al.  A Supervised Method for Constructing Sentiment Lexicon in Persian Language , 2017 .

[59]  Muhammad Tariq,et al.  Cognitively Inspired Feature Extraction and Speech Recognition for Automated Hearing Loss Testing , 2019, Cognitive Computation.

[60]  Ahsan Adeel,et al.  A Semi-supervised Approach for Sentiment Analysis of Arab(ic+izi) Messages: Application to the Algerian Dialect , 2021, SN Computer Science.

[61]  Jon Barker,et al.  DNN driven Speaker Independent Audio-Visual Mask Estimation for Speech Separation , 2018, INTERSPEECH.

[62]  Ayoub Bagheri,et al.  Feature Selection Methods in Persian Sentiment Analysis , 2013, NLDB.

[63]  Dilek Z. Hakkani-Tür,et al.  Probabilistic model-based sentiment analysis of twitter messages , 2010, 2010 IEEE Spoken Language Technology Workshop.

[64]  Yaoru Sun,et al.  Sentiment Analysis of Movie Reviews Based on CNN-BLSTM , 2017, IFIP TC12 ICIS.

[65]  Tomoko Ohkuma,et al.  Sentiment Analysis for Low Resource Languages: A Study on Informal Indonesian Tweets , 2016, ALR@COLING.

[66]  Laith H. Baniata,et al.  Sentence Representation Network for Arabic Sentiment Analysis , 2016 .

[67]  Francesco Carlo Morabito,et al.  An Ensemble Based Classification Approach for Persian Sentiment Analysis , 2017, IIH-MSP.

[68]  Erik Cambria,et al.  Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[69]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[70]  Erik Cambria,et al.  PerSent 2.0: Persian Sentiment Lexicon Enriched with Domain-Specific Words , 2019, BICS.

[71]  Wansen Wang,et al.  Notice of RetractionEmotion recognition based on CSO&SVM in e-learning , 2011, 2011 Seventh International Conference on Natural Computation.

[72]  Muhammad Imran,et al.  Machine Learning Framework for the Detection of Anomalies in Aqueous Solutions Using Terahertz Waves , 2021 .

[73]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[74]  Sufal Das Sentiment Analysis for Web-based Big Data: A Survey , 2017 .

[75]  Baoxin Li,et al.  Unsupervised Sentiment Analysis for Social Media Images , 2015, IJCAI.

[76]  Min-Yuh Day,et al.  Deep Learning for Sentiment Analysis on Google Play Consumer Review , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).

[77]  Amir Hussain,et al.  Persian Named Entity Recognition , 2017, 2017 IEEE 16th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[78]  Amir Hussain,et al.  Lip-Reading Driven Deep Learning Approach for Speech Enhancement , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[79]  Erik Cambria,et al.  A Novel Context-Aware Multimodal Framework for Persian Sentiment Analysis , 2021, Neurocomputing.

[80]  Mandar Gogate,et al.  A Generative Learning Approach to Sensor Fusion and Change Detection , 2016, Cognitive Computation.

[81]  Long Chen,et al.  Weakly-Supervised Deep Embedding for Product Review Sentiment Analysis , 2018, IEEE Transactions on Knowledge and Data Engineering.

[82]  William J. Buchanan,et al.  An Experimental Analysis of Attack Classification Using Machine Learning in IoT Networks , 2021, Sensors.

[83]  Ahsan Adeel,et al.  CochleaNet: A Robust Language-independent Audio-Visual Model for Speech Enhancement , 2019, Inf. Fusion.

[84]  Tariq S. Durrani,et al.  Toward's Arabic Multi-modal Sentiment Analysis , 2017, CSPS.

[85]  Khuong Vo,et al.  A Deep Architecture for Sentiment Analysis of News Articles , 2017, ICCSAMA.

[86]  Arun Kumar Sangaiah,et al.  Intelligent sentiment analysis approach using edge computing‐based deep learning technique , 2020, Softw. Pract. Exp..

[87]  Shihui Ying,et al.  Parameter Transfer Deep Neural Network for Single-Modal B-Mode Ultrasound-Based Computer-Aided Diagnosis , 2020, Cogn. Comput..