Sentence-Level Classification Using Parallel Fuzzy Deep Learning Classifier

At present, with the growing number of Web 2.0 platforms such as Instagram, Facebook, and Twitter, users honestly communicate their opinions and ideas about events, services, and products. Owing to this rise in the number of social platforms and their extensive use by people, enormous amounts of data are produced hourly. However, sentiment analysis or opinion mining is considered as a useful tool that aims to extract the emotion and attitude from the user-posted data on social media platforms by using different computational methods to linguistic terms and various Natural Language Processing (NLP). Therefore, enhancing text sentiment classification accuracy has become feasible, and an interesting research area for many community researchers. In this study, a new Fuzzy Deep Learning Classifier (FDLC) is suggested for improving the performance of data-sentiment classification. Our proposed FDLC integrates Convolutional Neural Network (CNN) to build an effective automatic process for extracting the features from collected unstructured data and Feedforward Neural Network (FFNN) to compute both positive and negative sentimental scores. Then, we used the Mamdani Fuzzy System (MFS) as a fuzzy classifier to classify the outcomes of the two used deep (CNN+FFNN) learning models in three classes, which are: Neutral, Negative, and Positive. Also, to prevent the long execution time taking by our hybrid proposed FDLC, we have implemented our proposal under the Hadoop cluster. An experimental comparative study between our FDLC and some other suggestions from the literature is performed to demonstrate our offered classifier’s effectiveness. The empirical result proved that our FDLC performs better than other classifiers in terms of true positive rate, true negative rate, false positive rate, false negative rate, error rate, precision, classification rate, kappa statistic, F1-score and time consumption, complexity, convergence, and stability.

[1]  Deepa Gupta,et al.  Paraphrase Detection Using Deep Neural Network Based Word Embedding Techniques , 2020, 2020 4th International Conference on Trends in Electronics and Informatics (ICOEI)(48184).

[2]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[3]  Yossra H. Ali,et al.  Fuzzy logic and Genetic Algorithm based Text Classification Twitter , 2019, 2019 2nd Scientific Conference of Computer Sciences (SCCS).

[4]  Mahmoud Al-Ayyoub,et al.  Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels' reviews , 2017, J. Comput. Sci..

[5]  Prasenjit Majumder,et al.  Tracking Hate in Social Media: Evaluation, Challenges and Approaches , 2020, SN Computer Science.

[6]  MengChu Zhou,et al.  TL-GDBN: Growing Deep Belief Network With Transfer Learning , 2019, IEEE Transactions on Automation Science and Engineering.

[7]  Abdellatif Hair,et al.  An Improved ID3 Classification Algorithm Based On Correlation Function and Weighted Attribute* , 2019, 2019 International Conference on Intelligent Systems and Advanced Computing Sciences (ISACS).

[8]  Adnan Shaout,et al.  Fuzzy Based Sentiment Classification in the Arabic Language , 2018, IntelliSys.

[9]  Seba Susan,et al.  Fuzzy rule based unsupervised sentiment analysis from social media posts , 2019, Expert Syst. Appl..

[10]  Khin Thandar Nwet,et al.  Comparing SVM and KNN Algorithms for Myanmar News Sentiment Analysis System , 2020, ICCDE.

[11]  P. C. Reghu Raj,et al.  Fuzzy logic based hybrid approach for sentiment analysisl of Malayalam movie reviews , 2015, 2015 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES).

[12]  Eulalia Szmidt,et al.  Fuzzy thinking. The new science of fuzzy logic , 1996 .

[13]  Ehsan Pourjavad,et al.  A comparative study and measuring performance of manufacturing systems with Mamdani fuzzy inference system , 2017, Journal of Intelligent Manufacturing.

[14]  Abdellatif Hair,et al.  Big Data Solutions Proposed for Cluster Computing Systems Challenges: A survey , 2020, NISS.

[15]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[16]  Erik Cambria,et al.  Intelligent Asset Allocation via Market Sentiment Views , 2018, IEEE Computational Intelligence Magazine.

[17]  Liviu P. Dinu,et al.  On Transfer Learning for Detecting Abusive Language Online , 2019, IWANN.

[18]  José-Ángel González,et al.  ELiRF-UPV at SemEval-2017 Task 4: Sentiment Analysis using Deep Learning , 2017, SemEval@ACL.

[19]  Björn W. Schuller,et al.  Multimodal Bag-of-Words for Cross Domains Sentiment Analysis , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Shailendra Narayan Singh,et al.  Sentiment Analysis of a Product based on User Reviews using Random Forests Algorithm , 2020, 2020 10th International Conference on Cloud Computing, Data Science & Engineering (Confluence).

[21]  Junfei Qiao,et al.  A sparse deep belief network with efficient fuzzy learning framework , 2020, Neural Networks.

[22]  Wei Sun,et al.  Character-Level Hybrid Convolutional and Recurrent Neural Network for Fast Text Categorization , 2018, ELM.

[23]  Kunihiko Fukushima,et al.  Neocognitron: A hierarchical neural network capable of visual pattern recognition , 1988, Neural Networks.

[24]  Daniel Svozil,et al.  Introduction to multi-layer feed-forward neural networks , 1997 .

[25]  Xiao Cai,et al.  Sentiment Analysis on Movie Reviews , 2014 .

[26]  Arvind K Sharma,et al.  Sentiment analysis of smart phone product review using SVM classification technique , 2017, 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS).

[27]  MengChu Zhou,et al.  A fuzzy logic-based text classification method for social media data , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[28]  Jaydeep Balkrishna Sathe,et al.  A hybrid Sentiment Classification method using Neural Network and Fuzzy Logic , 2017, 2017 11th International Conference on Intelligent Systems and Control (ISCO).

[29]  Abdellatif Hair,et al.  A MapReduce C4.5 Decision Tree Algorithm Based on Fuzzy Rule-Based System , 2019, Fuzzy Information and Engineering.

[30]  W. P. Ramadhan,et al.  Sentiment analysis using multinomial logistic regression , 2017, 2017 International Conference on Control, Electronics, Renewable Energy and Communications (ICCREC).

[31]  Said A. Salloum,et al.  Survey Analysis: Enhancing the Security of Vectorization by Using word2vec and CryptDB , 2020 .

[32]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[33]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[34]  Alessandro Moschitti,et al.  Twitter Sentiment Analysis with Deep Convolutional Neural Networks , 2015, SIGIR.

[35]  Jacek Kitowski,et al.  Sentiment Analysis with Tree-Structured Gated Recurrent Units , 2017, TSD.

[36]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[37]  Apostol Vassilev,et al.  BowTie - A deep learning feedforward neural network for sentiment analysis , 2019, LOD.

[38]  Yahui Chen,et al.  Convolutional Neural Network for Sentence Classification , 2015 .

[39]  Vanita Jain,et al.  Sentiment classification of twitter data belonging to renewable energy using machine learning , 2019, Journal of Information and Optimization Sciences.

[40]  Jiang Qian,et al.  Text sentiment analysis based on long short-term memory , 2016, 2016 First IEEE International Conference on Computer Communication and the Internet (ICCCI).

[41]  Rutweek Sawant,et al.  SENTIMENT ANALYSIS ON ONLINE PRODUCT REVIEWS , 2017 .

[42]  Geraldo Xexéo,et al.  Word Embeddings: A Survey , 2019, ArXiv.

[43]  Begonya Garcia-Zapirain,et al.  Sentiment Classification Using a Single-Layered BiLSTM Model , 2020, IEEE Access.

[44]  Han Liu,et al.  Fuzzy rule based systems for interpretable sentiment analysis , 2017, 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI).

[45]  Bo Shen,et al.  Research on sentiment analysis of microblogging based on LSA and TF-IDF , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[46]  Ning Jin,et al.  Multi-Task Learning Model Based on Multi-Scale CNN and LSTM for Sentiment Classification , 2020, IEEE Access.

[47]  Sanjay Chakraborty,et al.  Sentiment Analysis of Review Datasets Using Naive Bayes and K-NN Classifier , 2016, International Journal of Information Engineering and Electronic Business.

[48]  Hongfei Lin,et al.  Sentiment Analysis With Comparison Enhanced Deep Neural Network , 2020, IEEE Access.

[49]  Hadi Veisi,et al.  Sentiment analysis based on improved pre-trained word embeddings , 2019, Expert Syst. Appl..

[50]  Li Li,et al.  A hybrid method for bilingual text sentiment classification based on deep learning , 2016, 2016 17th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[51]  Buyue Qian,et al.  Stacked Residual Recurrent Neural Networks With Cross-Layer Attention for Text Classification , 2020, IEEE Access.

[52]  Ricardo Ribeiro,et al.  Automatic cyberbullying detection: A systematic review , 2019, Comput. Hum. Behav..

[53]  Dipti Sharma,et al.  Sentiment Analysis Techniques for Social Media Data: A Review , 2020 .

[54]  Abhishek Verma,et al.  Deep CNN-LSTM with combined kernels from multiple branches for IMDb review sentiment analysis , 2017, 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON).