A text sentiment classification model using double word embedding methods

Sentiment analysis is an important topic in natural language processing (NLP) and text classifications. The existing algorithms of lexicon-based sentiment classification can deal with small corpus datasets or simple semantic texts. With the growth of text corpus data, word embedding methods have been gaining more attention. However, the single static word vector obtained by these methods can not accurately express the semantic information of the text. To optimize the word vector, we propose a text sentiment classification model using the double word embedding methods (DWE), which combines two models, GloVe and Word2vec, to represent the text to form a combinatory input of dual channels of convolution neural network (CNN). Based on the word vector fine-tuning strategy, the initial word vector is continuously learned and adjusted to find the CNN sentiment classification model with better combination input than a single vector representation. Experiment results show that DWE can effectively improve the accuracy of sentiment classification, which reaches 94.8%.

[1]  RaviVadlamani,et al.  A survey on opinion mining and sentiment analysis , 2015 .

[2]  Athena Vakali,et al.  Sentiment analysis leveraging emotions and word embeddings , 2017 .

[3]  Jiaqi Wang,et al.  Three-way enhanced convolutional neural networks for sentence-level sentiment classification , 2019, Inf. Sci..

[4]  Deepak Kumar Jain,et al.  An effective approach for emotion detection in multimedia text data using sequence based convolutional neural network , 2019, Multimedia Tools and Applications.

[5]  Yinong Chen,et al.  Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks , 2020, Applied Sciences.

[6]  Vadlamani Ravi,et al.  A survey on opinion mining and sentiment analysis: Tasks, approaches and applications , 2015, Knowl. Based Syst..

[7]  Natthakit Srikanjanapert,et al.  Concept-Based Sentiment Analysis for Opinion Texts with Multiple-Languages , 2016 .

[8]  Hadi Veisi,et al.  Sentiment analysis based on improved pre-trained word embeddings , 2019, Expert Syst. Appl..

[9]  Elise de Doncker,et al.  Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information , 2019, Cognitive Systems Research.

[10]  Qingcai Chen,et al.  Distributed representation and one-hot representation fusion with gated network for clinical semantic textual similarity , 2020, BMC Medical Informatics and Decision Making.

[11]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[12]  Cagatay CATAL,et al.  A sentiment classification model based on multiple classifiers , 2017, Appl. Soft Comput..

[13]  Behzad Naderalvojoud,et al.  Sentiment aware word embeddings using refinement and senti-contextualized learning approach , 2020, Neurocomputing.

[14]  Erik Cambria,et al.  Word Polarity Disambiguation Using Bayesian Model and Opinion-Level Features , 2014, Cognitive Computation.

[15]  Shiu-Li Huang,et al.  Discovering Chinese sentence patterns for feature-based opinion summarization , 2015, Electron. Commer. Res. Appl..

[16]  Abeer Alsadoon,et al.  Deep Learning for Aspect-Based Sentiment Analysis: A Comparative Review , 2019, Expert Syst. Appl..

[17]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[18]  J. Fernando Sánchez-Rada,et al.  Enhancing deep learning sentiment analysis with ensemble techniques in social applications , 2020 .

[19]  Prabhat Mahanti,et al.  Sentiment Recognition in Customer Reviews Using Deep Learning , 2018, Int. J. Enterp. Inf. Syst..

[20]  Bin Jiang,et al.  A survey on sentiment analysis and opinion mining for social multimedia , 2018, Multimedia Tools and Applications.