Variants of Long Short-Term Memory for Sentiment Analysis on Vietnamese Students’ Feedback Corpus

The Long Short-Term Memory (LSTM) and Dependency Tree-LSTM have shown the state-of-the-art results for the sentiment analysis task for the English language. Despite many studies of LSTM approach, there are no studies of Dependency Tree-LSTM approach for Vietnamese sentiment analysis. In this paper, we conducted experiments with LSTM, Dependency Tree-LSTM, and our proposed models on Vietnamese Students’ Feedback Corpus. According to the experimental results, the Dependency Tree-LSTM were not better than the LSTM model. However, when combining final hidden state vectors of LSTM and Dependency Tree-LSTM models with a Support Vector Machine classifier, we achieved the F1-score of 90.2%, which is higher than the performance of the LSTM model.

[1]  Zied Kechaou,et al.  Improving e-learning with sentiment analysis of users' opinions , 2011, 2011 IEEE Global Engineering Education Conference (EDUCON).

[2]  Kiet Van Nguyen,et al.  Vietnamese transition-based dependency parsing with supertag features , 2016, 2016 Eighth International Conference on Knowledge and Systems Engineering (KSE).

[3]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[4]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[5]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[6]  Dai Quoc Nguyen,et al.  VnCoreNLP: A Vietnamese Natural Language Processing Toolkit , 2018, NAACL.

[7]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[8]  Christopher D. Manning,et al.  Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks , 2015, ACL.

[9]  Hiroya Takamura,et al.  Sentiment Classification Using Word Sub-sequences and Dependency Sub-trees , 2005, PAKDD.

[10]  Dat Quoc Nguyen,et al.  An empirical study for Vietnamese dependency parsing , 2016, ALTA.

[11]  Mohamed Medhat Gaber,et al.  SA-E: Sentiment Analysis for Education , 2013 .

[12]  Phil Blunsom,et al.  Multilingual Models for Compositional Distributed Semantics , 2014, ACL.

[13]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[14]  Irina Rish,et al.  An empirical study of the naive Bayes classifier , 2001 .

[15]  Son Bao Pham,et al.  Sentiment Analysis for Vietnamese , 2010, 2010 Second International Conference on Knowledge and Systems Engineering.

[16]  Kiet Van Nguyen,et al.  UIT-VSFC: Vietnamese Students’ Feedback Corpus for Sentiment Analysis , 2018, 2018 10th International Conference on Knowledge and Systems Engineering (KSE).

[17]  Anh-Cuong Le,et al.  Learning Semantic Representations for Rating Vietnamese Comments , 2016, 2016 Eighth International Conference on Knowledge and Systems Engineering (KSE).

[18]  Hoai Bac Le,et al.  Multi-channel LSTM-CNN model for Vietnamese sentiment analysis , 2017, 2017 9th International Conference on Knowledge and Systems Engineering (KSE).

[19]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[20]  Bing Liu,et al.  Opinion Mining and Sentiment Analysis , 2011 .

[21]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[22]  Adel M. Alimi,et al.  Novel Hybrid Method for Sentiment Classification of Movie Reviews , 2010, DMIN.

[23]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[24]  Yiming Yang,et al.  A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[25]  Ngo Xuan Bach,et al.  An empirical study on sentiment analysis for Vietnamese , 2014, 2014 International Conference on Advanced Technologies for Communications (ATC 2014).

[26]  Wojciech Zaremba,et al.  Learning to Execute , 2014, ArXiv.

[27]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[28]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.