Long Short Term Memory Convolutional Neural Network for Indonesian Sentiment Analysis towards Touristic Destination Reviews

Large amount of text has been created on the Internet which requires assessment to convert this data into useful information. Deep learning can address this challenge by delivering improved performance in sentiment analysis compared to classic machine learning that utilises the statistical technique. LSTM (Long short-term memory), CNN (Convolutional neural network), their combined model, and developments in their architecture have shown excellent performance for assessment of sentiment in English corpus. However, there have been limited research works on deep learning that utilizes a blend of the two models for the Indonesian body of languages. In this research, we present the LSTM-CNN combined model and the Word2Vec framework for assessment of sentiment in the Indonesian language with respect to the reviews of tourist regions. The dataset comprises 10000 touristic destination reviews in the Indonesian language (5000 positive and 5000 negative reviews). The parameters for LSTM-CNN and Word2Vec which were put to test in the study are dropout, pooling layer, learning level, convolutional activation, Word2Vec architecture, Word2Vec evaluation approach, and Word2Vec dimension. The outcomes indicate that the precision of the LSTM-CNN model is higher compared to LSTM; the precision of LSTM-CNN is 97.17% as against 90.82% for LSTM. Going forward, our results could be utilised by the government or the tourism sector as a material basis for fostering tourism, and by the public as a platform for selecting travel destination.

[1]  Avi Arampatzis,et al.  A comparative evaluation of pre-processing techniques and their interactions for twitter sentiment analysis , 2018, Expert Syst. Appl..

[2]  Santanu Kumar Rath,et al.  Classification of sentiment reviews using n-gram machine learning approach , 2016, Expert Syst. Appl..

[3]  Hugh E. Williams,et al.  Stemming Indonesian , 2005, ACSC.

[4]  Retno Kusumaningrum,et al.  Word2Vec for Indonesian Sentiment Analysis towards Hotel Reviews: An Evaluation Study , 2019, Procedia Computer Science.

[5]  Retno Kusumaningrum,et al.  Part of speech features for sentiment classification based on Latent Dirichlet Allocation , 2017, 2017 4th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE).

[6]  Md. Al-Amin,et al.  Sentiment analysis of Bengali comments with Word2Vec and sentiment information of words , 2017, 2017 International Conference on Electrical, Computer and Communication Engineering (ECCE).

[7]  Javier Palanca,et al.  Semantic-based padding in convolutional neural networks for improving the performance in natural language processing. A case of study in sentiment analysis , 2020, Neurocomputing.

[8]  Alex Pappachen James,et al.  A survey on LSTM memristive neural network architectures and applications , 2019, The European Physical Journal Special Topics.

[9]  Jiang Qian,et al.  Text sentiment analysis based on long short-term memory , 2016, 2016 First IEEE International Conference on Computer Communication and the Internet (ICCCI).

[10]  Feng Zeng,et al.  Deep Learning-Based Sentiment Analysis for Roman Urdu Text , 2018, IIKI.

[11]  Masayu Leylia Khodra,et al.  Deep learning and distributional semantic model for Indonesian tweet categorization , 2016, 2016 International Conference on Data and Software Engineering (ICoDSE).

[12]  Muljono,et al.  Sentiment Analysis of Indonesian News Using Deep Learning (Case Study: TVKU Broadcast) , 2018, 2018 International Seminar on Application for Technology of Information and Communication.

[13]  Nan Chen,et al.  Advanced Combined LSTM-CNN Model for Twitter Sentiment Analysis , 2018, 2018 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS).

[14]  Vadlamani Ravi,et al.  A survey on opinion mining and sentiment analysis: Tasks, approaches and applications , 2015, Knowl. Based Syst..

[15]  Dinesh Kumar Vishwakarma,et al.  Sentiment analysis using deep learning architectures: a review , 2019, Artificial Intelligence Review.

[16]  Widyawan Widyawan,et al.  Performance Improvement Using CNN for Sentiment Analysis , 2018, IJITEE (International Journal of Information Technology and Electrical Engineering).

[17]  Xuanjing Huang,et al.  Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification , 2016, EMNLP.