Aspect-based sentiment analysis for hotel reviews using an improved model of long short-term memory

Advances in information technology have given rise to online hotel reservation options. The user review feature is an important factor during the online booking of hotels. Generally, most online hotel booking service providers provide review and rating features for assessing hotels. However, not all service providers provide rating features or recap reviews for every aspect of the hotel services offered. Therefore, we propose a method to summarise reviews based on multiple aspects, including food, room, service, and location. This method uses long short-term memory (LSTM), together with hidden layers and automation of the optimal number of hidden neurons. The F1-measure value of 75.28% for the best model was based on the fact that (i) the size of the first hidden layer is 1,200 neurons with the tanh activation function, and (ii) the size of the second hidden layer is 600 neurons with the ReLU activation function. The proposed model outperforms the baseline model (also known as standard LSTM) by 10.16%. It is anticipated that the model developed through this study can be accessed by users of online hotel booking services to acquire a review recap on more specific aspects of services offered by hotels

[1]  Omar Alqaryouti,et al.  Aspect-based sentiment analysis using smart government review data , 2020, Applied Computing and Informatics.

[2]  Bo Shen,et al.  ReMemNN: A novel memory neural network for powerful interaction in aspect-based sentiment analysis , 2020, Neurocomputing.

[3]  Ning Liu,et al.  Aspect-based sentiment analysis with gated alternate neural network , 2020, Knowl. Based Syst..

[4]  Arie Pratama Sutiono,et al.  Aspect and Opinion Term Extraction for Aspect Based Sentiment Analysis of Hotel Reviews Using Transfer Learning , 2019, ArXiv.

[5]  Masayu Leylia Khodra,et al.  Aspect and Opinion Terms Extraction Using Double Embeddings and Attention Mechanism for Indonesian Hotel Reviews , 2019, 2019 International Conference of Advanced Informatics: Concepts, Theory and Applications (ICAICTA).

[6]  Wenchao Xu,et al.  Aspect based fine-grained sentiment analysis for online reviews , 2019, Inf. Sci..

[7]  Stephen Marshall,et al.  Activation Functions: Comparison of trends in Practice and Research for Deep Learning , 2018, ArXiv.

[8]  Ayu Purwarianti,et al.  Aspect Detection and Sentiment Classification Using Deep Neural Network for Indonesian Aspect-Based Sentiment Analysis , 2018, 2018 International Conference on Asian Language Processing (IALP).

[9]  Masayu Leylia Khodra,et al.  Aspect-Based Sentiment Analysis Using Convolutional Neural Network and Bidirectional Long Short-Term Memory , 2018, 2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA).

[10]  Philip S. Yu,et al.  Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction , 2018, ACL.

[11]  Mirna Adriani,et al.  Unsupervised aspect-based sentiment analysis on Indonesian restaurant reviews , 2017, 2017 International Conference on Asian Language Processing (IALP).

[12]  Mahmoud Al-Ayyoub,et al.  Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels' reviews , 2017, J. Comput. Sci..

[13]  Dwi H. Widyantoro,et al.  Aspect-sentiment classification in opinion mining using the combination of rule-based and machine learning , 2017, 2017 International Conference on Data and Software Engineering (ICoDSE).

[14]  Abhishek Kumar,et al.  Aspect based Sentiment Oriented Summarization of Hotel Reviews , 2017 .

[15]  Masayu Leylia Khodra,et al.  Aspect-based sentiment analysis for Indonesian restaurant reviews , 2017, 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA).

[16]  Xiaokui Xiao,et al.  Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms , 2017, AAAI.

[17]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[18]  Masayu Leylia Khodra,et al.  Aspect based sentiment analysis for review rating prediction , 2016, 2016 International Conference On Advanced Informatics: Concepts, Theory And Application (ICAICTA).

[19]  Cut Fiarni,et al.  Sentiment analysis system for Indonesia online retail shop review using hierarchy Naive Bayes technique , 2016, 2016 4th International Conference on Information and Communication Technology (ICoICT).

[20]  Ting Liu,et al.  Aspect Level Sentiment Classification with Deep Memory Network , 2016, EMNLP.

[21]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[22]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[23]  Li Chen,et al.  A Linear-Chain CRF-Based Learning Approach for Web Opinion Mining , 2010, WISE.

[24]  Syed Ismail Shah,et al.  Impact of Varying Neurons and Hidden Layers in Neural Network Architecture for a Time Frequency Application , 2006, 2006 IEEE International Multitopic Conference.

[25]  Yiming Yang,et al.  A re-examination of text categorization methods , 1999, SIGIR '99.

[26]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[27]  Retno Kusumaningrum,et al.  Word2Vec for Indonesian Sentiment Analysis towards Hotel Reviews: An Evaluation Study , 2019, Procedia Computer Science.

[28]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[29]  Yong Shi,et al.  The Role of Text Pre-processing in Sentiment Analysis , 2013, ITQM.