Sentiment Analysis and Trend Mapping of Hotel Reviews Using LSTM and GRU
Abstract
This study explores applying Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) models for sentiment analysis and trend mapping of hotel reviews, specifically focusing on customer feedback from Hotel Vila Ombak in Lombok, Indonesia. The primary objective was to leverage these advanced deep learning models to capture nuanced sentiment patterns in unstructured textual data, enhancing insights into guest satisfaction. The analysis was conducted on a dataset of 326 reviews, achieving an overall model accuracy of 91% (0.91). The results showed that while the models excelled in identifying positive sentiments, with a precision of 0.94, recall of 0.98, and F1-score of 0.96, they struggled with minority classes. Both negative and neutral sentiments exhibited 0% accuracy, primarily due to the dataset’s imbalance, where positive reviews constituted 92.3% of the total entries. The macro average metrics (precision 0.31, recall 0.33, F1-score 0.32) highlighted the model's limitations in classifying sentiments less frequently despite high weighted averages driven by the dominant positive class. This research underscores the need to address data imbalance and suggests that future studies incorporate techniques like data augmentation or hybrid models to improve performance across all sentiment categories. By optimizing sentiment analysis models, hospitality businesses can gain deeper insights into customer feedback, ultimately enhancing service quality and customer satisfaction.
Downloads
References
P. F. Muhammad, R. Kusumaningrum, and A. Wibowo, “Sentiment Analysis Using Word2vec and Long Short-Term Memory (LSTM) for Indonesian Hotel Reviews,” Procedia Computer Science, vol. 179. pp. 728–735, 2021. doi: 10.1016/j.procs.2021.01.061.
M. S. Hossen, A. H. Jony, T. Tabassum, M. T. Islam, M. M. Rahman, and T. Khatun, “Hotel review analysis for the prediction of business using deep learning approach,” Proceedings - International Conference on Artificial Intelligence and Smart Systems, ICAIS 2021. pp. 1489–1494, 2021. doi: 10.1109/ICAIS50930.2021.9395757.
R. A. Hameed, W. J. Abed, and A. T. Sadiq, “Evaluation of Hotel Performance with Sentiment Analysis by Deep Learning Techniques,” Int. J. Interact. Mob. Technol., vol. 17, no. 9, pp. 70–87, 2023, doi: 10.3991/ijim.v17i09.38755.
N. Zhao, H. Gao, X. Wen, and H. Li, “Combination of convolutional neural network and gated recurrent unit for aspect-based sentiment analysis,” IEEE Access, vol. 9, pp. 15561–15569, 2021, doi: 10.1109/ACCESS.2021.3052937.
N. Khamphakdee and P. Seresangtakul, “An Efficient Deep Learning for Thai Sentiment Analysis,” Data, vol. 8, no. 5, 2023, doi: 10.3390/data8050090.
P. B. Weerakody, K. W. Wong, G. Wang, and W. Ela, “A review of irregular time series data handling with gated recurrent neural networks,” Neurocomputing, vol. 441, pp. 161–178, 2021, doi: 10.1016/j.neucom.2021.02.046.
F. Ali et al., “An intelligent healthcare monitoring framework using wearable sensors and social networking data,” Futur. Gener. Comput. Syst., vol. 114, pp. 23–43, 2020, doi: 10.1016/j.future.2020.07.047.
B. Jang, M. Kim, G. Harerimana, S. U. Kang, and J. W. Kim, “Bi-LSTM model to increase accuracy in text classification: Combining word2vec CNN and attention mechanism,” Appl. Sci., vol. 10, no. 17, 2020, doi: 10.3390/app10175841.
A. Al Wazrah and S. Alhumoud, “Sentiment Analysis Using Stacked Gated Recurrent Unit for Arabic Tweets,” IEEE Access, vol. 9, pp. 137176–137187, 2021, doi: 10.1109/ACCESS.2021.3114313.
A. S. Fadel, M. E. Saleh, and O. A. Abulnaja, “Arabic Aspect Extraction Based on Stacked Contextualized Embedding With Deep Learning,” IEEE Access, vol. 10, pp. 30526–30535, 2022, doi: 10.1109/ACCESS.2022.3159252.
H. J. Alshahrani, A. Q. A. Hassan, N. S. Almalki, M. M. Alnfiai, A. S. Salama, and M. A. Hamza, “Applied Linguistics With Red-Tailed Hawk Optimizer-Based Ensemble Learning Strategy in Natural Language Processing,” IEEE Access, vol. 11, pp. 132448–132456, 2023, doi: 10.1109/ACCESS.2023.3331061.
M. Jamshidi et al., “Artificial Intelligence and COVID-19: Deep Learning Approaches for Diagnosis and Treatment,” IEEE Access, vol. 8, pp. 109581–109595, 2020, doi: 10.1109/ACCESS.2020.3001973.
N. Aslam, F. Rustam, E. Lee, P. B. Washington, and I. Ashraf, “Sentiment Analysis and Emotion Detection on Cryptocurrency Related Tweets Using Ensemble LSTM-GRU Model,” IEEE Access, vol. 10, pp. 39313–39324, 2022, doi: 10.1109/ACCESS.2022.3165621.
Z. Jin, Y. Yang, and Y. Liu, “Stock closing price prediction based on sentiment analysis and LSTM,” Neural Comput. Appl., vol. 32, no. 13, pp. 9713–9729, 2020, doi: 10.1007/s00521-019-04504-2.
S. Mifrah and E. H. Benlahmar, “Sentence-Level Sentiment Classification A Comparative Study between Deep Learning Models,” J. ICT Stand., vol. 10, no. 2, pp. 339–352, 2022, doi: 10.13052/jicts2245-800X.10213.
Mamta, A. Ekbal, P. Bhattacharyya, S. Srivastava, A. Kumar, and T. Saha, “Multi-domain tweet corpora for sentiment analysis: Resource creation and evaluation,” LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings. pp. 5046–5054, 2020.
Q. Jiang, C. S. Chan, S. Eichelberger, H. Ma, and B. Pikkemaat, “Sentiment analysis of online destination image of Hong Kong held by mainland Chinese tourists,” Curr. Issues Tour., vol. 24, no. 17, pp. 2501–2522, 2021, doi: 10.1080/13683500.2021.1874312.
U. Chakraborty and S. K. Biswal, “Impact of Online Reviews on Consumer’s Hotel Booking Intentions: Does Brand Image Mediate?,” J. Promot. Manag., vol. 26, no. 7, pp. 943–963, 2020, doi: 10.1080/10496491.2020.1746465.
M. Gharzouli, A. K. Hamama, and Z. Khattabi, “Topic-based sentiment analysis of hotel reviews,” Curr. Issues Tour., vol. 25, no. 9, pp. 1368–1375, 2022, doi: 10.1080/13683500.2021.1940107.
Y. H. Hsiao and Y. T. Hsiao, “Online review analytics for hotel quality at macro and micro levels,” Ind. Manag. Data Syst., vol. 121, no. 2, pp. 268–289, Jan. 2021, doi: 10.1108/IMDS-04-2020-0214.
M. Jeong, H. H. Shin, M. Lee, and J. Lee, “Assessing brand performance consistency from consumer-generated media: the US hotel industry,” Int. J. Contemp. Hosp. Manag., vol. 35, no. 6, pp. 2056–2083, Jan. 2023, doi: 10.1108/IJCHM-12-2021-1516.
J. Wang, Y. Xia, and Y. Wu, “Emotional characteristics and theme mining of star-rated hotels from the perspective of social sensing: a case study of Nanchang City, China,” Comput. Urban Sci., vol. 2, no. 1, 2022, doi: 10.1007/s43762-022-00042-1.
K. L. Tan, C. P. Lee, K. S. M. Anbananthen, and K. M. Lim, “RoBERTa-LSTM: A Hybrid Model for Sentiment Analysis With Transformer and Recurrent Neural Network,” IEEE Access, vol. 10, pp. 21517–21525, 2022, doi: 10.1109/ACCESS.2022.3152828.
J. Wang, L. C. Yu, K. R. Lai, and X. Zhang, “Tree-Structured Regional CNN-LSTM Model for Dimensional Sentiment Analysis,” IEEE/ACM Trans. Audio Speech Lang. Process., vol. 28, pp. 581–591, 2020, doi: 10.1109/TASLP.2019.2959251.
Y. Liu, L. Wang, T. Shi, and J. Li, “Detection of spam reviews through a hierarchical attention architecture with N-gram CNN and Bi-LSTM,” Inf. Syst., vol. 103, 2022, doi: 10.1016/j.is.2021.101865.
A. Parasyris, G. Alexandrakis, G. V. Kozyrakis, K. Spanoudaki, and N. A. Kampanis, “Predicting Meteorological Variables on Local Level with SARIMA, LSTM and Hybrid Techniques,” Atmosphere (Basel)., vol. 13, no. 6, 2022, doi: 10.3390/atmos13060878.


Copyright (c) 2024 Journal of Information Systems and Informatics

This work is licensed under a Creative Commons Attribution 4.0 International License.
- I certify that I have read, understand and agreed to the Journal of Information Systems and Informatics (Journal-ISI) submission guidelines, policies and submission declaration. Submission already using the provided template.
- I certify that all authors have approved the publication of this and there is no conflict of interest.
- I confirm that the manuscript is the authors' original work and the manuscript has not received prior publication and is not under consideration for publication elsewhere and has not been previously published.
- I confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
- I confirm that the paper now submitted is not copied or plagiarized version of some other published work.
- I declare that I shall not submit the paper for publication in any other Journal or Magazine till the decision is made by journal editors.
- If the paper is finally accepted by the journal for publication, I confirm that I will either publish the paper immediately or withdraw it according to withdrawal policies
- I Agree that the paper published by this journal, I transfer copyright or assign exclusive rights to the publisher (including commercial rights)