Sentiment Analysis of Google Maps Reviews on Temple Tourism in Central Java Using IndoBERT Embeddings and BiLSTM
DOI:
https://doi.org/10.63158/journalisi.v8i3.1589Keywords:
Sentiment analysis, Google Maps reviews, IndoBERT, BiLSTM, pseudo-labeled sentiment classificationAbstract
The rapid growth of user-generated content provides valuable insights into tourists’ perceptions of destinations. This study analyzes sentiment in Google Maps reviews of temple tourism destinations in Central Java using IndoBERT embeddings and a Bidirectional Long Short-Term Memory (BiLSTM) model. A total of 10,714 Indonesian-language reviews were collected through web scraping and processed through preprocessing, pseudo-labeling, embedding generation, and model training. To prevent data leakage, the dataset was divided into stratified training and testing sets, while Random OverSampling (ROS) was applied only to the training data. Since manually annotated labels were unavailable, sentiment categories were generated automatically using a pre-trained IndoBERT classifier. The BiLSTM model achieved 80.25% accuracy on the imbalanced dataset and approximately 95% accuracy against IndoBERT-generated pseudo-labels under balanced training conditions. Improvements in Macro F1-score and balanced accuracy indicate better recognition of minority classes. However, the results should be interpreted cautiously because pseudo-labeling and oversampling may affect performance. Overall, this exploratory study demonstrates the potential of IndoBERT and BiLSTM for Indonesian tourism sentiment analysis while highlighting the need for human-annotated data and stronger validation in future research.
Downloads
References
[1] M. S. Viñán-Ludeña and L. M. de Campos, “Discovering a tourism destination with social media data: BERT-based sentiment analysis,” J. Hosp. Tour. Technol., vol. 13, no. 5, pp. 907–921, 2022, doi: 10.1108/JHTT-09-2021-0259.
[2] W. Xu, Z. Yao, Y. Ma, and Z. Li, “Understanding customer complaints from negative online hotel reviews: A BERT-based deep learning approach,” Int. J. Hosp. Manag., vol. 126, p. 104057, 2025, doi: 10.1016/j.ijhm.2024.104057.
[3] G. Sasongko, D. D. Kameo, V. N. Siwi, Y. Wahyudi, and A. D. Huruta, “The Effect of Service Quality and Heritage Tourism on Tourist Loyalty: The Case of Borobudur Temple,” Heritage, vol. 8, no. 2, 2025, doi: 10.3390/heritage8020077.
[4] L. Qin and H. Zhang, “Impact of rich cultural tourism experience on tourist satisfactions and behavioral intentions toward Ningxia’s cultural heritage: Moderation role of perceived cultural distance,” PLoS One, vol. 20, no. 11 November, pp. 1–21, 2025, doi: 10.1371/journal.pone.0336220.
[5] J. A. Fernández Gallardo and R. Hernandez Rojas, “Impact of touristic sustainability on satisfaction with touristic services in a world heritage city. The case of the equestrian show in Córdoba (Spain),” J. Cult. Herit. Manag. Sustain. Dev., vol. 15, no. 4, pp. 796–812, 2025, doi: 10.1108/JCHMSD-12-2023-0226.
[6] C. Zhang, Y.-X. Tian, and A.-Y. Hu, “Utilizing textual data from online reviews for daily tourism demand forecasting: A deep learning approach leveraging word embedding techniques,” Expert Syst. Appl., vol. 260, p. 125439, 2025, doi: 10.1016/j.eswa.2024.125439.
[7] R. N. Patil, Y. P. Singh, S. A. Rawandale, and S. Singh, “Improving Sentiment Classification on Restaurant Reviews Using Deep Learning Models,” Procedia Comput. Sci., vol. 235, pp. 3246–3256, 2024, doi: 10.1016/j.procs.2024.04.307.
[8] T. Anilsagar and S. A. S. S, “War strategy assisted Bi-LSTM for sentiment analysis of customer review,” Indones. J. Electr. Eng. Comput. Sci., vol. 40, no. 1, pp. 480–489, 2025, doi: 10.11591/ijeecs.v40.i1.pp480-489.
[9] K. Gao, J. Zhou, Y. Chi, and Y. Wen, “TourismNER: A Tourism Named Entity Recognition method based on entity boundary joint prediction,” Intell. Syst. with Appl., vol. 25, no. December 2024, p. 200475, 2025, doi: 10.1016/j.iswa.2025.200475.
[10] H. Murfi, Syamsyuriani, T. Gowandi, G. Ardaneswari, and S. Nurrohmah, “BERT-based combination of convolutional and recurrent neural network for indonesian sentiment analysis,” Appl. Soft Comput., vol. 151, p. 111112, 2024, doi: 10.1016/j.asoc.2023.111112.
[11] N. M. Sabri, S. N. A. M. Subki, U. F. M. Bahrin, and M. Puteh, “Post Pandemic Tourism: Sentiment Analysis using Support Vector Machine Based on TikTok Data,” Int. J. Adv. Comput. Sci. Appl., vol. 15, no. 2, pp. 323–330, 2024, doi: 10.14569/IJACSA.2024.0150234.
[12] S. Yang, Q. Li, D. Jang, and J. Kim, “Deep learning mechanism and big data in hospitality and tourism: Developing personalized restaurant recommendation model to customer decision-making,” Int. J. Hosp. Manag., vol. 121, p. 103803, 2024, doi: 10.1016/j.ijhm.2024.103803.
[13] J. Chen, T. Zhang, Z. Yan, Z. Zheng, W. Zhang, and J. Zhang, “Attention-based BiLSTM with positional embeddings for fake review detection,” J. Big Data, vol. 12, no. 1, 2025, doi: 10.1186/s40537-025-01130-9.
[14] R. Pramana, M. Jonathan, H. S. Yani, and R. Sutoyo, “A Comparison of BiLSTM, BERT, and Ensemble Method for Emotion Recognition on Indonesian Product Reviews,” Procedia Comput. Sci., vol. 245, pp. 399–408, 2024, doi: 10.1016/j.procs.2024.10.266.
[15] D. Zhu, R. Jing, Q. Guo, D. Zhang, and F. Wan, “Sentiment analysis of tourism review text combined with bert-bilstm and attention mechanism,” J. Com. Methods SE, vol. 2024. doi: 10.3233/JCM-247135.
[16] A. K. A. Ahamed, K. Lalitha, S. Saravanan, and S. Muthukumar, “Enhanced Deep Learning Based Non-Invasive Anomaly Detection of ECG Signals with Emphasis on Diabetes,” Int. J. Intell. Syst. Appl. Eng. IJISAE, vol. 2023, no. 6s, pp. 284–294, 2023, [Online]. Available: www.ijisae.org
[17] Aachal Jakhotiya, Harshada Jain, Bhavik Jain, and Ms. Charmi Chaniyara, “Text Pre-Processing Techniques in Natural Language Processing: A Review,” Int. Res. J. Eng. Technol., vol. 9, no. 2, pp. 878–880, 2022.
[18] J. Sawicki, M. Ganzha, and M. Paprzycki, The State of the Art of Natural Language Processing—A Systematic Automated Review of NLP Literature Using NLP Techniques, vol. 5, no. 3. 2023. doi: 10.1162/dint_a_00213.
[19] S. C. Necula, F. Dumitriu, and V. Greavu-Șerban, “A Systematic Literature Review on Using Natural Language Processing in Software Requirements Engineering,” Electron., vol. 13, no. 11, 2024, doi: 10.3390/electronics13112055.
[20] A. T. Riadi, F. Indriani, M. I. Mazdadi, M. R. Faisal, and R. Herteno, “Cross-Temporal Generalization of IndoBERT for Indonesian Hoax News Classification,” J. Tek. Inform., vol. 6, no. 5, pp. 5291–5304, 2025, doi: 10.52436/1.jutif.2025.6.5.4757.
[21] D. D. Purwanto, “Empirical Evaluation of IndoBERT and LSTM for Sentiment Analysis of Tourism Reviews : A Data-Driven Study on Kenjeran Park,” J. Tek. Inform., vol. 7, no. 1, pp. 463–474, 2026, doi: 10.52436/1.jutif.2026.7.1.4901.
[22] H. Setyawan, “Identification Of Plants And Its Use In Ancient Java : A Case Study Of The Ramayana And Kresnayana Reliefs Of Prambanan Temple,” Naditira Wirya, vol. 16, no. 1, pp. 1–22, 2022, doi: 10.24832/nw.v16i1.498.
[23] A. Haque et al., “Implication of Different Data Split Ratio on the Performance of Model in Price Prediction of Used Vehicles Using Regression Analysis,” Data Metadata, vol. 3, 2024, doi: 10.56294/dm2024425.
[24] M. Hayaeian Shirvan, M. H. Moattar, and M. Hosseinzadeh, “Deep generative approaches for oversampling in imbalanced data classification problems: A comprehensive review and comparative analysis,” Appl. Soft Comput., vol. 170, p. 112677, 2025, doi: 10.1016/j.asoc.2024.112677.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Journal of Information Systems and Informatics
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors Declaration
- The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
- The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
- The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
- The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
- The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
- The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
- If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
- The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights
