Evaluating Digital Narratives in Heritage Tourism and Museum: Content Analysis, Toxicity Score, and Sentiment Classification Trough SVM and SMOTE
Abstract
This research uses the Digital Content Reviews and Analysis Framework to explore the dynamic interplay between digital content, sentiment, and toxicity within the context of heritage tourism at the Sangiran site. The study is driven by the urgency to understand how digital narratives impact public engagement and perception, particularly for heritage sites of global significance. Through a comprehensive analysis, the research evaluates toxicity scores, sentiment classifications, and thematic content across multiple videos related to Sangiran. The toxicity analysis reveals generally low levels of harmful content, with an average score of 0.04717, but identifies occasional peaks, highlighting the potential for negative discourse. Sentiment analysis, conducted using the SVM model enhanced by SMOTE, achieves an accuracy rate of 94.59%, with precision and recall rates of 92.07% and 97.79%, respectively, demonstrating the model's robustness in capturing audience sentiment. Content analysis identifies critical themes, such as human evolution and fossil discoveries, emphasizing the educational value of digital content. The research underscores the importance of curating digital narratives that engage, educate, and foster a positive and respectful discourse. The findings suggest that while digital content successfully educates the audience, managing contentious topics is crucial to maintaining constructive engagement. This study contributes to developing more effective digital strategies for heritage tourism, ensuring the sustainable promotion and preservation of sites like Sangiran while addressing the challenges of online discourse. The research highlights the need for continued exploration of digital content's role in shaping public perceptions of cultural heritage.
Downloads
References
S. A. Orr, J. Richards, and S. Fatorić, “Climate Change and Cultural Heritage: A Systematic Literature Review (2016–2020),” Hist. Environ. Policy Pract., vol. 12, no. 3–4, pp. 434–477, 2021, doi: 10.1080/17567505.2021.1957264.
J. Moreno-Manzo, L. Coromina, and A. Gassiot-Melian, “Examining the structural relationships between perceived value, satisfaction and loyalty among disabled tourists in two world heritage sites,” Consum. Behav. Tour. Hosp., vol. 19, no. 1, pp. 37–54, Jan. 2024, doi: 10.1108/CBTH-02-2023-0011.
J. Bąkiewicz, A. Leask, P. Barron, and T. Rakić, “Towards a visitor taxonomy at (film-induced) heritage attractions,” J. Herit. Tour., vol. 17, no. 3, pp. 247–263, May 2022, doi: 10.1080/1743873X.2021.2002340.
K. Bezova and I. Azara, “Generating and Sustaining Value Through Guided Tour Experiences’ Co-Creation at Heritage Visitor Attractions,” Tour. Plan. Dev., vol. 18, no. 2, pp. 226–244, Mar. 2021, doi: 10.1080/21568316.2021.1879923.
M. S. Hossain, M. F. Rahman, M. K. Uddin, and M. K. Hossain, “Customer sentiment analysis and prediction of halal restaurants using machine learning approaches,” J. Islam. Mark., vol. 14, no. 7, pp. 1859–1889, Jan. 2023, doi: 10.1108/JIMA-04-2021-0125.
A. Ahmed Bilal, O. Ayhan Erdem, and S. Toklu, “Children’s Sentiment Analysis from Texts by Using Weight Updated Tuned with Random Forest Classification,” IEEE Access, vol. 12, pp. 70089–70104, 2024, doi: 10.1109/ACCESS.2024.3400992.
T. Huu Do, M. Berneman, J. Patro, G. Bekoulis, and N. Deligiannis, “Context-Aware Deep Markov Random Fields for Fake News Detection,” IEEE Access, vol. 9, pp. 130042–130054, 2021, doi: 10.1109/ACCESS.2021.3113877.
P. Thiengburanathum and P. Charoenkwan, “SETAR: Stacking Ensemble Learning for Thai Sentiment Analysis Using RoBERTa and Hybrid Feature Representation,” IEEE Access, vol. 11, no. July, pp. 92822–92837, 2023, doi: 10.1109/ACCESS.2023.3308951.
E. Del Soldato and S. Massari, “Creativity and digital strategies to support food cultural heritage in Mediterranean rural areas,” EuroMed J. Bus., vol. 19, no. 1, pp. 113–137, Jan. 2024, doi: 10.1108/EMJB-05-2023-0152.
M. I. Roque, A. C. Campos, S. Almeida, and S. Pasandideh, “Transforming museum management through ICT adoption: an analysis of the Portuguese context during the COVID-19 pandemic,” J. Herit. Tour., pp. 1–18, 2024, doi: 10.1080/1743873X.2024.2331239.
B. Frame, D. Liggett, K. Lindström, R. M. Roura, and L. M. van der Watt, “Tourism and heritage in Antarctica: exploring cultural, natural and subliminal experiences,” Polar Geogr., vol. 45, no. 1, pp. 37–57, 2022, doi: 10.1080/1088937X.2021.1918787.
E. Mele and L. Egberts, “Exploring travel blogs on tourism and landscape heritage: representations of the Swiss Alps,” J. Herit. Tour., vol. 18, no. 6, pp. 785–806, 2023, doi: 10.1080/1743873X.2023.2237617.
J. Li, X. Peng, X. Liu, H. Tang, and W. Li, “A study on shaping tourists’ conservational intentions towards cultural heritage in the digital era: exploring the effects of authenticity, cultural experience, and place attachment,” J. Asian Archit. Build. Eng., vol. 00, no. 00, pp. 1–20, 2024, doi: 10.1080/13467581.2024.2321999.
C. Bareither, “Difficult heritage and digital media: ‘selfie culture’ and emotional practices at the Memorial to the Murdered Jews of Europe,” Int. J. Herit. Stud., vol. 27, no. 1, pp. 57–72, Jan. 2021, doi: 10.1080/13527258.2020.1768578.
A. M. Walter, “Images of the Mountains: Touristic Consumption and Gendered Representations of Landscape and Heritage in Gilgit-Baltistan,” Vis. Anthropol., vol. 35, no. 3, pp. 225–247, May 2022, doi: 10.1080/08949468.2022.2094185.
G. Z. Kohe, J. Smith, and J. Hughson, “#hoops #basketballhistory @Hoops_Heritage: examining possibilities for basketball heritage within the context of higher education, critical museology and digital redirections,” Sport Hist., vol. 43, no. 3, pp. 354–377, Jul. 2023, doi: 10.1080/17460263.2021.1952481.
S. Geng, H.-W. Chau, E. Jamei, and Z. Vrcelj, “Understanding place identity in urban scale Smart Heritage using a cross-case analysis method,” Int. J. Tour. Cities, vol. 9, no. 3, pp. 729–750, Jan. 2023, doi: 10.1108/IJTC-10-2022-0244.
I. Pinke-Sziva, K. Keller, and L. Kovács, “Smart positioning: how smart technologies can increase the attractiveness of heritage tourism destinations? The case of a small-scale Hungarian heritage city,” J. Herit. Tour., pp. 1–19, 2023, doi: 10.1080/1743873X.2023.2276271.
A. Flint and B. Jennings, “The role of cultural heritage in visitor narratives of peatlands: analysis of online user-generated reviews from three peatland sites in England,” Int. J. Herit. Stud., vol. 28, no. 2, pp. 163–179, 2022, doi: 10.1080/13527258.2021.1941198.
M. Madandola and D. Boussaa, “Cultural heritage tourism as a catalyst for sustainable development; the case of old Oyo town in Nigeria,” Int. J. Herit. Stud., vol. 29, no. 1–2, pp. 21–38, 2023, doi: 10.1080/13527258.2023.2169332.
H. Xu, L. T. O. Cheung, J. Lovett, X. Duan, Q. Pei, and D. Liang, “Understanding the influence of user-generated content on tourist loyalty behavior in a cultural World Heritage Site,” Tour. Recreat. Res., vol. 48, no. 2, pp. 173–187, 2023, doi: 10.1080/02508281.2021.1913022.
T. D. Quang, W. B. Noseworthy, and D. Paulson, “Rising tensions: heritage-tourism development and the commodification of ‘Authentic’ culture among the Cham community of Vietnam,” Cogent Soc. Sci., vol. 8, no. 1, 2022, doi: 10.1080/23311886.2022.2116161.
M. H. Liao and P. Bartie, “Translating heritage: a study of visitors’ experiences mediated through multilingual audio guides in Edinburgh Castle,” J. Herit. Tour., vol. 17, no. 3, pp. 283–295, May 2022, doi: 10.1080/1743873X.2021.1976786.
C. Santoso and O. Gjerald, “Guided discussion or immersive play? Influence of on-site presentation platform on visitor satisfaction in a heritage attraction,” Scand. J. Hosp. Tour., vol. 22, no. 4–5, pp. 393–410, 2022, doi: 10.1080/15022250.2022.2112416.
M. B. Gillette and E. Boyd, “Mining for tourists in China: a digital ethnography of user-generated content from coal mining heritage parks,” J. Herit. Tour., vol. 19, no. 1, pp. 1–19, Jan. 2024, doi: 10.1080/1743873X.2023.2255691.
C. Scarles, H. Treharne, M. Casey, and H. Z. Abidin, “Micro-mobilities in curated spaces: agency, autonomy and dwelling in visitor experiences of augmented reality in arts and heritage,” Mobilities, vol. 15, no. 6, pp. 776–791, Nov. 2020, doi: 10.1080/17450101.2020.1816439.
X. Zhang, Z. Zhao, and K. Wang, “The effects of live comments and advertisements on social media engagement: application to short-form online video,” J. Res. Interact. Mark., vol. 18, no. 3, pp. 485–505, Jan. 2024, doi: 10.1108/JRIM-02-2023-0069.
A. Huang, W. Wu, and T. Yu, “Textual analysis for China’s financial markets: a review and discussion,” China Financ. Rev. Int., vol. 10, no. 1, pp. 1–15, Jan. 2020, doi: 10.1108/CFRI-08-2019-0134.
T. Redek and U. Godnov, “From data to decision: distilling decision intelligence from user-generated content,” Kybernetes, vol. 53, no. 13, pp. 1–23, Jan. 2024, doi: 10.1108/K-08-2023-1447.
O. Alqaryouti, N. Siyam, A. Abdel Monem, and K. Shaalan, “Aspect-based sentiment analysis using smart government review data,” Appl. Comput. Informatics, vol. 20, no. 1–2, pp. 142–161, Jan. 2024, doi: 10.1016/j.aci.2019.11.003.
T. Yu, P. Rita, S. Moro, and C. Oliveira, “Insights from sentiment analysis to leverage local tourism business in restaurants,” Int. J. Cult. Tour. Hosp. Res., vol. 16, no. 1, pp. 321–336, Jan. 2022, doi: 10.1108/IJCTHR-02-2021-0037.
R. Sospedra-Roca, F. X. Hernàndez-Cardona, and M. Hernàndez-Pongiluppi, “Digital iconography, conflict heritage, and the teaching of history: The case of the Spanish Civil War,” Cogent Educ., vol. 9, no. 1, p. 2082087, Dec. 2022, doi: 10.1080/2331186X.2022.2082087.
G. Tiberghien, R. Mukhamedjanova, and P. F. Xie, “Authenticity and spectrality of space heritage: Baikonur Cosmodrome, Kazakhstan,” Tour. Geogr., vol. 25, no. 5, pp. 1445–1464, Jul. 2023, doi: 10.1080/14616688.2023.2231422.
L. Chang, S. Vada, B. D. Moyle, and S. Gardiner, “Unlocking the gateway to tourist well-being: the Triple-A model of engagement in tourism experiences,” Curr. Issues Tour., no. May, pp. 1–20, 2024, doi: 10.1080/13683500.2024.2359544.
S. S. Karayazi, G. Dane, and T. Arentze, “Visitors’ heritage location choices in Amsterdam in times of mass tourism: a latent class analysis,” J. Herit. Tour., vol. 19, no. 4, pp. 497–518, 2024, doi: 10.1080/1743873X.2024.2331227.
Download PDF: 69 times
Copyright (c) 2024 Journal of Information Systems and Informatics
This work is licensed under a Creative Commons Attribution 4.0 International License.
- I certify that I have read, understand and agreed to the Journal of Information Systems and Informatics (Journal-ISI) submission guidelines, policies and submission declaration. Submission already using the provided template.
- I certify that all authors have approved the publication of this and there is no conflict of interest.
- I confirm that the manuscript is the authors' original work and the manuscript has not received prior publication and is not under consideration for publication elsewhere and has not been previously published.
- I confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
- I confirm that the paper now submitted is not copied or plagiarized version of some other published work.
- I declare that I shall not submit the paper for publication in any other Journal or Magazine till the decision is made by journal editors.
- If the paper is finally accepted by the journal for publication, I confirm that I will either publish the paper immediately or withdraw it according to withdrawal policies
- I Agree that the paper published by this journal, I transfer copyright or assign exclusive rights to the publisher (including commercial rights)