Measuring the User Experience of LMS CLASS-IPB Using the User Experience Questionnaire Method

  • Arya Dimas Wicaksana College of Vocational Studies IPB University, Indonesia
  • Rizki Juliansyah College of Vocational Studies IPB University, Indonesia
  • Muhammad Anggi Lubis College of Vocational Studies IPB University, Indonesia
  • Amata Fami College of Vocational Studies IPB University, Indonesia
  • Bontisesari Wahyoedi College of Vocational Studies IPB University, Indonesia
DOI: 10.51519/journalisi.v6i2.731
Keywords: LMS, UX, UEX, IPB, CLASS-IPB LMS

Abstract

This study conducts the measurement of user experience (UX) of the CLASS-IPB Learning Management System (LMS) using the User Experience Questionnaire (UEQ) method. The research was carried out through several stages, including a literature review, method determination, data collection, and data analysis using UEQ Data Analysis Tools. It involved 45 students who provided feedback on six UX aspects: attractiveness, perspicuity, efficiency, dependability, stimulation, and novelty. Results indicated that CLASS-IPB excels in pragmatic qualities, particularly in efficiency, perspicuity, and dependability, with scores above the benchmark average. However, the system scored lower in hedonic qualities, specifically in stimulation and novelty, suggesting areas for improvement. The study concludes that while CLASS-IPB is effective in aiding task completion and user control, it needs enhancements to become more motivating and innovative.

Downloads

Download data is not yet available.

References

D. Al-Fraihat, M. Joy, R. Masa’deh, and J. Sinclair, “Evaluating E-learning systems success: An empirical study,” Computers in Human Behavior, vol. 102, pp. 67–86, Jan. 2020, doi: 10.1016/j.chb.2019.08.004.

M. Schrepp, A. Hinderks, and J. Thomaschewski, “Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S),” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 6, p. 103, 2017, doi: 10.9781/ijimai.2017.09.001.

M. Rauschenberger, M. Schrepp, M. Perez-Cota, S. Olschner, and J. Thomaschewski, “Efficient Measurement of the User Experience of Interactive Products. How to use the User Experience Questionnaire (UEQ). Example: Spanish Language Version,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 2, no. 1, p. 39, 2013, doi: 10.9781/ijimai.2013.215.

M. Schrepp, A. Hinderks, and J. Thomaschewski, “Applying the User Experience Questionnaire (UEQ) in Different Evaluation Scenarios,” in Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience, Cham: Springer International Publishing, 2014, pp. 383–392. Accessed: May 25, 2024, doi: 10.1007/978-3-319-07668-3_37

J. S. Mtebe and R. Raisamo, “Challenges and instructors’ intention to adopt and use open educational resources in higher education in Tanzania,” The International Review of Research in Open and Distributed Learning, vol. 15, no. 1, Jan. 2014, doi: 10.19173/irrodl.v15i1.1687.

A. K. M. N. Islam, “E-learning system use and its outcomes: Moderating role of perceived compatibility,” Telematics and Informatics, vol. 33, no. 1, pp. 48–55, Feb. 2016, doi: 10.1016/j.tele.2015.06.010.

F. A. Azhari and L. C. Ming, “Review of e-learning Practice at the Tertiary Education level in Malaysia,” Indian Journal of Pharmaceutical Education and Research, vol. 49, no. 4, pp. 248–257, Jun. 2015, doi: 10.5530/ijper.49.4.2.

H. Abuhassna, W. M. Al-Rahmi, N. Yahya, M. A. Z. M. Zakaria, A. Bt. M. Kosnin, and M. Darwish, “Development of a new model on utilizing online learning platforms to improve students’ academic achievements and satisfaction,” International Journal of Educational Technology in Higher Education, vol. 17, no. 1, Oct. 2020, doi: 10.1186/s41239-020-00216-z.

A. Hinderks, M. Schrepp, F. J. Domínguez Mayo, M. J. Escalona, and J. Thomaschewski, “Developing a UX KPI based on the user experience questionnaire,” Computer Standards & Interfaces, vol. 65, pp. 38–44, Jul. 2019, doi: 10.1016/j.csi.2019.01.007.

A. M. Saleh, H. Y. Abuaddous, I. S. Alansari, and O. Enaizan, “The Evaluation of User Experience on Learning Management Systems Using UEQ,” International Journal of Emerging Technologies in Learning (iJET), vol. 17, no. 07, pp. 145–162, Apr. 2022, doi: 10.3991/ijet.v17i07.29525.

A. Y. Alsabawy, A. Cater-Steel, and J. Soar, “Determinants of perceived usefulness of e-learning systems,” Computers in Human Behavior, vol. 64, pp. 843–858, Nov. 2016, doi: 10.1016/j.chb.2016.07.065.

Y.-M. Cheng, “Roles of interactivity and usage experience in e-learning acceptance: a longitudinal study,” International Journal of Web Information Systems, vol. 10, no. 1, pp. 2–23, Apr. 2014, doi: 10.1108/ijwis-05-2013-0015.

A. Pratama, A. Faroqi, and E. P. Mandyartha, “Evaluation of User Experience in Integrated Learning Information Systems Using User Experience Questionnaire (UEQ),” Journal of Information Systems and Informatics, vol. 4, no. 4, pp. 1019–1029, Nov. 2022, doi: 10.51519/journalisi.v4i4.394.

M. Schrepp, A. Hinderks, and J. Thomaschewski, “Construction of a Benchmark for the User Experience Questionnaire (UEQ),” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 4, p. 40, 2017, doi: 10.9781/ijimai.2017.445.

S. F. Novitasari, Y. T. Mursityo, and A. N. Rusydi, “Evaluasi Pengalaman Pengguna pada E-Commerce Sociolla.com Menggunakan Usability Testing dan User Experience Questionnaire (UEQ),” Jurnal Sistem Informasi, Teknologi Informasi, dan Edukasi Sistem Informasi, vol. 1, no. 2, pp. 57–63, Dec. 2020, doi: 10.25126/justsi.v1i2.9.

Published
2024-06-13
Abstract views: 1901 times
Download PDF: 191 times
How to Cite
Wicaksana, A., Juliansyah, R., Lubis, M., Fami, A., & Wahyoedi, B. (2024). Measuring the User Experience of LMS CLASS-IPB Using the User Experience Questionnaire Method. Journal of Information Systems and Informatics, 6(2), 851-864. https://doi.org/10.51519/journalisi.v6i2.731
Issue
Vol 6 No 2 (2024): Journal of Information Systems and Informatics
Section
Articles

Copyright (c) 2024 Journal of Information Systems and Informatics

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

  1. I certify that I have read, understand and agreed to the Journal of Information Systems and Informatics (Journal-ISI) submission guidelines, policies and submission declaration. Submission already using the provided template.
  2. I certify that all authors have approved the publication of this and there is no conflict of interest.
  3. I confirm that the manuscript is the authors' original work and the manuscript has not received prior publication and is not under consideration for publication elsewhere and has not been previously published.
  4. I confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
  5. I confirm that the paper now submitted is not copied or plagiarized version of some other published work.
  6. I declare that I shall not submit the paper for publication in any other Journal or Magazine till the decision is made by journal editors.
  7. If the paper is finally accepted by the journal for publication, I confirm that I will either publish the paper immediately or withdraw it according to withdrawal policies
  8. I Agree that the paper published by this journal, I transfer copyright or assign exclusive rights to the publisher (including commercial rights)