An Explainable AHP with Sensitivity Analysis Approach for Strategic IT Project Prioritization in Higher Education

Authors

  • Hilyah Magdalena Institut Sains dan Bisnis Atma Luhur, Indonesia
  • Ade Septryanti Institut Sains dan Bisnis Atma Luhur, Indonesia
Pages Icon

DOI:

https://doi.org/10.63158/journalisi.v8i3.1597

Keywords:

Analytic Hierarchy Process, IT project portfolio, higher education digital transformation, decision explainability, sensitivity analysis

Abstract

This study addresses the strategic challenges faced by private universities in Indonesia in selecting the most suitable IT project to support digital transformation, comparing a Next-Generation Learning Management System (LMS) and an Integrated University Mobile Super-App. Rather than developing a new method, this study enhances the conventional Analytical Hierarchy Process (AHP) by integrating sensitivity analysis and priority decomposition to improve decision explainability (Explainable MCDM). Expert assessments were collected from five academic stakeholders using pairwise comparisons based on Saaty's scale. Four criteria were assessed: Strategic Alignment, Benefits & Impact, Feasibility & Resources, and Risk Assessment. The results show a narrow preference for the LMS (50.7%) over the Super-App (49.3%), primarily driven by its superiority on the highest-weighted criterion, Strategic Alignment (35.6%), particularly the "Support for Core Educational Goals" sub-criterion. Sensitivity analysis reveals that the ranking would reverse if the Benefits & Impact weight increases from 0.200 to above 0.278. This study provides a transparent, replicable, explainable AHP framework that enables decision-makers to understand not only what is recommended but also why and under what conditions the recommendation changes.

Downloads

Download data is not yet available.

Author Biography

  • Ade Septryanti, Institut Sains dan Bisnis Atma Luhur

    Faculty of Information Technology

References

[1] R. A. Kambau, U. Islam, and N. Alauddin, “Proses transformasi digital pada perguruan tinggi di Indonesia,” J. Rekayasa Sist. Inf. dan Teknol., vol. 1, no. 3, pp. 126–136, 2024, doi: 10.59407/jrsit.v1i3.481.

[2] A. J. Singun, Unveiling the barriers to digital transformation in higher education institutions : a systematic literature review, no. Ml. Springer International Publishing, 2025. doi: 10.1007/s44217-025-00430-9.

[3] S. Ningsih, M. Suhardi, I. N. Sari, D. S. Wulan, M. Fadillah, and N. Amalia, “Implementasi Learning Management System (LMS) di Lingkungan Pendidikan Tinggi,” EDUTECH J. Inov. Pendidik. Berbantuan Teknol., vol. 5, no. 2, pp. 422–432, 2025.

[4] D. A. Fristianingroem, “Implementation of Learning Management System ( Lms ) - Based Curriculum in Course and Training Institutions in Tegal City : A Theoretical Study,” Nidhomul Haq J. Manaj. Pendidik. Islam, vol. 10, no. 1, pp. 137–150, 2025, doi: 10.31538/v10i1.100.

[5] N. Anggeraini, “Eksplorasi Implementasi LMS di Perguruan Tinggi : Studi Kualitatif Pengalaman Mahasiswa Indonesia,” Indo-MathEdu Intellectuals J., vol. 6, no. 5, pp. 6875–6886, 2025, doi: 10.54373/imeij.v6i5.3904.

[6] G. C. Akwene, “Adoption of Learning Management Systems in Higher Education : A Qualitative Analysis of Enabling Factors,” Int. J. Sci. Res. Manag., vol. 12, no. 02, pp. 3229–3237, 2024, doi: 10.18535/ijsrm/v12i02.el09.

[7] A. Z. Fitri and U. Hasanah, “Smart Campus Development : Trends In Building A Digital-Based Academic Culture In Cyber Learning Environments,” Int. J. Sci. Technol. Manag., vol. 5, no. 2, pp. 349–357, 2024.

[8] G. Altun and M. Zencirkıran, “A Web-Based Learning Model for Smart Campuses : A Case in Landscape Architecture Education,” Sustain. MDPI, vol. 17, no. 11203, 2025, doi: 10.3390/su172411203.

[9] Y. Vitriani and M. Irsyad, “Smart Campus as Digital Transformation in Indonesian Universities : A Research Landscape Perspective,” Eng. Technol. J., vol. 11, no. 01, pp. 8786–8790, 2026, doi: 10.47191/etj/v11i01.43.

[10] S. M. A. A. Koesanto, G. Wiradharma, M. A. Prasetyo, A. Rubyasih, E. Rusyana, and K. P. Ningrum, “Toward a Smart Campus: A Qualitative Study of the Digital Learning Ecosystem Model in Indonesian Higher Education,” J. Kependidikan, vol. 12, no. 1, pp. 411–422, 2026, doi: 10.33394/jk.v12i1.19810.

[11] C. B. Setiawan et al., “Pengaruh Budaya Organisasi Terhadap Kesuksesan Manajemen Proyek Teknologi Informasi: Studi Kasus Perguruan Tinggi di Indonesia,” JSI J. Sist. Inf., vol. 17, no. 1, 2025.

[12] M. M. Taherdoost, Hamed, “Multi-Criteria Decision Making ( MCDM ) Methods and Concepts,” Encycl. MDPI, vol. 3, no. MCDM, pp. 77–87, 2023, doi: 10.3390/ encyclopedia3010006.

[13] A. Siekelova, I. Podhorska, and J. J. Imppola, “Analytic Hierarchy Process in Multiple – Criteria Decision – Making : A Model Example,” in SHS Web of Conferences ECCW 2020, 2021. doi: 10.1051/shsconf/20219001019.

[14] M. Faizal, Y. Priyandari, N. Rosyidi, S. T. Industri, F. Teknik, and U. S. Maret, “Penentuan Prioritas Alternatif Solusi terhadap Kegagalan Proyek TI dengan Metode ANP dan BWM,” Performa Media Ilm. Tek. Ind., vol. 21, no. 2, pp. 221–235, 2022, doi: 10.20961/performa.21.2.59846.

[15] M. Elena, N. Fabio, D. F. Cristina, and D. L. Antonio, How artificial intelligence will transform project management in the age of digitization : a systematic literature review, vol. 75, no. 2. Springer International Publishing, 2025. doi: 10.1007/s11301-024-00418-z.

[16] H. Gaspars-wieloch, “AHP based on scenarios and the optimism coefficient for new and risky projects : case of independent criteria,” Ann. Oper. Res., vol. 341, no. 2, pp. 937–961, 2024, doi: 10.1007/s10479-024-06197-w.

[17] F. S. Hillier, C. C. Price, and S. F. Austin, Models , Methods , Concepts & Applications of the Analytic Hierarchy Process, Second Edi., vol. 175. 2015.

[18] K. Zhao, Y. Dai, Y. E. Ji, and Z. Jia, “Decision-Making Model to Portfolio Selection Using Analytic Hierarchy Process ( AHP ) With Expert Knowledge,” IEEE Access, vol. 2, 2021, doi: 10.1109/ACCESS.2021.3082529.

[19] M. K. L. Duran, “Study on the Top 30 Blue Chip Companies in the Philippine Stock Portfolio Selection utilizing Analytical Hierarchy Process ( AHP ): A Study on the Top 30 Blue Chip Companies in the Philippine Stock Exchange,” in ICIBE ’24: Proceedings of the 10th International Conference on Industrial and Business Engineering, 2024, pp. 0–9. doi: 10.1145/3716097.3716128.

[20] J. E. Leal, “MethodsX AHP-express : A simpli fi ed version of the analytical hierarchy process method,” vol. 7, 2020, doi: 10.1016/j.mex.2019.11.021.

[21] A. U. Khan and T. Topi, “Analytical Hierarchy Process ( AHP ) and Analytic Network Process methods and their applications : A twenty year review from 2000-2019,” IJAHP, vol. 12, no. 3, pp. 369–459, 2019, doi: 10.13033/ijahp.v12i3.822.

[22] J. Stofkova, M. Krejnus, K. R. Stofkova, and P. Malega, “Use of the Analytic Hierarchy Process and Selected Methods in the Managerial Decision-Making Process in the Context of Sustainable Development,” Sustain. MDPI, vol. 14, no. 11546, 2022, doi: 10.3390/ su141811546.

[23] E. Gomes et al., “Binary Decision Support Using AHP : A Model for Alternative Analysis,” MDPI algorithm, vol. 18, no. 320, pp. 1–20, 2025, doi: 10.3390/a18060320.

[24] D. Garcia, B. De Souza, E. Antonio, N. Y. Soma, and C. Eduardo, “MCDM-Based R & D Project Selection : A Systematic Literature Review,” MDPI Sustain., vol. 13, no. 11626, pp. 1–34, 2021, doi: 10.3390/su 132111626.

[25] B. Akinnuwesi and F. Uzoka, “Assessment of Software Project Proposal using Analytical Hierarchy Process : A Framework,” J. Res. Rev. Sci., vol. 4, pp. 44–55, 2018, doi: 10.36108/jrrslasu/7102/40(0170).

[26] F. E. Uzoka and B. A. Akinnuwesi, “Development and Evaluation Of An AHP Model For Software System Selection,” Multipel Criterria Decis. Mak., vol. 14, 2019, doi: 10.22367/mcdm.2019.14.07.

[27] T. A. Muttaqin and R. Jayadi, “Leveraging AHP for Optimal Project Management Software Selection,” vol. 14, no. 12, pp. 469–483, 2024, doi: 10.33168/JSMS.2024.1228.

[28] N. Nurhuda, E. Darwiyanto, and S. Widowati, “Implementation of Analytical Hierarchy Process ( AHP ) for Determining Priority of Software Assessment in West Java Provincial Government Based on ISO / IEC 25010 ( Case Study : Sapawarga Application ),” vol. 6, no. April, pp. 23–40, 2021, doi: 10.34818/indojc.2021.6.1.525.

[29] L. Changing, S. Moslem, D. Farooq, A. Jamal, Y. Almarhabi, and M. Almoshaogeh, “An Integrated Fuzzy Analytic Hierarchy Process ( AHP ) Model,” entropy MDPI, vol. 24, no. 367, pp. 1–19, 2022, doi: 10.3390/e24030367.

[30] P. Bhadu, Jagdish, Bhamu, Jaiprakash, Saraswat, “An Analytic Hierarchy Process ( AHP ) Approach for Prioritizing the Industries 4.0 Technologies (I4.0T),” Evergr. Jt. J. Nov. Carbon Resour. Sci. Green Asia Strateg., vol. 10, no. 2, pp. 667–675, 2023, doi: 10.5109/6792813.

[31] M. H. M. H, H. Elkadi, and N. El Tazi, “Identifying and Prioritizing Digital Transformation Elements Using Fuzzy Analytic Hierarchy Process,” no. September, 2023, doi: 10.14569/IJACSA.2023.0140986.

[32] J. A. Restrepo-morales, J. Echavarria, and C. Durango-yepes, “Strategic decision-making in project management : Applying FAHP to select research agendas,” J. Infrastructure, Policy Dev., vol. 8, no. 9, pp. 1–23, 2024, doi: 10.24294/jipd.v8i9.4627.

[33] C. Slamet, A. Rahman, and M. A. Ramdhani, “Determinant Factors in the Implementation of Information Technology Strategic Management to Academicians ’ Performance in Higher Education Institution,” vol. 6, no. 2, pp. 246–252, 2021, doi: 10.15575/join.v6i2.829.

[34] S. Sahin, “Utilizing AHP and conjoint analysis in educational research : Characteristics of a good mathematical problem,” Educ. Inf. Technol., vol. 29, no. 18, pp. 25375–25401, 2024, doi: 10.1007/s10639-024-12830-9.

[35] D. Kaftan et al., “Performance analysis of mathematical methods used to forecast the 2022 New York City Mpox outbreak,” J. Med. Virol., vol. 96, no. 8, pp. 1–8, 2024, doi: 10.1002/jmv.29791.

[36] M. H. Akmal, “Strategic management in digital transformation : prioritizing strategic initiatives through Analytic Hierarchy Process (AHP) in Indonesia’s services sector,” J. Multidiscip. Acad. Bus. Stud., vol. 1, no. 4, pp. 875–898, 2024, doi: doi.org/10.35912/jomabs.v1i4.2379.

[37] I. Canco and D. Kruja, “AHP , a Reliable Method for Quality Decision Making : A Case Study in Business,” MDPI Sustain., vol. 13, no. 13932, pp. 1–14, 2021, doi: 10.3390/ su132413932.

[38] Z. S. Omar, “Prioritizing Research and Development Projects using a MCDM Technique,” Int. J. Adv. Eng. Res. Appl., vol. 9, no. 3, pp. 14–25, 2023, doi: 10.46593/ijaera.2023.v09i03.001.

[39] R. Sari, I. Kurniastuti, and E. Sulistiyani, “Comparative Analysis of Prioritization Model Between AHP ( Analytic Hierarchy Process ) and ANP ( Analytic Network Process ) for Project Portfolio Management SI / IT Surabaya City Government,” Appl. Technol. Comput. Sci. J., vol. 4474, no. 200, pp. 88–95, 2024.

[40] Z. K. Szabo, Z. Sz, and D. S. St, Gabriela C, “An Analytic Hierarchy Process Approach for Prioritisation of Strategic Objectives of Sustainable Development,” Sustain. MDPI, vol. 13, no. 2254, pp. 1–26, 2021, doi: 10.3390/ su13042254.

[41] A. O. Mogbojuri and O. A. Olanrewaju, “An integrated AHP-GP-GA approach for public project portfolio selection problem,” Ain Shams Eng. J., vol. 16, no. 10, p. 103644, 2025, doi: 10.1016/j.asej.2025.103644.

[42] M. Mansour, S. Dawood, and I. Falqi, “An Integrated Structural Equation Modeling and Analytic Hierarchy Process Approach to Prioritize Investment in the Construction Industry to Achieve Sustainable Development in Saudi Arabia,” vol. 29, no. 3, pp. 2285–2302, 2020, doi: 10.15244/pjoes/110516.

[43] M. A. Mahajabeen and G. A. Neema, “Analytical Hierarchy Process for Project Selection Considering Risks,” Int. J. Res. Eng. Sci. Manag., vol. 3, no. 6, pp. 296–300, 2020.

[44] G. Claus and L. Aldianto, “Application of the Analytical Hierarchy Process ( AHP ) for Innovative Technological Projects Evaluation and Prioritization in an FMCG Company,” Int. J. Curr. Sci. Res. Rev., vol. 07, no. 06, pp. 3612–3622, 2024, doi: 10.47191/ijcsrr/V7-i6-10.

[45] L. A. De Souza and H. G. Costa, “Prioritizing Criteria to Evaluate Project Success : Modeling With The Analytic Hierarchy Process (AHP),” IJAHP, vol. 14, no. 1, pp. 1–20, 2022, doi: 10.13033/ijahp.v14i1.913.

[46] B. B. Mahmood, I. A. Husain, A. Mohammed, and R. Mahjoob, “Project Delivery System Selection using the AHP Multi-Criteria Decision Making Method,” Eng. Technol. Appl. Sci. Res., vol. 15, no. 1, pp. 20118–20122, 2025, doi: 10.48084/etasr.9434.

[47] A. Maceika, A. Bugajev, O. R. Šostak, and T. Vilutien, “Decision Tree and AHP Methods Application for Projects Assessment : A Case Study,” MDPI data, vol. 13, no. 5502, pp. 1–33, 2021, doi: 10.3390/su13105502.

[48] S. Nurhidayarnis, A. Putri, R. Zaid, and I. Zarier, “Implementation of Analytic Hierarchy Process Method In the Decision Support System for Selecting Department in University,” IJATIS Indones. J. Appl. Technol. Innov. Sci., vol. 1, no. August, pp. 103–111, 2024, doi: 10.57152/IJATIS.v1i2.1138.

[49] Z. Azhar, H. Effendi, and M. Muskhir, “Decision Support System Analytical Hierarchy Process in Learning Method Selection Decision Support System Analytical Hierarchy Process in Learning Method Selection,” 2021, doi: 10.1088/1742-6596/1933/1/012065.

[50] R. Sari, E. Sulistiyani, and N. S. Meutia, “Prioritization Model for IT Project Portfolio Management in Private University : A Literature Review,” vol. 5, no. 1, pp. 1–14, 2023, doi: 10.51519/journalisi.v5i1.416.

[51] Yulmaini, A. Sanusi, M. A. E. Yusendra, and S. Kholijah, “Implementation of Analytic Hierarchy Process for Determining Priority Criteria in Higher Education Competitiveness Development Strategy Based on RAISE ++,” JICETS, vol. 1529, no. 022064, 2019, doi: 10.1088/1742-6596/1529/2/022064.

[52] H. W. Aripradono, I. Nursyamsi, A. Wahab, and Z. Sultan, “Educational Technology for Digital Transformation of Higher Education Institutions into Entrepreneurial Universities,” Policy Gov. Rev., vol. 8, no. 2, pp. 303–322, 2024, doi: 0.30589/pgr. v8i3.1019.

[53] M. O. Fitri, Y. Lizar, R. F. Gunawan, N. Shalihin, and S. Syafril, “Analytic Hierarchy Process ( AHP ) Method to Prioritize the Development of Smart Campus Dimensions,” J. Adv. Res. Appl. Sci. Eng. Technol., vol. 63, no. 4, pp. 132–142, 2026, doi: 10.37934/araset.63.4.132142.

[54] N. Thi, H. Van Hai, K. Lich, and M. Tuan, “Prioritizing components of university brands by using the integrated Delphi and AHP methods,” Multidiscip. Rev., vol. February, no. 5, 2024, doi: 10.31893/multirev.2024067.

[55] S. Arifa and R. Isnanto, “Analysis of University Helpdesk Information Technology governance Using Cobit 2019 and Fuzzy-AHP,” JTIULM, vol. 8, no. 2, pp. 31–40, 2023.

[56] S. Zhang and T. Zhang, “AHP-Based Evaluation of Discipline-Specific Information Services in Academic Libraries Under Digital Intelligence,” MDPI Inf., vol. 16, no. 245, pp. 1–28, 2025, doi: 10.3390/ info16030245.

[57] P. Laguna-s, “A Multiple Criteria Decision Making Approach to Designing Teaching Plans in Higher Education Institutions,” MDPI Math., vol. 9, no. 9, 2021, doi: 10.3390/ math9010009.

[58] F. Lv, “Research on the Application of Computer Technology in Software Technology Talents Training System in Higher Vocational Colleges,” ISCE 2021 J. Phys. Conf. Ser., vol. 1915, no. 032035, 2021, doi: 10.1088/1742-6596/1915/3/032035.

[59] Q. N. Naveed et al., “Evaluating and Prioritizing Barriers for Sustainable E-Learning Using Analytic Hierarchy Process-Group Decision Making,” Sustain. MDPI, vol. 14, no. 8973, pp. 1–18, 2022, doi: 10.3390/ su14158973.

[60] R. Alshehri and A. Alrashedi, “The Efficacy of the Strategy Planning Process Criteria based on the Fuzzy Analytical Hierarchy Process,” Eng. Technol. Appl. Sci. Res., vol. 13, no. 4, pp. 11235–11241, 2023.

[61] M. Laaziri, K. Benmoussa, A. E. A. El Amrani, and A. Mouchtachi, “A New Approach to University IT Project Portfolio Management Based on Multi-Criteria Methods and the COBIT 5 Governance Framework,” J. Syst. Sci. Inf., vol. 11, no. 5, pp. 636–654, 2023, doi: 10.21078/JSSI-2022-0033.

[62] C. Shi and Y. Yao, “Explainable multi-criteria decision-making : A three-way decision perspective,” Int. J. Approx. Reason. J., vol. 187, no. July, 2025, doi: 10.1016/j.ijar.2025.109528.

[63] L. Wei and E. Rokou, “A Literature Review on the Integration of AI with AHP / ANP 3 . Applications of AI in Integrating AI with AHP and ANP,” in International Symposium of the Analytic Hierarchy Process 2024, Web Conference, 2024, pp. 1–5.

[64] T. L. Saaty and L. G. Vargas, Models, Methods, Concepts & Applications of the Analytic Hierarchy Process, Second Edi. Springer New York Heidelberg Dordrecht London, 2022. doi: 10.1007/978-1-4614-3597-6.

[65] T. L. Saaty, “Decision making with the analytic hierarchy process,” Int. J. Serv. Sci., vol. 1, no. 1, p. 83, 2008, doi: 10.1504/IJSSCI.2008.017590.

[66] T. L. Saaty, “What is the Analytic Hierarchy Process?,” in Mathematical Models for Decision Support, 2011. doi: 10.1007/978-3-642-83555-1_5.

[67] M. B. Barfod, “Graphical and technical options in Expert Choice for group decision making,” in DTU Transport Compendium Series part 3, First Edit., 2014, p. 35.

Downloads

Published

2026-06-22

Issue

Vol. 8 No. 3 (2026): June

Section

Articles

License

Copyright (c) 2026 Journal of Information Systems and Informatics

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors Declaration

  1. The Authors certify that they have read, understood, and agreed to the Journal of Information Systems and Informatics (JournalISI) submission guidelines, policies, and submission declaration. The submission has been prepared using the provided template.
  2. The Authors certify that all authors have approved the publication of this manuscript and that there is no conflict of interest.
  3. The Authors confirm that the manuscript is their original work, has not received prior publication, is not under consideration for publication elsewhere, and has not been previously published.
  4. The Authors confirm that all authors listed on the title page have contributed significantly to the work, have read the manuscript, attest to the validity and legitimacy of the data and its interpretation, and agree to its submission.
  5. The Authors confirm that the manuscript is not copied from or plagiarized from any other published work.
  6. The Authors declare that the manuscript will not be submitted for publication in any other journal or magazine until a decision is made by the journal editors.
  7. If the manuscript is finally accepted for publication, the Authors confirm that they will either proceed with publication immediately or withdraw the manuscript in accordance with the journal’s withdrawal policies.
  8. The Authors agree that, upon publication of the manuscript in this journal, they transfer copyright or assign exclusive rights to the publisher, including commercial rights