Change Management Model for Effective Use of Examination Administration System: Developing Country Case Study

Ngoanamosadi Stanford Mphahlele; Raymond Mompoloki Kekwaletswe; Tshinakaho Relebogile Seaba

doi:10.51519/journalisi.v6i1.658

Ngoanamosadi Stanford Mphahlele Tshwane University of Technology, South Africa
Raymond Mompoloki Kekwaletswe University of Johannesburg, South Africa https://orcid.org/0000-0002-3455-3127
Tshinakaho Relebogile Seaba Tshwane University of Technology, South Africa https://orcid.org/0000-0002-5773-887X

Keywords: Examination Administration System, Change management factors, Effective Use Theory, Unified Theory of Acceptance and Use of Technology, Change Management Model

Abstract

There is inadequate knowledge on change management model (CMM) for post-acceptance phase of information systems. This paper intends to determine and model change management factors (CMFs) that explain effective use of Examination Administration System (EAS) in South Africa. A survey was used to collect data from 215 EAS users in Technical and Vocational Education and Training colleges and was analyzed quantitatively. Empirical results evince existence of casual nexuses between user involvement and change recognition, user satisfaction, performance measurement with use of EAS which through EAS adaptive use (EAU) in turn together with EAS verification, user learning representational fidelity and informed actions influence effective use of EAS. This study results add to literature by explaining the indirect mechanisms (i.e., EAS and EAU) through which the CMFs can influence effective use. This paper also offers a novel integration of Effective Use Theory and Unified Theory of Acceptance and Use of Technology with three CMFs which provides a holistic model. This study recommends that various communities endeavour to use CMM as a guide to influence user communities to effectively use information systems in diverse contexts. The model also has potential to drive improved return on investments and enhance employees’ productivity.

Downloads

Download data is not yet available.

References

J. Recker, M. Indulska, P. Green, A. Burton-Jone, and R. Weber, “Information systems as representations: a review of the theory and evidence,” J. Assoc. Inf. Syst., vol. 20, no. 6, pp. 735–786, 2019.

V. Venkatesh, M. G. Morris, B. G. Davis, and D. F. Davis, “User acceptance of Information Technology: Towards a Unified View,” MIS Q. MIS Res. Cent. Univ. Minn., vol. 27, no. 3, pp. 425–478, 2003.

A. Burton-Jones and C. Grange, “From use to effective use: a representation theory perspective,” Inf. Syst. Res., vol. 24, no. 3, pp. 632–658, 2013.

T. G. Smith et al., “Creating a Practical Transformational Change Management Model for Novel Artificial Intelligence-Enabled Technology Implementation in the Operating Room,” Elsevier Inc Behalf Mayo Found. Med. Educ. Res., 2022.

M. Rohmah and A. P. Subriadi, “Processes and activities for managing change in information systems implementation in higher education institution,” The Winners, vol. 23, no. 1, pp. 51–64, 2022.

S. Musungwini and L. Mono, “Developing a Change Management Model for Managing Information Systems Initiated Organisational Change: A Case of the Banking Sector in Zimbabwe,” 2019, doi: 10.20470/jsi.v10i1.362.

S. Yusif, A. Hafeez-Bai, and J. Soar, “Change management and adoption of health information technology (HIT)/eHealth in public hospitals in Ghana: A qualitative study,” Appl. Comput. Inform., vol. 18, no. 3/4, pp. 279–289, 2019, doi: 10.1016/j.aci.2019.11.007.

K. E. Mogogole and O. Jokonya, “Conceptual framework for implementing IT Change Management within South African Public Sectors,” in International Conference on ENTERprise Information Systems / ProjMAN - International Conference on Project MANagement / HCist - International Conference on Health and Social Care Information Systems and Technologies, Procedia Computer Science, 2018, pp. 835–842.

O. K. Abatan and M. Maharaj, “Change management and the integration of information technology: Research notes from selected African universities,” in 12th International Conference for Internet Technology and Secured Transactions (ICITST -2017), Infonomics Society, 2017, pp. 167–172. doi: 10.23919/ ICITST.2017.8356370.

N. Chepa, M. N. Jasin, and N. A. Abu Bakar, “How Change Management can prevent the Failure of Information System Implementation among Malaysian Government Hospitals?,” in AIP Conference Proceedings 1891, vol. 3, 2017. doi: 10.1063/1.5005352.

E. Ziemba and I. Obłąk, “Change management in information systems projects for public organizations in Poland,” Interdiscip. J. Inf. Knowl. Manag., vol. 10, pp. 47–62, 2015.

R. Kapupu and M. Mignerat, “Change Management Strategies in ERP Implementations: A Case Study,” in Conference on Information Resources Management (CONF-IRM) 2015, Association for Information Systems AIS Electronic Library (AISeL). [Online]. Available: http://aisel.aisnet.org/confirm2015/41

A. Burton-Jones and C. Grange, “Using Information Systems Effectively: A Representational Perspective,” in Proceeding> Proceedings of JAIS Theory Development Workshop., Sprouts, 2008.

M. M. Visser, “A methodology for the evaluation of management information systems at public technical and vocational education and training colleges in South Africa,” Doctoral dissertation, University of South Africa, South Africa, Pretoria, 2017.

M. M. Visser, J. A. van Biljon, and M. E. Herselman, “Evaluation of management information systems: A study at a Further Education and Training college,” SA J. Inf. Manag., vol. 15, no. 1, 2013, doi: dx.doi.org/10.4102/ sajim. v15i1.531.

M. M. Visser, J. A. van Biljon, and M. E. Herselman, “Modeling Management Information Systems Success: a study in the domain of Further Education and Training,” in Kroeze, J.H. & De Villiers, R. (eds). SAICSIT ’12 Proceedings of the South African Institute for Computer Scientists and Information Technologists conference, South Africa, Pretoria: New York: Association of Computing Machinery, Oct. 2012, pp. 384–393. [Online]. Available: http://hdl.handle.net/20.500.11910/9018

D2L, “Navigating Change Management in Higher Education,” Navigating Change Management in Higher Education. Accessed: Jan. 01, 2024. [Online]. Available: https://www.d2l.com/blog/navigating-change-management-in-higher-education

Y. E. Mrini, M. Belaissaoui, and I. Taqafi, “Difficulties Related to the Implementation of ERPs in Morocco: Focus on Change Management,” Am. Sci. Res. J. Eng. Technol. Sci. ASRJETS, vol. 51, no. 1, pp. 47–55, 2019.

V. Trieu, A. Burton-Jones, P. Green, and S. Cockcroft, “Applying and extending the theory of effective use in a business intelligence context,” MIS Q., vol. 6, no. 1, pp. 645–678, 2022.

K. B. Osnes, J. R. Olsen, P. Vassilakopoulou, and E. Hustad, “ERP systems in multinational enterprises: A literature review of post-implementation challenges,” in CENTERIS - International Conference on ENTERprise Information Systems / ProjMAN - International Conference on Project MANagement / HCist - International Conference on Health and Social Care Information Systems and Technologies, Procedia Computer Science, 2018, pp. 541–548.

H. Yang, X. Guo, Z. Peng, and L. H. Lai, “The antecedents of effective use of hospital information systems in the Chinese context: A mixed-method approach,” Inf. Process. Manag., vol. 58, no. 2, 2021, doi: doi.org/10.1016/j.ipm.2020.102461.

R. Eden, E. Fielt, and G. Murphy, “Advancing the Theory of Effective Use through Operationalization,” in Proceedings of the 28th European Conference on Information Systems (ECIS), Online AIS conference, Jun. 2020.

P. Haake, “Understanding Effective Use in (Post) - Implementation Phase of Information Systems,” Unpublished Doctoral DegreE Dissertation, Karlsruhe Institute of Technology (KIT), 2017.

G. Piccoli and F. Pigni, Information systems for managers: with cases, 4.0. Prospect Press, 2018.

E. Tantua and F. Godwin-Biragbara, “Management Information System and Office Productivity of the Print Media in Rivers State Nigeria,” Int. J. Bus. Law Res., vol. 8, no. 1, pp. 74–84, 2020.

Republic of South Africa National e-Government Strategy and roadmap (Notice 886 of 2017). 2017.

Republic of South Africa Continuing Education and Training Act 16 (CET Act 16). 2006. Accessed: Jan. 21, 2022.

“The Statistics on Post-School Education and Training in South Africa 2021,” Department of Higher Education and Training (DHETb), 2023. Accessed: Apr. 30, 2023.

“United Nations Report, E-Government Survey: The Future of Digital Government,” United Nations, 2022. Accessed: Jan. 01, 2023. [Online]. Available: https://desapublications.un.org/publications/un-e-government-survey-2022

I. O. Adam, J. Effah, and R. Boateng, “Virtualisation of an administrative work environment in higher education,” J. Enterp. Inf. Manag., vol. 30, no. 5, pp. 723–747, 2017, doi: 10.1108/jeim-06-2016-0119.

Z. T. Butarbutar, P. W. Handayani, R. R. Suryono, and W. W. Wibowo, “Systematic literature review of Critical success factors on enterprise resource planning post implementation,” Cogent Bus. Manag., vol. 10, no. 3, pp. 1–29, 2023, doi: 10.1080/23311975.2023.2264001.

Y. Xie, C. Allen, and M. Ali, “Critical success factor based resource allocation in ERP implementation: A nonlinear programming model,” Heliyon, vol. 8, no. 8, pp. 1–15, 2022, doi: 10.1016/J.HELIYON.2022.E10044.

S. Finney and M. Corbett, “ERP Implementation: A Compilation and Analysis of Critical Success Factors,” Bus. Process Manag. J., vol. 13, no. 3, pp. 329–349, 2007.

R. A. Wijaya, P. Widyaningrum, B. Prasetyo, and R. Satria, “Analyzing of Implementation Enterprise Budgeting System Using SAP BPC: Case Study on a Financial Government Institution,” in 2018 International Conference on Advanced Computer Science and Information Systems (ICACSIS), 2018, pp. 475–480. doi: 10.1109/ICACSIS.2018.8618253.

N. Phaphoom, J. Qu, A. Kheaksong, and W. Saelee, “An Investigation of ERP implementation: A Comparative Case Study of SME and Large Enterprises in Thailand,” in International Conference on ICT and Knowledge Engineering, IEEE, 2018, pp. 1–6.

A. M. Aladwani, “Change management strategies for successful ERP implementation,” Bus. Process Manag. J., vol. 7, no. 3, pp. 266–275, 2001.

T. Creasey, “Using the ADKAR model as a structured change management approach,” Accessed: Dec. 23, 2021. [Online]. Available: https://blog.prosci.com/the-adkar-model-a-structured approach

M. Almanei, K. Salonitis, and C. Tsinopoulos, “A conceptual lean implementation framework based on change management theory,” in 51st CIRP Conference on Manufacturing Systems, Procedia CIRP, 2018, pp. 1160–1165. doi: 10.1016/j.procir.2018.03.141.

S. Sachdeva, “Change Management for e-Governance (Working Paper).,” 2008.

T. D. Susanta, “Manajemen Layanan Teknologi Informasi,” Surabaya AISINDO, 2016.

D. Goodhue and R. L. Thompson, “Task-technology fit and individual performance,” MIS Q., vol. 19, pp. 213–236, 1995, doi: 10.2307/249689.

V. Venkatesh, J. Y. Thong, and X. Xu, “Unified Theory of Acceptance and Use of Technology: A synthesis and the Road Ahead,” J. Assoc. Inf. Syst., vol. 17, no. 5, pp. 328–376, 2016.

M. C. Mashaba and A. B. Pretorius, “Electronic library resource use by postgraduate students at a university of technology in South Africa,” South Afr. J. Inf. Manag., vol. 25, no. 1, pp. 1–11, 2023, doi: 10.4102/sajim.v25i1.1602.

Y. K. Dwivedi, N. P. Rana, A. Jeyaraj, M. Clement, and M. D. Williams, “Re-examining the unified theory of acceptance and use of technology (UTAUT): Towards a revised theoretical model,” Inf. Syst. Front., vol. 21, pp. 719–734, 2019, doi: 10.1007/s10796-017-9774-y.

C. Kim, J. Jahng, and J. Lee, “An empirical investigation into the utilization-based information technology success model: Integrating task-performance and social influence perspective,” J. Inf. Technol., vol. 22, no. 2, pp. 152–160, 2007.

T. Zhou, Y. Lu, and B. Wang, “Integrating TTF and UTAUT to explain mobile banking user adoption,” Comput. Hum. Behav., vol. 26, pp. 760–767, 2010.

A. Burton-Jones and D. W. Straub, “Reconceptualising System Usage: An Approach and Empirical Test,” Inf. Syst. Res., vol. 17, no. 3, pp. 1–49, 2006.

Y. Wand and R. Weber, “Toward a theory of the deep structure of information systems,” in ICIS 1990 Proceedings, 1990.

Y. Wand and R. Weber, “On the Deep Structure of Information Systems,” Inf. Syst. J., vol. 5, no. 3, pp. 203–223, 1995.

T. B. S. Urus, “Living with Enterprise Resource Planning (ERP): An investigation of End User Problems and Coping Mechanisms,” Doctoral Degree thesis, RMIT University, 2013.

C. Koo, N. Chung, and H. W. Kim, “Examining explorative and exploitative uses of smartphones: a user competence perspective,” Inf. Technol. People, vol. 28, no. 1, pp. 133–162, 2015.

J. G. March, “Exploration and exploitation in organizational learning,” March, vol. 2, no. 1, pp. 71–87, 1991.

E. J. Y. Liew, S. Vaithilingam, and M. Nair, “Facebook and socio-economic benefits in the developing world,” Behav. Inf. Technol., vol. 33, no. 4, pp. 345–360, 2014.

V. Venkatesh, J. Y. Thong, and X. Xu, “Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology,” MIS Q., vol. 36, no. 1, pp. 157–178, 2012.

S. Park, L. Lee, and M. Y. Yi, “Group-level effects of facilitating conditions on individual acceptance of information systems,” Inf. Technol. Manag., vol. 12, no. 4, pp. 315–334, 2011, doi: 10.1007/s10799-011-0097-2.

C. Calvo-Porral and M. Nieto-Mengotti, “The moderating influence of involvement with ICTs in mobile services,” Span. J. Mark.-ESI, vol. 23, no. 1, pp. 25–43, 2019.

B. M. Kalema, “Critical Factors Influencing the Use of Integrated Tertiary Software, T, 2012.,” Unpblished Doctoral Degree Thesis, Tshwane University of Technology, South Africa, Pretoria, 2012.

W. H. Delone and E. Mclean, “The DeLone and McLean Model of Information Systems Success: A Ten-Year Update,” J. Manag. Inf. Syst., vol. 19, no. 4, pp. 9–30, 2003.

M. C. Bolen and Ü. Özen, “Understanding the factors affecting consumers’ continuance intention in mobile shopping: The case of private shopping clubs,” Int J Mob Commun, vol. 18, pp. 101–129, 2020.

A. Bhattacherjee, “Understanding information systems continuance: an expectation-confirmation model,” MIS Q., vol. 25, no. 3, pp. 351–370, 2001b.

M. M. Phahlane, “Multidimensional Framework for Human Resource Information Systems Adoption and Use in a South African University,” Unpblished Doctoral Degree Thesis, University of the Witwatersrand, South Africa, Johannesburg, 2017.

S. Salih et al., “The CSFs from the perspective of users in achieving ERP system implementation and post-implementation success: A case of Saudi Arabian food industry,” Sustainability, vol. 14, no. 23, pp. 1–24, 2022, doi: 10.3390/su142315942.

J. B. Maas, P. C. Van Fenema, and J. Soeters, “Post-implementation ERP usage: A longitudinal study of the impact of Control and empowerment,” Inf. Syst. Manag., vol. 35, no. 4, pp. 330–347, 2018, doi: 10.1080/10580530.2018.1503804.

H. Sun, R. T. Wright, and J. Thatcher, “Revisiting the Impact of System Use on Task Performance: An Exploitative Explorative System Use Framework,” J. Assoc. Inf. Syst., vol. 20, no. 4, pp. 398–433, 2019.

A. Burton-Jones and O. Volkoff, “How can we develop contextualized theories of effective use? A demonstration in the context of community-care electronic health records,” Inf. Syst. Res., vol. 28, no. 3, pp. 468–489, 2017.

F. Brooks, The Mythical Man-Month. ReadinG. MA: Addison-Wesley, 1995.

J. S. Jasperson, P. E. Carter, and R. W. Zmud, “A comprehensive conceptualization of the post-adoptive behaviors associated with IT-enabled work systems,” MIS Q., vol. 29, no. 3, pp. 525–557, 2005.

F. Carton and F. Adam, “Analysing the impact of the enterprise resource planning systems roll-outs in multi-national companies,” Electron. J. Inf. Syst. Eval., vol. 6, pp. 21–32, 2003.

A. Bhattacherjee, “An empirical analysis of the antecedents of electronic commerce service continuance,” Decis. Support Syst., vol. 32, no. 2, pp. 201–214, 2001a.

M. Marchand and L. Raymond, “Characterizing, explaining and valuing the effective use of an IT artefact: A field study of performance management information systems in SMEs,” in Proceedings of the 50th Hawaii International Conference on System Sciences, Hilton Waikoloa Village, Hawaii, US: AIS Electronic Library, Jan. 2017, pp. 5027–5036.

D. E. Campbell and N. Roberts, “Effective use of analytic DSS and job performance: Looking beyond technology acceptance,” J. Organ. Comput. Electron. Commer., vol. 29, no. 2, pp. 125–138, 2019.

Department of Higher Education and Training (DHETa), “The Statistics on Post-School Education and Training in South Africa: 2018,” Department of Higher Education and Training, 2018. Accessed: Sep. 08, 2019.

Raosoft Incorporated, 2004. Accessed: Nov. 30, 2019. Raosoft Sample size calculator. Available: http://www.raosoft.com/samplesize.html

J. F. Hair, G. T. M. Hult, C. M. Ringle, and M. Sarstedt, A primer on partial least squares structural equation modelling (PLS-SEM). Thousand Oaks: Sage, 2014.

B. Holtom, Y. Baruch, H. Aguinis, and G. A. Ballinger, “Survey response rates: Trends and a validity assessment framework,” Hum. Relat., vol. 75, no. 8, 2022.

J. F. Hair, G. T. M. Hult, C. M. Ringle, and M. Sarstedt, A primer on partial least squares structural equation modeling (PLS-SEM), 3rd ed. Thousand Oaks, CA: Sage, 2022.

Statistics South Africa (STATSSA), “Statistic South Africa mid-year population estimates 2019 report,” Statistics South Africa. Accessed: Dec. 23, 2023.

J. F. Hair, W. C. Black, B. J. Babin, R. E. Anderson, and R. L. Tatham, Multivariate data analysis, 7th ed. Upper Saddle River, NJ: Prentice Hall, 2010.

N. Kock and M. Moqbel, “Social networking site use, positive emotions, and job performance,” J. Comput. Inf. Syst., vol. 61, no. 2, pp. 163–173, 2021.

S. M. Maat, E. Zakaria, N. M. Nordin, and T. S. M. Meerah, “Confirmatory factor analysis of the mathematics teachers’ teaching practices instrument,” World Appl. Sci. J., vol. 12, no. 11, pp. 2092–2096, 2011.

J. Henseler, G. Hubona, and P. Ash Ray, “Using PLS Path Modeling in New Technology Research: Updated Guidelines,” Ind. Manag. Data Syst., vol. 116, no. 1, pp. 2–20, 2015.

J. F. Hair, M. Sarstedt, T. M. Pieper, and C. M. Ringle, “The use of partial least squares structural equation modeling in strategic management: A review of past practices and recommendation for future applications,” Long Range Plann., vol. 45, pp. 320–340, 2012.

G. Cepeda, C. Nitzl, and J. L. Roldán, “G. Cepeda, C. Nitzl, and J. L. Roldán, “Mediation Analyses in Partial Least Squares Structural Equation Modeling: Guidelines and Empirical Examples, in Partial Least Squares Path Modeling: Basic Concepts, Methodological Issues and Applications, H. Latan and R. Noonan (eds.),” Springer Cham, pp. 173–195, 2017.

K. Rouibah, H. I. Hamdy, and M. Z. Al-Enezi, “Effect of management sport, training, and user involvement on system usage and satisfaction in Kuwait,” Ind. Manag. Data Syst., vol. 109, no. 3, pp. 338–356, 2009.

H. Sun, “Understanding user revisions when using information system features: Adaptive system use and triggers,” MIS Q. MIS Res. Cent. Univ. Minn., vol. 36, no. 2, pp. 453–478, 2012.

P. Haake, S. Schacht, B. Mueller, J. Lauterbach, and A. Maedche, “Toward an operationalization of effective use”, European Conference on Information Systems,” in Twenty-Sixth European Conference on Information Systems (ECIS2018), Portsmouth, UK: Association for Information Systems AIS Electronic Library (AISeL), Nov. 2018.