Evaluation of the Effectiveness of Online Training to Improve Lecturers’ Ability in E-Learning Management Using the Kirkpatrick Model

Yari Dwikurnaningsih(1,Mail), Marinu Waruwu(2) | CountryCountry:


(1) Universitas Kristen Satya Wacana, Indonesia
(2) Universitas Kristen Satya Wacana, Indonesia

MailCorresponding Author

DOI 10.23960/jpp.v12.i2.202220
Metrics→
              
Indexing Site→


Download Full Text: PDF

Copyright (c) 2025 Yari Dwikurnaningsih, Marinu Waruwu


Social distancing causes lecturer training to be carried out online. Objectives: This study aims at the effectiveness of online training for lecturers in managing e-learning. This study uses an evaluation evaluation method with the Kirkpatrick model which includes evaluation of reactions, learning, behavior and results. Methods: The research approach is a mixed method with a sequential explanation model, where quantitative methods are used first and then qualitative methods are used in the next stage. Data collection techniques using questionnaires, and interviews. The research subjects are lecturers and students. Qualitative data were analyzed using the Miles and Huberman model and quantitative data were processed descriptively by calculating percentages and categorizing. Findings: The results showed that the reaction aspect was satisfied, learning was in the high category, behavior was in the moderate category and the results were in the good category. Conclusion: it works effectively, but needs improvement in the technical implementation of the training.

Keywords:  evaluation, e-training, Kirkpatrick, e-learning


DOI: http://dx.doi.org/10.23960/jpp.v12.i2.202220


Aji, R. H. S. (2020). Dampak Covid-19 pada Pendidikan di Indonesia: Sekolah, Keterampilan, dan Proses Pembelajaran {The Impact of Covid-19 on Education in Indonesia: Schools, Skills, and the Learning Process}. SALAM: Jurnal Sosial Dan Budaya Syar-I, 7(5), 395–402.

Ali, M., Hossain, S. . K., & Ahmed, T. (2018). Effectiveness of E-Learning for University Students: Evidence from Bangladesh. Asian Journal of Empirical Research, 8(10), 352–360.

Alsalamah, A., & Callinan, C. (2021). Adaptation of Kirkpatrick’s four-level model of training criteria to evaluate training programmes for head teachers. Education Sciences, 11(3).

Arkorful, V., & Abaidoo, N. (2015). The role of e-learning, advantages and disadvantages of its adoption in higher education. International Journal of Instructional Technology and Distance Learning, 2(12), 29–42.

Baczek, M., Zaganczyk-Baczek, M., Szpringer, M., Jaroszynski, A., & Wozakowska-Kapłon, B. (2021). Student’s Perception of Online Learning during COVID Pandemic. Medicine, 100(7), 1–6.

Bali, S., & Liu, M. C. (2018). Students’ perceptions toward online learning and face-to-face learning courses. Journal of Physics: Conference Series, 1108(1).

Calvo, S., Morales, A., & Wade, J. (2019). The use of MOOCs in social enterprise education: an evaluation of a North–South collaborative FutureLearn program. Journal of Small Business and Entrepreneurship, 31(3), 201–223.

Deodhar, M. and Powdwal, S. (2017). Impact of Continuing Education Programs (CEPs) on LIS Professionals in Academic Libraries in Mumbai, India. Library Management, 38(2/3), 117–130.

Dewi, L. R., & Kartowagiran, B. (2018). An evaluation of internship program by using Kirkpatrick evaluation model. Research and Evaluation in Education, 4(2), 155–163.

Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22.

Dorri, S., Akbari, M., & Dorri Sedeh, M. (2016). Kirkpatrick evaluation model for in-service training on cardiopulmonary resuscitation. Iranian Journal of Nursing and Midwifery Research, 21(5), 493–497.

Eghtesadi, A. R., & Hassanabadi, S. (2016). An Evaluation of In-Service Training Courses for the Seventh Grade English Package for Iranian Schools ( Prospect 1 ). Journal of Applied Linguistics and Language Research, 3(5), 130–143.

Fidiantara, F., Lestari, A., Juniati, N., Syukur, A., & Jamaluddin, J. (2021). Innovation of learning methods during the covid-19 pandemic at junior high school in Mataram City and West Lombok Regency. Jurnal Pijar Mipa, 16(4), 479–485.

Firmansyah, A., & Aima, H. (2020). Pengaruh pelatihan, kompensasi, dan motivasi kerja terhadap kinerja karyawan {The effect of training, compensation, and work motivation on employee performance}. Journal FEB Unmul: Kinerja, 17(2), 172–185.

Husain, B., Idi, Y. N., & Basri, M. (2021). Teachers’ Perceptions on Adopting E-Learning During Covid-19 Outbreaks; Advantages, Disadvantages, Suggestions. Jurnal Tarbiyah, 27(2), 41–57.

Hussein, E., Daoud, S., Alrabaiah, H., & Badawi, R. (2020). Exploring undergraduate students’ attitudes towards emergency online learning during COVID-19: A case from the UAE. Children and Youth Services Review, 119, 105699.

I. Dhull, M. S. (2017). Online Learning. International Education & Research Journal [IERJ], 3(8), 32–34. https://doi.org/10.1007/978-3-030-33120-7_6

Ismail, A., Zaharudin, R., Hashim, N., & Ariffin, J. (2020). The Impact of e-NPQEL on the Continuance Intention of Using e-Training among Aspired School Leaders in Malaysia. International Journal of Interactive Mobile Technologies, 14(19), 109–123.

Jain, G., Sharma, N., & Shrivastava, A. (2021). Enhancing training effectiveness for organizations through blockchain-enabled training effectiveness measurement (BETEM). Journal of Organizational Change Management, 34(2), 439–461.

Joan, R. (2013). Flexible Learning As New Learning Design In Classroom Process To Promote Quality Education. I-Manager’s Journal on School Educational Technology, 9(1), 37–42.

Kamal, K., Alaghbari, M., & Atteia, M. (2016). E-training & employees ’ performance a practical study on the ministry of education in the Kingdom of Bahrain E-Training & Employees ’ Performance a Practical Study on the Ministry of Education in the Kingdom of Bahrain. Journal of Resources Development and Management ISSN 2422-8397 An International Peer-Reviewed Journal Vol.18, 18(March), 1–8.

Kirkpatrick, J. & Kirkpatrick, W. (2009). The Kirkpatrick Model: Past, Present and Future.

Lampong Klomkul, Phraratsutaporn. (2021). Technological Innovation for Online Learning during the Situation of COVID-19 Pandemic in Thailand. Psychology and Education Journal, 58(1), 1578–1584.

Luckyardi, S., & Rahman, L. (2021). Application of E-Learning System in the World of Education. Jurnal Teknologi Informasi Dan Pendidikan, 14(1), 47–52.

Mahmoodi, M., Rashtchi, M., & Abbasian, G. R. (2019). Evaluation of in-service teacher training program in iran: Focus on the Kirkpatrick model. Education and Self Development, 14(4), 20–38. https://doi.org/10.26907/esd14.4.03

Marini, S., & Milawati, M. (2020). Distance Learning Innovation Strategy in Indonesia During the COVID-19 Pandemic. 488(Aisteel), 416–421.

Maudsley, G., & Taylor, D. (2020). Analysing synthesis of evidence in a systematic review in health professions education: observations on struggling beyond Kirkpatrick. Medical Education Online, 25(1).

Mawardi. (2020). Keefektifan Flexible Learning dalam Menumbuhkan Self-Regulated Learning dan Hasil Belajar Mahasiswa PGSD {The Effectiveness of Flexible Learning in Growing Self-Regulated Learning and Learning Outcomes of PGSD Students}. Scholaria: Jurnal Pendidikan Dan Kebudayaan, 10(3), 251–262.

Miles,M.B, Huberman,A.M, dan Saldana, J. (2014). Qualitative Data Analysis, A Methods Sourcebook, Edition 3. Sage Publications. Retrieved from Terjemahan Tjetjep Rohindi Rohidi UI-Press

Ngabiyanto, Nurkhin, A., Mukhibad, H., & Harsono. (2021). E-learning evaluation using general extended technology acceptance model approach at schools in COVID-19 pandemic. European Journal of Educational Research, 10(3), 1171–1180.

Noori, A. Q. (2021). The impact of COVID-19 pandemic on students’ learning in higher education in Afghanistan. Heliyon, 7(10), e08113. Retrieved from

Park, Y., & Jo, I. H. (2019). Factors that affect the success of learning analytics dashboards. Educational Technology Research and Development, 67(6), 1547–1571.

Paull, M., Whitsed, C., & Girardi, A. (2016). Applying the Kirkpatrick model: Evaluating an Interaction for Learning Framework curriculum intervention. Issues in Educational Research, 26(3), 490–507.

Putranto, A. (2011). Perancangan Training dengan E-Learning pada Perusahaan Manufacture (Planning Training with E-Learning in Manufacturing Companies}. ComTech: Computer, Mathematics and Engineering Applications, 2(1), 317.

Ragsdale, J. W., Berry, A., Gibson, J. W., Herber-Valdez, C. R., Germain, L. J., & Engle, D. L. (2020). Evaluating the effectiveness of undergraduate clinical education programs. Medical Education Online, 25(1).

Rayuwati, R. (2020). How educational technology innovates distance learning during pandemic crisis in remote areas in Indonesia? International Research Journal of Management, IT and Social Sciences, 7(6), 161–166.

Ruskanda, L. (2018). Implementation of the Kirkpatrick Model Training Program Evaluation. International Journal of Advanced Research, 6(8), 878–892.

Sahni, J. (2020). Managerial training effectiveness: An assessment through Kirkpatrick framework. TEM Journal, 9(3), 1227–1233.

Salamatina, Y. V. (2020). The use of e-learning resources in distance learning. Journal of Physics: Conference Series, 1691(1).

Sari, A. U. (2021). Evaluasi Pelatihan Dengan Model Evaluasi Kirkpatrick Di Balai Perlindungan Dan Rehabilitasi Sosial Wanita {Training Evaluation Using Kirkpatrick Evaluation Model In Balai Women’s Social Protection and Rehabilitation}. Jurnal Manajemen Pendidikan Dan Pelatihan, 5(3), 269–274.

Thanji, M., & Vasantha, S. (2018). A Study of Benefits and Limitations of e- Learning-A Learner ’ s Perspective. 118(5), 175–184.

Zahro, S., & Wu, M. C. (2016). Implementing of the employees training evaluation using Kirkpatrick’s model in tourism industry-A case study. International Journal of Innovation and Applied Studies, 17(3), 1042–1049.

Zain, Z. M., & Nurudin, S. M. (2016). Kirkpatrick’s Training Evaluation Model in Associates with the Effectiveness of Skim Latihan 1 Malaysia (SL1M). Journal of Education and Social Science, 5(2), 175–180.

Zalat, M. M., Hamed, M. S., & Bolbol, S. A. (2021). The experiences, challenges, and acceptance of e-learning as a tool for teaching during the COVID-19 pandemic among university medical staff. PLoS ONE, 16(3 March), 1–12. Retrieved from

Zuhir, A., Rawashdeh, A., Mohammed, E. Y., Rebhi, A., Arab, A., Alara, M., & Al-rawashdeh, B. (2021). Advantages and Disadvantages of Using e-Learning in University Education : Analyzing Students ’ Perspectives. The Electronic Journal of E-Learning, 19(3), 107–117.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.


View My Stats