European Journal of Educational Research A Combination of Context Input Process Product and Kirkpatrick Evaluation Model to Determine the Effectiveness of E-Training for Principals during COVID-19 Pandemic

: COVID-19 pandemic forces training for principals to be conducted online. This study aims to evaluate the context, input, process, response, study, behavior, and outcome to determine the effectiveness and make recommendations for training. The approach used in this study was a mixed method with a concurrent embedded design and a qualitative method as the main method. The subjects of this study were the principals, committees, and instructors. Data were collected through interviews, observations, and questionnaires and analyzed using Miles and Huberman's model, descriptive analysis, and a t-test. The results show that e-training is effective in context, input, and process. Response, learning, and attitude assessments prove that knowledge, skills, and attitude have improved. Participants will be able to implement the experience gained and impact school quality improvement. This study contributes to the combination of the two evaluation models proven to produce a complete result. The study for the e-training recommends needed assessment before the training, the activity before the training to acquire the skills in using the learning management system, and the monitoring and evaluation after the training. A combination of context input process product and kirkpatrick evaluation model to determine the effectiveness of e-training for principals during COVID-19 input training impact, are CIPP evaluation

[1]  L. Gumede,et al.  Online teaching and learning through the students’ eyes – Uncertainty through the COVID-19 lockdown: A qualitative case study in Gauteng province, South Africa , 2021, Radiography.

[2]  A. Yousaf,et al.  What Shapes E-Learning Effectiveness among Tourism Education Students? An Empirical Assessment during COVID19 , 2021, Journal of Hospitality, Leisure, Sport & Tourism Education.

[3]  C. Chiang,et al.  Comparison of learning effectiveness between physical classroom and online learning for dental education during the COVID-19 pandemic , 2021, Journal of Dental Sciences.

[4]  Tenzin Doleck,et al.  Transition to online learning during the COVID-19 pandemic , 2021, Computers in Human Behavior Reports.

[5]  M. Alia,et al.  Evaluation online learning of undergraduate students under lockdown amidst COVID-19 Pandemic: The online learning experience and students’ satisfaction , 2021, Children and Youth Services Review.

[6]  M. Hsu,et al.  Effect of online learning for dental education in asia during the pandemic of COVID-19 , 2021, Journal of Dental Sciences.

[7]  V. Easwaran,et al.  The influence of COVID-19 related psychological and demographic variables on the effectiveness of e-learning among health care students in the southern region of Saudi Arabia , 2021, Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society.

[8]  M. Hamed,et al.  The experiences, challenges, and acceptance of e-learning as a tool for teaching during the COVID-19 pandemic among university medical staff , 2021, PloS one.

[9]  Archana Shrivastava,et al.  Enhancing training effectiveness for organizations through blockchain-enabled training effectiveness measurement (BETEM) , 2021 .

[10]  S. Suyatno,et al.  The Effect of Principals’ Competencies on Teachers’ Job Satisfaction and Work Commitment , 2021, Participatory Educational Research.

[11]  Nouwar Q. Al-Hamad,et al.  Training Needs for Kindergarten Principals in the Light of Digital Age Requirements , 2020 .

[12]  Grigorios L. Kyriakopoulos,et al.  The school principal’s role as a leader in teachers’ professional development: the case of public secondary education in Athens , 2020, Problems and Perspectives in Management.

[13]  Tia L. Finney Confirmative Evaluation: New CIPP Evaluation Model , 2020 .

[14]  Hussam Alrabaiah,et al.  Exploring undergraduate students’ attitudes towards emergency online learning during COVID-19: A case from the UAE , 2020, Children and Youth Services Review.

[15]  S. Salmah,et al.  The Effect of Principals Competencies on Teachers' Performance of Public Schools in Makassar City , 2020, Universal Journal of Educational Research.

[16]  Aziah Ismail,et al.  The Impact of e-NPQEL on the Continuance Intention of Using e-Training among Aspired School Leaders in Malaysia , 2020, Int. J. Interact. Mob. Technol..

[17]  Ibrahim Yavuz,et al.  Turkish Ministry of National Education school-based disaster education program: A preliminary results of the program evaluation , 2020 .

[18]  Tuulikki Ukkonen-Mikkola,et al.  Integrated initial and continuing training as a way of developing the professional agency of teachers and student teachers , 2020 .

[19]  Christian Wiradendi Wolor,et al.  Effectiveness of E-Training, E-Leadership, and Work Life Balance on Employee Performance during COVID-19 , 2020 .

[20]  Jolly Sahni Managerial Training Effectiveness:An Assessment through Kirkpatrick Framework , 2020, TEM Journal.

[21]  J. König,et al.  Adapting to online teaching during COVID-19 school closure: teacher education and teacher competence effects among early career teachers in Germany , 2020 .

[22]  A. Saregar,et al.  The Effect of Principals’ Leadership towards Effective Learning at an Indonesian Secondary School , 2020 .

[23]  M. Pilz,et al.  Using E-Learning to Deliver In-Service Teacher Training in the Vocational Education Sector: Perception and Acceptance in Poland, Italy and Germany , 2020, Education Sciences.

[24]  Shalini Garg,et al.  User Satisfaction and Continuance Intention for Using E-Training: A Structural Equation Model , 2020 .

[25]  Abdalellah O. Mohmmed,et al.  Emergency remote teaching during Coronavirus pandemic: the current trend and future directive at Middle East College Oman , 2020, Innovative Infrastructure Solutions.

[26]  Tesfaye Gemechu Gurmu Primary school principals in Ethiopia: Selection and preparation , 2020, Educational Management Administration & Leadership.

[27]  Megan Smith,et al.  Evaluation of an accredited training program on implementation of point-of-care testing in community pharmacies. , 2020, Journal of the American Pharmacists Association : JAPhA.

[28]  Carla Curado,et al.  Training evaluation: a configurational analysis of success and failure of trainers and trainees , 2020 .

[29]  Sakshi Agarwal,et al.  Student’s Perception of Online Learning during COVID Pandemic , 2020, The Indian Journal of Pediatrics.

[30]  Trung Tran,et al.  A study on factors affecting school principals’ competencies in Vietnam’s mountainous provinces , 2020 .

[31]  H. Ärlestig,et al.  Bringing context and educational leadership together: fostering the professional development of school principals , 2020, Professional Development in Education.

[32]  Junainor Hassan,et al.  E-training and development, motivation and employee performance among academicians: Case study of academicians in UniMAP , 2020, Journal of Physics: Conference Series.

[33]  M. M. N. H. Ja'ashan,et al.  The Challenges and Prospects of Using E-learning among EFL Students in Bisha University , 2020, Arab World English Journal.

[34]  Agus Amin Sulistiono,et al.  Factors Influencing the Principal's Leadership and Its Impact on Learning Quality and Learning Outcome , 2020 .

[35]  Andrea Berry,et al.  Evaluating the effectiveness of undergraduate clinical education programs , 2020, Medical education online.

[36]  G. Maudsley,et al.  Analysing synthesis of evidence in a systematic review in health professions education: observations on struggling beyond Kirkpatrick , 2020, Medical education online.

[37]  Alexander Nanni,et al.  The CIPP Model : Applications in Language Program Evaluation , 2019, The Journal of AsiaTEFL.

[38]  S. Hsu,et al.  Evaluating A Continuing Medical Education Program: New World Kirkpatrick Model Approach , 2019 .

[39]  Juneyoung Park,et al.  GAMESIT: A gamified system for information technology training , 2019, Comput. Educ..

[40]  S. Foster,et al.  Implementation of CIPP Model for Quality Evaluation at Zawia University , 2019, International Journal of Applied Linguistics and English Literature.

[41]  M. Sponder,et al.  Paper-based training diaries for monitoring of performance progress due to long-term physical activity. , 2019 .

[42]  Yeonjeong Park,et al.  Factors that affect the success of learning analytics dashboards , 2019, Educational Technology Research and Development.

[43]  M. Amini,et al.  Using Kirkpatrick’s model to measure the effect of a new teaching and learning methods workshop for health care staff , 2019, BMC Research Notes.

[44]  Jorge Cotes,et al.  A systemic and strategic approach for training needs analysis for the International Bank , 2019 .

[45]  Sara Calvo,et al.  The use of MOOCs in social enterprise education: an evaluation of a North–South collaborative FutureLearn program , 2019 .

[46]  Y. Shih,et al.  Evaluating an English Elite Program in Taiwan Using the CIPP Model , 2019, The Journal of AsiaTEFL.

[47]  Hania M. Al-Shanawani Evaluation of Self-Learning Curriculum for Kindergarten Using Stufflebeam’s CIPP Model , 2019, SAGE Open.

[48]  B. Kartowagiran,et al.  An evaluation of internship program by using Kirkpatrick evaluation model , 2018, Research and Evaluation in Education.

[49]  Xiaoli Shi Research on Performance Evaluation System of College Entrepreneurship Education Level Based on CIPP Model , 2018 .

[50]  K. Norberg The Swedish national principal training programme: a programme in constant change , 2018, Journal of Educational Administration and History.

[51]  Lukman Ruskanda,et al.  IMPLEMENTATION OF THE KIRKPATRICK MODEL TRAINING PROGRAM EVALUATION. , 2018, International Journal of Advanced Research.

[52]  J. Fraser,et al.  The evaluation of a home-based paediatric nursing service: concept and design development using the Kirkpatrick model , 2018, Journal of research in nursing : JRN.

[53]  Vera Belaya,et al.  The Use of e-Learning in Vocational Education and Training (VET): Systematization of Existing Theoretical Approaches , 2018, Journal of Education and Learning.

[54]  Shamsa Aziz,et al.  Implementation of CIPP Model for Quality Evaluation at School Level: A Case Study , 2018, Journal of Education and Educational Development.

[55]  Samy S. Abu Naser,et al.  The Impact of Applying the Dimensions of IT Governance in Improving E-training - Case Study of the Ministry of Telecommunications and Information Technology in Gaza Governorates , 2017 .

[56]  Nur Naha Abu Mansor,et al.  Interactivity and Trust as Antecedents of E-Training Use Intention in Nigeria: A Structural Equation Modelling Approach , 2017, Behavioral sciences.

[57]  Jos J de Koning,et al.  Monitoring Training Loads: The Past, the Present, and the Future. , 2017, International journal of sports physiology and performance.

[58]  Faizuniah Pangil,et al.  An examination of the factors affecting the adoption of E‐training in the Nigerian civil service sector , 2017 .

[59]  R. Mestry EMPOWERING PRINCIPALS TO LEAD AND MANAGE PUBLIC SCHOOLS EFFECTIVELY IN THE 21ST CENTURY , 2017, Education and New Developments 2022 – Volume I.

[60]  Madhura Deodhar,et al.  Impact of continuing education programs (CEPs) on LIS professionals in academic libraries in Mumbai, India , 2017 .

[61]  Narges Neyazi,et al.  Evaluation of selected faculties at Tehran University of Medical Sciences using CIPP model in students and graduates point of view. , 2016, Evaluation and program planning.

[62]  Safoura Dorri,et al.  Kirkpatrick evaluation model for in-service training on cardiopulmonary resuscitation , 2016, Iranian journal of nursing and midwifery research.

[63]  Siti Zahro,et al.  Implementing of the employees training evaluation using Kirkpatrick's model in tourism industry - A case study , 2016 .

[64]  Megan Paull,et al.  Applying the Kirkpatrick model: Evaluating an Interaction for Learning Framework curriculum intervention , 2016 .

[65]  Jalal Hanaysha,et al.  Examining the Effects of Employee Empowerment, Teamwork, and Employee Training on Organizational Commitment , 2016 .

[66]  Dalia Khalil,et al.  Adaptations of International Standards on Educational Leadership Preparation in Egypt. , 2016 .

[67]  Logan L. Watts,et al.  How Do We Know What Works? A Review and Critique of Current Practices in Ethics Training Evaluation , 2016, Accountability in research.

[68]  Mthokozisi Mpofu,et al.  Training and Development as a Tool for Improving Basic Service Delivery; the Case of a Selected Municipality , 2015 .

[69]  Amin Karimnia,et al.  An Evaluation of the Undergraduate TEFL Program in Iran: A Multi-Case Study. , 2015 .

[70]  Khwanying Sriprasertpap,et al.  The Development of Online Training Model for Srinakharinwirot University in Thailand , 2015 .

[71]  Vandana Ahuja,et al.  Expanding the Kirkpatrick Evaluation Model-Towards more Efficient Training in the IT Sector , 2014, Int. J. Hum. Cap. Inf. Technol. Prof..

[72]  A. I. Alhaqwi,et al.  Research methodology workshops evaluation using the Kirkpatrick’s model: Translating theory into practice , 2014, Medical teacher.

[73]  Marcia J. Simmering,et al.  E-learning: emerging uses, empirical results and future directions , 2003 .

[74]  A. Huberman,et al.  Qualitative Data Analysis: A Methods Sourcebook , 1994 .

[75]  Chunlei Qin,et al.  Online teaching in universities during the Covid-19 epidemic: a study of the situation, effectiveness and countermeasures , 2021 .

[76]  Hakan Tuna,et al.  Curriculum evaluation of tourism undergraduate programs in Turkey: A CIPP model-based framework , 2021 .

[77]  Corinne Jacqueline Perera,et al.  Training preparation and the professional development of principals in Henan Province, China: formal and informal learning , 2018 .

[78]  K. Ludwikowska The effectiveness of training needs analysis and its relation to employee efficiency , 2018 .

[79]  P. Carter,et al.  Using the CIPP Model to Assess Nursing Education Program Quality and Merit , 2018 .

[80]  Dewa Bagus Sanjaya,et al.  CIPP EVALUATION MODEL BASED ON MOBILE PHONE IN EVALUATING THE USE OF BLENDED LEARNING PLATFORMS AT VOCATIONAL SCHOOLS IN BALI , 2017 .

[81]  Mai Neo,et al.  Using Kirkpatrick’s Evaluation Model in a Multimedia-based Blended Learning Environment , 2017 .

[82]  Khloud Bou Kamal,et al.  E-Training & Employees’ Performance a Practical Study on the Ministry of Education in the Kingdom of Bahrain , 2016 .

[83]  Karatas Hakan,et al.  CIPP evaluation model scale: development, reliability and validity , 2011 .

[84]  M. Yarmohammadian,et al.  Application of CIPP model for evaluating the medical records education course at master of science level at Iranian medical sciences universities , 2011 .

[85]  Jha Ajeya,et al.  TRAINING NEED ASSESSMENT : A CRITICAL STUDY , 2010 .

[86]  Eric Deeson,et al.  Online learning , 2005, Br. J. Educ. Technol..