FSC College of Education

The emergence of information and communication technology (ICT) has created opportunities for enhancing the learning process at different educational levels. However, its potential benefits can only be fully realized if teachers are properly trained to utilize such tools. The rapid evolution of ICT also necessitates rigorous assessment of training programs by participants. Thus, this study proposes an evaluation framework based on the Analytic Hierarchy Process (AHP) to systematically evaluate such workshops designed for teachers. The evaluation model is decomposed hierarchically into four main criteria namely: (1) workshop design, (2) quality of content of the workshop, (3) quality of delivery of the content of the workshop, and the (4) relevance of the workshop. These criteria are further disaggregated into 24 sub-indicators to measure the effectiveness of the workshop as perceived by the participants based on their own expectations. This framework is applied to a case study of ICT workshops done in the Philippines. In this case, relevance of the workshop is found to be the most important main criterion identified by the participants, particularly on the new ICT knowledge that promotes teachers' professional growth and development. The workshop evaluation index (WEI) is also proposed as a metric to support decision-making by providing a mechanism for benchmarking performance, tracking improvement over time, and developing strategies for the design and improvement of training programs or workshops on ICT for teachers.

[1]  Pieter Hogenbirk,et al.  ICT Action School Development at Helen Parkhurst Dalton School, Part II , 2009, WCCE.

[2]  Luis G. Vargas,et al.  Uncertainty and rank order in the analytic hierarchy process , 1987 .

[3]  P. Petegem,et al.  The impact of instructional development in higher education: the state-of-the-art of the research , 2010 .

[4]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[5]  Jacinto González-Pachón,et al.  Measuring systems sustainability with multi-criteria methods: A critical review , 2017, Eur. J. Oper. Res..

[6]  W. Pedrycz,et al.  A fuzzy extension of Saaty's priority theory , 1983 .

[7]  J. Pellegrino,et al.  Professional Development in Integrating Technology Into Teaching and Learning: Knowns, Unknowns, and Ways to Pursue Better Questions and Answers , 2007 .

[8]  Hui-Wen Vivian Tang,et al.  Optimizing an immersion ESL curriculum using analytic hierarchy process. , 2011, Evaluation and program planning.

[9]  M. Mclaughlin,et al.  Staff Development and School Change , 1978, Teachers College Record: The Voice of Scholarship in Education.

[10]  M. Ramachandran,et al.  Application of multi-criteria decision making to sustainable energy planning--A review , 2004 .

[11]  Alessio Ishizaka,et al.  Review of the main developments in the analytic hierarchy process , 2011, Expert Syst. Appl..

[12]  Philip C. Abrami,et al.  What Forty Years of Research Says About the Impact of Technology on Learning , 2011 .

[13]  T. L. Saaty A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[14]  R. MacDonald Professional Development for Information Communication Technology Integration , 2008 .

[15]  P. Twining,et al.  The Vital Program: Transforming ICT Professional Development , 2012 .

[16]  Insung Jung,et al.  ICT-Pedagogy Integration in Teacher Training: Application Cases Worldwide , 2005, J. Educ. Technol. Soc..

[17]  C. V. D. van der Vleuten,et al.  A One-Day Dental Faculty Workshop in Writing Multiple-Choice Questions: An Impact Evaluation. , 2015, Journal of dental education.

[18]  D. Light,et al.  Factors Influencing Outcomes From A Technology-Focused Professional Development Program , 2005 .

[19]  Andreas Andronikidis,et al.  Capturing and prioritizing students' requirements for course design by embedding Fuzzy-AHP and linear programming in QFD , 2014, Eur. J. Oper. Res..

[20]  Christine S. Bruce,et al.  Information literacy as a catalyst for educational change: a background paper , 2002 .

[21]  Frank Fuller,et al.  Information and communication technologies in teacher education: a planning guide , 2003 .

[22]  Peggy A. Ertmer,et al.  Teacher Technology Change , 2010 .

[24]  T. Laosirihongthong,et al.  A fuzzy AHP to prioritize enabling factors for strategic management of university business incubators: Resource-based view , 2014 .

[25]  Sushil Kumar,et al.  Analytic hierarchy process: An overview of applications , 2006, Eur. J. Oper. Res..

[26]  D. Shek,et al.  Quantitative evaluation of the revised training program Project P.A.T.H.S. in Hong Kong , 2012, International journal of adolescent medicine and health.

[27]  Ying-Chyi Chou,et al.  Evaluating the criteria for human resource for science and technology (HRST) based on an integrated fuzzy AHP and fuzzy DEMATEL approach , 2012, Appl. Soft Comput..

[28]  Atef Abuhmaid,et al.  ICT Training Courses for Teacher Professional Development in Jordan , 2011 .

[29]  Mary Burns,et al.  Using technology to train teachers : appropriate uses of ICT for teacher professional development in developing countires , 2005 .

[30]  R. Phelps,et al.  Developing Technology Together, Together , 2008 .

[31]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[32]  B. Rienties,et al.  The effects of online professional development on higher education teachers' beliefs and intentions towards learning facilitation and technology , 2013 .

[33]  Nilza Costa,et al.  Evaluating an online e-module for Portuguese primary teachers: trainees’ perceptions , 2012 .

[34]  E. Rosenbloom A probabilistic interpretation of the final rankings in AHP , 1997 .

[35]  Manik Chandra Das,et al.  A framework to measure relative performance of Indian technical institutions using integrated fuzzy AHP and COPRAS methodology , 2012 .

[36]  Tamás Rapcsák,et al.  On Saaty’s and Koczkodaj’s inconsistencies of pairwise comparison matrices , 2008, J. Glob. Optim..

[37]  Jeng-Fung Chen,et al.  Evaluating teaching performance based on fuzzy AHP and comprehensive evaluation approach , 2015, Appl. Soft Comput..

[38]  Curtis J. Bonk,et al.  A Special Passage Through Asia E-Learning , 2009 .

[39]  Luis G. Vargas An overview of the analytic hierarchy process and its applications , 1990 .

[40]  J. Kojuri,et al.  Assessing the impact of faculty development fellowship in Shiraz University of Medical Sciences. , 2012, Archives of Iranian medicine.