An evaluation system for training programs: a case study using a four‐phase approach

Purpose – With the increased importance of training in organizations, creating important and meaningful programs are critical to an organization and its members. The purpose of this paper is to suggest a four‐phase systematic approach to designing and evaluating training programs that promotes collaboration between organizational leaders, trainers, participants and evaluators.Design/methodology/approach – The paper presents a case study of a leadership training program conducted at a Midwestern corporate university. Analysis of the qualitative data from interviews with participants and field notes during the first two iterations of the program highlight three major aspects that were then used to develop a unique measure for the evaluation of subsequent iterations. The case study was conducted over a period of 31/2 years involving a total of 175 managers.Findings – A main finding in this study was that content was three times stronger than applicability. This finding was critical in understanding the learn...

[1]  J. Pfeffer.  Seven Practices of Successful Organizations , 1998 .

[2]  Philip E. T. Lewis,et al.  The Evaluation of Training: An Organizational Culture Approach. , 1994 .

[3]  P. Stevens.  What works and what does not in career development programmes , 1996 .

[4]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .

[5]  R. W. Tyler.  General Statement on Evaluation , 1942 .

[6]  Pao-Long Chang,et al.  A study of career needs, career development programs, job satisfaction and the turnover intentions of R&D personnel , 2004 .

[7]  Irwin L. Goldstein,et al.  Training in Organizations , 2001 .

[8]  Maria Arnone.  Corporate universities: a viewpoint on the challenges and best practices , 1998 .

[9]  J. Black,et al.  High impact training: Forging leaders for the global frontier , 2000 .

[10]  David L. Cooperrider,et al.  Appreciative management and leadership : the power of positive thought and action in organizations , 1990 .

[11]  C. Prahalad.  Managing discontinuities : The emerging challenges , 1998 .

[12]  E. Guba,et al.  Fourth Generation Evaluation , 1989 .

[13]  Irwin L. Goldstein,et al.  Training in organizations: Needs assessment, development, and evaluation , 1986 .

[14]  L. Cronbach,et al.  Toward Reform of Program Evaluation , 1981 .

[15]  Mike Wills,et al.  Managing the Training Process: Putting the Basics into Practice , 1994 .

[16]  Yehuda Baruch,et al.  Developing Top Managers: The Impact of Interpersonal Skills Training. , 2003 .

[17]  R. Vince.  Behind and Beyond Kolb's Learning Cycle , 1998 .

[18]  Yehuda Baruch,et al.  Response Rate in Academic Studies — A Comparative Analysis , 1999 .

[19]  Shani D. Carter.  Matching training methods and factors of cognitive ability: A means to improve training outcomes , 2002 .

[20]  Jean Hartley,et al.  Case study research , 2004 .

[21]  Aaron W. Hughey,et al.  Designing effective employee training programmes , 1997 .

[22]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[23]  G. Alliger,et al.  IBM Takes the Guessing out of Testing. , 1989 .

[24]  N. Bozionelos,et al.  Team leaders’ development: findings from a case study , 2002 .

[25]  Roger Williams,et al.  Seven key issues for management development , 2001 .

[26]  Tony Lingham,et al.  Appreciative Inquiry and Public Dialogue: An Approach to Community Change , 2002 .

[27]  Marianne White,et al.  Feeling valued at work? A qualitative study of corporate training consultants , 2003 .

[28]  David A. Whetten,et al.  An Integrated Model for Teaching Management Skills , 1996 .

[29]  M. Scriven.  The methodology of evaluation , 1966 .

[30]  Mark W. Lipsey,et al.  Evaluation: A Systematic Approach , 1979 .

[31]  P. Rossi,et al.  Evaluation: A systematic approach, 5th ed. , 1989 .

[32]  D. Kolb.  Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[33]  O D Hargie,et al.  Evaluating evaluation: implications for assessing quality. , 2001, International journal of health care quality assurance incorporating Leadership in health services.

[34]  Increasing the ROI on management education efforts , 1998 .

[35]  Dennis O’Connor,et al.  Appreciative Pedagogy: Constructing Positive Models for Learning , 2000 .

[36]  E. Kossek,et al.  Leadership education: the impact of managerial level and gender on learning , 1996 .

[37]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[38]  Stephen A. Stumpf.  Corporate universities of the future , 1998 .

[39]  Suleiman K. Kassicieh,et al.  Training, performance evaluation, rewards, and TQM implementation success , 1998 .

[40]  D. Campbell.  Reforms as experiments , 1969 .

[41]  Sam McClelland.  A Model for Designing Objective‐oriented Training Evaluations , 1994 .

[42]  S. Maitlis,et al.  Predicting immediate and longer-term transfer of training , 1997 .