Training Evaluation: Knowing More Than Is Practiced

The problem and the solution. Training program evaluation is an important and culminating phase in the analysis, design, develop, implement, evaluate (ADDIE) process. However, evaluation has often been overlooked or not implemented to its full capacity. To assess and ensure the quality, effectiveness, and the impact of systematic training, this article emphasizes the importance of summative evaluation at the last phase of ADDIE and presents developments toward a summative evaluation framework of training program effectiveness. The focus is the connection of final summative evaluation to the direction provided by the analysis phase and the concerns of the host organization.

[1]  Milton D. Rosenau,et al.  Improving performance: How to manage the white space in the organization chart (2nd edition): by Geary A. Rummler and Alan P. Brache. San Francisco: Jossey-Bass, 1995. 226 + xxv pages. $29.95 , 1996 .

[2]  Leslie Moller,et al.  Utilizing Performance Technology to Improve Evaluative Practices of Instructional Designers , 2008 .

[3]  F. Nickols,et al.  Why a Stakeholder Approach to Evaluating Training , 2005 .

[4]  Dean R. Spitzer.  Learning Effectiveness Measurement: A New Approach for Measuring and Managing Learning to Achieve Business Results , 2005 .

[5]  Wallace H. Hannum,et al.  Instructional Systems Development in Large Organizations , 1989 .

[6]  Robert Brinkerhoff.  The Success Case Method , 2003 .

[7]  Richard A. Swanson.  Assessing the Financial Benefits of Human Resource Development , 2001 .

[8]  M. Scriven.  Evaluation thesaurus, 4th ed. , 1991 .

[9]  Kim Kiser.  When Those Who "Do," Teach. , 1999 .

[10]  Raymond A. Noe,et al.  Employee Training and Development , 2001 .

[11]  Janice Z. Rouiller,et al.  The relationship between organizational transfer climate and positive transfer of training , 1993 .

[12]  Elwood F. Holton.  Holton's Evaluation Model: New Evidence and Construct Elaborations , 2005 .

[13]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .

[14]  Elwood F. Holton,et al.  Development of a generalized learning transfer system inventory , 2000 .

[15]  Jon M. Werner,et al.  Human Resource Development , 2005 .

[16]  Elwood F. Holton,et al.  Toward construct validation of a transfer climate instrument , 1997 .

[17]  G. Alliger,et al.  KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER , 1989 .

[18]  Timothy T. Baldwin,et al.  TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH , 1988 .

[19]  Greg G. Wang,et al.  Human Resource Development Evaluation: Emerging Market, Barriers, and Theory Building , 2005 .

[20]  Richard A. Swanson.  Evaluation, a State of Mind , 2005 .

[21]  Greg G. Wang,et al.  A Systems Approach to Measuring Return on Investment for HRD Interventions. , 2002 .

[22]  UIf Johanson,et al.  Return on Investment in Training and Performance Improvement Programs , 1998 .

[23]  Brent W. Mattson.  Using the Critical Outcome Technique to Demonstrate Financial and Organizational Performance Results , 2005 .

[24]  Leslie Moller,et al.  Evaluation Practices of Instructional Designers and Organizational Supports and Barriers. , 2008 .

[25]  Elwood F. Holton.  The flawed four‐level evaluation model , 1996 .

[26]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[27]  Darlene Russ-Eft,et al.  In Search of the Holy Grail: Return on Investment Evaluation in Human Resource Development , 2005 .

[28]  G. Latham,et al.  Developing and Training Human Resources in Organizations , 1991 .

[29]  Kenneth G. Brown,et al.  FORMATIVE EVALUATION: AN INTEGRATIVE PRACTICE MODEL AND CASE STUDY , 2002 .

[30]  Geary A. Rummler,et al.  Improving Performance: How to Manage the White Space on the Organization Chart , 1990 .

[31]  E. Salas,et al.  An Integrated Model of Training Evaluation and Effectiveness , 2004 .

[32]  Jack J. Phillips,et al.  Handbook of Training Evaluation and Measurement Methods , 1987 .

[33]  M. Scriven.  Types of Evaluation and Types of Evaluator , 1996 .

[34]  Dean R. Spitzer,et al.  Human Resource Development Measurement and Evaluation: Looking Back and Moving Forward , 2005 .