A META-ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA

An augmented framework for training criteria based on Kirkpatrick's (1959a, 1959b, 1960a, 1960b) model divides training reactions into affective and utility reactions, and learning into post-training measures of learning, retention, and behavior/skill demonstration. A total of 34 studies yielding 115 correlations were analyzed meta-analytically. Results included substantial reliabilities across training criteria and reasonable convergence among subdivisions of criteria within a larger level. Utility-type reaction measures were more strongly related to learning or on-the-job performance (transfer) than affective-type reaction measures. Moreover, utility-type reaction measures were stronger correlates of transfer than were measures of immediate or retained learning. These latter findings support recent concurrent thinking regarding use of reactions in training (e.g., Warr & Bunce, 1995). Implications for choosing and developing training criteria are discussed.

[1]  Elwood F. Holton.  The flawed four‐level evaluation model , 1996 .

[2]  D. Kirkpatrick.  Invited reaction: Reaction to holton article , 1996 .

[3]  Laurie J. Bassi.  The Top Ten Trends. , 1996 .

[4]  P. Warr,et al.  TRAINEE CHARACTERISTICS AND THE OUTCOMES OF OPEN LEARNING , 1995 .

[5]  M. Quiñones.  Pretraining context effects: Training assignment as feedback. , 1995 .

[6]  Michael J. Kavanagh,et al.  Applying Trained Skills on the Job: The Importance of the Work Environment , 1995 .

[7]  Timothy T. Baldwin,et al.  Augmenting behavior-modeling training: Testing the effects of pre- and post-training interventions , 1994 .

[8]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[9]  Cecilia M. Falbe,et al.  Training‐related Variables, Gender and Training Outcomes: A Field Investigation , 1993 .

[10]  Joseph J. Martocchio,et al.  Turning Work into Play: Implications for Microcomputer Software Training , 1993 .

[11]  S. Chaiken,et al.  The psychology of attitudes. , 1993 .

[12]  Sue R. Faerman,et al.  Trainee Satisfaction and Training Impact: Issues in Training Evaluation , 1993 .

[13]  J. Harrison,et al.  Individual and combined effects of behavior modeling and the cultural assimilator in cross-cultural management training. , 1992 .

[14]  J. Mathieu,et al.  Influences of Individual and Situational Characteristics on Measures of Training Effectiveness , 1992 .

[15]  Scott I. Tannenbaum,et al.  Determining a Strategy for Evaluating Training: Operating within Organizational Constraints , 1992 .

[16]  Timothy A. Judge,et al.  Effects of Work Values on Job Choice Decisions , 1992 .

[17]  Timothy T. Baldwin,et al.  Effects of alternative modeling strategies on outcomes of interpersonal-skills training. , 1992, The Journal of applied psychology.

[18]  G. Yukl,et al.  Training and development in work organizations. , 1992 .

[19]  J. Mathieu,et al.  Meeting trainees' expectations: The influence of training fulfillment on the development of commitment, self-efficacy, and motivation. , 1991 .

[20]  S. J. Kraus,et al.  Attitudes and the Prediction of Behavior: A Meta-Analysis of the Empirical Literature , 1990 .

[21]  Marilyn E. Gist,et al.  EFFECTS OF ALTERNATIVE TRAINING METHODS ON SELF-EFFICACY AND PERFORMANCE IN COMPUTER SOFTWARE TRAINING , 1989 .

[22]  Marilyn E. Gist,et al.  THE INFLUENCE OF TRAINING METHOD ON SELF‐EFFICACY AND IDEA GENERATION AMONG MANAGERS , 1989 .

[23]  G. Alliger,et al.  KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER , 1989 .

[24]  G. Alliger,et al.  IBM Takes the Guessing out of Testing. , 1989 .

[25]  Terry R. Johnson,et al.  A Survey of Management Training and Education Practices in U.S. Companies. , 1988 .

[26]  Lawrence H. Peters,et al.  An Examination of Situational Constraints in Air Force Work Settings , 1988 .

[27]  Timothy T. Baldwin,et al.  TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH , 1988 .

[28]  Gary P. Latham,et al.  Application of social learning theory to employee self-management of attendance , 1987 .

[29]  Timothy T. Baldwin,et al.  Posttraining Strategies for Facilitating Positive Transfer: An Empirical Exploration , 1986 .

[30]  N. Schmitt,et al.  THE INFLUENCE OF TRAINEE ATTITUDES ON TRAINING EFFECTIVENESS: TEST OF A MODEL , 1986 .

[31]  Irwin L. Goldstein,et al.  Training in organizations: Needs assessment, development, and evaluation , 1986 .

[32]  Michelle T. Iaffaldano,et al.  Job satisfaction and job performance: A meta-analysis. , 1985 .

[33]  D L Kirkpatrick.  Effective supervisory training and development, Part 2: In-house approaches and techniques. , 1985, Personnel.

[34]  Ronald W. Clement,et al.  Testing the Hierarchy Theory of Training Evaluation: An Expanded Role for Trainee Reactions , 1982 .

[35]  Abraham B. Shani,et al.  Pygmalion goes to boot camp: Expectancy, leadership, and trainee performance. , 1982 .

[36]  Michael L. Fineberg,et al.  Proficiency Maintenance and Assessment in an Instrument Flight Simulator , 1979 .

[37]  D. Kirkpatrick.  Techniques for evaluating training programs , 1979 .

[38]  I. Ajzen,et al.  Attitude-behavior relations: A theoretical analysis and review of empirical research. , 1977 .

[39]  Preston E. Smith.  Management Modeling Training to Improve Morale and Customer Satisfaction. , 1976 .

[40]  D. T. Vernon,et al.  Specificity of the attitude as a determinant of attitude-behavior congruence. , 1974 .

[41]  I. Ajzen,et al.  Attitudinal and normative variables as predictors of specific behavior. , 1973 .

[42]  L. Bolman.  Some Effects of Trainers on their T Groups , 1971 .

[43]  M. Miles.  Changes During and Following Laboratory Training: A Clinical-Experimental Study , 1965 .

[44]  P. W. Thayer,et al.  Product Knowledge and Performance–A Study of Life Insurance Agents , 1958 .

[45]  Daryl Severin.  The Predictability of Various Kinds of Criteria , 1952 .

[46]  H. E. Brogden,et al.  The Dollar Criterion—Applying the Cost Accounting Concept to Criterion Construction , 1950 .