Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation.

Although training evaluation is recognized as an important component of the instructional design model, there are no theoretically based models of training evaluation. This article attempts to move toward such a model by developing a classification scheme for evaluating learning outcomes. Learning constructs are derived from a variety of research domains, such as cognitive, social, and instructional psychology and human factors. Drawing from this research, we propose cognitive, skill-based, and affective learning outcomes (relevant to training) and recommend potential evaluation measures. The learning outcomes and associated evaluation measures are organized into a classification scheme. Requirements for providing construct-oriented evidence of validity for the scheme are also discussed

[1]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[2]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[3]  F. Lord.  A study of speed factors in tests and academic grades , 1956 .

[4]  L. Cronbach.  Essentials of psychological testing , 1960 .

[5]  L. Cronbach.  Essentials of psychological testing, 2nd ed. , 1960 .

[6]  Howard S. Becker,et al.  Boys In White , 1961 .

[7]  D. Krathwohl.  Taxonomy of educational objectives: The Classification of educational goals. Handbook II: Affective domain / David R. Krathwohl, Benyamin S. Bloom, Bertram B. Masia , 1964 .

[8]  R. Gagne.  Conditions of Learning , 1965 .

[9]  Leslie J. Briggs.  Sequencing of instruction in relation to hierarchies of competence , 1967 .

[10]  M. L. Blum,et al.  Industrial Psychology: Its Theoretical and Social Foundations , 1968 .

[11]  John P. Campbell,et al.  Personnel Training and Development , 1971 .

[12]  A. Goldstein,et al.  Changing supervisor behavior , 1973 .

[13]  R. Shavelson.  Methods for examining representations of A subject-matter structure in a student's memory , 1974 .

[14]  Kenneth N. Wexley,et al.  Effectiveness of positive reinforcement and goal setting as methods of management development. , 1975 .

[15]  Ann L. Brown,et al.  The development of memory: knowing, knowing about knowing, and knowing how to know. , 1975, Advances in child development and behavior.

[16]  Donald Meichenbaum,et al.  Enhancing Creativity by Modifying What Subjects Say to Themselves1 , 1975 .

[17]  Allen I. Kraut,et al.  Developing Managerial Skills via Modeling Techniques: Some Positive Research Findings--A Symposium. , 1976 .

[18]  Robert L. Craig,et al.  Training and development handbook: A guide to human resource development , 1976 .

[19]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[20]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[21]  A. Bandura.  Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychological review.

[22]  A. Bandura.  Social learning theory , 1977 .

[23]  D. L. Hintzman.  The psychology of learning and memory , 1978 .

[24]  R. Klatzky,et al.  Semantic factors in cognition , 1978 .

[25]  Robert Weinberg,et al.  Expectations and Performance: An Empirical Test of Bandura's Self-efficacy Theory , 1979 .

[26]  James G Greeno,et al.  Some Examples of Cognitive Task Analysis with Instructional Implications , 1979, Aptitude, Learning, and Instruction.

[27]  S. Tyler,et al.  Cognitive Effort and Memory , 1979 .

[28]  D. Lohman.  Spatial Ability: A Review and Reanalysis of the Correlational Literature. , 1979 .

[29]  James L. Farr,et al.  A Model for the Systemic Evaluation of Human Resource Development Programs , 1980 .

[30]  Michael A. Campion,et al.  The situational interview. , 1980 .

[31]  I. Goldstein.  Training in Work Organizations , 1980 .

[32]  D. Ilgen,et al.  A Theory of Behavior in Organizations , 1980 .

[33]  John R. Anderson,et al.  Knowledge Compilation: Mechanisms for the Automatization of Cognitive Skills. , 1980 .

[34]  J. Komaki,et al.  Effect of training and feedback: component analysis of a behavioral safety program. , 1980, The Journal of applied psychology.

[35]  W. Montague,et al.  Aptitude, Learning, and Instruction , 1980 .

[36]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[37]  L. Frederiksen,et al.  ORGANIZATIONAL BEHAVIOR MANAGEMENT , 1981 .

[38]  Ray R. Buss,et al.  Students' aptitudes and their reports of cognitive processes during direct instruction , 1981 .

[39]  Leopold E. Klopfer,et al.  Structural representations of students' knowledge before and after science instruction , 1981 .

[40]  D. Gould,et al.  The Effects of Model Similarity and Model Talk on Self-efficacy and Muscular Endurance , 1981 .

[41]  T. Osberg,et al.  The Relative Accuracy of Self-Predictions and Judgments by Others in Psychological Assessment , 1981 .

[42]  R. Sternberg.  Advances in the psychology of human intelligence , 1982 .

[43]  Ronald W. Clement.  Testing the Hierarchy Theory of Training Evaluation: An Expanded Role for Trainee Reactions , 1982 .

[44]  J. D. Hagman,et al.  On sustaining procedural skills over a prolonged retention interval. , 1982 .

[45]  M. Weiss,et al.  Developing Self-Efficacy through Sport , 1982 .

[46]  Stephen G. West,et al.  Validity of self-evaluation of ability: A review and meta-analysis , 1982 .

[47]  Ann L. Brown.  Learning, remembering, and understanding , 1982 .

[48]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[49]  M. R. Louis,et al.  THE AVAILABILITY AND HELPFULNESS OF SOCIALIZATION PRACTICES , 1983 .

[50]  Albert Bandura.  Self-Efficacy Determinants of Anticipated Fears and Calamities , 1983 .

[51]  G. Latham,et al.  The Motivational Effects of Participation Versus Goal Setting on Performance , 1983 .

[52]  P. Johnson-Laird.  Mental models , 1989 .

[53]  J. Barling,et al.  Self-Efficacy Beliefs and Sales Performance , 1983 .

[54]  Barbara S. Plake,et al.  Preface: Social and Technical Issues in Testing: Implications for Test Construction and Usage , 1984 .

[55]  D. C. Feldman,et al.  The Development and Enforcement of Group Norms , 1984 .

[56]  John R. Kirby,et al.  Cognitive strategies and educational performance , 1984 .

[57]  P. Peterson,et al.  Students’ Cognitions and Time on Task During Mathematics Instruction , 1984 .

[58]  R. Gagne.  Learning outcomes and their effects: Useful categories of human performance. , 1984 .

[59]  P. Christopher Earley,et al.  The influence of component participation and role models on goal acceptance, goal satisfaction and performance , 1985 .

[60]  E. McAuley.  Modeling and Self-Efficacy: A Test of Bandura's Model , 1985 .

[61]  Alan H. Schoenfeld,et al.  Mathematical Problem Solving , 1985 .

[62]  D. Schunk.  Self-Efficacy and Classroom Learning , 1985 .

[63]  Robert Glaser,et al.  Research and open questions , 1985 .

[64]  R. Noe.  Trainees' Attributes and Attitudes: Neglected Influences on Training Effectiveness , 1986 .

[65]  N. Schmitt,et al.  THE INFLUENCE OF TRAINEE ATTITUDES ON TRAINING EFFECTIVENESS: TEST OF A MODEL , 1986 .

[66]  G D Logan,et al.  On the autonomy of mental processes: a case study of arithmetic. , 1986, Journal of experimental psychology. General.

[67]  Carol S. Dweck,et al.  Motivational processes affecting learning. , 1986 .

[68]  P. Ackerman.  Individual differences in information processing: An investigation of intellectual abilities and task performance during practice ☆ , 1986 .

[69]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[70]  Learning Research Laboratory: Proposed Research Issues. , 1986 .

[71]  Charles C. Manz.  Self-Leadership: Toward an Expanded Theory of Self-Influence Processes in Organizations , 1986 .

[72]  M. E. Tubbs,et al.  Goal setting: A meta-analytic examination of the empirical evidence. , 1986 .

[73]  Timothy T. Baldwin,et al.  Posttraining Strategies for Facilitating Positive Transfer: An Empirical Exploration , 1986 .

[74]  F. Weinert,et al.  Metacognition, motivation, and understanding , 1987 .

[75]  Robert P. Steel,et al.  A meta-analytic study of the effects of goal setting on task performance: 1966-1984 , 1987 .

[76]  James E. McDonald,et al.  The Application of Psychological Scaling Techniques to Knowledge Elicitation for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[77]  Shelly Chaiken,et al.  Attitudes and Attitude Change , 1987 .

[78]  P. Ackerman.  Individual differences in skill learning: An integration of psychometric and information processing perspectives. , 1987 .

[79]  Richard K. Wagner,et al.  Tacit knowledge in everyday intelligent behavior. , 1987 .

[80]  Michael Pressley,et al.  Perceived Readiness for Examination Performance (PREP) Produced by Initial Reading of Text and Text Containing Adjunct Questions. , 1987 .

[81]  Gary P. Latham,et al.  Application of social learning theory to employee self-management of attendance , 1987 .

[82]  Stephen A. Stumpf,et al.  Self-efficacy expectations and coping with career-related events , 1987 .

[83]  M. Chi,et al.  The Nature of Expertise , 1988 .

[84]  Timothy T. Baldwin,et al.  TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH , 1988 .

[85]  Barbara Means,et al.  Cognitive task analysis as a basis for tutor development: Articulating abstract knowledge representations. , 1988 .

[86]  Joseph Psotka,et al.  Intelligent tutoring systems : lessons learned , 1988 .

[87]  Kate Ehrlich,et al.  Knowledge and processes in the comprehension of computer programs. , 1988 .

[88]  Edwin A. Locke,et al.  The Determinants of Goal Commitment , 1988 .

[89]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[90]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[91]  Carole A. Ames,et al.  Achievement Goals in the Classroom: Students' Learning Strategies and Motivation Processes , 1988 .

[92]  G. Latham.  Human Resource Training and Development , 1988 .

[93]  D. C. Feldman,et al.  Socialization, resocialization, and training: Reframing the research agenda. , 1989 .

[94]  J. R. Thomas,et al.  Relation of knowledge and performance in boys' tennis: age and expertise. , 1989, Journal of experimental child psychology.

[95]  Irwin L. Goldstein,et al.  Training and Development in Organizations , 1989 .

[96]  P. Ackerman,et al.  Motivation and cognitive abilities: an integrative/aptitude-treatment interaction approach to skill acquisition , 1989 .

[97]  Gerald V. Barrett,et al.  Validity of Personnel Decisions: A Conceptual Analysis of the Inferential and Evidential Bases , 1989 .

[98]  R. Fazio.  On the power and functionality of attitudes: The role of attitude accessibility. , 1989 .

[99]  G. Latham,et al.  Self-management training for increasing job attendance: A follow-up and a replication. , 1988 .

[100]  Arthur D. Fisk,et al.  Training Consistent Components of Tasks: Developing an Instructional System Based on Automatic/Controlled Processing Principles , 1989 .

[101]  Richard S. Prawat,et al.  Promoting Access to Knowledge, Strategy, and Disposition in Students: A Research Synthesis , 1989 .

[102]  David A. Waldman,et al.  Putting Together the Pieces: A Closer Look at the Determinants of Job Performance , 1989 .

[103]  G. Alliger,et al.  KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER , 1989 .

[104]  Paul Busch,et al.  Knowledge bases and salesperson effectiveness: A script-theoretic analysis. , 1989 .

[105]  Marilyn E. Gist,et al.  THE INFLUENCE OF TRAINING METHOD ON SELF‐EFFICACY AND IDEA GENERATION AMONG MANAGERS , 1989 .

[106]  T. O. Nelson,et al.  Do different metamemory judgments tap the same underlying aspects of memory , 1990 .

[107]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[108]  T. Hardin,et al.  Remembering with and without awareness in a depressed mood: evidence of deficits in initiative. , 1990, Journal of experimental psychology. General.

[109]  T. Goldsmith,et al.  Assessing structural similarity of graphs , 1990 .

[110]  E. A. Locke,et al.  A theory of goal setting & task performance , 1990 .

[111]  Howard M. Weiss,et al.  Learning theory and industrial and organizational psychology. , 1990 .

[112]  John P. Campbell,et al.  AN OVERVIEW OF THE ARMY SELECTION AND CLASSIFICATION PROJECT (PROJECT A) , 1990 .

[113]  Timothy E. Goldsmith,et al.  A structural assessment of classroom learning , 1990 .

[114]  Marilyn E. Gist,et al.  TRANSFER TRAINING METHOD: ITS INFLUENCE ON SKILL GENERALIZATION, SKILL REPETITION, AND PERFORMANCE LEVEL , 1990 .

[115]  Robert L. Helmreich,et al.  The structure of cockpit management attitudes , 1990 .

[116]  Henry L. Tosi.  A Theory of Goal Setting and Task Performance , 1991 .

[117]  J. Mathieu,et al.  Meeting trainees' expectations: The influence of training fulfillment on the development of commitment, self-efficacy, and motivation. , 1991 .

[118]  Walter C. Borman,et al.  Observation accuracy for assessors of work-sample performance: Consistency across task and individual-differences correlates. , 1991 .

[119]  Walter C. Borman,et al.  Job behavior, performance, and effectiveness. , 1991 .

[120]  Peder J. Johnson,et al.  Assessing Structural Knowledge. , 1991 .

[121]  S. McPherson,et al.  Changes in cognitive strategies and motor skill in tennis. , 1991 .

[122]  E. Salas,et al.  Toward an Integration of Training Theory and Technique , 1991 .

[123]  G. Latham,et al.  Developing and Training Human Resources in Organizations , 1991 .

[124]  C. A. Weaver,et al.  Depression, cognitive skill, and metacognitive skill in problem solving , 1992 .

[125]  William B. Rouse,et al.  The role of mental models in team performance in complex systems , 1992, IEEE Trans. Syst. Man Cybern..

[126]  G. Yukl,et al.  Training and development in work organizations. , 1992 .

[127]  Martha Reeves,et al.  Evaluation of Training , 1993 .