The Moderating Effect of Individual Differences in Error-Management Training

Objective: We investigated the effectiveness of error-encouragement training and the influence of ability and personality attribute-treatment interactions using a dynamic decision-making task. Background: Error-encouragement training is said to be more effective than error-avoidance training because active exploration and error encouragement promote better learning and transfer. Past research, which is limited by confounded experimental designs involving simple tasks with little consideration of individual differences, provides evidence for the value of active exploration but less so for error encouragement. Method: We randomly allocated 164 participants to receive error-encouragement, error-avoidance, or no error-related instructions in training on ATC-lab, a dynamic computer simulated air traffic control task. Active exploration and task information were controlled, and ability and personality were assessed. Results: Error encouragement yielded better transfer performance than did error avoidance but was no better than the control training. Higher- rather than lower-ability trainees benefited from training with an error orientation (positive or negative), suggesting that learning from errors in training requires greater cognitive resources. Trainees higher in openness to experience and agreeableness performed more poorly with error-avoidance training than with error-encouragement and control training. Conclusion: Error-avoidance training had a detrimental effect especially for those less open to experience, lower in agreeableness, and of lower ability. The significant benefits of error-encouragement training reported in previous research were probably attributable to confounding factors, such as active exploration and differential task information. Application: Although errors and active exploration can be useful learning tools in training, trainers should be mindful that focusing on errors, whether positively or negatively, may not suit everyone.

[1]  A. Neal,et al.  Using “War Stories” to Train for Adaptive Performance: Is it Better to Learn from Error or Success? , 2006 .

[2]  G. Regehr,et al.  A role for error training in surgical technical skill instruction and evaluation. , 2002, American journal of surgery.

[3]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[4]  Gillian B. Yeo,et al.  A multilevel analysis of effort, practice, and performance: effects; of ability, conscientiousness, and goal orientation. , 2004, The Journal of applied psychology.

[5]  J. Wixted The psychology and neuroscience of forgetting. , 2004, Annual review of psychology.

[6]  P. Costa,et al.  Domains and facets: hierarchical personality assessment using the revised NEO personality inventory. , 1995, Journal of personality assessment.

[7]  Beryl Hesketh,et al.  Enhancing Performance through Training , 2005 .

[8]  M. Frese,et al.  Effectiveness of error management training: a meta-analysis. , 2008, The Journal of applied psychology.

[9]  Gillian B. Yeo,et al.  BIS Sensitivity, Negative Affect and Performance: Dynamic and Multilevel Relationships , 2008 .

[10]  Nadine B. Sarter,et al.  Flight Deck Disturbance Management: A Simulator Study of Diagnosis and Recovery From Breakdowns in Pilot-Automation Coordination , 2007, Hum. Factors.

[11]  M. Frese,et al.  INTEGRATING ERRORS INTO THE TRAINING PROCESS: THE FUNCTION OF ERROR MANAGEMENT INSTRUCTIONS AND THE ROLE OF GOAL ORIENTATION , 2003 .

[12]  M. Frese,et al.  Self-regulation in error management training: emotion control and metacognition as mediators of performance effects. , 2005, The Journal of applied psychology.

[13]  S. Sonnentag,et al.  Psychological management of individual performance. , 2005 .

[14]  James E. Driskell,et al.  Does Stress Training Generalize to Novel Settings? , 2001, Hum. Factors.

[15]  B Hesketh,et al.  Learning from errors in a driving simulation: effects on driving skill and self-confidence , 2000, Ergonomics.

[16]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[17]  Richard F. Potthoff,et al.  On the Johnson-:neyman Technique and Some Extensions Thereof , 1963 .

[18]  Berndt Brehmer,et al.  Man as a Stabiliser of Systems: From Static Snapshots of Judgement Processes to Dynamic Decision Making , 1996 .

[19]  Hans J. Eysenck,et al.  Eysenck on extraversion , 1973 .

[20]  T. Keith Multiple Regression and Beyond , 2005, Principles & Methods of Statistical Analysis.

[21]  Jeffrey B Vancouver,et al.  The effect of feedback sign on task performance depends on self-concept discrepancies. , 2004, The Journal of applied psychology.

[22]  Richard E. Snow,et al.  Individual differences and the design of educational programs , 1986 .

[23]  Gilad Chen,et al.  Individual differences, attribute-treatment interactions, and training outcomes. , 2009 .

[24]  Marissa L. Shuffler,et al.  Learning, training, and development in organizations , 2012 .

[25]  R. Snow,et al.  Lecture 2: Toward a Theory of Cognitive Aptitude for Learning from Instruction , 1984 .

[26]  C. Nordstrom,et al.  “To Err is Human”: An Examination of the Effectiveness of Error Management Training , 1998 .

[27]  S. Kozlowski,et al.  Active learning: effects of core training design elements on self-regulatory processes, learning, and adaptability. , 2008, The Journal of applied psychology.

[28]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[29]  Ellen B. Mandinach,et al.  Remaking the Concept of Aptitude: Extending the Legacy of Richard E. Snow , 2001 .

[30]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[31]  Julie S. Lyon,et al.  Manager personality, manager service quality orientation, and service climate: test of a model. , 2007, The Journal of applied psychology.

[32]  Catherine Berthelon,et al.  The Evaluation of Traditional and Early Driver Training With Simulated Accident Scenarios , 2011, Hum. Factors.

[33]  S. Payne,et al.  The impact of error training and individual differences on training outcomes: an attribute-treatment interaction perspective. , 2002, The Journal of applied psychology.

[34]  Cleotilde González Decision Support for Real-Time, Dynamic Decision-Making Tasks , 2005 .

[35]  L. R. Goldberg The structure of phenotypic personality traits. , 1993, The American psychologist.

[36]  Karolina Ivancic Errors as a means of promoting transfer of training. , 1998 .

[37]  Deniz S. Ones,et al.  Personality at Work: Raising Awareness and Correcting Misconceptions , 2005 .

[38]  Cleotilde Gonzalez,et al.  The Relationships between Cognitive Ability and Dynamic Decision Making. , 2005 .

[39]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[40]  P. Ackerman,et al.  Motivation and cognitive abilities: an integrative/aptitude-treatment interaction approach to skill acquisition , 1989 .

[41]  Stellan Ohlsson,et al.  Learning from Performance Errors. , 1996 .

[42]  James L. Farr,et al.  Personnel selection and assessment : individual and organizational perspectives , 1993 .

[43]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[44]  Jonathan Lazar,et al.  Training Novice Users in Developing Strategies for Responding to Errors When Browsing the Web , 2003, Int. J. Hum. Comput. Interact..

[45]  Shayne Loft,et al.  ATC-lab: An air traffic control simulator for the laboratory , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[46]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[47]  P. Ackerman,et al.  A self-regulatory skills perspective to reducing cognitive interference. , 1996 .