Effectiveness of error management training: a meta-analysis.

Error management training (EMT) is a training method that involves active exploration as well as explicit encouragement for learners to make errors during training and to learn from them. Past evaluation studies, which compared skill-based training outcomes of EMT with those of proceduralized erroravoidant training or of exploratory training without error encouragement, have yielded considerable variation in effect sizes. The present meta-analysis compiles the results of the existing studies and seeks to explain this variation. Although the mean effect of EMT across all 24 identified studies (N = 2,183) was positive and significant (Cohen's d = 0.44), there were several moderators. Moderator analyses showed effect sizes to be larger (a) for posttraining transfer (d = 0.56) than for within-training performance and (b) for performance tasks that were structurally distinct (adaptive transfer; d = 0.80) than for tasks that were similar to training (analogical transfer). In addition, both active exploration and error encouragement were identified as effective elements in EMT. Results suggest that EMT may be better suited than error-avoidant training methods for promotion of transfer to novel tasks.

[1]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[2]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[3]  S. Folkman,et al.  Stress, appraisal, and coping , 1974 .

[4]  L. Sjodahl.  Evaluation of Training. , 1975 .

[5]  Robert L. Craig,et al.  Training and development handbook: A guide to human resource development , 1976 .

[6]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[7]  M. Taylor,et al.  Consequences of individual feedback on behavior in organizations. , 1979 .

[8]  J. Shea,et al.  Contextual interference effects on the acquisition, retention, and transfer of a motor skill. , 1979 .

[9]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[10]  L. Hedges.  Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[11]  Jens Rasmussen,et al.  Human errors. a taxonomy for describing human malfunction in industrial installations , 1982 .

[12]  L. Hedges.  Fitting Categorical Models to Effect Sizes from a Series of Experiments , 1982 .

[13]  Ann L. Brown.  Learning, remembering, and understanding , 1982 .

[14]  L. James,et al.  Mediators, Moderators, and Tests for Mediation. , 1984 .

[15]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[16]  S. Folkman,et al.  Journal of Personality and Social Psychology If It Changes It Must Be a Process: Study of Emotion and Coping during Three Stages of a College Examination , 2022 .

[17]  A. Bandura.  Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[18]  Joseph I. Lipson,et al.  Twenty questions about student errors , 1986 .

[19]  Irwin L. Goldstein,et al.  Training in organizations: Needs assessment, development, and evaluation , 1986 .

[20]  Siegfried Greif,et al.  Aktives Lernen durch systematische Fehlerexploration oder programmiertes Lernen durch Tutorials , 1987 .

[21]  D. Perkins,et al.  Rocky Roads to Transfer: Rethinking Mechanism of a Neglected Phenomenon , 1989 .

[22]  P. Ackerman,et al.  Motivation and cognitive abilities: an integrative/aptitude-treatment interaction approach to skill acquisition , 1989 .

[23]  C. Carver,et al.  Assessing coping strategies: a theoretically based approach. , 1989, Journal of personality and social psychology.

[24]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[25]  Marilyn E. Gist,et al.  EFFECTS OF ALTERNATIVE TRAINING METHODS ON SELF-EFFICACY AND PERFORMANCE IN COMPUTER SOFTWARE TRAINING , 1989 .

[26]  Bernhard Wilpert,et al.  Applied psychology : an international review , 1989 .

[27]  Heidi Keller,et al.  Innovation and the design of work and learning environments: The concept of exploration in human-computer interaction. , 1990 .

[28]  A. King.  Effects of training in strategic questioning on children's problem-solving performance , 1991 .

[29]  Michael Frese,et al.  Errors in Training Computer Skills: on the Positive Function of Errors , 1991, Hum. Comput. Interact..

[30]  Jochen Prümper,et al.  Errors in working with office computers: A first validation of a taxonomy for observed errors in a field setting , 1992, Int. J. Hum. Comput. Interact..

[31]  M. West,et al.  Innovation and creativity at work::Psychological and organizational strategies , 1992 .

[32]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[33]  Martha Reeves,et al.  Evaluation of Training , 1993 .

[34]  P. Karoly.  Mechanisms of Self-Regulation: A Systems View , 1993 .

[35]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[36]  Kevin M. Brooks,et al.  Thoughts beyond words : When language overshadows insight , 1993 .

[37]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[38]  Michael Frese,et al.  Error training: Replication and the function of exploratory behavior , 1994, Int. J. Hum. Comput. Interact..

[39]  M. Frese,et al.  Action as the core of work psychology: A German approach. , 1994 .

[40]  B. Zimmerman,et al.  Self-regulation of learning and performance: Issues and educational applications. , 1994 .

[41]  Paul E. Levy,et al.  Moving from Cognition to Action: A Control Theory Perspective , 1994 .

[42]  Michael Frese,et al.  Error management in training: Conceptual and empirical results , 1995 .

[43]  R. L. Dominowski,et al.  Metacognition and problem solving : A process-oriented approach. , 1995 .

[44]  Michael Frese.  Human-computer interaction , 1995 .

[45]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[46]  Eric D. Heggestad,et al.  Motivational skills & self-regulation for learning: A trait perspective , 1996 .

[47]  H. Marsh,et al.  Effects of Metacognitive Strategy Training within a Cooperative Group Learning Context on Computer Achievement and Anxiety: An Aptitude-Treatment Interaction Study , 1997 .

[48]  Steve W. J. Kozlowski,et al.  Building adaptive expertise: Implications for training design strategies. , 1997 .

[49]  Beryl Hesketh,et al.  Dilemmas in training for transfer and retention , 1997 .

[50]  M. Neubert.  The Value of Feedback and Goal Setting Over Goal Setting Alone and Potential Moderators of this Effect: a Meta-Analysis , 1998 .

[51]  S. Sonnentag.  Expertise in professional software design: a process study. , 1998, The Journal of applied psychology.

[52]  Eleanor M. Smith,et al.  Relationships of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer , 1998 .

[53]  Roger L. Dominowski,et al.  Verbalization and Problem Solving , 1998 .

[54]  W. Hacker.  Allgemeine Arbeitspsychologie : psychische Regulation von Arbeitstätigkeiten , 1998 .

[55]  Janet E. Davidson,et al.  Smart Problem Solving: How Metacognition Helps , 1998 .

[56]  C. Nordstrom,et al.  “To Err is Human”: An Examination of the Effectiveness of Error Management Training , 1998 .

[57]  Karolina Ivancic.  Errors as a means of promoting transfer of training. , 1998 .

[58]  C. Carver,et al.  On the Self-Regulation of Behavior , 1998 .

[59]  Auble,et al.  Resource-Allocation Strategies: A Verbal Protocol Analysis. , 1998, Organizational behavior and human decision processes.

[60]  Goodman,et al.  The Interactive Effects of Task and External Feedback on Practice Performance and Learning. , 1998, Organizational behavior and human decision processes.

[61]  Michael Frese,et al.  Error orientation questionnaire (EOQ): Reliability, validity, and different language equivalence , 1999 .

[62]  Connie R. Wanberg,et al.  Unemployed individuals: motives, job-search competencies, and job-search constraints as predictors of job seeking and reemployment. , 1999, The Journal of applied psychology.

[63]  R. Baumeister,et al.  Self-regulation and depletion of limited resources: does self-control resemble a muscle? , 2000, Psychological bulletin.

[64]  B Hesketh,et al.  Learning from errors in a driving simulation: effects on driving skill and self-confidence , 2000, Ergonomics.

[65]  J. Gross,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Emotion Regulation and Memory: The Cognitive Costs of Keeping One's Cool , 2004 .

[66]  Robert E. Wood,et al.  The impact of enactive exploration on intrinsic motivation, strategy, and performance in electronic search , 2000 .

[67]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[68]  R E Wood,et al.  Impact of guided exploration and enactive exploration on self-regulatory mechanisms and information acquisition through electronic search. , 2001, The Journal of applied psychology.

[69]  E. Salas,et al.  The science of training: a decade of progress. , 2001, Annual review of psychology.

[70]  Cathy van Dyck,et al.  Exploration strategies, performance, and error consequences when learning a complex computer task , 2001 .

[71]  R. Rosenthal,et al.  Meta-analysis: recent developments in quantitative methods for literature reviews. , 2001, Annual review of psychology.

[72]  Eduardo Salas,et al.  Effects of Training Goals and Goal Orientation Traits on Multidimensional Training Outcomes and Performance Adaptability. , 2001, Organizational behavior and human decision processes.

[73]  S. Payne,et al.  The impact of error training and individual differences on training outcomes: an attribute-treatment interaction perspective. , 2002, The Journal of applied psychology.

[74]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[75]  S. Kozlowski,et al.  Adaptive Guidance: Enhancing Self-Regulation, Knowledge, and Performance in Technology-Based Training , 2002 .

[76]  Susan M. Barnett,et al.  When and where do we apply what we learn? A taxonomy for far transfer. , 2002, Psychological bulletin.

[77]  Frederick L. Oswald,et al.  Meta-analysis and the art of the average. , 2003 .

[78]  Jonathan Lazar,et al.  Training Novice Users in Developing Strategies for Responding to Errors When Browsing the Web , 2003, Int. J. Hum. Comput. Interact..

[79]  C. Nordstrom,et al.  Learning from Our Mistakes: Error Management Training for Mature Learners , 2003 .

[80]  D. Holman,et al.  Emotion regulation in customer service roles: testing a model of emotional labor. , 2003, Journal of occupational health psychology.

[81]  M. Frese,et al.  INTEGRATING ERRORS INTO THE TRAINING PROCESS: THE FUNCTION OF ERROR MANAGEMENT INSTRUCTIONS AND THE ROLE OF GOAL ORIENTATION , 2003 .

[82]  Udo Konradt,et al.  Handbook of industrial, work and organizational psychology (Vol. 1: Personnel Psychology; Vol. 2: Organizational Psychology) , 2004 .

[83]  Robert E Wood,et al.  Feedback specificity, learning opportunities, and learning. , 2004, The Journal of applied psychology.

[84]  Michael J. Strube,et al.  Validity Generalization: A Critical Review , 2004 .

[85]  Alicia A. Grandey,et al.  The customer is not always right: customer aggression and emotion regulation of service employees , 2004 .

[86]  M. Frese,et al.  Organizational error management culture and its impact on performance: a two-study replication. , 2005, The Journal of applied psychology.

[87]  Beryl Hesketh,et al.  Enhancing Performance through Training , 2005 .

[88]  M. Frese,et al.  Self-regulation in error management training: emotion control and metacognition as mediators of performance effects. , 2005, The Journal of applied psychology.

[89]  Eduardo Salas,et al.  Benefiting from mistakes: The impact of guided errors on learning, performance, and self-efficacy , 2005 .

[90]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[91]  S. Sonnentag,et al.  Psychological management of individual performance. , 2005 .

[92]  Paul J. Taylor,et al.  A meta-analytic review of behavior modeling training. , 2005, The Journal of applied psychology.

[93]  A. Neal,et al.  Using “War Stories” to Train for Adaptive Performance: Is it Better to Learn from Error or Success? , 2006 .

[94]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .