Looking in the mirror: Self-debriefing versus instructor debriefing for simulated crises*

Objective: To examine the effectiveness of self-debriefing as compared to instructor debriefing in the change of nontechnical skills performance of anesthesiology residents. Design: Prospective, randomized, controlled study. Setting: A university hospital simulation center. Subjects: Fifty anesthesiology residents. Interventions: Subjects were instructed in the principles of nontechnical skills for crisis management. Subsequently, each resident participated in a high-fidelity simulated anesthesia crisis scenario (pretest). Participants were randomized to either a video-assisted self-debriefing or instructor debriefing. In the self-debriefing group, subjects reviewed their pretest scenario by themselves, guided by the Anesthetists' Non-Technical Skills scale. The instructor debriefing group reviewed their pretest scenario guided by an expert instructor also using the Anesthetists' Non-Technical Skills scale as a framework. Immediately following their respective debriefings, subjects managed a second simulated crisis (post-test). Measurements and Main Results: After all data were collected, two blinded experts independently rated videos of all performances in a random order using the Anesthetists' Non-Technical Skills scale. Performance significantly improved from pretest to post-test (p < .01) regardless of the type of debriefing received. There was no significant difference in the degree of improvement between self-debriefing and instructor debriefing (p = .58). Conclusions: Nontechnical skills for crisis resource management improved with training, as measured by the Anesthetists' Non-Technical Skills scale. Crisis resource management can be taught, with measurable improvements. Effective teaching of nontechnical skills can be achieved through formative self-assessment even when instructors are not available.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  M. J. Gordon A review of the validity and accuracy of self‐assessments in health professions training , 1991, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Barbara Steinwachs How to Facilitate a Debriefing , 1992 .

[4]  Rebecca W. Black,et al.  Three Levels of Learning in Simulations: Participating, Debriefing, and Journal Writing , 1992 .

[5]  G. Regehr,et al.  Measuring self‐assessment skills: an innovative relative ranking model , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[6]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .

[7]  Beyond Metaphor: Applying a New Paradigm of Change to Experiential Debriefing , 1999 .

[8]  A. Edmondson Psychological Safety and Learning Behavior in Work Teams , 1999 .

[9]  R. Key Dismukes,et al.  Facilitation and Debriefing in Aviation Training and Operations , 2000 .

[10]  David M. Gaba,et al.  Simulation-Based Training in Anesthesia Crisis Resource Management (ACRM): A Decade of Experience , 2001 .

[11]  Glenn Regehr,et al.  Measuring Self-assessment: Current State of the Art , 2002, Advances in health sciences education : theory and practice.

[12]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[13]  David C Leach,et al.  Competence is a habit. , 2002, JAMA.

[14]  R. Flin,et al.  Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. , 2003, British journal of anaesthesia.

[15]  David Boud,et al.  The Impact of Self-assessment on Achievement: The effects of self-assessment training on performance in external examinations , 2003 .

[16]  Victoria Hoban,et al.  The Reflective Practitioner , 2013 .

[17]  K. A. Ericsson,et al.  Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[18]  H. Barrows,et al.  EDITORIAL: Self-Assessment in Medical Practice: A Further Concern About the Conventional Research Paradigm , 2005, Teaching and learning in medicine.

[19]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[20]  Daniel B. Raemer,et al.  There's No Such Thing as “Nonjudgmental” Debriefing: A Theory and Method for Debriefing with Good Judgment , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[21]  Roger Chow,et al.  Value of Debriefing during Simulated Crisis Management: Oral versus Video-assisted Oral Feedback , 2006, Anesthesiology.

[22]  Rhona Flin,et al.  Safety at the Sharp End: A Guide to Non-Technical Skills , 2008 .

[23]  Glenn Regehr,et al.  "I'll never play professional football" and other fallacies of self-assessment. , 2008, The Journal of continuing education in the health professions.

[24]  Maddalena Taras Summative assessment: the missing link for formative assessment , 2009 .

[25]  Vicki R LeBlanc,et al.  Personalized Oral Debriefing Versus Standardized Multimedia Instruction After Patient Crisis Simulation , 2009, Anesthesia and analgesia.

[26]  Viren N. Naik,et al.  Simulation-based Training Improves Physicians' Performance in Patient Care in High-stakes Clinical Setting of Cardiac Surgery , 2010, Anesthesiology.