Implementation of an Effective Strategy for Teaching Nontechnical Skills in the Operating Room: A Single-blinded Nonrandomized Trial

Objective:To evaluate the effectiveness of debriefing and feedback on intraoperative nontechnical performance as an instructional strategy in surgical training. Background:Regulatory authorities for accreditation in North America have included nontechnical skills such as communication and teamwork in the competencies to be acquired by surgical residents before graduation. Concrete recommendations regarding the training and assessment of these competencies, however, are lacking. Methods:Nonrandomized, single-blinded study using an interrupted time-series design. Eleven senior surgical residents were observed during routine cases in the operating room (OR) at baseline and post-training. The Non-Technical Skills for Surgeons (NOTSS) rating system was used. Observers were trained in NOTSS and blinded to the study purpose. Independent of the blinded observations, a surgeon educator conducted intraoperative observations, which served as the basis for the structured debriefing and feedback intervention. The intervention was administered to participants after a set of (blinded) baseline observations had been completed. Primary outcome was nontechnical performance in the OR as measured by the NOTSS system. Secondary outcome was perceived utility as assessed by a post-training questionnaire. Results:Twelve senior trainees were recruited, 11 completed the study. Average NOTSS scores improved significantly from 3.2 (SD 0.37) at baseline to 3.5 (SD 0.43) post-training [t(10) = −2.55, P = 0.29]. All participants felt the intervention was useful, and the majority thought that debriefing and feedback on nontechnical skills should be integrated in surgical training. Conclusions:Debriefing and feedback in the OR may represent an effective strategy to ensure development of nontechnical skills in competency-based education.

[1]  Linda C. Lederman,et al.  Debriefing: A Critical Reexamination of the Postexperience Analytic Process with Implications for Its Effective Use. , 1984 .

[2]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[3]  J. Beard,et al.  Evaluation of procedure‐based assessment for assessing trainees' skills in the operating theatre , 2011, The British journal of surgery.

[4]  Jason H. Szostek,et al.  Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis , 2013, Medical teacher.

[5]  D. Kolb Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[6]  F. Hafferty Beyond curriculum reform: confronting medicine's hidden curriculum , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[7]  Rhona Flin,et al.  Surgeons’ Non-technical Skills in the Operating Room: Reliability Testing of the NOTSS Behavior Rating System , 2008, World Journal of Surgery.

[8]  Jonathan Sherbino,et al.  The role of assessment in competency-based medical education , 2010, Medical teacher.

[9]  E. Petrusa,et al.  Practicality of intraoperative teamwork assessments. , 2014, The Journal of surgical research.

[10]  A. Scherpbier,et al.  How residents learn: qualitative evidence for the pivotal role of clinical activities , 2007, Medical education.

[11]  Nick Sevdalis,et al.  Training Faculty in Nontechnical Skill Assessment: National Guidelines on Program Requirements , 2013, Annals of surgery.

[12]  David M. Gaba,et al.  The Role of Debriefing in Simulation-Based Learning , 2007, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[13]  Robert Simon,et al.  Debriefing as formative assessment: closing performance gaps in medical education. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[14]  Teodor P. Grantcharov,et al.  The impact of objective assessment and constructive feedback on improvement of laparoscopic performance in the operating room , 2007, Surgical Endoscopy.

[15]  P. McCulloch,et al.  The influence of non-technical performance on technical outcome in laparoscopic cholecystectomy , 2007, Surgical Endoscopy.

[16]  Rhona Flin,et al.  Debriefing surgeons on non-technical skills (NOTSS) , 2008, Cognition, Technology & Work.

[17]  R. Chung How much time do surgical residents need to learn operative surgery? , 2005, American journal of surgery.

[18]  Gerald Häubl,et al.  Motivation by Anticipation , 2010, Psychological science.

[19]  T. Grantcharov,et al.  Structured Training to Improve Nontechnical Performance of Junior Surgical Residents in the Operating Room: A Randomized Controlled Trial. , 2016, Annals of surgery.

[20]  J. Portelli,et al.  Exposing the Hidden Curriculum. , 1993 .

[21]  J. Ende Feedback in clinical medical education. , 1983, JAMA.

[22]  R. Duvivier,et al.  Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 Conference , 2011, Medical teacher.

[23]  I. Eardley,et al.  Workplace‐based assessment in surgical training: experiences from the Intercollegiate Surgical Curriculum Programme , 2013, ANZ journal of surgery.

[24]  J. Beard,et al.  Prospective observational study to evaluate NOTSS (Non‐Technical Skills for Surgeons) for assessing trainees' non‐technical performance in the operating theatre , 2011, The British journal of surgery.

[25]  B. Zevin Design and Validation of a Comprehensive Simulation-enhanced Training Curriculum for a Complex Minimally Invasive Operation , 2014 .

[26]  James T. Reason,et al.  Behavioural markers of surgical excellence , 2003 .

[27]  K. T. Fong,et al.  Surgical team behaviors and patient outcomes. , 2009, American journal of surgery.

[28]  J. Rosenberg,et al.  Comprehensive feedback on trainee surgeons’ non-technical skills , 2015, International journal of medical education.

[29]  Heinrich Husslein,et al.  Objective structured assessment of nontechnical skills: Reliability of a global rating scale for the in-training assessment in the operating room. , 2015, Surgery.