Teamwork Assessment Tools in Modern Surgical Practice: A Systematic Review

Introduction. Deficiencies in teamwork skills have been shown to contribute to the occurrence of adverse events during surgery. Consequently, several teamwork assessment tools have been developed to evaluate trainee nontechnical performance. This paper aims to provide an overview of these instruments and review the validity of each tool. Furthermore, the present paper aims to review the deficiencies surrounding training and propose several recommendations to address these issues. Methods. A systematic literature search was conducted to identify teamwork assessment tools using MEDLINE (1946 to August 2015), EMBASE (1974 to August 2015), and PsycINFO (1806 to August 2015) databases. Results. Eight assessment tools which encompass aspects of teamwork were identified. The Nontechnical Skills for Surgeons (NOTSS) assessment was found to possess the highest level of validity from a variety of sources; reliability and acceptability have also been established for this tool. Conclusions. Deficits in current surgical training pathways have prompted several recommendations to meet the evolving requirements of surgeons. Recommendations from the current paper include integration of teamwork training and assessment into medical school curricula, standardised formal training of assessors to ensure accurate evaluation of nontechnical skill acquisition, and integration of concurrent technical and nontechnical skills training throughout training.

[1]  P. McCulloch,et al.  The effects of aviation-style non-technical skills training on technical performance and outcome in the operating theatre , 2009, Quality & Safety in Health Care.

[2]  J. Archer,et al.  Initial evaluation of the first year of the Foundation Assessment Programme , 2009, Medical education.

[3]  Ara Darzi,et al.  Observational Assessment of Surgical Teamwork: A Feasibility Study , 2006, World Journal of Surgery.

[4]  N. Sevdalis,et al.  67 Crisis simulations for robotic procedures: Development of a training module and initial results , 2012 .

[5]  Rhona Flin,et al.  Evaluation of the Scrub Practitioners' List of Intraoperative Non-Technical Skills system. , 2012, International journal of nursing studies.

[6]  A. Spigelman.  Consultant surgeons' opinion of the skills required of basic surgical trainees , 2000, The British journal of surgery.

[7]  Hao-min Cheng,et al.  Assessment of first-year post-graduate residents: Usefulness of multiple tools , 2011, Journal of the Chinese Medical Association.

[8]  J. Neily,et al.  Association between implementation of a medical team training program and surgical mortality. , 2010, JAMA.

[9]  Nicole K Roberts,et al.  A surgical simulation curriculum for senior medical students based on TeamSTEPPS. , 2012, Archives of surgery.

[10]  W. Marsden.  I and J , 2012 .

[11]  P. McCulloch,et al.  The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre , 2009, Quality & Safety in Health Care.

[12]  R. Flin,et al.  Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. , 2003, British journal of anaesthesia.

[13]  Nick Sevdalis,et al.  Self vs expert assessment of technical and non-technical skills in high fidelity simulation. , 2011, American journal of surgery.

[14]  S Undre,et al.  Developing observational measures of performance in surgical teams , 2004, Quality and Safety in Health Care.

[15]  J. Beard,et al.  Prospective observational study to evaluate NOTSS (Non‐Technical Skills for Surgeons) for assessing trainees' non‐technical performance in the operating theatre , 2011, The British journal of surgery.

[16]  Trudie Roberts,et al.  Evaluating the utility of workplace-based assessment tools for speciality training. , 2010, Best practice & research. Clinical obstetrics & gynaecology.

[17]  R Flin,et al.  Development of a rating system for surgeons' non‐technical skills , 2006, Medical education.

[18]  Mohsen Tavakol,et al.  Assessing the skills of surgical residents using simulation. , 2008, Journal of surgical education.

[19]  I. Eardley,et al.  Workplace‐based assessment in surgical training: experiences from the Intercollegiate Surgical Curriculum Programme , 2013, ANZ journal of surgery.

[20]  Nick Sevdalis,et al.  Training Faculty in Nontechnical Skill Assessment: National Guidelines on Program Requirements , 2013, Annals of surgery.

[21]  S. Paterson-Brown,et al.  Feasibility, reliability and validity of a new assessment form for use with basic surgical trainees. , 2001, American journal of surgery.

[22]  P. Barach,et al.  Assessing and improving teamwork in cardiac surgery , 2010, Quality and Safety in Health Care.

[23]  Rhona Flin,et al.  Rating non-technical skills: developing a behavioural marker system for use in anaesthesia , 2004, Cognition, Technology & Work.

[24]  Nick Sevdalis,et al.  Observational Teamwork Assessment for Surgery: Construct Validation With Expert Versus Novice Raters , 2009, Annals of surgery.

[25]  Rhona Flin,et al.  Evaluation of the Scrub Practitioners ’ List of Intraoperative Non-Technical Skills ( SPLINTS ) system , 2012 .

[26]  Nick Sevdalis,et al.  The impact of nontechnical skills on technical performance in surgery: a systematic review. , 2012, Journal of the American College of Surgeons.

[27]  Peter Jaye,et al.  Development and implementation of centralized simulation training: evaluation of feasibility, acceptability and construct validity , 2013, BJU international.

[28]  David M Studdert,et al.  Analysis of errors reported by surgeons at three teaching hospitals. , 2003, Surgery.

[29]  H Purdie,et al.  Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. , 2011, Health technology assessment.

[30]  D. P. Baker,et al.  Teamwork as an essential component of high-reliability organizations. , 2006, Health services research.

[31]  Nick Sevdalis,et al.  Observational Teamwork Assessment for Surgery (OTAS): Refinement and Application in Urological Surgery , 2007, World Journal of Surgery.

[32]  Rhona Flin,et al.  Surgeons’ Non-technical Skills in the Operating Room: Reliability Testing of the NOTSS Behavior Rating System , 2008, World Journal of Surgery.

[33]  K. T. Fong,et al.  Surgical team behaviors and patient outcomes. , 2009, American journal of surgery.

[34]  C. Violato,et al.  Multisource feedback: a method of assessing surgical practice , 2003, BMJ : British Medical Journal.

[35]  C. Sundaram,et al.  Towards a standardised training curriculum for robotic surgery , 2015, BJU international.

[36]  Ara Darzi,et al.  Effectiveness of procedural simulation in urology: a systematic review. , 2011, The Journal of urology.

[37]  H Ashrafian,et al.  Safety of training and assessment in operating theatres – a systematic review and meta-analysis , 2013, Perfusion.

[38]  A. Darzi,et al.  The simulated operating theatre: comprehensive training for surgical teams , 2004, Quality and Safety in Health Care.

[39]  Nick Sevdalis,et al.  Observational teamwork assessment for surgery: content validation and tool refinement. , 2011, Journal of the American College of Surgeons.

[40]  Rhona Flin,et al.  Experience matters: comparing novice and expert ratings of non‐technical skills using the NOTSS system , 2009, ANZ journal of surgery.

[41]  A. Kennedy,et al.  Coping with stress in surgery: the difficulty of measuring non-technical skills , 2011, Irish journal of medical science.

[42]  Eva Kassab,et al.  Distributed Simulation in surgical training: An off-site feasibility study , 2013, Medical teacher.

[43]  Rhona Flin,et al.  Development of a behavioural marker system for scrub practitioners' non-technical skills (SPLINTS system). , 2013, Journal of evaluation in clinical practice.

[44]  R. Flin,et al.  Non-technical skills for surgeons in the operating room: a review of the literature. , 2006, Surgery.