Pilot Testing of a Model for Insurer-Driven, Large-Scale Multicenter Simulation Training for Operating Room Teams

Objective:To test the feasibility of implementing a standardized teamwork training program with full operating room teams in multiple institutions, driven by malpractice insurer support and incentives. Background:Failures in intraoperative teamwork are among the leading causes of preventable patient injury and death in surgical patients. Teamwork training, particularly using simulation, can be an effective intervention but is difficult to scale. Methods:A malpractice insurer convened a collaborative with 4 Harvard-affiliated simulation programs to develop a standardized operating room teamwork training curriculum, including principles of communication, assertiveness, and use of the World Health Organization Surgical Safety Checklist. Participant teams were compensated for lost operative time via malpractice premium discounts, continuing education credits, and compensation for lost wages. The course was delivered through a simulation program involving the management of intraoperative emergency scenarios. Participants were surveyed for their perceptions of the program and of its impact on clinical practice. Results:A total of 221 active operating room staff members participated in the program. Each team contained at least 1 attending surgeon, 1 attending anesthesiologist, and 1 operating room nurse (mean size per team: 7 ± 2 participants). No study dates were cancelled because of lack of attendance. The survey response rate was 99% (218/221). Overall, the vast majority of participants found the scenarios realistic [94% (95% confidence interval: 90.9%, 97.2%)], appropriately challenging [95.4% (92.6%, 98.2%)], relevant to their practice [96.3% (93.8%, 98.8%)], and found the training would help them provide safer patient care [92.6% (89.1%, 96.1%)]. Surgeons reported their greatest personal deficit as communication skills. Operating room nurses and anesthesiologists reported a greater need than surgeons to work on personal assertiveness. Conclusions:A standardized multicenter team training program involving full operative teams is feasible with high-fidelity simulation and modest compensation for lost time. The vast majority of the multidisciplinary participants believed the course to have had a meaningful impact on their approach to clinical practice.

[1]  Lorri A. Lee,et al.  Liability Associated with Obstetric Anesthesia: A Closed Claims Analysis , 2009, Anesthesiology.

[2]  Suzette Woodward,et al.  Patient Safety (2nd edn) , 2011 .

[3]  Nick Sevdalis,et al.  Factors compromising safety in surgery: stressful events in the operating room. , 2010, American journal of surgery.

[4]  Douglas A. Wiegmann,et al.  Identifying methods to improve heart surgery: an operative approach and strategy for implementation on an organizational level. , 2008, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[5]  Rosemarie Fernandez,et al.  The use of simulation in emergency medicine: a research agenda. , 2007, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[6]  R S Newbower,et al.  Preventable anesthesia mishaps: a study of human factors* , 1978, Anesthesiology.

[7]  J. Birkmeyer.  Strategies for improving surgical quality--checklists and beyond. , 2010, The New England journal of medicine.

[8]  Catherine Yoon,et al.  Analysis of surgical errors in closed malpractice claims at 4 liability insurers. , 2006, Surgery.

[9]  H A Schwid,et al.  Anesthesiologists' management of simulated critical incidents. , 1992, Anesthesiology.

[10]  K. Posner,et al.  Violations of Behavioral Practices Revealed in Closed Claims Reviews , 2008, Annals of surgery.

[11]  Daniel B. Jones.  The Current Role of Simulators in Teaching Surgical Techniques , 2011, Journal of Gastrointestinal Surgery.

[12]  J. Neily,et al.  Association between implementation of a medical team training program and surgical mortality. , 2010, JAMA.

[13]  D. Gaba,et al.  A comprehensive anesthesia simulation environment: re-creating the operating room for research and training. , 1988, Anesthesiology.

[14]  W. J. Russell,et al.  The ‘'Wrong Drug” Problem in Anaesthesia: An Analysis of 2000 Incident Reports , 1993, Anaesthesia and intensive care.

[15]  E. D. de Vries,et al.  Effect of a comprehensive surgical safety system on patient outcomes. , 2010, The New England journal of medicine.

[16]  Daniel B. Raemer,et al.  There's No Such Thing as “Nonjudgmental” Debriefing: A Theory and Method for Debriefing with Good Judgment , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[17]  Daniel B. Jones,et al.  Integrating Simulation in Surgery as a Teaching Tool and Credentialing Standard , 2008, Journal of Gastrointestinal Surgery.

[18]  David M Gaba,et al.  So many roads: facilitated debriefing in healthcare. , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[19]  P. McCulloch,et al.  Teamwork and Error in the Operating Room: Analysis of Skills and Roles , 2008, Annals of surgery.

[20]  Douglas A Wiegmann,et al.  Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. , 2007, Surgery.

[21]  W. Berry,et al.  Educational program in crisis management for cardiac surgery teams including high realism simulation. , 2012, The Journal of thoracic and cardiovascular surgery.

[22]  Shawn Tsuda,et al.  Malpractice carrier underwrites Fundamentals of Laparoscopic Surgery training and testing: a benchmark for patient safety , 2010, Surgical Endoscopy.

[23]  Daniel B. Jones,et al.  Simulation and OR Team Performance , 2012 .

[24]  Stephanie Guerlain,et al.  RATE: an ethnographic data collection and review system. , 2008, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[25]  Ara Darzi,et al.  Surgical Crisis Management Skills Training and Assessment: A Stimulation-Based Approach to Enhancing Operating Room Performance , 2006 .

[26]  Thoralf M Sundt,et al.  Teamwork and communication in the operating room: relationship to discrete outcomes and research challenges. , 2011, Anesthesiology clinics.

[27]  T H Kappen,et al.  Effects of the Introduction of the WHO “Surgical Safety Checklist” on In-Hospital Mortality: A Cohort Study , 2012, Annals of surgery.

[28]  Stuart R. Lipsitz,et al.  Patterns of Technical Error Among Surgical Malpractice Claims: An Analysis of Strategies to Prevent Injury to Surgical Patients , 2007, Annals of surgery.

[29]  Jeffrey B Cooper,et al.  Crisis resource management training for an anaesthesia faculty: a new approach to continuing education , 2004, Medical education.

[30]  David M. Gaba,et al.  Simulation-Based Training in Anesthesia Crisis Resource Management (ACRM): A Decade of Experience , 2001 .

[31]  D. Shannon.  How a Captive Insurer Uses Data and Incentives to Advance Patient Safety , 2009 .

[32]  D M Gaba,et al.  Improving anesthesiologists' performance by simulating reality. , 1992, Anesthesiology.

[33]  Ian Curran,et al.  Simulation-Based Team Training in Healthcare , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[34]  K. T. Fong,et al.  Surgical team behaviors and patient outcomes. , 2009, American journal of surgery.

[35]  Daniel B Raemer,et al.  Simulation in obstetrics and gynecology. , 2008, Obstetrics and gynecology clinics of North America.

[36]  A. Darzi,et al.  The simulated operating theatre: comprehensive training for surgical teams , 2004, Quality and Safety in Health Care.

[37]  T. K. Harrison,et al.  Coordination Patterns Related to High Clinical Performance in a Simulated Anesthetic Crisis , 2009, Anesthesia and analgesia.

[38]  T. K. Harrison,et al.  Use of Cognitive Aids in a Simulated Anesthetic Crisis , 2006, Anesthesia and analgesia.

[39]  Stuart R Lipsitz,et al.  Patterns of communication breakdowns resulting in injury to surgical patients. , 2007, Journal of the American College of Surgeons.

[40]  Nick Sevdalis,et al.  Multidisciplinary Crisis Simulations: The Way Forward for Training Surgical Teams , 2007, World Journal of Surgery.

[41]  S. Lipsitz,et al.  A novel method for reproducibly measuring the effects of interventions to improve emotional climate, indices of team skills and communication, and threat to patient outcome in a high-volume thoracic surgery center. , 2010, Archives of surgery.

[42]  Peter Weinstock,et al.  Using Medical Simulation to Teach Crisis Resource Management and Decision-Making Skills to Otolaryngology Housestaff , 2011, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[43]  D. Gaba,et al.  Assessment of Clinical Performance during Simulated Crises Using Both Technical and Behavioral Ratings , 1998, Anesthesiology.

[44]  Peter E. Rivard,et al.  Debriefing with good judgment: combining rigorous feedback with genuine inquiry. , 2007, Anesthesiology clinics.

[45]  J. Reason,et al.  Human factors and cardiac surgery: a multicenter study. , 2000, The Journal of thoracic and cardiovascular surgery.

[46]  P. Myles,et al.  Analysis of demographic characteristics. , 1994, Anaesthesia and intensive care.

[47]  Ruth Kanfer,et al.  Simulation-Based Crisis Team Training for Multidisciplinary Obstetric Providers , 2009, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[48]  Rhona Flin,et al.  Evaluation of the Scrub Practitioners' List of Intraoperative Non-Technical Skills system. , 2012, International journal of nursing studies.

[49]  P. Benneworth.  There's no such thing as [...] , 2014 .

[50]  Stephanie Guerlain,et al.  Assessing team performance in the operating room: development and use of a "black-box" recorder and other tools for the intraoperative environment. , 2005, Journal of the American College of Surgeons.

[51]  Robert Simon,et al.  Debriefing as formative assessment: closing performance gaps in medical education. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[52]  Emilie M. Roth,et al.  War stories: a qualitative analysis of narrative teaching strategies in the operating room. , 2012, American journal of surgery.

[53]  Rhona Flin,et al.  Non-technical skills for anaesthetists: developing and applying ANTS. , 2011, Best practice & research. Clinical anaesthesiology.

[54]  A. Arriaga,et al.  Postgame analysis: using video-based coaching for continuous professional development. , 2012, Journal of the American College of Surgeons.

[55]  Robert Hanscom,et al.  Medical simulation from an insurer's perspective. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[56]  Rhona Flin,et al.  Surgeons’ Non-technical Skills in the Operating Room: Reliability Testing of the NOTSS Behavior Rating System , 2008, World Journal of Surgery.

[57]  Daniel B. Jones,et al.  Simulated laparoscopic operating room crisis: An approach to enhance the surgical team performance , 2008, Surgical Endoscopy.

[58]  S D Small,et al.  Anesthesia crisis resource management: real-life simulation training in operating room crises. , 1995, Journal of clinical anesthesia.

[59]  R. Reznick,et al.  Communication failures in the operating room: an observational classification of recurrent types and effects , 2004, Quality and Safety in Health Care.

[60]  J. Cooper,et al.  Are simulation and didactic crisis resource management (CRM) training synergistic? , 2004, Quality and Safety in Health Care.

[61]  Simulated anaesthetic emergencies. , 1997, British journal of anaesthesia.

[62]  Nick Sevdalis,et al.  Observational Teamwork Assessment for Surgery: Construct Validation With Expert Versus Novice Raters , 2009, Annals of surgery.

[63]  Emilie M. Roth,et al.  Protecting Patients From an Unsafe System: The Etiology and Recovery of Intraoperative Deviations in Care , 2012, Annals of surgery.

[64]  W. J. Russell,et al.  The Australian Incident Monitoring Study: An Analysis of 2000 Incident Reports , 1993, Anaesthesia and intensive care.

[65]  Peter H Weinstock,et al.  Simulation at the point of care: Reduced-cost, in situ training via a mobile cart , 2009, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[66]  K Moorthy,et al.  Simulation based training , 2005, BMJ : British Medical Journal.

[67]  V. Nadkarni,et al.  Research Regarding Debriefing as Part of the Learning Process , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[68]  A. Darzi,et al.  Surgical crisis management skills training and assessment: a simulation[corrected]-based approach to enhancing operating room performance. , 2006, Annals of surgery.

[69]  A. Arriaga,et al.  Communication Practices on 4 Harvard Surgical Services: A Surgical Safety Collaborative , 2009, Annals of surgery.

[70]  Eileen Entin,et al.  Video Technology to Advance Safety in the Operating Room and Perioperative Environment , 2007, Surgical innovation.

[71]  Daniel B. Jones,et al.  The SAGES Manual of Quality, Outcomes and Patient Safety , 2011 .

[72]  Yan Xiao,et al.  The Use of Distributed Displays of Operating Room Video When Real-Time Occupancy Status Was Available , 2008, Anesthesia and analgesia.

[73]  Daniel B. Raemer,et al.  The Tumor: A Simulator for Open Surgery , 2006 .

[74]  David M Studdert,et al.  Analysis of errors reported by surgeons at three teaching hospitals. , 2003, Surgery.

[75]  P. McCulloch,et al.  The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre , 2009, Quality & Safety in Health Care.

[76]  Stuart R. Lipsitz,et al.  Simulation-Based Trial of Surgical-Crisis Checklists , 2013 .

[77]  John E. Ziewacz,et al.  Crisis checklists for the operating room: development and pilot testing. , 2011, Journal of the American College of Surgeons.

[78]  R. Simon,et al.  Obstetric Simulation as a Risk Control Strategy: Course Design and Evaluation , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[79]  Jennifer Hayes,et al.  Design and Evaluation of Simulation Scenarios for a Program Introducing Patient Safety, Teamwork, Safety Leadership, and Simulation to Healthcare Leaders and Managers , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[80]  James T. Reason,et al.  Behavioural markers of surgical excellence , 2003 .

[81]  S. Fagan,et al.  Bridging the communication gap in the operating room with medical team training. , 2005, American journal of surgery.

[82]  A. Arriaga,et al.  A Policy-based Intervention for the Reduction of Communication Breakdowns in Inpatient Surgical Care: Results From a Harvard Surgical Safety Collaborative , 2011, Annals of surgery.

[83]  D. Gaba,et al.  The Response of Anesthesia Trainees to Simulated Critical Incidents , 1988, Anesthesia and analgesia.

[84]  W. Berry,et al.  A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population , 2009, The New England journal of medicine.

[85]  Robert M Mentzer,et al.  Risk-adjusted morbidity in teaching hospitals correlates with reported levels of communication and collaboration on surgical teams but not with scale measures of teamwork climate, safety climate, or working conditions. , 2007, Journal of the American College of Surgeons.