Use of human patient simulation and validation of the Team Situation Awareness Global Assessment Technique (TSAGAT): a multidisciplinary team assessment tool in trauma education.

OBJECTIVE Situation awareness (SA) is a vital construct for decision making in intense, dynamic environments such as trauma resuscitation. Human patient simulation (HPS) allows for a safe environment where individuals can develop these skills. Trauma resuscitation is performed by multidisciplinary teams that are traditionally difficult to globally assess. Our objective was to create and validate a novel tool to measure SA in multidisciplinary trauma teams using a HPS--the Team Situation Awareness Global Assessment Technique (TSAGAT). SETTING Memorial University Simulation Centre. DESIGN/PARTICIPANTS Using HPS, 4 trauma teams completed 2 separate trauma scenarios. Student, junior resident, senior resident, and attending staff teams each had 3 members (trauma team leader, nurse, and airway manager). Individual SAGATs were developed by experts in each respective field and contained shared and complimentary knowledge questions. Teams were assessed with SAGAT in real time and with traditional checklists using video review. TSAGAT was calculated as the sum of individual SAGAT scores and was compared with the traditional checklist scores. RESULTS Shared, complimentary, and TSAGAT scores improved with increasing team experience. Differences between teams for TSAGAT and complimentary knowledge were statistically significant (p < 0.05). Mean checklist differences between teams also reached statistical significance (p < 0.05). TSAGAT scores correlated strongly with traditional checklist scores (Pearson correlation r = 0.996). Interrater reliability for the checklist tool was high (Pearson correlation r = 0.937). CONCLUSION TSAGAT is the first valid and reliable assessment tool incorporating SA and HPS for multidisciplinary team performance in trauma resuscitation. TSAGAT could compliment or improve on current assessment methods and curricula in trauma and critical care and provides a template for team assessment in other areas of surgical education.

[1]  Ronald D. Miller.  Miller's Anesthesia , 2005 .

[2]  M. Endsley,et al.  Objective measures of situation awareness in a simulated medical environment , 2004, Quality and Safety in Health Care.

[3]  M. Chiarugi,et al.  ATLS STUDENT COURSE MANUAL , 1997 .

[4]  P. Barash,et al.  Clinical Anesthesia for the PDA: Powered by Skyscape, Inc. , 2005 .

[5]  David J Lockey,et al.  The performance and assessment of hospital trauma teams , 2010, Scandinavian journal of trauma, resuscitation and emergency medicine.

[6]  Christopher P. Nemeth,et al.  Improving Healthcare Team Communication : Building on Lessons from Aviation and Aerospace , 2017 .

[7]  J. Ali,et al.  Effect of the Advanced Trauma Life Support program on medical students' performance in simulated trauma patient management. , 1998, The Journal of trauma.

[8]  D. Gaba,et al.  Trauma assessment training with a patient simulator: a prospective, randomized study. , 2003, The Journal of trauma.

[9]  E. Petrusa,et al.  Assessing teamwork in medical education and practice: Relating behavioural teamwork ratings and clinical performance , 2009, Medical teacher.

[10]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[11]  D. Boone,et al.  Use of human patient simulation and the situation awareness global assessment technique in practical trauma skills assessment. , 2006, The Journal of trauma.

[12]  M. Endsley,et al.  Building Shared Situation Awareness in Healthcare Settings , 2017 .

[13]  J. G. West,et al.  Systems of trauma care. A study of two counties. , 1979, Archives of surgery.

[14]  J. Woodhouse,et al.  Acute Care Skills in Anesthesia Practice: A Simulation-based Resident Performance Assessment , 2004, Anesthesiology.

[15]  R. Reznick,et al.  Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examination , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[16]  T. Krummel,et al.  Use of a human patient simulator in the development of resident trauma management skills. , 2001, The Journal of trauma.

[17]  Mica R. Endsley,et al.  Direct Measurement of Situation Awareness: Validity and Use of SAGAT , 2000 .

[18]  V. Rahimi-Movaghar,et al.  Effect of Advanced Trauma Life Support program on medical interns' performance in simulated trauma patient management. , 2013, Chinese journal of traumatology = Zhonghua chuang shang za zhi.

[19]  Kenji Hira,et al.  Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training. , 2002, The Journal of trauma.