Use of human patient simulation and the situation awareness global assessment technique in practical trauma skills assessment.

BACKGROUND Situation awareness (SA) is defined as the perception of elements in the environment within a volume of time and space, the comprehension of their meaning, and the projection of their status in the near future. This construct is vital to decision making in intense, dynamic environments. It has been used in aviation as it relates to pilot performance, but has not been applied to medical education. The most widely used objective tool for measuring trainee SA is the Situation Awareness Global Assessment Technique (SAGAT). The purpose of this study was to design and validate SAGAT for assessment of practical trauma skills, and to compare SAGAT results to traditional checklist style scoring. METHODS Using the Human Patient Simulator, we designed SAGAT for practical trauma skills assessment based on Advanced Trauma Life Support objectives. Sixteen subjects (four staff surgeons, four senior residents, four junior residents, and four medical students) participated in three scenarios each. They were assessed using SAGAT and traditional checklist assessment. A questionnaire was used to assess possible confounding factors in attaining SA and overall trainee satisfaction. RESULTS SAGAT was found to show significant difference (analysis of variance; p < 0.001) in scores based on level of training lending statistical support to construct validity. SAGAT was likewise found to display reliability (Cronbach's alpha 0.767), and significant scoring correlation with traditional checklist performance measures (Pearson's coefficient 0.806). The questionnaire revealed no confounding factors and universal satisfaction with the human patient simulator and SAGAT. CONCLUSIONS SAGAT is a valid, reliable assessment tool for trauma trainees in the dynamic clinical environment created by human patient simulation. Information provided by SAGAT could provide specific feedback, direct individualized teaching, and support curriculum change. Introduction of SAGAT could improve the current assessment model for practical trauma education.

[1]  M. Endsley,et al.  Individual Differences in Pilot Situation Awareness , 1994 .

[2]  R. Reznick.  Surgical simulation: a vital part of our future. , 2005, Annals of surgery.

[3]  Jameel Ali,et al.  Teaching Effectiveness of the Advanced Trauma Life Support Program as Demonstrated by an Objective Structured Clinical Examination for Practicing Physicians , 1996, World Journal of Surgery.

[4]  R. Reznick,et al.  Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examination , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[5]  J. Ali,et al.  Effect of the Advanced Trauma Life Support program on medical students' performance in simulated trauma patient management. , 1998, The Journal of trauma.

[6]  D. Gaba,et al.  Trauma assessment training with a patient simulator: a prospective, randomized study. , 2003, The Journal of trauma.

[7]  G. Regehr,et al.  OSCE checklists do not capture increasing levels of expertise. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[8]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[9]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[10]  Brian Hodges,et al.  Analytic global OSCE ratings are sensitive to level of training , 2003, Medical education.

[11]  Kenji Hira,et al.  Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training. , 2002, The Journal of trauma.

[12]  M. Endsley,et al.  Objective measures of situation awareness in a simulated medical environment , 2004, Quality and Safety in Health Care.

[13]  André De Champlain,et al.  Assessment of patient management skills and clinical skills of practising doctors using computer‐based case simulations and standardised patients , 2004, Medical education.