Objective measures of situation awareness in a simulated medical environment

One major limitation in the use of human patient simulators is a lack of objective, validated measures of human performance. Objective measures are necessary if simulators are to be used to evaluate the skills and training of medical practitioners and teams or to evaluate the impact of new processes or equipment design on overall system performance. Situation awareness (SA) refers to a person’s perception and understanding of their dynamic environment. This awareness and comprehension is critical in making correct decisions that ultimately lead to correct actions in medical care settings. An objective measure of SA may be more sensitive and diagnostic than traditional performance measures. This paper reviews a theory of SA and discusses the methods required for developing an objective measure of SA within the context of a simulated medical environment. Analysis and interpretation of SA data for both individual and team performance in health care are also presented.

[1]  Laura D. Strater,et al.  PC-Based Tools to Improve Infantry Situation Awareness , 2004 .

[2]  H. Schwid,et al.  Evaluation of Anesthesia Residents Using Mannequin-based Simulation: A Multiinstitutional Study , 2002, Anesthesiology.

[3]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[4]  Mica R. Endsley,et al.  General Aviation Pilot Training for Situation Awareness: An Evaluation , 2002 .

[5]  Yinqi Zhang,et al.  Effects of Integrated Graphical Displays on Situation Awareness in Anaesthesiology , 2002, Cognition, Technology & Work.

[6]  Frank A Drews,et al.  Development and Evaluation of a Graphical Anesthesia Drug Display , 2002, Anesthesiology.

[7]  A F Merry,et al.  Evaluation in an anaesthetic simulator of a prototype of a new drug administration system designedto reduce error* , 2002, Anaesthesia.

[8]  Pamela J Morgan,et al.  Simulation Technology: A Comparison of Experiential and Visual Learning for Undergraduate Medical Students , 2002, Anesthesiology.

[9]  D. Gaba.  Two examples of how to evaluate the impact of new approaches to teaching. , 2002, Anesthesiology.

[10]  T. Krummel,et al.  Use of a human patient simulator in the development of resident trauma management skills. , 2001, The Journal of trauma.

[11]  Laura D. Strater,et al.  Measures of Platoon Leader Situation Awareness in Virtual Decision-Making Exercises , 2001 .

[12]  Mica R. Endsley,et al.  Designing for Situation Awareness in Complex System , 2001 .

[13]  Mica R. Endsley,et al.  Analysis of Situation Awareness from Critical Incident Reports , 2000 .

[14]  Mica R. Endsley,et al.  Situation Awareness Problems in General Aviation , 2000 .

[15]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[16]  Don R. Lyon,et al.  Using Observer Ratings to Assess Situation Awareness , 2000 .

[17]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[18]  Mica R. Endsley,et al.  Direct Measurement of Situation Awareness: Validity and Use of SAGAT , 2000 .

[19]  Akiko Nakata,et al.  Situation awareness in air traffic control : enhanced displays for advanced operations , 2000 .

[20]  D. Gaba,et al.  USE OF TASK ANALYSIS TO EVALUATE THE EFFECTS OF FATIGUE ON PERFORMANCE DURING SIMULATED ANESTHESIA CASES , 1998 .

[21]  David M. Gaba,et al.  Assessment of Clinical Performance during Simulated Crises Using Both Technical and Behavioral Ratings , 1998, Anesthesiology.

[22]  D. Murray.  Clinical simulation: technical novelty or innovation in education. , 1998, Anesthesiology.

[23]  A J Byrne,et al.  Errors on anaesthetic record charts as a measure of anaesthetic performance during simulated critical incidents. , 1998, British journal of anaesthesia.

[24]  Kenneth R. Allendoerfer,et al.  Effect of Free Flight Conditions on Controller Performance, Workload, and Situation Awareness , 1997 .

[25]  Mica R. Endsley,et al.  Experimental Analysis and Measurement of Situation Awareness , 1995 .

[26]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[27]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[28]  David M. Gaba,et al.  Situation Awareness in Anesthesiology , 1995, Hum. Factors.

[29]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[30]  J Spierdijk,et al.  Does training on an anaesthesia simulator lead to improvement in performance? , 1994, British journal of anaesthesia.

[31]  Marilyn Sue Bogner,et al.  Human Error in Medicine , 1995 .

[32]  R. M. Taylor,et al.  Workload or Situational Awareness?: TLX vs. SART for Aerospace Systems Design Evaluation , 1991 .

[33]  E. N. Corlett,et al.  Evaluation of human work : a practical ergonomics methodology , 1991 .

[34]  Mica R. Endsley,et al.  Predictive Utility of an Objective Measure of Situation Awareness , 1990 .

[35]  David Woods,et al.  Situation Awareness: A Critical But Ill-Defined Phenomenon , 1991 .

[36]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[37]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[38]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .