Developing an instrument for measuring shared understanding

Shared situation awareness is hard to measure, especially in operative environments such as crisis management. In this paper the purpose is to develop a novel method to measure to what extent the team has shared situation awareness that can be used in operations. 20 two person teams participated in a study where a dynamic and evolving tactical decision-making task was solved. Shared situation awareness, shared priorities, and team performance were assessed. The results show that the shared priorities measure in this study did not relate to shared situation awareness. Several methodological concerns was identified which could have affected the results. The measure did relate to subjective ratings of cooperation which is very interesting and it is suggested that the measure captured aspects of teamwork. The shared priorities measure was easy to employ, required little preparation, and is a promising addition to team research.

[1]  M. Kendall,et al.  The Problem of $m$ Rankings , 1939 .

[2]  Erik Hollnagel,et al.  Pre-requisites for large scale coordination , 2007, Cognition, Technology & Work.

[3]  S. Tremblay.  A Cognitive Approach to Situation Awareness: Theory and Application , 2004 .

[4]  William M. Jones,et al.  Situation Awareness Information Dominance & Information Warfare. , 1997 .

[5]  Marie-Eve Jobidon,et al.  Team Response to Workload Transition: The Role of Team Structure , 2006 .

[6]  E. Salas,et al.  Team cognition : understanding the factors that drive process and performance , 2004 .

[7]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[8]  Rego Granlund,et al.  Monitoring experiences from command and control research with the C3Fire microworld , 2003, Cognition, Technology & Work.

[9]  Björn Johansson,et al.  The communicative aspects of distributed dynamic decision making in the ROLF-environment , 2000 .

[10]  Ida Lindgren,et al.  National Patterns of Teamwork during an Emergency Management Simulation , 2006 .

[11]  Eduardo Salas,et al.  Team Effectiveness in Complex Organizations: Cross-Disciplinary Perspectives and Approaches , 2008 .

[12]  Eduardo Salas,et al.  Team Performance Assessment and Measurement: Theory, Methods, and Applications. Series in Applied Psychology. , 1997 .

[13]  Carol McCann,et al.  The human in command : exploring the modern military experience , 2000 .

[14]  Neville Stanton,et al.  Situation awareness measurement: a review of applicability for C4i environments. , 2006, Applied ergonomics.

[15]  Rego Granlund,et al.  Research on Decision Making and New Technology - Methodological Issues , 2004 .

[16]  Dianne E. Howie,et al.  Measures of operator performance in complex, dynamic microworlds: advancing the state of the art. , 1998, Ergonomics.

[17]  Carol McCann,et al.  The Human in Command , 2000 .

[18]  B. Brehmer,et al.  Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study , 1993 .

[19]  Rego Granlund,et al.  Monitoring distributed teamwork training , 2002 .

[20]  S. Mohammed,et al.  The Measurement of Team Mental Models: We Have No Shared Schema , 2000 .