Supporting situation awareness: A tradeoff between benefits and overhead

The prevalence of surveillance and information collection technologies provides decision-makers with greater volume and complexity of information to monitor and on which to base decisions than ever before. In this ever increasing dynamic and information rich environment, the role for decision support systems (DSS) to augment cognition and situation awareness (SA) is becoming crucial. However, unless a better understanding is gained of the factors that promote SA without interfering with other critical cognitive functions, the design and development of such technology may serve only to exacerbate rather than enhance the desired effect. The present study investigates how DSS designed to support particular aspects of SA may affect task performance. In the context of a functional computer-controlled simulation of single ship naval anti-air warfare, a baseline condition was compared to two conditions in which a DSS was integrated to the original interface to support different facets of SA. Participants in the two DSS conditions showed an increased SA level, as measured by the QUASA technique, compared to those in the control condition. Despite this benefit, the two DSS actually lead to a reduced performance, as indexed by defense effectiveness. These findings suggest that the benefits of DSS in terms of SA may be accompanied by an overhead with adverse effects on task performance, particularly in situations of high cognitive load and time constraints. This calls for more holistic evaluations of the cognitive impacts of decision support technologies and the development of methods to simultaneously address competing constraints when designing DSS.

[1]  Graham K Edgar,et al.  QUASA: Quantifying and analysing situational awareness , 2000 .

[2]  Cleotilde Gonzalez,et al.  The use of microworlds to study dynamic decision making , 2005, Comput. Hum. Behav..

[3]  Harvey S. Smallman,et al.  Recovery from Interruptions to a Dynamic Monitoring Task: The Beguiling Utility of Instant Replay , 2005 .

[4]  David Woods,et al.  Generic Support Requirements for Cognitive Work: Laws that Govern Cognitive Work in Action , 2005 .

[5]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[6]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[7]  B. McGuinness,et al.  Quantitative Analysis of Situational Awareness (QUASA): Applying Signal Detection Theory to True/False Probes and Self-Ratings , 2004 .

[8]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[9]  James Moffat,et al.  NATO NEC C2 Maturity Model , 2010 .

[10]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[11]  Emilie M. Roth,et al.  Evaluating the Effectiveness of a Joint Cognitive System: Metrics, Techniques, and Frameworks , 2006 .

[12]  Mark W. Wiggins,et al.  Polychronicity and Information Acquisition in Pilot Decision Making , 2008 .

[13]  E. M. Roth,et al.  Chapter 1 – Cognitive Systems Engineering , 1988 .

[14]  Daniel Lafond,et al.  A Cognitive and Holistic Approach to Developing Metrics for Decision Support Incommand and Control , 2010 .

[15]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[16]  John J. Garstka Network Centric Operations Conceptual Framework Version 1.0 , 2003 .

[17]  Adel Guitouni,et al.  The role of metacognition in the relationship between objective and subjective measures of situation awareness , 2010 .

[18]  Daniel Lafond,et al.  Assessing temporal support for dynamic decision making in C2 , 2007 .

[19]  N. Stanton,et al.  Is situation awareness all in the mind? , 2010 .

[20]  Graham K Edgar,et al.  Using Signal Detection Theory to Measure Situation Awareness: The Technique, The Tool (QUASATM), the Test, the Way Forward , 2006 .

[21]  Mica R. Endsley,et al.  Direct Measurement of Situation Awareness: Validity and Use of SAGAT , 2000 .

[22]  Erik Hollnagel,et al.  Cognitive Systems Engineering: New wine in new bottles , 1999, Int. J. Hum. Comput. Stud..

[23]  Bruce A. Chalmers Supporting Threat Response Management in a Tactical Naval Environment , 2003 .

[24]  F. Javier Lerch,et al.  Cognitive Support for Real-Time Dynamic Decision Making , 2001, Inf. Syst. Res..

[25]  Neville Stanton,et al.  Situation awareness measurement: a review of applicability for C4i environments. , 2006, Applied ergonomics.

[26]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[27]  John M. Flach,et al.  Situation Awareness: Proceed with Caution , 1995, Hum. Factors.

[28]  William C. Elm,et al.  Case Studies: Applied Cognitive Work Analysis in the Design of Innovative Decision Support , 2003 .

[29]  Harvey S. Smallman,et al.  Chex (Change History Explicit): New HCI Concepts for Change Awareness , 2003 .

[30]  V Grosjean,et al.  Temporal awareness: pivotal in performance? , 1999, Ergonomics.

[31]  N. Sarter,et al.  Capturing the dynamics of attention control from individual to distributed systems: the shape of models to come , 2010 .

[32]  Harvey S. Smallman,et al.  Staying Up to Speed: Four Design Principles for Maintaining and Recovering Situation Awareness , 2008 .

[33]  Daniel Lafond,et al.  Decision Analysis Using Policy Capturing and Process Tracing Techniques in a Simulated Naval Air-Defense Task , 2009 .

[34]  Francis T. Durso,et al.  Situation Awareness: Understanding Dynamic Environments , 2008, Hum. Factors.

[35]  Simon P. Banbury,et al.  Applying the Contextual Control Model (COCOM) to the Identification of Situation Awareness Requirements for Tactical Army Commanders , 2008 .