A joint human-automation cognitive system to support rapid decision-making in hostile environments

Honeywell has designed a joint human-computer cognitive system to support rapid decision making demands of dismounted soldiers. In highly networked environments the sheer magnitude of communication amid multiple tasks could overwhelm individual soldiers. Key cognitive bottlenecks constrain information flow and the performance of decision-making, especially under stress. The adaptive decision-support system mitigates non-optimal human performance via automation when the system detects a breakdown in the human's cognitive state. The human's cognitive state is assessed in real-time via a suite of neuro-physiological and physiological sensors. Adaptive mitigation strategies can include task management, optimizing information presentation via modality management, task sharing, and task loading. Mitigations are designed with consideration for both the costs and benefits of intermittent augmentation. The paper describes the system development and evolution, explorations of usable cognitive mitigation strategies, and four evaluations that show adaptive automaton can effectively, mitigate human decision-making performance at extremes (overload and underload) of workload.

[1]  Christopher A. Miller,et al.  Trust and etiquette in high-criticality automated systems , 2004, CACM.

[2]  John R. Anderson.  Cognitive Psychology and Its Implications , 1980 .

[3]  John R. Anderson.  Cognitive psychology and its implications, 2nd ed. , 1985 .

[4]  Michael C. Dorneich,et al.  Mitigating cognitive bottlenecks via an augmented cognition adaptive system , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[5]  Santosh Mathan,et al.  Enabling Improved Performance though a Closed-Loop Adaptive System Driven by Real-Time Assessment of Cognitive State , 2005 .

[6]  Santosh Mathan,et al.  Sensor-Based Cognitive State Assessment in a Mobile Environment , 2005 .

[7]  F. Freeman,et al.  Evaluation of an adaptive automation system using three EEG indices with a visual tracking task , 1999, Biological Psychology.

[8]  Barak A. Pearlmutter,et al.  Linear Spatial Integration for Single-Trial Detection in Encephalography , 2002, NeuroImage.

[9]  Lucas C. Parra,et al.  Spatial signatures of visual object recognition events learned from single-trial analysis of EEG , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[10]  D. Broadbent.  Perception and communication , 1958 .

[11]  Tian Lan,et al.  Cognitive State Estimation Based on EEG for Augmented Cognition , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[12]  Adam W. Hoover,et al.  A Real-Time Index of Vagal Activity , 2004, Int. J. Hum. Comput. Interact..

[13]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[14]  Michael C. Dorneich,et al.  Closing the Loop of an Adaptive System with Cognitive State , 2004 .

[15]  A. Treisman.  VERBAL CUES, LANGUAGE, AND MEANING IN SELECTIVE ATTENTION. , 1964, The American journal of psychology.

[16]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[17]  D. Kahneman,et al.  Attention and Effort , 1973 .