Cognitive Metrics Profiling: A Model-Driven Approach to Predicting and Classifying Workload

Workload management is integral to the success of human-machine teams, and involves measuring and predicting workload and implementing proactive interventions to mitigate the adverse effects of degraded performance. Common approaches to workload measurement rely on the use of subjective, behavioral, and physiological metrics. These approaches suffer from two important limitations. First, the mapping between workload, subjective ratings, behavior, and physiology is complex and noisy, resulting in high uncertainty. Second, metrics based on subjective ratings, behavior, and physiology often fail to explain why performance degrades, and consequentially does not inform the development of mitigation strategies. As an alternative, we propose using cognitive metrics profiling (CMP) to improve the measurement and prediction of workload. This approach uses computational cognitive models to simulate the activity within individual cognitive systems, such as vision, audition, memory, and motor, to measure and understand workload. We discuss how CMP can be used in an unmanned vehicle control task.

[1]  T. Troscianko,et al.  Effort during visual search and counting: Insights from pupillometry , 2007, Quarterly journal of experimental psychology.

[2]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982 .

[3]  Dakota Evans,et al.  Intelligent Multi-Unmanned Vehicle Planner with Adaptive Collaborative/Control Technologies (Impact) , 2017 .

[4]  Ulf Ahlstrom,et al.  Using eye movement activity as a correlate of cognitive workload , 2006 .

[5]  C. Lebiere,et al.  An integrated theory of list memory. , 1998 .

[6]  Sarah Spriggs,et al.  Fusion: A Framework for Human Interaction with Flexible-Adaptive Automation Across Multiple Unmanned Systems , 2015 .

[7]  Gerald Matthews,et al.  Use of EEG Workload Indices for Diagnostic Monitoring of Vigilance Decrement , 2014, Hum. Factors.

[8]  G. Dedić Maslach C, Schaufeli W, Leiter M. Job burnout. Annu Rev Psychol 2001; 52: 397-422. , 2002 .

[9]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[10]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[11]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[12]  John R. Anderson Problem solving and learning. , 1993 .

[13]  Rohae Myung,et al.  Quantitative prediction of mental workload with the ACT-R cognitive architecture , 2012 .

[14]  Niels Taatgen,et al.  Instance-Based Models of Metacognition in the Prisoner's Dilemma , 2016, Top. Cogn. Sci..

[15]  Luz-Eugenia Cox-Fuenzalida,et al.  Effect of Workload History on Task Performance , 2007, Hum. Factors.

[16]  J. Stern,et al.  Eye movements and blinks: their relationship to higher cognitive processes. , 1989, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Christopher W. Myers,et al.  Profile before optimizing: a cognitive metrics approach to workload analysis , 2005, CHI Extended Abstracts.

[18]  Ying Le-an,et al.  Brief review on physiological and biochemical evaluations of human mental workload , 2012 .

[19]  Glenn Gunzelmann,et al.  A Cognitive-Pharmacokinetic Computational Model of the Effect of Toluene on Performance , 2017, CogSci.

[20]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[21]  Daniel J. Barber,et al.  The Psychometrics of Mental Workload , 2015, Hum. Factors.

[22]  Dario D. Salvucci Modeling Driver Behavior in a Cognitive Architecture , 2006, Hum. Factors.

[23]  Glenn Gunzelmann,et al.  Sleep Deprivation and Sustained Attention Performance: Integrating Mathematical and Cognitive Modeling , 2009, Cogn. Sci..