A Composite Cognitive Workload Assessment System in Pilots Under Various Task Demands Using Ensemble Learning

The preservation of attentional resources under mental stress holds particular importance for the execution of effective performance. Specifically, the failure to conserve attentional resources could result in an overload of attentional capacity, the failure to execute critical brain processes, and suboptimal decision-making for effective motor performance. Therefore, assessment of attentional resources is particularly important for individuals such as pilots who must retain adequate attentional reserve to respond to unexpected events when executing their primary task. This study aims to devise an expert model to assess an operator’s dynamic cognitive workload in a flight simulator under various levels of challenge. The results indicate that the operator’s cognitive workload can be effectively predicted with combined classifiers of neurophysiological biomarkers, subjective assessments of perceived cognitive workload, and task performance. This work provides conceptual feasibility to develop a real-time cognitive state monitoring tool that facilitates adaptive human-computer interaction in operational environments.

[1]  Rodolphe J. Gentili,et al.  Cerebral-cortical networking and activation increase as a function of cognitive-motor task difficulty , 2012, Biological Psychology.

[2]  Barry H. Kantowitz,et al.  Mental Workload , 2020, Encyclopedia of Behavioral Medicine.

[3]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[4]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[5]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  D. Kahneman,et al.  Attention and Effort , 1973 .

[7]  A. Kok Event-related-potential (ERP) reflections of mental resource̊s: a review and synthesis , 1997, Biological Psychology.

[8]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[9]  Rodolphe J. Gentili,et al.  Brain biomarkers based assessment of cognitive workload in pilots under various task demands , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Matthew W. Miller,et al.  A novel approach to the physiological measurement of mental workload. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Kenneth W. Bauer,et al.  Improving pilot mental workload classification through feature exploitation and combination: a feasibility study , 2005, Comput. Oper. Res..

[12]  Michael K. Johnson,et al.  Probe-independent EEG assessment of mental workload in pilots , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[13]  P. Hancock Human Factors Psychology , 1987 .

[14]  Andreas Henelius,et al.  Mental workload classification using heart rate metrics , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[16]  Barry H. Kantowitz,et al.  3. Mental Workload , 1987 .