Dynamic cognitive workload assessment for fighter pilots in simulated fighter aircraft environment using EEG

Abstract The trend in aviation automation demands more mental workload of pilots, in addition to their routine manoeuvring task. For fighter aircraft pilots, the mental workload multifold due to read-back or hear-back with precise weapon handling in combat scenarios. Assessing the pilot cognitive workload is an important aspect, as it influences the pilot performance, and this is an error intolerance environment. This study aims to assess fighter aircraft Pilot’s Cognitive WorkLoad (PCWL) and attention when they exposed to a dynamic workload environment; by monitoring the neuronal activities. Here the spectral Electroencephalographic (EEG) features were extracted to assess the dynamic workload (normal, moderate, high, and very high workload), and attention monitored by National Aeronautics and Space Administration-Task Load Index (NASA-TLX) and it serves as a validation for cognitive findings. Also, brain source localization obtained from EEG inverse calculation technique, Standardized Low-Resolution brain Electromagnetic Tomography (sLORETA) performed to understand the coherence of workload and neuronal activity engagement concerning brain lobes. Statistical significance (p

[1]  J. C. Smith,et al.  Electroencephalographic Correlates of Pilot Performance: Simulation and In-Flight Studies , 1988 .

[2]  Bryan Reimer,et al.  A Comparison of Heart Rate and Heart Rate Variability Indices in Distinguishing Single-Task Driving and Driving Under Secondary Cognitive Workload , 2017 .

[3]  J. A. Veltman,et al.  A Comparative Study of Psychophysiological Reactions During Simulator and Real Flight , 2002 .

[4]  Nadine Matton,et al.  Using theta and alpha band power to assess cognitive workload in multitasking environments. , 2018, International Journal of Psychophysiology.

[5]  N. Turk-Browne,et al.  Attention promotes episodic encoding by stabilizing hippocampal representations , 2016, Proceedings of the National Academy of Sciences.

[6]  Fabio Babiloni,et al.  EEG-Based Cognitive Control Behaviour Assessment: an Ecological study with Professional Air Traffic Controllers , 2017, Scientific Reports.

[7]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996 .

[8]  Chen Liu,et al.  A model for discrimination and prediction of mental workload of aircraft cockpit display interface , 2014 .

[9]  Dieter Vaitl,et al.  Relationship between regional hemodynamic activity and simultaneously recorded EEG‐theta associated with mental arithmetic‐induced workload , 2007, Human brain mapping.

[10]  Jonathan Allsop,et al.  Flying under pressure: Effects of anxiety on attention and gaze behavior in aviation , 2014 .

[11]  Fatemeh Malekpour,et al.  ASSESSMENT OF MENTAL WORKLOAD IN NURSING BY USING NASA- TLX , 2014 .

[12]  Glenn F. Wilson,et al.  An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures , 2002 .

[13]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[14]  Rolf Pfeifer,et al.  Sensory - motor coordination: The metaphor and beyond , 1997, Robotics Auton. Syst..

[15]  Mickaël Causse,et al.  EEG/ERP as a Measure of Mental Workload in a Simple Piloting Task , 2015 .

[16]  David Badre,et al.  Ventral fronto-temporal pathway supporting cognitive control of episodic memory retrieval. , 2015, Cerebral cortex.

[17]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[18]  Daniel J. Barber,et al.  The Psychometrics of Mental Workload , 2015, Hum. Factors.

[19]  Steven L. Miller,et al.  Neural deficits in children with dyslexia ameliorated by behavioral remediation: Evidence from functional MRI , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[20]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[22]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[23]  H. Heuer,et al.  Frontal theta activity reflects distinct aspects of mental fatigue , 2014, Biological Psychology.

[24]  Laura Astolfi,et al.  Study of the functional hyperconnectivity between couples of pilots during flight simulation: An EEG hyperscanning study , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  D A Bennett,et al.  Relation of cognitive activity to risk of developing Alzheimer disease , 2007, Neurology.

[26]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[27]  G. Matthews,et al.  EEG Indices to Time-On-Task Effects and to a Workload Manipulation (Cueing) , 2011 .

[28]  A. Bakker,et al.  A multifaceted investigation of the link between mental fatigue and task disengagement. , 2015, Psychophysiology.

[29]  Michael E. Smith,et al.  Neurophysiological measures of cognitive workload during human-computer interaction , 2003 .

[30]  W H Teichner,et al.  The Detection of a Simple Visual Signal as a Function of Time of Watch , 1974, Human factors.

[31]  Detection of EEG basic rhythm feature by using band relative intensity ratio(BRIR) , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[32]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[33]  Philip A. Gable,et al.  The role of asymmetric frontal cortical activity in emotion-related phenomena: A review and update , 2010, Biological Psychology.

[34]  Jim Nixon,et al.  Measuring mental workload using physiological measures: A systematic review. , 2019, Applied ergonomics.

[35]  Matthew W. Miller,et al.  Empirical evidence for the relationship between cognitive workload and attentional reserve. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Herbert Ugrinowitsch,et al.  Task engagement and mental workload involved in variation and repetition of a motor skill , 2017, Scientific Reports.

[37]  Elizabeth B. Torres,et al.  Characterization of Sensory-Motor Behavior Under Cognitive Load Using a New Statistical Platform for Studies of Embodied Cognition , 2018, Front. Hum. Neurosci..

[38]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[39]  Vinod Kumar,et al.  Cognitive Behavior Evaluation Based on Physiological Parameters among Young Healthy Subjects with Yoga as Intervention , 2015, Comput. Math. Methods Medicine.

[40]  Philip A. Gable,et al.  On the role of asymmetric frontal cortical activity in approach and withdrawal motivation: An updated review of the evidence. , 2018, Psychophysiology.

[41]  Jürgen Margraf,et al.  The influence of frontal alpha-asymmetry on the processing of approach- and withdrawal-related stimuli-A multichannel psychophysiology study. , 2017, Psychophysiology.