Neurophysiological Vigilance Characterisation and Assessment: Laboratory and Realistic Validations Involving Professional Air Traffic Controllers

Vigilance degradation usually causes significant performance decrement. It is also considered the major factor causing the out-of-the-loop phenomenon (OOTL) occurrence. OOTL is strongly related to a high level of automation in operative contexts such as the Air Traffic Management (ATM), and it could lead to a negative impact on the Air Traffic Controllers’ (ATCOs) engagement. As a consequence, being able to monitor the ATCOs’ vigilance would be very important to prevent risky situations. In this context, the present study aimed to characterise and assess the vigilance level by using electroencephalographic (EEG) measures. The first study, involving 13 participants in laboratory settings allowed to find out the neurophysiological features mostly related to vigilance decrements. Those results were also confirmed under realistic ATM settings recruiting 10 professional ATCOs. The results demonstrated that (i) there was a significant performance decrement related to vigilance reduction; (ii) there were no substantial differences between the identified neurophysiological features in controlled and ecological settings, and the EEG-channel configuration defined in laboratory was able to discriminate and classify vigilance changes in ATCOs’ vigilance with high accuracy (up to 84%); (iii) the derived two EEG-channel configuration was able to assess vigilance variations reporting only slight accuracy reduction.

[1]  R. Elul Gaussian Behavior of the Electroencephalogram: Changes during Performance of Mental Task , 1969, Science.

[2]  John J. Foxe,et al.  Optimal sustained attention is linked to the spectral content of background EEG activity: greater ongoing tonic alpha (∼10 Hz) power supports successful phasic goal activation , 2007 .

[3]  Fabio Babiloni,et al.  Passive BCI in Operational Environments: Insights, Recent Advances, and Future Trends , 2017, IEEE Transactions on Biomedical Engineering.

[4]  J. Gregory Trafton,et al.  Examining the Role of Task Requirements in the Magnitude of the Vigilance Decrement , 2018, Front. Psychol..

[5]  J. Sauer,et al.  Pirate Stealth or Inattentional Blindness? The Effects of Target Relevance and Sustained Attention on Security Monitoring for Experienced and Naïve Operators , 2014, PloS one.

[6]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[7]  Yoshiyuki Hirano,et al.  Chewing and Attention: A Positive Effect on Sustained Attention , 2015, BioMed research international.

[8]  Daniel Sanabria,et al.  Sport participation and vigilance in children: Influence of different sport expertise , 2017, Journal of sport and health science.

[9]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[10]  I. Mack,et al.  Vigilance Latencies to Aircraft Detection among NORAD Surveillance Operators , 1995, Hum. Factors.

[11]  Fabio Babiloni,et al.  Quantitative Assessment of the Training Improvement in a Motor-Cognitive Task by Using EEG, ECG and EOG Signals , 2015, Brain Topography.

[12]  Laura E. Matzen,et al.  Frequency-Dependent Enhancement of Fluid Intelligence Induced by Transcranial Oscillatory Potentials , 2013, Current Biology.

[13]  M. Steriade Coherent oscillations and short-term plasticity in corticothalamic networks , 1999, Trends in Neurosciences.

[14]  Francisco J. Pelayo,et al.  Trends in EEG-BCI for daily-life: Requirements for artifact removal , 2017, Biomed. Signal Process. Control..

[15]  Philippe Lacherez,et al.  When and Why Threats Go Undetected , 2016, Hum. Factors.

[16]  A. Lutz,et al.  Mental Training Enhances Attentional Stability: Neural and Behavioral Evidence , 2009, The Journal of Neuroscience.

[17]  Charles M. Jones,et al.  What Do We Know About High-Frequency Trading? , 2013 .

[18]  Narendra D. Londhe,et al.  Power Spectrum Analysis of EEG Signals for Estimating Visual Attention , 2012 .

[19]  J. Mandrekar Receiver operating characteristic curve in diagnostic test assessment. , 2010, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[20]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996 .

[21]  Daniel Sánchez Morillo,et al.  Dry EEG Electrodes , 2014, Sensors.

[22]  Yufeng Ke,et al.  The timing of theta phase synchronization accords with vigilant attention , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Jonathan Z. Bakdash,et al.  Repeated Measures Correlation , 2016 .

[24]  D. R. Davies,et al.  Human vigilance performance , 1969 .

[25]  Saturnino Luz,et al.  Human Mental Workload: Models and Applications , 2017, Communications in Computer and Information Science.

[26]  Claus Bundesen,et al.  Prompt but inefficient: nicotine differentially modulates discrete components of attention , 2011, Psychopharmacology.

[27]  M. Loeb,et al.  The Psychology of Vigilance , 1982 .

[28]  N. Mackworth The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[29]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[30]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[31]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[32]  Walter Sturm,et al.  Functional Anatomy of Intensity Aspects of Attention , 2003 .

[33]  Christian Guilleminault,et al.  Chapter 32 – Polysomnographic Evaluation of Sleep Disorders , 2005 .

[34]  Kelley S. Parsons,et al.  The abbreviated vigilance task and cerebral hemodynamics , 2007, Journal of clinical and experimental neuropsychology.

[35]  C. Im,et al.  Brain Areas Responsible for Vigilance: An EEG Source Imaging Study , 2017, Brain Topography.

[36]  K Gerbert,et al.  The causes of causes: determinants and background variables of human factor incidents and accidents. , 1986, Ergonomics.

[37]  K. Bengler,et al.  Vigilance Decrement and Passive Fatigue Caused by Monotony in Automated Driving , 2015 .

[38]  David F. Dinges,et al.  Microcomputer analyses of performance on a portable, simple visual RT task during sustained operations , 1985 .

[39]  Fabio Babiloni,et al.  The Dry Revolution: Evaluation of Three Different EEG Dry Electrode Types in Terms of Signal Spectral Features, Mental States Classification and Usability , 2019, Sensors.

[40]  Janice R. Kelly,et al.  Out of the Loop ' : Ostracism Through Information Exclusion , 2009 .

[41]  Fabio Babiloni,et al.  EEG-Based Cognitive Control Behaviour Assessment: an Ecological study with Professional Air Traffic Controllers , 2017, Scientific Reports.

[42]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[43]  Brandon G. King,et al.  Intensive Meditation Training Improves Perceptual Discrimination and Sustained Attention , 2010, Psychological science.

[44]  R Parasuraman,et al.  Consistency of individual differences in human vigilance performance: an abilities classification analysis. , 1976, The Journal of applied psychology.

[45]  R I Thackray,et al.  Personality and physiological correlates of performance decrement on a monotonous task requiring sustained attention. , 1974, British journal of psychology.

[46]  E. Soetens,et al.  Psychophysiological investigation of vigilance decrement: Boredom or cognitive fatigue? , 2008, Physiology & Behavior.

[47]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[48]  P A Hancock,et al.  Training for vigilance on the move: a video game-based paradigm for sustained attention , 2018, Ergonomics.

[49]  D. Norman The psychology of everyday things", Basic Books Inc , 1988 .

[50]  Lauren Reinerman-Jones,et al.  Detection tasks in nuclear power plant operation: Vigilance decrement and physiological workload monitoring , 2016 .

[51]  Fabio Babiloni,et al.  Industrial Neuroscience in Aviation , 2017 .

[52]  Fabio Babiloni,et al.  EEG-Based Mental Workload Neurometric to Evaluate the Impact of Different Traffic and Road Conditions in Real Driving Settings , 2018, Front. Hum. Neurosci..

[53]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[54]  Harris R Lieberman,et al.  Carbohydrate administration during a day of sustained aerobic activity improves vigilance, as assessed by a novel ambulatory monitoring device, and mood. , 2002, The American journal of clinical nutrition.

[55]  R. Parasuraman The attentive brain in aging and Alzheimer's disease. , 1998 .

[56]  F Babiloni,et al.  Passive BCI beyond the lab: current trends and future directions , 2018, Physiological measurement.

[57]  H. Fruhstorfer,et al.  Human vigilance and auditory evoked responses. , 1969, Electroencephalography and clinical neurophysiology.

[58]  F. Babiloni,et al.  Vigilance Decrement and Enhancement Techniques: A Review , 2019, Brain sciences.

[59]  N. Lowe,et al.  A critical review of visual analogue scales in the measurement of clinical phenomena. , 1990, Research in nursing & health.

[60]  Gary H Kamimori,et al.  Caffeine maintains vigilance and improves run times during night operations for Special Forces. , 2005, Aviation, space, and environmental medicine.

[61]  Fabio Babiloni,et al.  MINIMA Project: Detecting and Mitigating the Negative Impact of Automation , 2017, HCI.

[62]  Anthony J. Masalonis,et al.  DYNAMIC DENSITY AND COMPLEXITY METRICS FOR REALTIME TRAFFIC FLOW MANAGEMENT , 2003 .

[63]  Fabio Babiloni,et al.  A New Perspective for the Training Assessment: Machine Learning-Based Neurometric for Augmented User's Evaluation , 2017, Front. Neurosci..

[64]  N. Draper,et al.  Applied Regression Analysis. , 1967 .

[65]  Glenn Gunzelmann,et al.  Relationship of Event-Related Potentials to the Vigilance Decrement , 2018, Front. Psychol..

[66]  D. Dawson,et al.  Can a Shorter Psychomotor Vigilance Task Be Usedas a Reasonable Substitute for the Ten‐Minute Psychomotor Vigilance Task? , 2006, Chronobiology international.

[67]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[68]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[69]  I. THE ATTENTION SYSTEM OF THE HUMAN BRAIN , 2002 .

[70]  David B. Kaber,et al.  Out‐of‐the‐loop performance problems and the use of intermediate levels of automation for improved control system functioning and safety , 1997 .

[71]  J. Dorrian,et al.  The validity of psychomotor vigilance tasks of less than 10-minute duration , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[72]  Andrew J. Johnson Cognitive Facilitation Following Intentional Odor Exposure , 2011, Sensors.

[73]  S Pozzi,et al.  A passive brain-computer interface application for the mental workload assessment on professional air traffic controllers during realistic air traffic control tasks. , 2016, Progress in brain research.

[74]  E L Wiener,et al.  Application of Vigilance Research: Rare, Medium, or Well Done? , 1987, Human factors.

[75]  Fabio Babiloni,et al.  Human Factors and Neurophysiological Metrics in Air Traffic Control: A Critical Review , 2017, IEEE Reviews in Biomedical Engineering.

[76]  Fabio Babiloni,et al.  Adaptive Automation Triggered by EEG-Based Mental Workload Index: A Passive Brain-Computer Interface Application in Realistic Air Traffic Control Environment , 2016, Front. Hum. Neurosci..

[77]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[78]  Kenneth Hugdahl,et al.  Dichotic listening and sleep deprivation: vigilance effects. , 2002, Scandinavian journal of psychology.

[79]  Tzyy-Ping Jung,et al.  Sustained Attention in Real Classroom Settings: An EEG Study , 2017, Front. Hum. Neurosci..

[80]  H. McIlvaine Parsons,et al.  Automation and the Individual: Comprehensive and Comparative Views , 1985 .

[81]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .