Mobile EEG-based situation awareness recognition for air traffic controllers

With the growing volume and complexity of air traffic, air traffic controllers (ATCOs) encounter heavier burden nowadays. Therefore, human factors study in air traffic control (ATC) is increasingly essential, paving the way to a safer air transportation system. In this paper, we conducted an ATC experiment, where Electroencephalogram (EEG) data were collected throughout the experiment. Compared to traditional questionnaires and psychological tests used in human factors study, the proposed novel EEG approach provides monitoring of situation awareness (SA) in a non-invasive and non-interruptive fashion. SA was represented as the response latency in situation-present assessment method (SPAM), which was predicted from EEG signals using three machine learning algorithms. Support vector regression obtained the lowest prediction error of 1.5 seconds, which is lower than 10% of the range of actual response latency. The results show that EEG is a promising approach forward in measuring situation awareness of ATCOs in both real-time and accurate manner.

[1]  T. Higuchi.  Approach to an irregular time series on the basis of the fractal theory , 1988 .

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  Danko Nikolić,et al.  SITUATION AWARENESS AS A PREDICTOR OF PERFORMANCE IN EN ROUTE AIR TRAFFIC CONTROLLERS , 1998 .

[4]  C.W. Anderson,et al.  Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks , 1998, IEEE Transactions on Biomedical Engineering.

[5]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[6]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[7]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  M. Teplan.  FUNDAMENTALS OF EEG MEASUREMENT , 2002 .

[9]  Peter Y. Chen,et al.  Correlation: Parametric and Nonparametric Measures , 2002 .

[10]  Mark W. Scerbo,et al.  A brain-based system for adaptive automation , 2003 .

[11]  J. J. Wright,et al.  Autoregression models of EEG , 2004, Biological Cybernetics.

[12]  R. Palaniappan,et al.  Classification of Mental Tasks Using Fixed and Adaptive Autoregressive Models of EEG Signals , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[13]  A. Kirlik,et al.  Situation awareness as judgment I: Statistical modeling and quantitative measurement , 2006 .

[14]  Luzheng Bi,et al.  Study on Real-time Detection of Alertness Based on EEG , 2007, 2007 IEEE/ICME International Conference on Complex Medical Engineering.

[15]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[16]  Olga Sourina,et al.  Real-Time EEG-Based Human Emotion Recognition and Visualization , 2010, 2010 International Conference on Cyberworlds.

[17]  Olga Sourina,et al.  A Fractal-based Algorithm of Emotion Recognition from EEG using Arousal-Valence Model , 2011, BIOSIGNALS.

[18]  Abdul-Bary Raouf Suleiman,et al.  FEATURES EXTRACTION TECHNIQES OF EEG SIGNAL FOR BCI APPLICATIONS , 2011 .

[19]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Guofa Shou,et al.  Frontal theta EEG dynamics in a real-world air traffic control task , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Steven Baker,et al.  Mapping Brain Activity During Loss of Situation Awareness , 2014, Hum. Factors.

[22]  L. Ding,et al.  EEG Correlates of Fluctuation in Cognitive Performance in an Air Traffic Control Task , 2014 .

[23]  Hussein A. Abbass,et al.  Augmented Cognition using Real-time EEG-based Adaptive Strategies for Air Traffic Control , 2014 .

[24]  Xingda Qu,et al.  Benefits of Imperfect Conflict Resolution Advisory Aids for Future Air Traffic Control , 2016, Hum. Factors.

[25]  Wei Tech Ang,et al.  EEG-Based Human Factors Evaluation of Conflict Resolution Aid and Tactile User Interface in Future Air Traffic Control Systems , 2017 .