Investigation of the effect of EEG-BCI on the simultaneous execution of flight simulation and attentional tasks

Brain–computer interfaces (BCIs) are widely used for clinical applications and exploited to design robotic and interactive systems for healthy people. We provide evidence to control a sensorimotor electroencephalographic (EEG) BCI system while piloting a flight simulator and attending a double attentional task simultaneously. Ten healthy subjects were trained to learn how to manage a flight simulator, use the BCI system, and answer to the attentional tasks independently. Afterward, the EEG activity was collected during a first flight where subjects were required to concurrently use the BCI, and a second flight where they were required to simultaneously use the BCI and answer to the attentional tasks. Results showed that the concurrent use of the BCI system during the flight simulation does not affect the flight performances. However, BCI performances decrease from the 83 to 63 % while attending additional alertness and vigilance tasks. This work shows that it is possible to successfully control a BCI system during the execution of multiple tasks such as piloting a flight simulator with an extra cognitive load induced by attentional tasks. Such framework aims to foster the knowledge on BCI systems embedded into vehicles and robotic devices to allow the simultaneous execution of secondary tasks.

[1]  Carlo Menon,et al.  Assisting drinking with an affordable BCI-controlled wearable robot and electrical stimulation: a preliminary investigation , 2014, Journal of NeuroEngineering and Rehabilitation.

[2]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[3]  F. Cincotti,et al.  The use of EEG modifications due to motor imagery for brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Zoran Nenadic,et al.  Brain-computer interface controlled robotic gait orthosis , 2012, Journal of NeuroEngineering and Rehabilitation.

[5]  G. Vecchiato,et al.  The issue of multiple univariate comparisons in the context of neuroelectric brain mapping: An application in a neuromarketing experiment , 2010, Journal of Neuroscience Methods.

[6]  T. Jung,et al.  Dry and Noncontact EEG Sensors for Mobile Brain–Computer Interfaces , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Catharina Zich,et al.  Mobile EEG and its potential to promote the theory and application of imagery-based motor rehabilitation. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  Sacha Jennifer van Albada,et al.  Transformation of arbitrary distributions to the normal distribution with application to EEG test–retest reliability , 2007, Journal of Neuroscience Methods.

[9]  P. Zimmermann,et al.  Applied Neuropsychology of Attention. Theory, Diagnosis and Rehabilitation. , 2002 .

[10]  Laura Astolfi,et al.  The Track of Brain Activity during the Observation of TV Commercials with the High-Resolution EEG Technology , 2009, Comput. Intell. Neurosci..

[11]  Vicente Mut,et al.  Attention-level transitory response: a novel hybrid BCI approach. , 2015, Journal of neural engineering.

[12]  Bin He,et al.  EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  José del R. Millán,et al.  Transferring brain-computer interfaces beyond the laboratory: Successful application control for motor-disabled users , 2013, Artif. Intell. Medicine.

[14]  N. V. Thakor,et al.  Translating the Brain-Machine Interface , 2013, Science Translational Medicine.

[15]  K. Willmes,et al.  Do Specific Attention Deficits Need Specific Training , 1997 .

[16]  F. Cincotti,et al.  Changes in Brain Activity During the Observation of TV Commercials by Using EEG, GSR and HR Measurements , 2010, Brain Topography.

[17]  Y. Benjamini,et al.  Controlling the false discovery rate in behavior genetics research , 2001, Behavioural Brain Research.

[18]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[19]  Jon Touryan,et al.  Isolating the Neural Mechanisms of Interference during Continuous Multisensory Dual-task Performance , 2014, Journal of Cognitive Neuroscience.

[20]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[21]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[22]  Febo Cincotti,et al.  EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  F. Cincotti,et al.  Eye-gaze independent EEG-based brain–computer interfaces for communication , 2012, Journal of neural engineering.

[24]  Cong Wang,et al.  A brain-computer interface controlled mail client , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  F. Cincotti,et al.  Attention and P300-based BCI performance in people with amyotrophic lateral sclerosis , 2013, Front. Hum. Neurosci..

[26]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[27]  An H. Do,et al.  Operation of a brain-computer interface walking simulator for individuals with spinal cord injury , 2013, Journal of NeuroEngineering and Rehabilitation.

[28]  Febo Cincotti,et al.  Hybrid P300-based brain-computer interface to improve usability for people with severe motor disability: electromyographic signals for error correction during a spelling task. , 2015, Archives of physical medicine and rehabilitation.

[29]  Feng Li,et al.  A Hybrid Brain-Computer Interface-Based Mail Client , 2013, Comput. Math. Methods Medicine.

[30]  G. Vecchiato,et al.  A hybrid platform based on EOG and EEG signals to restore communication for patients afflicted with progressive motor neuron diseases , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Seungjin Choi,et al.  A hybrid NIRS-EEG system for self-paced brain computer interface with online motor imagery , 2015, Journal of Neuroscience Methods.

[32]  D. Rojas,et al.  Neuronal effects of auditory distraction on visual attention , 2013, Brain and Cognition.

[33]  Jonathan R Wolpaw,et al.  Papers from the Fifth International Brain–Computer Interface Meeting , 2014, Journal of neural engineering.

[34]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[35]  Dawn M Taylor,et al.  Speaking and cognitive distractions during EEG-based brain control of a virtual neuroprosthesis-arm , 2013, Journal of NeuroEngineering and Rehabilitation.

[36]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[37]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.

[38]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..