Exploring Training Effect in 42 Human Subjects Using a Non-invasive Sensorimotor Rhythm Based Online BCI

Electroencephalography based brain-computer interfaces (BCIs) show promise of providing an alternative communication channel between the brain and an external device. It is well acknowledged that BCI control is a skill and could be improved through practice and training. In this study, we explore the change of BCI behavioral performance as well as the electrophysiological properties across three training sessions in a pool of 42 human subjects. Our results show that the group average of BCI accuracy and the information transfer rate improved significantly in the third session compared to the first session; especially the significance reached in a smaller subset of a low BCI performance group (average accuracy <70%) as well. There was a significant difference of event-related desynchronization (ERD) lateralization for BCI control between the left- and right-hand imagination task in the last two sessions, but this significant difference was not revealed in the first training sessions. No significant change of R2 value or event-related desynchronization and synchronization (ERD/ERS) for either channel C3 or channel C4, which were used for online control, was found across the training sessions. The change of ERD lateralization was also not significant across the training sessions. The present results indicate that BCI training could induce a change of behavioral performance and electrophysiological properties quickly, within just a few hours of training, distributed into three sessions. Multiple training sessions might especially be beneficial for the low BCI performers.

[1]  J. Ushiba,et al.  Daily training with realistic visual feedback improves reproducibility of event-related desynchronisation following hand motor imagery , 2013, Clinical Neurophysiology.

[2]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[3]  B. Hjorth.  An on-line transformation of EEG scalp potentials into orthogonal source derivations. , 1975, Electroencephalography and clinical neurophysiology.

[4]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[5]  N. Birbaumer,et al.  Brain–computer interfaces for communication and rehabilitation , 2016, Nature Reviews Neurology.

[6]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[7]  Sing-Yau Goh,et al.  Effect of mindfulness meditation on brain–computer interface performance , 2014, Consciousness and Cognition.

[8]  Benjamin Blankertz,et al.  Visuo-motor coordination ability predicts performance with brain-computer interfaces controlled by modulation of sensorimotor rhythms (SMR) , 2014, Front. Hum. Neurosci..

[9]  Catharina Zich,et al.  Multimodal Evaluation of Motor Imagery Training Supported by Mobile EEG at Home: A Case Report , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[10]  Bin He,et al.  EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[12]  N. Birbaumer,et al.  Predictors of successful self control during brain-computer communication , 2003, Journal of neurology, neurosurgery, and psychiatry.

[13]  Ricardo Chavarriaga,et al.  Errare machinale est: the use of error-related potentials in brain-machine interfaces , 2014, Front. Neurosci..

[14]  Vera Kaiser,et al.  Cortical effects of user training in a motor imagery based brain–computer interface measured by fNIRS and EEG , 2014, NeuroImage.

[15]  Jianjun Meng,et al.  Simultaneously Optimizing Spatial Spectral Features Based on Mutual Information for EEG Classification , 2015, IEEE Transactions on Biomedical Engineering.

[16]  B He,et al.  Combined rTMS and virtual reality brain–computer interface training for motor recovery after stroke , 2018, Journal of neural engineering.

[17]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[18]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[19]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[20]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[21]  Ricardo Chavarriaga,et al.  Harnessing Prefrontal Cognitive Signals for Brain-Machine Interfaces. , 2017, Trends in biotechnology.

[22]  Bin He,et al.  Effects of Soft Drinks on Resting State EEG and Brain–Computer Interface Performance , 2017, IEEE Access.

[23]  F Lotte,et al.  Advances in user-training for mental-imagery-based BCI control: Psychological and cognitive factors and their neural correlates. , 2016, Progress in brain research.

[24]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[25]  J. Millán,et al.  The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users , 2018, PLoS biology.

[26]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[27]  Soo-Young Lee,et al.  Brain–computer interface using fMRI: spatial navigation by thoughts , 2004, Neuroreport.

[28]  Rajesh P. N. Rao,et al.  Distributed cortical adaptation during learning of a brain–computer interface task , 2013, Proceedings of the National Academy of Sciences.

[29]  Bin He,et al.  Brain-Computer Interface Control in a Virtual Reality Environment and Applications for the Internet of Things , 2018, IEEE Access.

[30]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[31]  Bernhard Schölkopf,et al.  A Review of Performance Variations in SMR-Based Brain−Computer Interfaces (BCIs) , 2013 .

[32]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[33]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[34]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Bin He,et al.  A Study of the Effects of Electrode Number and Decoding Algorithm on Online EEG-Based BCI Behavioral Performance , 2018, Front. Neurosci..

[36]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[37]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[38]  Bin He,et al.  EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks , 2016, IEEE Transactions on Biomedical Engineering.

[39]  Gordon Cheng,et al.  Long-Term Training with a Brain-Machine Interface-Based Gait Protocol Induces Partial Neurological Recovery in Paraplegic Patients , 2016, Scientific Reports.

[40]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[41]  Bin He,et al.  Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks , 2016, Scientific Reports.

[42]  José del R. Millán,et al.  Simultaneous Real-Time Detection of Motor Imagery and Error-Related Potentials for Improved BCI Accuracy , 2008 .

[43]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[44]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[45]  M. Hallett,et al.  Asymmetric spatiotemporal patterns of event-related desynchronization preceding voluntary sequential finger movements: a high-resolution EEG study , 2005, Clinical Neurophysiology.

[46]  Qiong Zhang,et al.  Improving motor imagery BCI with user response to feedback , 2017 .

[47]  S. Debener,et al.  Modulating hemispheric lateralization by brain stimulation yields gain in mental and physical activity , 2017, Scientific Reports.

[48]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[49]  G Pfurtscheller,et al.  Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data , 2002, Clinical Neurophysiology.

[50]  Jonathan R Wolpaw,et al.  Sensorimotor rhythm-based brain–computer interface (BCI): model order selection for autoregressive spectral analysis , 2008, Journal of neural engineering.

[51]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[52]  Motoaki Kawanabe,et al.  Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces , 2011, IEEE Transactions on Biomedical Engineering.

[53]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[54]  Xiangyang Zhu,et al.  Fast Recognition of BCI-Inefficient Users Using Physiological Features from EEG Signals: A Screening Study of Stroke Patients , 2018, Front. Neurosci..

[55]  Fabien Lotte,et al.  Defining and quantifying users’ mental imagery-based BCI skills: a first step , 2018, Journal of neural engineering.

[56]  Xinjun Sheng,et al.  Decoding Covert Somatosensory Attention by a BCI System Calibrated With Tactile Sensation , 2018, IEEE Transactions on Biomedical Engineering.

[57]  M. Molinari,et al.  Brain–computer interface boosts motor imagery practice during stroke recovery , 2015, Annals of neurology.

[58]  Bin He,et al.  Noninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms , 2015, Proceedings of the IEEE.

[59]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[60]  Bin He,et al.  Brain–Computer Interfaces Using Sensorimotor Rhythms: Current State and Future Perspectives , 2014, IEEE Transactions on Biomedical Engineering.

[61]  Bin He,et al.  BRAIN^COMPUTER INTERFACE , 2007 .

[62]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[63]  M. Doppelmayr,et al.  Predicting Successful Learning of SMR Neurofeedback in Healthy Participants: Methodological Considerations , 2011, Applied psychophysiology and biofeedback.

[64]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[65]  Brendan Z. Allison,et al.  A Brain-Computer Interface for Motor Rehabilitation With Functional Electrical Stimulation and Virtual Reality , 2017 .

[66]  Maarten De Vos,et al.  Wireless EEG with individualized channel layout enables efficient motor imagery training , 2015, Clinical Neurophysiology.

[67]  Febo Cincotti,et al.  EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[68]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[69]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[70]  Fabien Lotte,et al.  How Well Can We Learn With Standard BCI Training Approaches? A Pilot Study. , 2014 .

[71]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .

[72]  Jianjun Meng,et al.  Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCI , 2014, IEEE Transactions on Biomedical Engineering.

[73]  Christa Neuper,et al.  Future prospects of ERD/ERS in the context of brain-computer interface (BCI) developments. , 2006, Progress in brain research.

[74]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[75]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[76]  Bin He,et al.  The impact of mind-body awareness training on the early learning of a brain-computer interface. , 2014, Technology.

[77]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[78]  Mahta Mousavi,et al.  Towards Elaborated feedback for Training motor imagery brain Computer Interfaces , 2017, GBCIC.

[79]  N. Birbaumer,et al.  Predictability of Brain-Computer Communication , 2004 .

[80]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[81]  J. H. Hong,et al.  Gamma band activity associated with BCI performance: simultaneous MEG/EEG study , 2013, Front. Hum. Neurosci..