User’s Self-Prediction of Performance in Motor Imagery Brain–Computer Interface

Performance variation is a critical issue in motor imagery brain–computer interface (MI-BCI), and various neurophysiological, psychological, and anatomical correlates have been reported in the literature. Although the main aim of such studies is to predict MI-BCI performance for the prescreening of poor performers, studies which focus on the user’s sense of the motor imagery process and directly estimate MI-BCI performance through the user’s self-prediction are lacking. In this study, we first test each user’s self-prediction idea regarding motor imagery experimental datasets. Fifty-two subjects participated in a classical, two-class motor imagery experiment and were asked to evaluate their easiness with motor imagery and to predict their own MI-BCI performance. During the motor imagery experiment, an electroencephalogram (EEG) was recorded; however, no feedback on motor imagery was given to subjects. From EEG recordings, the offline classification accuracy was estimated and compared with several questionnaire scores of subjects, as well as with each subject’s self-prediction of MI-BCI performance. The subjects’ performance predictions during motor imagery task showed a high positive correlation (r = 0.64, p < 0.01). Interestingly, it was observed that the self-prediction became more accurate as the subjects conducted more motor imagery tasks in the Correlation coefficient (pre-task to 2nd run: r = 0.02 to r = 0.54, p < 0.01) and root mean square error (pre-task to 3rd run: 17.7% to 10%, p < 0.01). We demonstrated that subjects may accurately predict their MI-BCI performance even without feedback information. This implies that the human brain is an active learning system and, by self-experiencing the endogenous motor imagery process, it can sense and adopt the quality of the process. Thus, it is believed that users may be able to predict MI-BCI performance and results may contribute to a better understanding of low performance and advancing BCI.

[1]  Sing-Yau Goh,et al.  Effect of mindfulness meditation on brain–computer interface performance , 2014, Consciousness and Cognition.

[2]  Sung Chan Jun,et al.  EEG datasets for motor imagery brain–computer interface , 2017, GigaScience.

[3]  J. Peters,et al.  Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery , 2011, Journal of neural engineering.

[4]  Jonathan R Wolpaw,et al.  Sensorimotor rhythm-based brain–computer interface (BCI): model order selection for autoregressive spectral analysis , 2008, Journal of neural engineering.

[5]  A Kübler,et al.  A P 300-based brain-computer interface for people with amyotrophic lateral sclerosis , 2010 .

[6]  H. Flor,et al.  A multimodal brain-based feedback and communication system , 2004, Experimental Brain Research.

[7]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.

[8]  Wolfgang Rosenstiel,et al.  Neural mechanisms of brain–computer interface control , 2011, NeuroImage.

[9]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[10]  Chi Thanh Vi,et al.  Continuous Tactile Feedback for Motor-Imagery Based Brain-Computer Interaction in a Multitasking Context , 2015, INTERACT.

[11]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[12]  Girijesh Prasad,et al.  Is Sensorimotor BCI Performance Influenced Differently by Mono, Stereo, or 3-D Auditory Feedback? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Klaus-Robert Müller,et al.  Co-adaptive calibration to improve BCI efficiency , 2011, Journal of neural engineering.

[14]  Bernhard Schölkopf,et al.  Causal influence of gamma oscillations on the sensorimotor rhythm , 2011, NeuroImage.

[15]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Babak Mahmoudi,et al.  Electro-encephalogram based brain–computer interface: improved performance by mental practice and concentration skills , 2006, Medical and Biological Engineering and Computing.

[17]  Sangtae Ahn,et al.  Achieving a hybrid brain–computer interface with tactile selective attention and motor imagery , 2014, Journal of neural engineering.

[18]  K. Müller,et al.  Psychological predictors of SMR-BCI performance , 2012, Biological Psychology.

[19]  Gwyn McClelland Survivors , 1891, The Hospital.

[20]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[21]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[22]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[23]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[24]  F Lotte,et al.  Advances in user-training for mental-imagery-based BCI control: Psychological and cognitive factors and their neural correlates. , 2016, Progress in brain research.

[25]  Benjamin Blankertz,et al.  THE BERLIN BRAIN-COMPUTER INTERFACE PRESENTS THE NOVEL MENTAL TYPEWRITER HEX-O-SPELL , 2006 .

[26]  Fabien Lotte,et al.  Signal Processing Approaches to Minimize or Suppress Calibration Time in Oscillatory Activity-Based Brain–Computer Interfaces , 2015, Proceedings of the IEEE.

[27]  Sung Chan Jun,et al.  A Review of Brain-Computer Interface Games and an Opinion Survey from Researchers, Developers and Users , 2014, Sensors.

[28]  Olaf Blanke,et al.  Quantifying the role of motor imagery in brain-machine interfaces , 2016, Scientific Reports.

[29]  Benjamin Blankertz,et al.  Weighted spatial based geometric scheme as an efficient algorithm for analyzing single-trial EEGS to improve cue-based BCI classification , 2017, Neural Networks.

[30]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[31]  B. Blankertz,et al.  Pre-Stimulus Sensorimotor Rhythms Influence Brain–Computer Interface Classification Performance , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[33]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[34]  Gerwin Schalk,et al.  Contralesional Brain–Computer Interface Control of a Powered Exoskeleton for Motor Recovery in Chronic Stroke Survivors , 2017, Stroke.

[35]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[36]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[37]  Dong Ming,et al.  Enhancing performance of a motor imagery based brain–computer interface by incorporating electrical stimulation-induced SSSEP , 2017, Journal of neural engineering.

[38]  John P. Cunningham,et al.  Encoder-Decoder Optimization for Brain-Computer Interfaces , 2015, PLoS Comput. Biol..

[39]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[40]  Aleksandra Vuckovic,et al.  Using a motor imagery questionnaire to estimate the performance of a Brain–Computer Interface based on object oriented motor imagery , 2013, Clinical Neurophysiology.

[41]  Fabien Lotte,et al.  Why standard brain-computer interface (BCI) training protocols should be changed: an experimental study , 2016, Journal of neural engineering.

[42]  Fabien Lotte,et al.  Human Learning for Brain-Computer Interfaces , 2016 .

[43]  M. Lotze,et al.  Motor imagery , 2006, Journal of Physiology-Paris.

[44]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[45]  Brendan Z. Allison,et al.  A Brain-Computer Interface for Motor Rehabilitation With Functional Electrical Stimulation and Virtual Reality , 2017 .

[46]  J. H. Hong,et al.  Gamma band activity associated with BCI performance: simultaneous MEG/EEG study , 2013, Front. Hum. Neurosci..

[47]  Sung Chan Jun,et al.  Feasibility of approaches combining sensor and source features in brain–computer interface , 2012, Journal of Neuroscience Methods.

[48]  Jie Li,et al.  A Co-adaptive Training Paradigm for Motor Imagery Based Brain-Computer Interface , 2012, ISNN.

[49]  C. Neuper,et al.  Sensorimotor rhythm-based brain–computer interface training: the impact on motor cortical responsiveness , 2011, Journal of neural engineering.

[50]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[51]  Han-Jeong Hwang,et al.  Neurofeedback-based motor imagery training for brain–computer interface (BCI) , 2009, Journal of Neuroscience Methods.

[52]  Klaus-Robert Müller,et al.  Predicting BCI Subject Performance Using Probabilistic Spatio-Temporal Filters , 2014, PloS one.

[53]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[54]  Wei He,et al.  Performance of Motor Imagery Brain-Computer Interface Based on Anodal Transcranial Direct Current Stimulation Modulation , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[56]  Sung Chan Jun,et al.  High Theta and Low Alpha Powers May Be Indicative of BCI-Illiteracy in Motor Imagery , 2013, PloS one.

[57]  V. Caggiano,et al.  Proprioceptive Feedback and Brain Computer Interface (BCI) Based Neuroprostheses , 2012, PloS one.

[58]  Sung-Jin Cho,et al.  Draft genome of the sea cucumber Apostichopus japonicus and genetic polymorphism among color variants , 2017, GigaScience.

[59]  Rupert Ortner,et al.  A Motor Imagery Based Brain-Computer Interface for Stroke Rehabilitation , 2012, Annual Review of Cybertherapy and Telemedicine.

[60]  Javier Andreu-Perez,et al.  Performance predictors of motor imagery brain-computer interface based on spatial abilities for upper limb rehabilitation , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[61]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .

[62]  B. Varkuti,et al.  Prediction of brain-computer interface aptitude from individual brain structure , 2013, Front. Hum. Neurosci..

[63]  Sriram Subramanian,et al.  Predicting Mental Imagery-Based BCI Performance from Personality, Cognitive Profile and Neurophysiological Patterns , 2015, PloS one.

[64]  Febo Cincotti,et al.  Vibrotactile Feedback for Brain-Computer Interface Operation , 2007, Comput. Intell. Neurosci..