A visual-haptic neurofeedback training improves sensorimotor cortical activations and BCI performance *

Neurofeedback training (NFT) could provide a novel way to investigate or restore the impaired brain function and neuroplasticity. However, it remains unclear how much the different feedback modes can contribute to NFT training. Specifically, whether they can enhance the cortical activations for motor trainingƒ To this end, our study proposed a brain-computer interface (BCI) based visual-haptic NFT incorporating synchronous visual scene and proprioceptive electrical stimulation feedback. By comparison between previous and posterior control sessions, the cortical activations measured by multi-band (i.e. alpha_1: 8-10Hz, alpha_2: 11-13Hz, beta_1: 15-20Hz and beta_2: 22-28Hz) lateralized relative event-related desynchronization (lrERD) patterns were significantly enhanced after NFT. And the classification performance was also significantly improved, achieving a ~9% improvement and reaching ~85% in mean classification accuracy from a relatively low MI-BCI performance. These findings validate the feasibility of our proposed visual- haptic NFT approach to improve sensorimotor cortical activations and BCI performance during motor training.

[1]  J. Millán,et al.  Brain-actuated functional electrical stimulation elicits lasting arm motor recovery after stroke , 2018, Nature Communications.

[2]  Aymeric Guillot,et al.  Multiple roles of motor imagery during action observation , 2013, Front. Hum. Neurosci..

[3]  Marie Johnston,et al.  Mental practice with motor imagery in stroke recovery: randomized controlled trial of efficacy , 2011, Brain : a journal of neurology.

[4]  Jarrod A. Lewis-Peacock,et al.  Closed-loop brain training: the science of neurofeedback , 2017, Nature Reviews Neuroscience.

[5]  Catharina Zich,et al.  Motor Imagery Impairment in Postacute Stroke Patients , 2017, Neural plasticity.

[6]  Toshiyuki Kondo,et al.  Modulation of event-related desynchronization during kinematic and kinetic hand movements , 2014, Journal of NeuroEngineering and Rehabilitation.

[7]  Dong Ming,et al.  Enhancing performance of a motor imagery based brain–computer interface by incorporating electrical stimulation-induced SSSEP , 2017, Journal of neural engineering.

[8]  V Kaiser,et al.  Motor imagery-induced EEG patterns in individuals with spinal cord injury and their impact on brain–computer interface accuracy , 2014, Journal of neural engineering.

[9]  Kenya Wada,et al.  Enhancement of motor-imagery ability via combined action observation and motor-imagery training with proprioceptive neurofeedback , 2018, Neuropsychologia.

[10]  Alireza Gharabaghi,et al.  Reinforcement learning of self-regulated sensorimotor β-oscillations improves motor performance , 2016, NeuroImage.

[11]  Fei Meng,et al.  A Minimal Set of Electrodes for Motor Imagery BCI to Control an Assistive Device in Chronic Stroke Subjects: A Multi-Session Study , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Timothy Bardouille,et al.  Combined Action Observation and Motor Imagery Neurofeedback for Modulation of Brain Activity , 2017, Front. Hum. Neurosci..

[13]  Vera Kaiser,et al.  Cortical effects of user training in a motor imagery based brain–computer interface measured by fNIRS and EEG , 2014, NeuroImage.