A Multi-Class BCI Based on Somatosensory Imagery

In this paper, we investigated the performance of a multi-class brain-computer interface (BCI). The BCI system is based on the concept of somatosensory attentional orientation (SAO), in which the user shifts and maintains somatosensory attention by imagining the sensation of tactile stimulation of a body part. At the beginning of every trial, a vibration stimulus (200 ms) informed the subjects to prepare for the task. Four SAO tasks were performed following randomly presented cues: SAO of the left hand (SAO-LF), SAO of the right hand (SAO-RT), bilateral SAO (SAO-BI), and SAO suppressed or idle state (SAO-ID). Analysis of the event-related desynchronization and synchronization (ERD/ERS) in the EEG indicated that the four SAO tasks had different somatosensory cortical activation patterns. SAO-LF and SAO-RT exhibited stronger contralateral ERD, whereas bilateral ERD activation was indicative of SAO-BI, and bilateral ERS activation was associated with SAO-ID. By selecting the frequency bands and/or optimal classes, classification accuracy of the system reached 85.2%±11.2% for two classes, 69.5%±16.2% for three classes, and 55.9%±15.8% for four classes. The results validated a multi-class BCI system based on SAO, on a single trial basis. Somatosensory attention to different body parts induces diverse oscillatory dynamics within the somatosensory area of the brain, and the proposed SAO paradigm provided a new approach for a multiple-class BCI that is potentially stimulus independent.

[1]  G Pfurtscheller,et al.  Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data , 2002, Clinical Neurophysiology.

[2]  Dirk Ostwald,et al.  Imaging tactile imagery: Changes in brain connectivity support perceptual grounding of mental images in primary sensory cortices , 2014, NeuroImage.

[3]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[4]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[5]  Bin He,et al.  Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks , 2016, Scientific Reports.

[6]  Jianjun Meng,et al.  Selective Sensation Based Brain-Computer Interface via Mechanical Vibrotactile Stimulation , 2013, PloS one.

[7]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[8]  Junichi Ushiba,et al.  EEG-based classification of imaginary left and right foot movements using beta rebound , 2013, Clinical Neurophysiology.

[9]  Cuntai Guan,et al.  Brain–Computer Interface for Neurorehabilitation of Upper Limb After Stroke , 2015, Proceedings of the IEEE.

[10]  Sangtae Ahn,et al.  Achieving a hybrid brain–computer interface with tactile selective attention and motor imagery , 2014, Journal of neural engineering.

[11]  Seung-Schik Yoo,et al.  Neural substrates of tactile imagery: a functional MRI study , 2003, Neuroreport.

[12]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[13]  Xinjun Sheng,et al.  Decoding Covert Somatosensory Attention by a BCI System Calibrated With Tactile Sensation , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[15]  G. Pfurtscheller,et al.  ERD/ERS patterns reflecting sensorimotor activation and deactivation. , 2006, Progress in brain research.

[16]  G. Pfurtscheller,et al.  Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces? , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[18]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[19]  Eric W. Sellers,et al.  Noninvasive brain-computer interface enables communication after brainstem stroke , 2014, Science Translational Medicine.

[20]  P. Derambure,et al.  Relationship between event-related beta synchronization and afferent inputs: Analysis of finger movement and peripheral nerve stimulations , 2006, Clinical Neurophysiology.

[21]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[22]  Bin He,et al.  Noninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms , 2015, Proceedings of the IEEE.

[23]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[24]  Jianjun Meng,et al.  Simultaneously Optimizing Spatial Spectral Features Based on Mutual Information for EEG Classification , 2015, IEEE Transactions on Biomedical Engineering.

[25]  S. Silvoni,et al.  Brain-Computer Interface in Stroke: A Review of Progress , 2011, Clinical EEG and neuroscience.

[26]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[28]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[29]  C. Neuper,et al.  Long-term evaluation of a 4-class imagery-based brain–computer interface , 2013, Clinical Neurophysiology.

[30]  J.R. Wolpaw,et al.  BCI meeting 2005-workshop on signals and recording methods , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[32]  Xinjun Sheng,et al.  A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[34]  Xinjun Sheng,et al.  A Multi-Class Tactile Brain–Computer Interface Based on Stimulus-Induced Oscillatory Dynamics , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[36]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[37]  L. Cohen,et al.  Brain–machine interfaces in neurorehabilitation of stroke , 2015, Neurobiology of Disease.

[38]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[39]  D. Farina,et al.  A BCI System Based on Somatosensory Attentional Orientation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[41]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[43]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[44]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[45]  Jianjun Meng,et al.  Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCI , 2014, IEEE Transactions on Biomedical Engineering.

[46]  Fred Tam,et al.  Magnetoencephalographic study of vibrotactile evoked transient and steady-state responses in human somatosensory cortex , 2006, NeuroImage.

[47]  Klaus-Robert Müller,et al.  Co-adaptive calibration to improve BCI efficiency , 2011, Journal of neural engineering.

[48]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[49]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[50]  M. Molinari,et al.  Brain-computer interface based motor and cognitive rehabilitation after stroke – state of the art, opportunity, and barriers: summary of the BCI Meeting 2016 in Asilomar , 2017 .

[51]  Christoph Pokorny,et al.  A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs. , 2016, Journal of neural engineering.

[52]  Xinjun Sheng,et al.  Performance of Brain–Computer Interfacing Based on Tactile Selective Sensation and Motor Imagery , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  G Pfurtscheller,et al.  Real-time EEG analysis with subject-specific spatial patterns for a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[54]  N. Ramsey,et al.  Fully Implanted Brain-Computer Interface in a Locked-In Patient with ALS. , 2016, The New England journal of medicine.

[55]  J. Baron,et al.  Motor Imagery: A Backdoor to the Motor System After Stroke? , 2006, Stroke.

[56]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[57]  B He,et al.  Combined rTMS and virtual reality brain–computer interface training for motor recovery after stroke , 2018, Journal of neural engineering.

[58]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[59]  G Pfurtscheller,et al.  Spatiotemporal ERD/ERS patterns during voluntary movement and motor imagery. , 2000, Supplements to Clinical neurophysiology.

[60]  Xiangyang Zhu,et al.  A novel calibration and task guidance framework for motor imagery BCI via a tendon vibration induced sensation with kinesthesia illusion , 2015, Journal of neural engineering.

[61]  Sung Chan Jun,et al.  High Theta and Low Alpha Powers May Be Indicative of BCI-Illiteracy in Motor Imagery , 2013, PloS one.

[62]  J. Farquhar,et al.  Transient and steady-state responses to mechanical stimulation of different fingers reveal interactions based on lateral inhibition , 2010, Clinical Neurophysiology.

[63]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[64]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[65]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .