Performance of Brain–Computer Interfacing Based on Tactile Selective Sensation and Motor Imagery

A large proportion of users do not achieve adequate control using current non-invasive brain–computer interfaces (BCIs). This issue has being coined “BCI-Illiteracy” and is observed among different BCI modalities. Here, we compare the performance and the BCI-illiteracy rate of a tactile selective sensation (SS) and motor imagery (MI) BCI, for a large subject samples. We analyzed 80 experimental sessions from 57 subjects with two-class SS protocols. For SS, the group average performance was 79.8 ± 10.6%, with 43 out of the 57 subjects (75.4%) exceeding the 70% BCI-illiteracy threshold for left- and right-hand SS discrimination. When compared with previous results, this tactile BCI outperformed all other tactile BCIs currently available. We also analyzed 63 experimental sessions from 43 subjects with two-class MI BCI protocols, where the group average performance was 77.2 ± 13.3%, with 69.7% of the subjects exceeding the 70% performance threshold for left- and right-hand MI. For within-subject comparison, the 24 subjects who participated to both the SS and MI experiments, the BCI performance was superior with SS than MI especially in beta frequency band (p < 0.05), with enhanced R2 discriminative information in the somatosensory cortex for the SS modality. Both SS and MI showed a functional dissociation between lower alpha ([8 10] Hz) and upper alpha ([10 13] Hz) bands, with BCI performance significantly better in the upper alpha than the lower alpha (p < 0.05) band. In summary, we demonstrated that SS is a promising BCI modality with low BCI illiteracy issue and has great potential in practical applications reaching large population.

[1]  P. Derambure,et al.  Brief and sustained movements: differences in event-related (de)synchronization (ERD/ERS) patterns , 2000, Clinical Neurophysiology.

[2]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[3]  Bin He,et al.  Brain–Computer Interfaces Using Sensorimotor Rhythms: Current State and Future Perspectives , 2014, IEEE Transactions on Biomedical Engineering.

[4]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[5]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[6]  P. Derambure,et al.  Movement preparation and cortical processing of afferent inputs in cortical tremor: An event-related (de)synchronization (ERD/ERS) study , 2008, Clinical Neurophysiology.

[7]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[8]  D. McFarland,et al.  An auditory brain–computer interface (BCI) , 2008, Journal of Neuroscience Methods.

[9]  Christoph Pokorny,et al.  A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs. , 2016, Journal of neural engineering.

[10]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[11]  G Pfurtscheller,et al.  Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data , 2002, Clinical Neurophysiology.

[12]  G Pfurtscheller,et al.  Contrasting behavior of beta event-related synchronization and somatosensory evoked potential after median nerve stimulation during finger manipulation in man , 2002, Neuroscience Letters.

[13]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[14]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[15]  Jianjun Meng,et al.  Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCI , 2014, IEEE Transactions on Biomedical Engineering.

[16]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[17]  Fred Tam,et al.  Magnetoencephalographic study of vibrotactile evoked transient and steady-state responses in human somatosensory cortex , 2006, NeuroImage.

[18]  G. Pfurtscheller,et al.  Motor imagery and action observation: Modulation of sensorimotor brain rhythms during mental control of a brain–computer interface , 2009, Clinical Neurophysiology.

[19]  J. Baron,et al.  Motor Imagery: A Backdoor to the Motor System After Stroke? , 2006, Stroke.

[20]  S. Baker Oscillatory interactions between sensorimotor cortex and the periphery , 2007, Current Opinion in Neurobiology.

[21]  Xinjun Sheng,et al.  A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  G. Pfurtscheller,et al.  Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces? , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Sangtae Ahn,et al.  Achieving a hybrid brain–computer interface with tactile selective attention and motor imagery , 2014, Journal of neural engineering.

[24]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[25]  D. Cheyne,et al.  Cortical dynamics of selective attention to somatosensory events , 2010, NeuroImage.

[26]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[27]  Xinjun Sheng,et al.  A Multi-Class Tactile Brain–Computer Interface Based on Stimulus-Induced Oscillatory Dynamics , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  P. Derambure,et al.  Relationship between event-related beta synchronization and afferent inputs: Analysis of finger movement and peripheral nerve stimulations , 2006, Clinical Neurophysiology.

[29]  J. Farquhar,et al.  Transient and steady-state responses to mechanical stimulation of different fingers reveal interactions based on lateral inhibition , 2010, Clinical Neurophysiology.

[30]  Brendan Z. Allison,et al.  How Many People Could Use an SSVEP BCI? , 2012, Front. Neurosci..

[31]  Arnaud Delorme,et al.  EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing , 2011, Comput. Intell. Neurosci..

[32]  Klaus-Robert Müller,et al.  Co-adaptive calibration to improve BCI efficiency , 2011, Journal of neural engineering.

[33]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[34]  Clemens Brunner,et al.  Better than random? A closer look on BCI results , 2008 .

[35]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[36]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[37]  Vera Kaiser,et al.  Stability and distribution of steady-state somatosensory evoked potentials elicited by vibro-tactile stimulation , 2012, Medical & Biological Engineering & Computing.

[38]  F. L. D. Silva,et al.  Beta rebound after different types of motor imagery in man , 2005, Neuroscience Letters.

[39]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[40]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[41]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .

[43]  Anne-Marie Brouwer,et al.  A tactile P 300 brain-computer interface , 2010 .

[44]  Héctor Pomares,et al.  Evidences of cognitive effects over auditory steady-state responses by means of artificial neural networks and its use in brain-computer interfaces , 2009, Neurocomputing.

[45]  G Pfurtscheller,et al.  Spatiotemporal ERD/ERS patterns during voluntary movement and motor imagery. , 2000, Supplements to Clinical neurophysiology.

[46]  Xiangyang Zhu,et al.  A novel calibration and task guidance framework for motor imagery BCI via a tendon vibration induced sensation with kinesthesia illusion , 2015, Journal of neural engineering.

[47]  Matthias M. Müller,et al.  Sustained spatial attention to vibration is mediated in primary somatosensory cortex , 2007, NeuroImage.

[48]  Jianjun Meng,et al.  Selective Sensation Based Brain-Computer Interface via Mechanical Vibrotactile Stimulation , 2013, PloS one.

[49]  Sung Chan Jun,et al.  Steady-State Somatosensory Evoked Potential for Brain-Computer Interface—Present and Future , 2016, Front. Hum. Neurosci..

[50]  Vera Kaiser,et al.  Cortical effects of user training in a motor imagery based brain–computer interface measured by fNIRS and EEG , 2014, NeuroImage.

[51]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[52]  D. Farina,et al.  A BCI System Based on Somatosensory Attentional Orientation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Jianjun Meng,et al.  Mechanical vibrotactile stimulation effect in motor imagery based brain-computer interface , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[54]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[56]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[57]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  C. Neuper,et al.  Sensorimotor rhythm-based brain–computer interface training: the impact on motor cortical responsiveness , 2011, Journal of neural engineering.

[59]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[60]  Jianjun Meng,et al.  Simultaneously Optimizing Spatial Spectral Features Based on Mutual Information for EEG Classification , 2015, IEEE Transactions on Biomedical Engineering.

[61]  Sung Chan Jun,et al.  High Theta and Low Alpha Powers May Be Indicative of BCI-Illiteracy in Motor Imagery , 2013, PloS one.

[62]  Brendan Z. Allison,et al.  How Many People Can Use a BCI System , 2015 .

[63]  Shozo Tobimatsu,et al.  Steady-state vibration somatosensory evoked potentials: physiological characteristics and tuning function , 1999, Clinical Neurophysiology.

[64]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[65]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..