A CNN-based Approach for three-class classification of motor imagery EEG data including ‘rest state’ in hybrid multi-user BCI

Multi-user BCI (brain computer interface) refers to a kind of BCI in which there are several users participating in one task. Differently from P300 and SSVEP (steady-state visual evoked potential), MI (motor imagery)-BCI does not rely on external stimulus, which is more widely used in the assistance of disabled people. The main problem of MI-BCI is to achieve asynchronous control, which needs to improve the rest state recognition accuracy. We proposed a CNN-based approach for three-class classification of motor imagery EEG data including rest state in hybrid multi-user BCI. Firstly, we designed a two-user hybrid MI-BCI experimental paradigm and moreover proposed a CNN-based processing framework method which contains several strategies for inter-brain phase locked value (PLV) features fusion. Results show that the alpha band shows the significantly better performance than other bands and the classification performance of multi-user MI is better than single-user MI. Multi-user BCI is a potential way to enhance the performance of asynchronous MI-BCI.

[1]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[2]  Kip A Ludwig,et al.  Using a common average reference to improve cortical neuron recordings from microelectrode arrays. , 2009, Journal of neurophysiology.

[3]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[4]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[5]  Jacqueline Nadel,et al.  From social behaviour to brain synchronization: Review and perspectives in hyperscanning , 2011 .

[6]  Robust Spatial Filters on Three-Class Motor Imagery EEG Data Using Independent Component Analysis , 2014 .

[7]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[8]  Shu-Chen Li,et al.  Brains swinging in concert: cortical phase synchronization while playing guitar , 2009, BMC Neuroscience.

[9]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  Rajesh P. N. Rao.  Brain-Computer Interfacing: An Introduction , 2010 .

[11]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[12]  F. Cincotti,et al.  Neuroelectrical Hyperscanning Measures Simultaneous Brain Activity in Humans , 2010, Brain Topography.

[13]  Laura Astolfi,et al.  Hypermethods for EEG hyperscanning , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Andrzej Cichocki,et al.  Neural Mechanisms of Social Emotion Perception: An EEG Hyper-Scanning Study , 2018, 2018 International Conference on Cyberworlds (CW).

[15]  Guojun Dai,et al.  EEG classification of driver mental states by deep learning , 2018, Cognitive Neurodynamics.

[16]  Riccardo Poli,et al.  Towards cooperative brain-computer interfaces for space navigation , 2013, IUI '13.

[17]  José del R. Millán,et al.  Transferring brain-computer interfaces beyond the laboratory: Successful application control for motor-disabled users , 2013, Artif. Intell. Medicine.

[18]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[19]  Jasmin Kevric,et al.  Biomedical Signal Processing and Control , 2016 .

[20]  Rajdeep Chatterjee,et al.  EEG Based Motor Imagery Classification Using SVM and MLP , 2016, 2016 2nd International Conference on Computational Intelligence and Networks (CINE).

[21]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[22]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[23]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  Gary E. Birch,et al.  Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch , 2004, IEEE Transactions on Biomedical Engineering.

[25]  M. Molinari,et al.  Brain–computer interface boosts motor imagery practice during stroke recovery , 2015, Annals of neurology.

[26]  A. Ishiyama,et al.  Three-class classification of motor imagery EEG data including “rest state” using filter-bank multi-class Common Spatial pattern , 2015, The 3rd International Winter Conference on Brain-Computer Interface.

[27]  J. Spildooren,et al.  Cued motor imagery in patients with multiple sclerosis , 2012, Neuroscience.

[28]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[29]  Febo Cincotti,et al.  Human brain oscillatory activity phase‐locked to painful electrical stimulations: A multi‐channel EEG study , 2002, Human brain mapping.