Wavelet Entropy-Based Inter-subject Associative Cortical Source Localization for Sensorimotor BCI

We propose event-related cortical sources estimation from subject-independent electroencephalography (EEG) recordings for motor imagery brain computer interface (BCI). By using wavelet-based maximum entropy on the mean (wMEM), task-specific EEG channels are selected to predict right hand and right foot sensorimotor tasks, employing common spatial pattern (CSP) and regularized common spatial pattern (RCSP). EEG from five healthy individuals (Dataset IVa, BCI Competition III) were evaluated by a cross-subject paradigm. Prediction performance was evaluated via a two-layer feed-forward neural network, where the classifier was trained and tested by data from two subjects independently. On average, the overall mean prediction accuracies obtained using all 118 channels are (55.98±6.53) and (71.20±5.32) in cases of CSP and RCSP, respectively, which are slightly lower than the accuracies obtained using only the selected channels, i.e., (58.95±6.90) and (71.41±6.65), respectively. The highest mean prediction accuracy achieved for a specific subject pair by using selected EEG channels was on average (90.36±5.59) and outperformed that achieved by using all available channels (86.07 ± 10.71). Spatially projected cortical sources approximated using wMEM may be useful for capturing inter-subject associative sensorimotor brain dynamics and pave the way toward an enhanced subject-independent BCI.

[1]  O. Faugeras,et al.  Generalized head models for MEG/EEG: boundary element method beyond nested volumes , 2006, Physics in medicine and biology.

[2]  Simanto Saha,et al.  Enhanced inter-subject brain computer interface with associative sensorimotor oscillations , 2017, Healthcare technology letters.

[3]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .

[4]  Christophe Grova,et al.  Wavelet-Based Localization of Oscillatory Sources From Magnetoencephalography Data , 2014, IEEE Transactions on Biomedical Engineering.

[5]  Jinung An,et al.  Minimizing inter-subject variability in fNIRS based Brain Computer Interfaces via multiple-kernel support vector learning , 2012, Medical engineering & physics.

[6]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[7]  Parag Chordia,et al.  Inter‐subject synchronization of brain responses during natural music listening , 2013, The European journal of neuroscience.

[8]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[9]  Anton Nijholt,et al.  Experiencing BCI Control in a Popular Computer Game , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[10]  Simanto Saha,et al.  Evidence of Variabilities in EEG Dynamics During Motor Imagery-Based Multiclass Brain–Computer Interface , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  Bart Vanrumste,et al.  Journal of Neuroengineering and Rehabilitation Open Access Review on Solving the Inverse Problem in Eeg Source Analysis , 2022 .

[13]  Rui Zhang,et al.  Predicting Inter-session Performance of SMR-Based Brain–Computer Interface Using the Spectral Entropy of Resting-State EEG , 2015, Brain Topography.

[14]  Yuan-Pin Lin,et al.  A subject-transfer framework for obviating inter- and intra-subject variability in EEG-based drowsiness detection , 2018, NeuroImage.

[15]  K. Müller,et al.  Psychological predictors of SMR-BCI performance , 2012, Biological Psychology.

[16]  C. Clarke,et al.  The solution of the biomagnetic inverse problem by maximum statistical entropy , 1989 .

[17]  Eric Larson,et al.  Leveraging anatomical information to improve transfer learning in brain–computer interfaces , 2015, Journal of neural engineering.

[18]  Mikko Sams,et al.  Synchronous brain activity across individuals underlies shared psychological perspectives , 2014, NeuroImage.

[19]  Bin He,et al.  Noninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms , 2015, Proceedings of the IEEE.

[20]  Simanto Saha,et al.  Application of wavelet-based maximum entropy on the mean in channel optimization for BCI , 2016, 2016 International Conference on Medical Engineering, Health Informatics and Technology (MediTec).

[21]  Antinus Nijholt,et al.  Artistic brain-computer interfaces: the expression and stimulation of the user’s affective state , 2015 .

[22]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[23]  Bin He,et al.  Classification of motor imagery by means of cortical current density estimation and Von Neumann entropy , 2007, Journal of neural engineering.

[24]  Addison W. Bohannon,et al.  Spectral Transfer Learning Using Information Geometry for a User-Independent Brain-Computer Interface , 2016, Front. Neurosci..

[25]  D. Louis Collins,et al.  Unbiased average age-appropriate atlases for pediatric studies , 2011, NeuroImage.

[26]  P. Jackson,et al.  The neural network of motor imagery: An ALE meta-analysis , 2013, Neuroscience & Biobehavioral Reviews.

[27]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[28]  M Congedo,et al.  Classification of movement intention by spatially filtered electromagnetic inverse solutions , 2006, Physics in medicine and biology.

[29]  D M Rice,et al.  If realistic neurophysiological constraints are imposed, then maximum statistical entropy is the most probable solution to the EEG inverse problem , 1990 .

[30]  Panagiotis D. Bamidis,et al.  Wireless Brain-Robot Interface: User Perception and Performance Assessment of Spinal Cord Injury Patients , 2017, Wirel. Commun. Mob. Comput..

[31]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[33]  Wen-Wen Chang,et al.  Functional brain network and multichannel analysis for the P300-based brain computer interface system of lying detection , 2016, Expert Syst. Appl..

[34]  R. Kass,et al.  Decoding and cortical source localization for intended movement direction with MEG. , 2010, Journal of neurophysiology.

[35]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[36]  Klaus-Robert Müller,et al.  Ensembles of adaptive spatial filters increase BCI performance: an online evaluation , 2016, Journal of neural engineering.

[37]  Benjamin Blankertz,et al.  Large-Scale Assessment of a Fully Automatic Co-Adaptive Motor Imagery-Based Brain Computer Interface , 2016, PloS one.

[38]  Klaus-Robert Müller,et al.  Subject-independent mental state classification in single trials , 2009, Neural Networks.

[39]  Tzyy-Ping Jung,et al.  Cortical surface alignment in multi-subject spatiotemporal independent EEG source imaging , 2014, NeuroImage.

[40]  Robert Oostenveld,et al.  Using Brain–Computer Interfaces and Brain-State Dependent Stimulation as Tools in Cognitive Neuroscience , 2011, Front. Psychology.

[41]  Takashi Hanakawa,et al.  Neuroanatomical correlates of brain–computer interface performance , 2015, NeuroImage.

[42]  Bin He,et al.  EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks , 2016, IEEE Transactions on Biomedical Engineering.

[43]  Sangkyun Lee,et al.  A toolbox for real-time subject-independent and subject-dependent classification of brain states from fMRI signals , 2013, Front. Neurosci..

[44]  Yijun Wang,et al.  Common Spatial Pattern Method for Channel Selelction in Motor Imagery Based Brain-computer Interface , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[45]  Théodore Papadopoulo,et al.  OpenMEEG: opensource software for quasistatic bioelectromagnetics , 2010, Biomedical engineering online.

[46]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[47]  Bernhard Schölkopf,et al.  Transfer Learning in Brain-Computer Interfaces , 2015, IEEE Computational Intelligence Magazine.

[48]  P. Peigneux,et al.  Inter- and Intra-Subject Variability of Neuromagnetic Resting State Networks , 2014, Brain Topography.

[49]  J B Poline,et al.  Partially overlapping neural networks for real and imagined hand movements. , 2000, Cerebral cortex.

[50]  Younes Zerouali,et al.  Localization of Synchronous Cortical Neural Sources , 2013, IEEE Transactions on Biomedical Engineering.

[51]  Daniel Svozil,et al.  Introduction to multi-layer feed-forward neural networks , 1997 .

[52]  Motoaki Kawanabe,et al.  Divergence-Based Framework for Common Spatial Patterns Algorithms , 2014, IEEE Reviews in Biomedical Engineering.

[53]  Seungjin Choi,et al.  Bayesian common spatial patterns for multi-subject EEG classification , 2014, Neural Networks.

[54]  Natasha M. Maurits,et al.  Correlating the alpha rhythm to BOLD using simultaneous EEG/fMRI: Inter-subject variability , 2006, NeuroImage.

[55]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[56]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[57]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[58]  Trent W. Lewis,et al.  Reducing training requirements through evolutionary based dimension reduction and subject transfer , 2016, Neurocomputing.

[59]  Fabrice Wendling,et al.  The neuronal sources of EEG: Modeling of simultaneous scalp and intracerebral recordings in epilepsy , 2008, NeuroImage.