Learning a common dictionary for subject-transfer decoding with resting calibration

Brain signals measured over a series of experiments have inherent variability because of different physical and mental conditions among multiple subjects and sessions. Such variability complicates the analysis of data from multiple subjects and sessions in a consistent way, and degrades the performance of subject-transfer decoding in a brain-machine interface (BMI). To accommodate the variability in brain signals, we propose 1) a method for extracting spatial bases (or a dictionary) shared by multiple subjects, by employing a signal-processing technique of dictionary learning modified to compensate for variations between subjects and sessions, and 2) an approach to subject-transfer decoding that uses the resting-state activity of a previously unseen target subject as calibration data for compensating for variations, eliminating the need for a standard calibration based on task sessions. Applying our methodology to a dataset of electroencephalography (EEG) recordings during a selective visual-spatial attention task from multiple subjects and sessions, where the variability compensation was essential for reducing the redundancy of the dictionary, we found that the extracted common brain activities were reasonable in the light of neuroscience knowledge. The applicability to subject-transfer decoding was confirmed by improved performance over existing decoding methods. These results suggest that analyzing multisubject brain activities on common bases by the proposed method enables information sharing across subjects with low-burden resting calibration, and is effective for practical use of BMI in variable environments.

[1]  Wei Zhou,et al.  Discriminative dictionary learning for EEG signal classification in Brain-computer interface , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[2]  Ricardo Chavarriaga,et al.  Learning dictionaries of spatial and temporal EEG primitives for brain-computer interfaces , 2011, ICML 2011.

[3]  Yasuharu Koike,et al.  Reconstruction of flexor and extensor muscle activities from electroencephalography cortical currents , 2012, NeuroImage.

[4]  J Leon Kenemans,et al.  Resting-state EEG theta activity and risk learning: sensitivity to reward or punishment? , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[5]  Seungjin Choi,et al.  Bayesian common spatial patterns for multi-subject EEG classification , 2014, Neural Networks.

[6]  Marty G Woldorff,et al.  Differential functional roles of slow-wave and oscillatory-α activity in visual sensory cortex during anticipatory visual-spatial attention. , 2011, Cerebral cortex.

[7]  Jean Ponce,et al.  Task-Driven Dictionary Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Darren Price,et al.  Investigating the electrophysiological basis of resting state networks using magnetoencephalography , 2011, Proceedings of the National Academy of Sciences.

[9]  A. Engel,et al.  Neuronal Synchronization along the Dorsal Visual Pathway Reflects the Focus of Spatial Attention , 2008, Neuron.

[10]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[11]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[12]  C. Grady,et al.  The Importance of Being Variable , 2011, The Journal of Neuroscience.

[13]  M. Corbetta,et al.  A Cortical Core for Dynamic Integration of Functional Networks in the Resting Human Brain , 2012, Neuron.

[14]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[15]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[16]  Rama Chellappa,et al.  Sparse Representations and Compressive Sensing for Imaging and Vision , 2013, Springer Briefs in Electrical and Computer Engineering.

[17]  Cédric Gouy-Pailler,et al.  Multivariate temporal dictionary learning for EEG , 2013, Journal of Neuroscience Methods.

[18]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[19]  Brendan Z. Allison,et al.  Brain-Computer Interfaces: Revolutionizing Human-Computer Interaction , 2013 .

[20]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[21]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[22]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[23]  Guillermo Sapiro,et al.  Non-Parametric Bayesian Dictionary Learning for Sparse Image Representations , 2009, NIPS.

[24]  Vasily A. Vakorin,et al.  Spatiotemporal Dependency of Age-Related Changes in Brain Signal Variability , 2013, Cerebral cortex.

[25]  Desney S. Tan,et al.  Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction , 2010 .

[26]  Takeo Watanabe,et al.  Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation , 2012 .

[27]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[28]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[29]  Á. Pascual-Leone,et al.  α-Band Electroencephalographic Activity over Occipital Cortex Indexes Visuospatial Attention Bias and Predicts Visual Target Detection , 2006, The Journal of Neuroscience.

[30]  Masa-aki Sato,et al.  Cortical current source estimation from electroencephalography in combination with near-infrared spectroscopy as a hierarchical prior , 2012, NeuroImage.

[31]  Liang-Tien Chia,et al.  Local features are not lonely – Laplacian sparse coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Ole Jensen,et al.  Alpha Oscillations Correlate with the Successful Inhibition of Unattended Stimuli , 2011, Journal of Cognitive Neuroscience.

[34]  Motoaki Kawanabe,et al.  Divergence-Based Framework for Common Spatial Patterns Algorithms , 2014, IEEE Reviews in Biomedical Engineering.

[35]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[36]  David B. Dunson,et al.  Multichannel Electrophysiological Spike Sorting via Joint Dictionary Learning and Mixture Modeling , 2013, IEEE Transactions on Biomedical Engineering.

[37]  Roman Filipovych,et al.  Sparse Dictionary Learning of Resting State fMRI Networks , 2012, 2012 Second International Workshop on Pattern Recognition in NeuroImaging.

[38]  Charles M. Gaona,et al.  Frequency-specific mechanism links human brain networks for spatial attention , 2013, Proceedings of the National Academy of Sciences.

[39]  Steven C. Cramer,et al.  Resting-state cortical connectivity predicts motor skill acquisition , 2014, NeuroImage.

[40]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[41]  Onur Dikmen,et al.  Maximum marginal likelihood estimation for nonnegative dictionary learning , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  M. Corbetta,et al.  Frontoparietal Cortex Controls Spatial Attention through Modulation of Anticipatory Alpha Rhythms , 2009, The Journal of Neuroscience.

[43]  Peter Dayan,et al.  Sparse Coding Can Predict Primary Visual Cortex Receptive Field Changes Induced by Abnormal Visual Input , 2013, PLoS Comput. Biol..

[44]  M. Corbetta,et al.  Individual variability in functional connectivity predicts performance of a perceptual task , 2012, Proceedings of the National Academy of Sciences.

[45]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[46]  J. Schoffelen,et al.  Dissociated α-band modulations in the dorsal and ventral visual pathways in visuospatial attention and perception. , 2014, Cerebral cortex.

[47]  Jamal Atif,et al.  Subspace metrics for multivariate dictionaries and application to EEG , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[48]  Terrence J. Sejnowski,et al.  Toward Brain-Computer Interfacing (Neural Information Processing) , 2007 .

[49]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Klaus-Robert Müller,et al.  Subject-independent mental state classification in single trials , 2009, Neural Networks.

[51]  Y Kamitani,et al.  Neural Decoding of Visual Imagery During Sleep , 2013, Science.

[52]  G. V. Simpson,et al.  Anticipatory Biasing of Visuospatial Attention Indexed by Retinotopically Specific α-Bank Electroencephalography Increases over Occipital Cortex , 2000, The Journal of Neuroscience.

[53]  Heung-No Lee,et al.  Sparse representation-based classification scheme for motor imagery-based brain–computer interface systems , 2012, Journal of neural engineering.

[54]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[55]  Motoaki Kawanabe,et al.  Decoding spatial attention by using cortical currents estimated from electroencephalography with near-infrared spectroscopy prior information , 2014, NeuroImage.

[56]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[57]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[58]  R. Oostenveld,et al.  Tactile Spatial Attention Enhances Gamma-Band Activity in Somatosensory Cortex and Reduces Low-Frequency Activity in Parieto-Occipital Areas , 2006, The Journal of Neuroscience.

[59]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[60]  C. Tallon-Baudry,et al.  Neural Dissociation between Visual Awareness and Spatial Attention , 2008, The Journal of Neuroscience.

[61]  M. Fox,et al.  Individual Variability in Functional Connectivity Architecture of the Human Brain , 2013, Neuron.