Multivariate Convolutional Sparse Coding for Electromagnetic Brain Signals

Frequency-specific patterns of neural activity are traditionally interpreted as sustained rhythmic oscillations, and related to cognitive mechanisms such as attention, high level visual processing or motor control. While alpha waves (8-12 Hz) are known to closely resemble short sinusoids, and thus are revealed by Fourier analysis or wavelet transforms, there is an evolving debate that electromagnetic neural signals are composed of more complex waveforms that cannot be analyzed by linear filters and traditional signal representations. In this paper, we propose to learn dedicated representations of such recordings using a multivariate convolutional sparse coding (CSC) algorithm. Applied to electroencephalography (EEG) or magnetoencephalography (MEG) data, this method is able to learn not only prototypical temporal waveforms, but also associated spatial patterns so their origin can be localized in the brain. Our algorithm is based on alternated minimization and a greedy coordinate descent solver that leads to state-of-the-art running time on long time series. To demonstrate the implications of this method, we apply it to MEG data and show that it is able to recover biological artifacts. More remarkably, our approach also reveals the presence of non-sinusoidal mu-shaped patterns, along with their topographic maps related to the somatosensory cortex.

[1]  José Carlos Príncipe,et al.  A fast proximal method for convolutional sparse coding , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[2]  Filip Sroubek,et al.  Fast convolutional sparse coding using matrix inversion lemma , 2016, Digit. Signal Process..

[3]  Pierre Vandergheynst,et al.  Shift-invariant dictionary learning for sparse representations: Extending K-SVD , 2008, 2008 16th European Signal Processing Conference.

[4]  Mark W. Schmidt,et al.  Coordinate Descent Converges Faster with the Gauss-Southwell Rule Than Random Selection , 2015, ICML.

[5]  Umut Simsekli,et al.  Learning the Morphology of Brain Signals Using Alpha-Stable Convolutional Sparse Coding , 2017, NIPS.

[6]  Anders P. Eriksson,et al.  Fast Convolutional Sparse Coding , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Brendt Wohlberg,et al.  Convolutional sparse representation of color images , 2016, 2016 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[8]  Martin Luessi,et al.  MEG and EEG data analysis with MNE-Python , 2013, Front. Neuroinform..

[9]  Y-Lan Boureau,et al.  Learning Convolutional Feature Hierarchies for Visual Recognition , 2010, NIPS.

[10]  S. Jones When brain rhythms aren't ‘rhythmic’: implication for their mechanisms and meaning , 2016, Current Opinion in Neurobiology.

[11]  Bradley Voytek,et al.  Nonsinusoidal Beta Oscillations Reflect Cortical Pathophysiology in Parkinson's Disease , 2017, The Journal of Neuroscience.

[12]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[13]  S. Osher,et al.  Coordinate descent optimization for l 1 minimization with application to compressed sensing; a greedy algorithm , 2009 .

[14]  ŠorelMichal,et al.  Fast convolutional sparse coding using matrix inversion lemma , 2016 .

[15]  Ali Bahramisharif,et al.  Discovering recurring patterns in electrophysiological recordings , 2017, Journal of Neuroscience Methods.

[16]  R. Hari,et al.  Studies of auditory evoked magnetic and electric responses: Modality specificity and modelling , 1983 .

[17]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[18]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[19]  O. Jensen,et al.  Asymmetric Amplitude Modulations of Brain Oscillations Generate Slow Evoked Responses , 2008, The Journal of Neuroscience.

[20]  Graham W. Taylor,et al.  Deconvolutional networks , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Peter Richtárik,et al.  Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function , 2011, Mathematical Programming.

[22]  R. Tibshirani,et al.  PATHWISE COORDINATE OPTIMIZATION , 2007, 0708.1485.

[23]  Théodore Papadopoulo,et al.  Adaptive Waveform Learning: A Framework for Modeling Variability in Neurophysiological Signals , 2017, IEEE Transactions on Signal Processing.

[24]  Brendt Wohlberg,et al.  Efficient Algorithms for Convolutional Sparse Representations , 2016, IEEE Transactions on Image Processing.

[25]  Brendt Wohlberg,et al.  Convolutional Dictionary Learning , 2017, Computer Vision.

[26]  A. Pérez-Villalba Rhythms of the Brain, G. Buzsáki. Oxford University Press, Madison Avenue, New York (2006), Price: GB £42.00, p. 448, ISBN: 0-19-530106-4 , 2008 .

[27]  Bradley Voytek,et al.  Cycle-by-cycle analysis of neural oscillations , 2018, bioRxiv.

[28]  Austin J. Brockmeier,et al.  Learning Recurrent Waveforms Within EEGs , 2016, IEEE Transactions on Biomedical Engineering.

[29]  Quentin Barthelemy,et al.  Shift & 2D Rotation Invariant Sparse Coding for Multivariate Signals , 2012, IEEE Transactions on Signal Processing.

[30]  K. Blinowska,et al.  Multichannel matching pursuit and EEG inverse solutions , 2005, Journal of Neuroscience Methods.

[31]  Adam M. Packer,et al.  Extracting regions of interest from biological images with convolutional sparse block coding , 2013, NIPS.

[32]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[33]  R. Hari Action-perception connection and the cortical mu rhythm. , 2006, Progress in brain research.

[34]  Pierre Vandergheynst,et al.  MoTIF: An Efficient Algorithm for Learning Translation Invariant Dictionaries , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[35]  Nicolas Vayatis,et al.  DICOD: Distributed Convolutional Sparse Coding. , 2017 .

[36]  Gordon Wetzstein,et al.  Fast and flexible convolutional sparse coding , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Gunnar Rätsch,et al.  On Matching Pursuit and Coordinate Descent , 2018, ICML 2018.

[38]  S. Cole,et al.  Brain Oscillations and the Importance of Waveform Shape , 2017, Trends in Cognitive Sciences.

[39]  Cédric Gouy-Pailler,et al.  Multivariate temporal dictionary learning for EEG , 2013, Journal of Neuroscience Methods.

[40]  Riitta Hari,et al.  MEG–EEG Primer , 2017 .

[41]  A. Nobre,et al.  Neural Oscillations: Sustained Rhythms or Transient Burst-Events? , 2018, Trends in Neurosciences.

[42]  Yurii Nesterov,et al.  Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems , 2012, SIAM J. Optim..