Estimating Learning Effects: A Short-Time Fourier Transform Regression Model for MEG Source Localization

Magnetoencephalography (MEG) has a high temporal resolution well-suited for studying perceptual learning. However, to identify where learning happens in the brain, one needs to apply source localization techniques to project MEG sensor data into brain space. Previous source localization methods, such as the short-time Fourier transform (STFT) method by Gramfort et al.([6]) produced intriguing results, but they were not designed to incorporate trial-by-trial learning effects. Here we modify the approach in [6] to produce an STFT-based source localization method (STFT-R) that includes an additional regression of the STFT components on covariates such as the behavioral learning curve. We also exploit a hierarchical L21 penalty to induce structured sparsity of STFT components and to emphasize signals from regions of interest (ROIs) that are selected according to prior knowledge. In reconstructing the ROI source signals from simulated data, STFT-R achieved smaller errors than a two-step method using the popular minimum-norm estimate (MNE), and in a real-world human learning experiment, STFT-R yielded more interpretable results about what time-frequency components of the ROI signals were correlated with learning.

[1]  R. Stine Bootstrap Prediction Intervals for Regression , 1985 .

[2]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[3]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[4]  Tohru Ozaki,et al.  A solution to the dynamical inverse problem of EEG generation using spatiotemporal Kalman filtering , 2004, NeuroImage.

[5]  Emery N. Brown,et al.  A spatiotemporal dynamic distributed solution to the MEG inverse problem , 2011, NeuroImage.

[6]  James W. Tanaka,et al.  Activation of Preexisting and Acquired Face Representations: The N250 Event-related Potential as an Index of Face Familiarity , 2006, Journal of Cognitive Neuroscience.

[7]  Yang Xu Cortical spatiotemporal plasticity in visual category learning , 2013 .

[8]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[9]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[10]  Richard N Henson,et al.  A multi-subject, multi-modal human neuroimaging dataset , 2015, Scientific Data.

[11]  D. Pitcher,et al.  The role of the occipital face area in the cortical face perception network , 2011, Experimental Brain Research.

[12]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[13]  Karl J. Friston,et al.  A Parametric Empirical Bayesian Framework for the EEG/MEG Inverse Problem: Generative Models for Multi-Subject and Multi-Modal Integration , 2011, Front. Hum. Neurosci..

[14]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[15]  Karl J. Friston,et al.  MEG source localization under multiple constraints: An extended Bayesian framework , 2006, NeuroImage.

[16]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.

[17]  Jens Haueisen,et al.  Time-frequency mixed-norm estimates: Sparse M/EEG imaging with non-stationary source activations , 2013, NeuroImage.

[18]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[19]  Julien Mairal,et al.  Proximal Methods for Hierarchical Sparse Coding , 2010, J. Mach. Learn. Res..

[20]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.