Neuro-current response functions: A unified approach to MEG source analysis under the continuous stimuli paradigm

Characterizing the neural dynamics underlying sensory processing is one of the central areas of investigation in systems and cognitive neuroscience. Neuroimaging techniques such as magnetoencephalography (MEG) and Electroencephalography (EEG) have provided significant insights into the neural processing of continuous stimuli, such as speech, thanks to their high temporal resolution. Existing work in the context of auditory processing suggests that certain features of speech, such as the acoustic envelope, can be used as reliable linear predictors of the neural response manifested in M/EEG. The corresponding linear filters are referred to as temporal response functions (TRFs). While the functional roles of specific components of the TRF are well-studied and linked to behavioral attributes such as attention, the cortical origins of the underlying neural processes are not as well understood. In this work, we address this issue by estimating a linear filter representation of cortical sources directly from neuroimaging data in the context of continuous speech processing. To this end, we introduce Neuro-Current Response Functions (NCRFs), a set of linear filters, spatially distributed throughout the cortex, that predict the cortical currents giving rise to the observed ongoing MEG (or EEG) data in response to continuous speech. NCRF estimation is cast within a Bayesian framework, which allows unification of the TRF and source estimation problems, and also facilitates the incorporation of prior information on the structural properties of the NCRFs. To generalize this analysis to M/EEG recordings which lack individual structural magnetic resonance (MR) scans, NCRFs are extended to free-orientation dipoles and a novel regularizing scheme is put forward to lessen reliance on fine-tuned coordinate co-registration. We present a fast estimation algorithm, which we refer to as the Champ-Lasso algorithm, by leveraging recent advances in optimization, and demonstrate its utility through application to simulated and experimentally recorded MEG data under auditory experiments. Our simulation studies reveal significant improvements over existing methods that typically operate in a two-stage fashion, in terms of spatial resolution, response function reconstruction, and recovering dipole orientations. The analysis of experimentally-recorded MEG data without MR scans corroborates existing findings, but also delineates the distinct cortical distribution of the underlying neural processes at high spatiotemporal resolution. In summary, we provide a principled modeling and estimation paradigm for MEG source analysis tailored to extracting the cortical origin of electrophysiological responses to continuous stimuli.

[1]  I F Gorodnitsky,et al.  Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm. , 1995, Electroencephalography and clinical neurophysiology.

[2]  L. Elliot Hong,et al.  Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech , 2018, Current Biology.

[3]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[4]  J. Rauschecker,et al.  Phoneme and word recognition in the auditory ventral stream , 2012, Proceedings of the National Academy of Sciences.

[5]  R. Leahy,et al.  EEG and MEG: forward solutions for inverse methods , 1999, IEEE Transactions on Biomedical Engineering.

[6]  Jon H. Kaas,et al.  'What' and 'where' processing in auditory cortex , 1999, Nature Neuroscience.

[7]  Nima Mesgarani,et al.  Phoneme representation and classification in primary auditory cortex. , 2008, The Journal of the Acoustical Society of America.

[8]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[9]  Christian Brodbeck,et al.  Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension , 2017, NeuroImage.

[10]  Wei Wu,et al.  Bayesian Machine Learning: EEG\/MEG signal processing measurements , 2016, IEEE Signal Processing Magazine.

[11]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[12]  Lars Kai Hansen,et al.  A hierarchical Bayesian M/EEG imagingmethod correcting for incomplete spatio-temporal priors , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[13]  Stephen J. Wright Coordinate descent algorithms , 2015, Mathematical Programming.

[14]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[15]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[16]  Jun Zhang,et al.  Bayesian Electromagnetic Spatio-Temporal Imaging of Extended Sources Based on Matrix Factorization , 2019, IEEE Transactions on Biomedical Engineering.

[17]  P. Tibbetts :Cognitive Neuroscience: The Biology of the Mind , 2009 .

[18]  Matthew H. Davis,et al.  Hearing speech sounds: Top-down influences on the interface between audition and speech perception , 2007, Hearing Research.

[19]  John J. Foxe,et al.  Resolving precise temporal processing properties of the auditory system using continuous stimuli. , 2009, Journal of neurophysiology.

[20]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[21]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[22]  Wolfgang Grodd,et al.  Reconstruction of extended cortical sources for EEG and MEG based on a Monte‐Carlo‐Markov‐chain estimator , 2003, Human brain mapping.

[23]  Christoph E Schreiner,et al.  Human Superior Temporal Gyrus Organization of Spectrotemporal Modulation Tuning Derived from Speech Stimuli , 2016, The Journal of Neuroscience.

[24]  Keith Johnson,et al.  Phonetic Feature Encoding in Human Superior Temporal Gyrus , 2014, Science.

[25]  Wasim Q. Malik,et al.  Computationally Efficient Algorithms for Sparse, Dynamic Solutions to the EEG Source Localization Problem , 2018, IEEE Transactions on Biomedical Engineering.

[26]  Todd C. Handy,et al.  Event-related potentials : a methods handbook , 2005 .

[27]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[28]  Seppo P. Ahlfors,et al.  Assessing and improving the spatial accuracy in MEG source localization by depth-weighted minimum-norm estimates , 2006, NeuroImage.

[29]  Alessandro Presacco,et al.  Effect of informational content of noise on speech representation in the aging midbrain and cortex. , 2016, Journal of neurophysiology.

[30]  R. E. Miles On random rotations in R3 , 1965 .

[31]  Michael J. Crosse,et al.  Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech , 2017, bioRxiv.

[32]  Brian N. Pasley,et al.  Reconstructing Speech from Human Auditory Cortex , 2012, PLoS biology.

[33]  David P. Wipf,et al.  A unified Bayesian framework for MEG/EEG source imaging , 2009, NeuroImage.

[34]  Thomas R. Knösche,et al.  Prior knowledge on cortex organization in the reconstruction of source current densities from EEG , 2013, NeuroImage.

[35]  S. Taulu,et al.  Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements , 2006, Physics in medicine and biology.

[36]  J. Sarvas Basic mathematical and electromagnetic concepts of the biomagnetic inverse problem. , 1987, Physics in medicine and biology.

[37]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[38]  Jonathan Z. Simon,et al.  Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech , 2013, The Journal of Neuroscience.

[39]  Karl J. Friston,et al.  Multiple sparse priors for the M/EEG inverse problem , 2008, NeuroImage.

[40]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[41]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[42]  R. Wise,et al.  Temporal lobe regions engaged during normal speech comprehension. , 2003, Brain : a journal of neurology.

[43]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[44]  Jonathan Z. Simon,et al.  Dynamic Estimation of the Auditory Temporal Response Function From MEG in Competing-Speaker Environments , 2017, IEEE Transactions on Biomedical Engineering.

[45]  S. Luck An Introduction to the Event-Related Potential Technique , 2005 .

[46]  M. Gazzaniga,et al.  Cognitive Neuroscience: The Biology of the Mind , 1998 .

[47]  Christian K. Machens,et al.  Linearity of Cortical Receptive Fields Measured with Natural Sounds , 2004, The Journal of Neuroscience.

[48]  Jonathan H. Venezia,et al.  Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. , 2010, Cerebral cortex.

[49]  Emery N. Brown,et al.  A spatiotemporal dynamic distributed solution to the MEG inverse problem , 2011, NeuroImage.

[50]  N. C. Singh,et al.  Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli , 2001 .

[51]  Richard G. Baraniuk,et al.  A Field Guide to Forward-Backward Splitting with a FASTA Implementation , 2014, ArXiv.

[52]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[53]  Martin Luessi,et al.  MEG and EEG data analysis with MNE-Python , 2013, Front. Neuroinform..

[54]  Edmund C. Lalor,et al.  Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing , 2015, Current Biology.

[55]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[56]  Christian Brodbeck,et al.  Cortical Localization of the Auditory Temporal Response Function from MEG via Non-convex Optimization , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[57]  Alexandre Gramfort,et al.  Automated model selection in covariance estimation and spatial whitening of MEG and EEG signals , 2015, NeuroImage.

[58]  Laurel J. Lewis,et al.  Linear systems analysis , 1969 .

[59]  Edmund C. Lalor,et al.  The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli , 2016, Front. Hum. Neurosci..

[60]  John J. Foxe,et al.  Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution , 2010, The European journal of neuroscience.

[61]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[62]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[63]  Andreas Ziehe,et al.  Combining sparsity and rotational invariance in EEG/MEG source reconstruction , 2008, NeuroImage.

[64]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[65]  Liina Pylkkänen,et al.  The LATL as locus of composition: MEG evidence from English and Arabic , 2015, Brain and Language.

[66]  J. Schoffelen,et al.  Source connectivity analysis with MEG and EEG , 2009, Human brain mapping.

[67]  Matthew H. Davis,et al.  Hierarchical Processing for Speech in Human Auditory Cortex and Beyond , 2010, Front. Hum. Neurosci..

[68]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[69]  T. Strohmer,et al.  Gabor Analysis and Algorithms: Theory and Applications , 1997 .

[70]  Nai Ding,et al.  Robust cortical encoding of slow temporal modulations of speech. , 2013, Advances in experimental medicine and biology.

[71]  Kuansan Wang,et al.  Auditory representations of acoustic signals , 1992, IEEE Trans. Inf. Theory.

[72]  K. Mardia Assessment of multinormality and the robustness of Hotelling's T^2 test , 1975 .

[73]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[74]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[75]  Shin Ishii,et al.  A State-Space Modeling Approach for Localization of Focal Current Sources From MEG , 2012, IEEE Transactions on Biomedical Engineering.

[76]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[77]  J. Gallant,et al.  Complete functional characterization of sensory neurons by system identification. , 2006, Annual review of neuroscience.

[78]  A M Aertsen,et al.  Reverse-correlation methods in auditory research , 1983, Quarterly Reviews of Biophysics.

[79]  Richard M. Leahy,et al.  Electromagnetic brain mapping - IEEE Signal Processing Magazine , 2001 .

[80]  S. David,et al.  Estimating sparse spectro-temporal receptive fields with natural stimuli , 2007, Network.

[81]  Friedemann Pulvermüller,et al.  Motor cortex maps articulatory features of speech sounds , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[82]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[83]  Masa-aki Sato,et al.  MEG source reconstruction based on identification of directed source interactions on whole-brain anatomical networks , 2015, NeuroImage.

[84]  Masa-aki Sato,et al.  Hierarchical Bayesian estimation for MEG inverse problem , 2004, NeuroImage.

[85]  Barak A. Pearlmutter,et al.  The VESPA: A method for the rapid estimation of a visual evoked potential , 2006, NeuroImage.

[86]  Emery N. Brown,et al.  A Subspace Pursuit-based Iterative Greedy Hierarchical solution to the neuromagnetic inverse problem , 2013, NeuroImage.

[87]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[88]  Frédéric E Theunissen,et al.  The Hierarchical Cortical Organization of Human Speech Processing , 2017, The Journal of Neuroscience.

[89]  N. Mesgarani,et al.  Selective cortical representation of attended speaker in multi-talker speech perception , 2012, Nature.

[90]  Julia P. Owen,et al.  Robust Bayesian estimation of the location, orientation, and time course of multiple correlated neural sources using MEG , 2010, NeuroImage.

[91]  Thomas R. Knösche,et al.  Spatio-temporal Regularization in Linear Distributed Source Reconstruction from EEG/MEG: A Critical Evaluation , 2013, Brain Topography.

[92]  Pavitra Krishnaswamy,et al.  Sparsity enables estimation of both subcortical and cortical activity from MEG and EEG , 2017, Proceedings of the National Academy of Sciences.

[93]  Alessandro Presacco,et al.  Robust decoding of selective auditory attention from MEG in a competing-speaker environment via state-space modeling , 2016, NeuroImage.

[94]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[95]  S. Scott,et al.  The neuroanatomical and functional organization of speech perception , 2003, Trends in Neurosciences.

[96]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[97]  A. Gramfort,et al.  Mixed-norm estimates for the M/EEG inverse problem using accelerated gradient methods , 2012, Physics in medicine and biology.

[98]  Gareth R. Barnes,et al.  Estimates of cortical column orientation improve MEG source inversion , 2019, NeuroImage.

[99]  Dario L. Ringach,et al.  Reverse correlation in neurophysiology , 2004, Cogn. Sci..