Improved decoding of neural activity from fMRI signals using non-separable spatiotemporal deconvolutions

The goal of most functional Magnetic Resonance Imaging (fMRI) analyses is to investigate neural activity. Many fMRI analysis methods assume that the temporal dynamics of the hemodynamic response function (HRF) to neural activation is separable from its spatial dynamics. Although there is empirical evidence that the HRF is more complex than suggested by space-time separable canonical HRF models, it is difficult to assess how much information about neural activity is lost when assuming space-time separability. In this study we directly test whether spatiotemporal variability in the HRF that is not captured by separable models contains information about neural signals. We predict intracranially measured neural activity from simultaneously recorded fMRI data using separable and non-separable spatiotemporal deconvolutions of voxel time series around the recording electrode. Our results show that abandoning the spatiotemporal separability assumption consistently improves the decoding accuracy of neural signals from fMRI data. We compare our findings with results from optical imaging and fMRI studies and discuss potential implications for classical fMRI analyses without invasive electrophysiological recordings.

[1]  S Warach,et al.  Monitoring the patient's EEG during echo planar MRI. , 1993, Electroencephalography and clinical neurophysiology.

[2]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[3]  Tom Heskes,et al.  Efficient Bayesian multivariate fMRI analysis using a sparsifying spatio-temporal prior , 2010, NeuroImage.

[4]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[5]  Fumikazu Miwakeichi,et al.  Concurrent EEG/fMRI analysis by multiway Partial Least Squares , 2004, NeuroImage.

[6]  N. Logothetis,et al.  Neurophysiology of the BOLD fMRI Signal in Awake Monkeys , 2008, Current Biology.

[7]  J. Mayhew,et al.  Fine detail of neurovascular coupling revealed by spatiotemporal analysis of the hemodynamic response to single whisker stimulation in rat barrel cortex. , 2008, Journal of neurophysiology.

[8]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[9]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[10]  Klaus-Robert Müller,et al.  Temporal kernel CCA and its application in multimodal neuronal data analysis , 2010, Machine Learning.

[11]  N. Logothetis,et al.  Magnetic Resonance Imaging of Neuronal Connections in the Macaque Monkey , 2001, Neuron.

[12]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[13]  Nikos K Logothetis,et al.  Laminar specificity in monkey V1 using high-resolution SE-fMRI. , 2006, Magnetic resonance imaging.

[14]  Jérémie Mattout,et al.  Symmetrical event-related EEG/fMRI information fusion in a variational Bayesian framework , 2007, NeuroImage.

[15]  N. Logothetis,et al.  Very slow activity fluctuations in monkey visual cortex: implications for functional brain imaging. , 2003, Cerebral cortex.

[16]  Janaina Mourão Miranda,et al.  Unsupervised analysis of fMRI data using kernel canonical correlation , 2007, NeuroImage.

[17]  W. Singer,et al.  Hemodynamic Signals Correlate Tightly with Synchronized Gamma Oscillations , 2005, Science.

[18]  Jose M. Sanchez-Bornot,et al.  Model driven EEG/fMRI fusion of brain oscillations , 2009, Human brain mapping.

[19]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[20]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[21]  Karl J. Friston,et al.  Analysis of functional MRI time‐series , 1994, Human Brain Mapping.

[22]  Axel Oeltermann,et al.  Simultaneous recording of neuronal signals and functional NMR imaging. , 2007, Magnetic resonance imaging.

[23]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[24]  D. Kleinfeld,et al.  Correlations of Neuronal and Microvascular Densities in Murine Cortex Revealed by Direct Counting and Colocalization of Nuclei and Vessels , 2009, The Journal of Neuroscience.

[25]  J. Fermaglich Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[26]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[27]  Dae-Shik Kim,et al.  Spatial relationship between neuronal activity and BOLD functional MRI , 2004, NeuroImage.

[28]  R. Buxton,et al.  Modeling the hemodynamic response to brain activation , 2004, NeuroImage.

[29]  A. Dale,et al.  Coupling of the cortical hemodynamic response to cortical and thalamic neuronal activity. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Essa Yacoub,et al.  Spatio-temporal point-spread function of fMRI signal in human gray matter at 7 Tesla , 2007, NeuroImage.

[31]  Mark D'Esposito,et al.  Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses , 2004, NeuroImage.

[32]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[33]  Yusuke Murayama,et al.  How not to study spontaneous activity , 2009, NeuroImage.

[34]  Johannes Reichold,et al.  The microvascular system of the striate and extrastriate visual cortex of the macaque. , 2008, Cerebral cortex.

[35]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Karl J. Friston,et al.  Dynamic discrimination analysis: A spatial–temporal SVM , 2007, NeuroImage.

[37]  G. Strang Introduction to Linear Algebra , 1993 .

[38]  Klaus-Robert Müller,et al.  Relationship between neural and hemodynamic signals during spontaneous activity studied with temporal kernel CCA. , 2010, Magnetic resonance imaging.

[39]  Mark W. Woolrich,et al.  Fully Bayesian spatio-temporal modeling of FMRI data , 2004, IEEE Transactions on Medical Imaging.

[40]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[41]  G. Rees,et al.  Predicting the Stream of Consciousness from Activity in Human Visual Cortex , 2005, Current Biology.

[42]  K. Uğurbil,et al.  The Spatial Dependence of the Poststimulus Undershoot as Revealed by High-Resolution BOLD- and CBV-Weighted fMRI , 2005, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[43]  Yingli Lu,et al.  Using voxel-specific hemodynamic response function in EEG-fMRI data analysis: An estimation and detection model , 2007, NeuroImage.

[44]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[45]  M. D’Esposito,et al.  The Variability of Human, BOLD Hemodynamic Responses , 1998, NeuroImage.

[46]  Arthur Gretton,et al.  Low-Frequency Local Field Potentials and Spikes in Primary Visual Cortex Convey Independent Visual Information , 2008, The Journal of Neuroscience.

[47]  Ying Zheng,et al.  The Hemodynamic Impulse Response to a Single Neural Event , 2003, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[48]  Yevgeniy B. Sirotin,et al.  Spatiotemporal precision and hemodynamic mechanism of optical point spreads in alert primates , 2009, Proceedings of the National Academy of Sciences.

[49]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[50]  Lloyd T. Elliott,et al.  Cortical surface-based searchlight decoding , 2011, NeuroImage.

[51]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[52]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[53]  耕太 片野田,et al.  A spatio-temporal regression model for the analysis of functional MRI data , 2002 .

[54]  F. Meinecke,et al.  Analysis of Multimodal Neuroimaging Data , 2011, IEEE Reviews in Biomedical Engineering.

[55]  Frithjof Kruggel,et al.  Spatio-temporal Covariance Model for Medical Images Sequences: Application to Functional MRI Data , 2001, IPMI.