Pattern classification precedes region-average hemodynamic response in early visual cortex

How quickly can information about the neural response to a visual stimulus be detected in the hemodynamic response measured using fMRI? Multi-voxel pattern analysis (MVPA) uses pattern classification to detect subtle stimulus-specific information from patterns of responses among voxels, including information that cannot be detected in the average response across a given brain region. Here we use MVPA in combination with rapid temporal sampling of the fMRI signal to investigate the temporal evolution of classification accuracy and its relationship to the average regional hemodynamic response. In primary visual cortex (V1) stimulus information can be detected in the pattern of voxel responses more than a second before the average hemodynamic response of V1 deviates from baseline, and classification accuracy peaks before the peak of the average hemodynamic response. Both of these effects are restricted to early visual cortex, with higher level areas showing no difference or, in some cases, the opposite temporal relationship. These results have methodological implications for fMRI studies using MVPA because they demonstrate that information can be decoded from hemodynamic activity more quickly than previously assumed.

[1]  Christopher J. Fox,et al.  Defining the face processing network: Optimization of the functional localizer in fMRI , 2009, Human brain mapping.

[2]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[3]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[4]  Daryl E. Wilson,et al.  Control of Spatial and Feature-Based Attention in Frontoparietal Cortex , 2010, The Journal of Neuroscience.

[5]  Stefan Bode,et al.  Decoding sequential stages of task preparation in the human brain , 2009, NeuroImage.

[6]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[7]  Brenna Argall,et al.  SUMA: an interface for surface-based intra- and inter-subject analysis with AFNI , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[8]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[9]  Robert T. Knight,et al.  Spatio-temporal information analysis of event-related BOLD responses , 2007, NeuroImage.

[10]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[11]  Essa Yacoub,et al.  Modeling and analysis of mechanisms underlying fMRI-based decoding of information conveyed in cortical columns , 2011, NeuroImage.

[12]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[13]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[14]  Peter U. Tse,et al.  Extrastriate cortical activity reflects segmentation of motion into independent sources , 2010, Neuropsychologia.

[15]  Wen-Ming Luh,et al.  The effect of spatial smoothing on fMRI decoding of columnar-level organization with linear support vector machine , 2013, Journal of Neuroscience Methods.

[16]  Steven Yantis,et al.  Efficient acquisition of human retinotopic maps , 2003, Human brain mapping.

[17]  Michael S. Beauchamp,et al.  A new method for improving functional-to-structural MRI alignment using local Pearson correlation , 2009, NeuroImage.

[18]  S. Ogawa,et al.  BOLD Based Functional MRI at 4 Tesla Includes a Capillary Bed Contribution: Echo‐Planar Imaging Correlates with Previous Optical Imaging Using Intrinsic Signals , 1995, Magnetic resonance in medicine.

[19]  Essa Yacoub,et al.  Spatio-temporal point-spread function of fMRI signal in human gray matter at 7 Tesla , 2007, NeuroImage.

[20]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[21]  Nicole C. Rust,et al.  Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT , 2010, The Journal of Neuroscience.

[22]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[23]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[24]  Johan Wagemans,et al.  Perceived Shape Similarity among Unfamiliar Objects and the Organization of the Human Object Vision Pathway , 2008, The Journal of Neuroscience.

[25]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[26]  Jeremy Freeman,et al.  Orientation Decoding Depends on Maps, Not Columns , 2011, The Journal of Neuroscience.

[27]  X Golay,et al.  PRESTO‐SENSE: An ultrafast whole‐brain fMRI technique , 2000, Magnetic resonance in medicine.

[28]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[29]  A. Dale,et al.  Functional Analysis of V3A and Related Areas in Human Visual Cortex , 1997, The Journal of Neuroscience.

[30]  Stefan Pollmann,et al.  Neuroinformatics Original Research Article Pymvpa: a Unifying Approach to the Analysis of Neuroscientifi C Data , 2022 .

[31]  Alex R. Wade,et al.  Visual field maps and stimulus selectivity in human ventral occipital cortex , 2005, Nature Neuroscience.

[32]  John-Dylan Haynes,et al.  Decoding visual consciousness from human brain signals , 2009, Trends in Cognitive Sciences.

[33]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.