A comparison of fMRI adaptation and multivariate pattern classification analysis in visual cortex

Functional magnetic resonance imaging (fMRI) has become a ubiquitous tool in cognitive neuroscience. The technique allows noninvasive measurements of cortical responses in the human brain, but only on the millimeter scale. Because a typical voxel contains many thousands of neurons with varied properties, establishing the selectivity of their responses directly is impossible. In recent years, two methods using fMRI aimed at studying the selectivity of neuronal populations on a ‘subvoxel’ scale have been heavily used. The first technique, fMRI adaptation, relies on the observation that the blood oxygen level-dependent (BOLD) response in a given voxel is reduced after prolonged presentation of a stimulus, and that this reduction is selective to the characteristics of the repeated stimuli (adapters). The second technique, multivariate pattern analysis (MVPA), makes use of multivariate statistics to recover small biases in individual voxels in their responses to different stimuli. It is thought that these biases arise due to the uneven distribution of neurons (with different properties) sampled by the many voxels in the imaged volume. These two techniques have not been compared explicitly, however, and little is known about their relative sensitivities. Here, we compared fMRI results from orientation-specific visual adaptation and orientation–classification by MVPA, using optimized experimental designs for each, and found that the multivariate pattern classification approach was more sensitive to small differences in stimulus orientation than the adaptation paradigm. Estimates of orientation selectivity obtained with the two methods were, however, very highly correlated across visual areas.

[1]  L. Maffei,et al.  Neural Correlate of Perceptual Adaptation to Gratings , 1973, Science.

[2]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[3]  T. Shallice,et al.  Face repetition effects in implicit and explicit memory tests as measured by fMRI. , 2002, Cerebral cortex.

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  David J. Heeger,et al.  Pattern-motion responses in human visual cortex , 2002, Nature Neuroscience.

[6]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[7]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[8]  G. Boynton,et al.  Adaptation: from single cells to BOLD signals , 2006, Trends in Neurosciences.

[9]  D. Heeger,et al.  Two Retinotopic Visual Areas in Human Lateral Occipital Cortex , 2006, The Journal of Neuroscience.

[10]  M. D’Esposito,et al.  Empirical analyses of BOLD fMRI statistics. I. Spatially unsmoothed data collected under null-hypothesis conditions. , 1997, NeuroImage.

[11]  M. Giese,et al.  Flexible Coding for Categorical Decisions in the Human Brain , 2007, The Journal of Neuroscience.

[12]  Zoe Kourtzi,et al.  Implied motion from form in the human visual cortex. , 2005, Journal of neurophysiology.

[13]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[14]  P. Lennie Single Units and Visual Cortical Organization , 1998, Perception.

[15]  D J Heeger,et al.  Robust multiresolution alignment of MRI brain volumes , 2000, Magnetic resonance in medicine.

[16]  Arthur Gretton,et al.  Comparison of Pattern Recognition Methods in Classifying High-resolution Bold Signals Obtained at High Magnetic Field in Monkeys , 2008 .

[17]  Lawrence C. Sincich,et al.  Complete Pattern of Ocular Dominance Columns in Human Primary Visual Cortex , 2007, The Journal of Neuroscience.

[18]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[19]  K. Obermayer,et al.  Geometry of orientation and ocular dominance columns in monkey striate cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  K. Grill-Spector,et al.  fMR-adaptation: a tool for studying the functional properties of human cortical neurons. , 2001, Acta psychologica.

[21]  Nikos K. Logothetis,et al.  Integration of Local Features into Global Shapes: Monkey and Human fMRI Studies , 2010 .

[22]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[23]  Stephen A Engel,et al.  Adaptation of Oriented and Unoriented Color-Selective Neurons in Human Visual Areas , 2005, Neuron.

[24]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[25]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[26]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[27]  Seong-Gi Kim,et al.  Neural Interpretation of Blood Oxygenation Level-Dependent fMRI Maps at Submillimeter Columnar Resolution , 2007, The Journal of Neuroscience.

[28]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[30]  N. Logothetis,et al.  Integration of Local Features into Global Shapes Monkey and Human fMRI Studies , 2003, Neuron.

[31]  Zoe Kourtzi,et al.  Spatiotemporal characteristics of form analysis in the human visual cortex revealed by rapid event-related fMRI adaptation , 2005, NeuroImage.

[32]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[33]  Nikos K. Logothetis,et al.  Motion Processing in the Macaque: Revisited with Functional Magnetic Resonance Imaging , 2001, The Journal of Neuroscience.

[34]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[35]  D. Heeger,et al.  Neuronal Basis of the Motion Aftereffect Reconsidered , 2001, Neuron.

[36]  J. Duyn,et al.  Investigation of Low Frequency Drift in fMRI Signal , 1999, NeuroImage.

[37]  Z. Kourtzi,et al.  Neural coding of global form in the human visual cortex. , 2008, Journal of neurophysiology.

[38]  B. Biswal,et al.  Simultaneous assessment of flow and BOLD signals in resting‐state functional connectivity maps , 1997, NMR in biomedicine.

[39]  P. Jezzard,et al.  Principles of nuclear magnetic resonance and MRI , 2012 .

[40]  D. Kersten,et al.  Orientation-tuned FMRI adaptation in human visual cortex. , 2005, Journal of neurophysiology.

[41]  Michael S. Landy,et al.  Orientation-Selective Adaptation to Illusory Contours in Human Visual Cortex , 2007, The Journal of Neuroscience.

[42]  B. Biswal,et al.  Hypercapnia Reversibly Suppresses Low-Frequency Fluctuations in the Human Motor Cortex during Rest Using Echo–Planar MRI , 1997, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[43]  A. Grinvald,et al.  Relationships between orientation-preference pinwheels, cytochrome oxidase blobs, and ocular-dominance columns in primate striate cortex. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[44]  R. Henson,et al.  Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming , 2002, Nature Neuroscience.

[45]  M A Georgeson,et al.  The effect of spatial adaptation on perceived contrast. , 1985, Spatial vision.

[46]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[47]  Stephen M. Smith,et al.  Functional MRI : an introduction to methods , 2002 .

[48]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[49]  Essa Yacoub,et al.  Robust detection of ocular dominance columns in humans using Hahn Spin Echo BOLD functional MRI at 7 Tesla , 2007, NeuroImage.

[50]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[51]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[52]  Timothy J. Andrews,et al.  Distinct representations for facial identity and changeable aspects of faces in the human temporal lobe , 2004, NeuroImage.

[53]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[54]  N. Kanwisher,et al.  Multivariate Patterns in Object-Selective Cortex Dissociate Perceptual and Physical Shape Similarity , 2008, PLoS biology.

[55]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[56]  I. Ohzawa,et al.  Contrast gain control in the cat's visual system. , 1985, Journal of neurophysiology.

[57]  I. Ohzawa,et al.  Contrast gain control in the cat visual cortex , 1982, Nature.

[58]  Arthur Bradley,et al.  Orientation and spatial frequency selectivity of adaptation to color and luminance gratings , 1988, Vision Research.

[59]  Raymond J. Dolan,et al.  fMRI Activity Patterns in Human LOC Carry Information about Object Exemplars within Category , 2008, Journal of Cognitive Neuroscience.

[60]  R. Weisskoff,et al.  Effect of temporal autocorrelation due to physiological noise and stimulus paradigm on voxel‐level false‐positive rates in fMRI , 1998, Human brain mapping.

[61]  P. Lennie,et al.  Profound Contrast Adaptation Early in the Visual Pathway , 2004, Neuron.

[62]  M. Landy,et al.  Orientation-selective adaptation to first- and second-order patterns in human visual cortex. , 2006, Journal of neurophysiology.

[63]  Alex R. Wade,et al.  Visual areas and spatial summation in human visual cortex , 2001, Vision Research.

[64]  Andrew T. Smith,et al.  Evidence for separate motion-detecting mechanisms for first- and second-order motion in human vision , 1994, Vision Research.

[65]  P. Lennie,et al.  Contrast adaptation in striate cortex of macaque , 1989, Vision Research.

[66]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[67]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[68]  K. Grill-Spector,et al.  Object-selective cortex exhibits performance-independent repetition suppression. , 2006, Journal of neurophysiology.

[69]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[70]  Brian A Wandell,et al.  Visual field map clusters in human cortex , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[71]  Jonas Larsson,et al.  Imaging vision : Functional mapping of intermediate visual processes in man , 2001 .

[72]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[73]  G. Boynton,et al.  Orientation-Specific Adaptation in Human Visual Cortex , 2003, The Journal of Neuroscience.

[74]  R. Snowden,et al.  Spatial frequency adaptation: Threshold elevation and perceived contrast , 1996, Vision Research.

[75]  R. Desimone,et al.  Neural mechanisms for visual memory and their role in attention. , 1996, Proceedings of the National Academy of Sciences of the United States of America.