Inverted Encoding Models of Human Population Response Conflate Noise and Neural Tuning Width

Channel-encoding models offer the ability to bridge different scales of neuronal measurement by interpreting population responses, typically measured with BOLD imaging in humans, as linear sums of groups of neurons (channels) tuned for visual stimulus properties. Inverting these models to form predicted channel responses from population measurements in humans seemingly offers the potential to infer neuronal tuning properties. Here, we test the ability to make inferences about neural tuning width from inverted encoding models. We examined contrast invariance of orientation selectivity in human V1 (both sexes) and found that inverting the encoding model resulted in channel response functions that became broader with lower contrast, thus apparently violating contrast invariance. Simulations showed that this broadening could be explained by contrast-invariant single-unit tuning with the measured decrease in response amplitude at lower contrast. The decrease in response lowers the signal-to-noise ratio of population responses that results in poorer population representation of orientation. Simulations further showed that increasing signal to noise makes channel response functions less sensitive to underlying neural tuning width, and in the limit of zero noise will reconstruct the channel function assumed by the model regardless of the bandwidth of single units. We conclude that our data are consistent with contrast-invariant orientation tuning in human V1. More generally, our results demonstrate that population selectivity measures obtained by encoding models can deviate substantially from the behavior of single units because they conflate neural tuning width and noise and are therefore better used to estimate the uncertainty of decoded stimulus properties. SIGNIFICANCE STATEMENT It is widely recognized that perceptual experience arises from large populations of neurons, rather than a few single units. Yet, much theory and experiment have examined links between single units and perception. Encoding models offer a way to bridge this gap by explicitly interpreting population activity as the aggregate response of many single neurons with known tuning properties. Here we use this approach to examine contrast-invariant orientation tuning of human V1. We show with experiment and modeling that due to lower signal to noise, contrast-invariant orientation tuning of single units manifests in population response functions that broaden at lower contrast, rather than remain contrast-invariant. These results highlight the need for explicit quantitative modeling when making a reverse inference from population response profiles to single-unit responses.

[1]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[2]  Justin L. Gardner,et al.  Demonstration of Tuning to Stimulus Orientation in the Human Visual Cortex: A High-Resolution fMRI Study with a Novel Continuous and Periodic Stimulation Paradigm , 2012, Cerebral cortex.

[3]  Edward F. Ester,et al.  Parietal and Frontal Cortex Encode Stimulus-Specific Mnemonic Representations during Visual Working Memory , 2015, Neuron.

[4]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Justin L Gardner,et al.  Encoding of graded changes in spatial specificity of prior cues in human visual cortex. , 2014, Journal of neurophysiology.

[6]  Justin L. Gardner,et al.  Cortical Correlates of Human Motion Perception Biases , 2014, The Journal of Neuroscience.

[7]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[8]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[9]  M. Farah,et al.  Functional Imaging in Behavioral Neurology and Cognitive Neuropsychology , 2002 .

[10]  S. Ogawa Brain magnetic resonance imaging with contrast-dependent oxygenation , 1990 .

[11]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[12]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[13]  Carrie J. McAdams,et al.  Effects of Attention on the Reliability of Individual Neurons in Monkey Visual Cortex , 1999, Neuron.

[14]  A. Dale,et al.  Functional analysis of primary visual cortex (V1) in humans. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[16]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[17]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[18]  J. Serences,et al.  Optimal Deployment of Attentional Gain during Fine Discriminations , 2012, The Journal of Neuroscience.

[19]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[20]  Nicholas J. Priebe,et al.  The Emergence of Contrast-Invariant Orientation Tuning in Simple Cells of Cat Visual Cortex , 2007, Neuron.

[21]  Alex R. Wade,et al.  Representation of Concurrent Stimuli by Population Activity in Visual Cortex , 2014, Neuron.

[22]  Essa Yacoub,et al.  Mechanisms underlying decoding at 7 T: Ocular dominance columns, broad structures, and macroscopic blood vessels in V1 convey information on the stimulated eye , 2010, NeuroImage.

[23]  John T Serences,et al.  Enhanced attentional gain as a mechanism for generalized perceptual learning in human visual cortex. , 2014, Journal of neurophysiology.

[24]  Franco Pestilli,et al.  A review of the mechanisms by which attentional feedback shapes visual selectivity , 2014, Brain Structure and Function.

[25]  Amiram Grinvald,et al.  Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns , 1991, Nature.

[26]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[27]  R. Poldrack Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.

[28]  A. Shmuel,et al.  Robust Detection of Ocular Dominance Columns in Humans using Hahn Spin Echo BOLD fMRI at High Fields , 2004 .

[29]  Stephen A. Engel,et al.  Linear systems analysis of the fMRI signal , 2012, NeuroImage.

[30]  D. Heeger,et al.  Categorical Clustering of the Neural Representation of Color , 2013, The Journal of Neuroscience.

[31]  J. Gallant,et al.  Attention to Stimulus Features Shifts Spectral Tuning of V4 Neurons during Natural Vision , 2008, Neuron.

[32]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[33]  D. Heeger,et al.  Normalization in human somatosensory cortex. , 2015, Journal of neurophysiology.

[34]  Paul Schrater,et al.  BOLD fMRI and psychophysical measurements of contrast response to broadband images , 2004, Vision Research.

[35]  Nikolaus Kriegeskorte,et al.  fMRI orientation decoding in V1 does not require global maps or globally coherent orientation stimuli , 2012, Front. Psychol..

[36]  Barbara A Dosher,et al.  Blood oxygenation level-dependent contrast response functions identify mechanisms of covert attention in early visual areas , 2008, Proceedings of the National Academy of Sciences.

[37]  Jeremy Freeman,et al.  Orientation Decoding Depends on Maps, Not Columns , 2011, The Journal of Neuroscience.

[38]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[39]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[40]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[41]  Barbara Anne Dosher,et al.  Mechanisms of visual attention. , 2013 .

[42]  Alex R. Wade,et al.  Representation of Concurrent Stimuli by Population Activity in Visual Cortex , 2009, Neuron.

[43]  Matteo Carandini,et al.  Coding of stimulus sequences by population responses in visual cortex , 2009, Nature Neuroscience.

[44]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[45]  J. Serences,et al.  Spatial attention improves the quality of population codes in human visual cortex. , 2010, Journal of neurophysiology.

[46]  Edward Awh,et al.  Feature-Selective Attentional Modulations in Human Frontoparietal Cortex , 2016, The Journal of Neuroscience.

[47]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[48]  Janneke F. M. Jehee,et al.  Attention Improves Encoding of Task-Relevant Features in the Human Visual Cortex , 2011, The Journal of Neuroscience.

[49]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[50]  Jeremy Freeman,et al.  Motion Direction Biases and Decoding in Human Visual Cortex , 2014, The Journal of Neuroscience.

[51]  John T. Serences,et al.  Acute Exercise Modulates Feature-selective Responses in Human Cortex , 2017, Journal of Cognitive Neuroscience.

[52]  Kenichi Ueno,et al.  A temporal frequency–dependent functional architecture in human V1 revealed by high-resolution fMRI , 2007, Nature Neuroscience.

[53]  C. Furmanski,et al.  An oblique effect in human primary visual cortex , 2000, Nature Neuroscience.

[54]  M. Sahani,et al.  Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes. , 2008, Journal of vision.

[55]  D. Heeger,et al.  Attentional Enhancement via Selection and Pooling of Early Sensory Responses in Human Visual Cortex , 2011, Neuron.

[56]  Jascha D. Swisher,et al.  Multiscale Pattern Analysis of Orientation-Selective Activity in the Primary Visual Cortex , 2010, The Journal of Neuroscience.

[57]  X Hu,et al.  Retrospective estimation and correction of physiological fluctuation in functional MRI , 1995, Magnetic resonance in medicine.

[58]  John H. R. Maunsell,et al.  Effects of spatial attention on contrast response functions in macaque area V4. , 2006, Journal of neurophysiology.

[59]  Denis Schluppeck,et al.  Contribution of large scale biases in decoding of direction-of-motion from high-resolution fMRI data in human early visual cortex , 2012, NeuroImage.

[60]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[61]  Franco Pestilli,et al.  Differing effects of attention in single-units and populations are well predicted by heterogeneous tuning and the normalization model of attention , 2014, Front. Comput. Neurosci..

[62]  Jeremy Freeman,et al.  Coarse-Scale Biases for Spirals and Orientation in Human Visual Cortex , 2013, The Journal of Neuroscience.

[63]  Taiyong Bi,et al.  Sharpened cortical tuning and enhanced cortico-cortical communication contribute to the long-term neural mechanisms of visual motion perceptual learning , 2015, NeuroImage.

[64]  John T. Serences,et al.  Visual attention mitigates information loss in small- and large-scale neural codes , 2015, Trends in Cognitive Sciences.

[65]  G. Blasdel,et al.  Voltage-sensitive dyes reveal a modular organization in monkey striate cortex , 1986, Nature.

[66]  Thomas C. Sprague,et al.  Changing the Spatial Scope of Attention Alters Patterns of Neural Gain in Human Cortex , 2014, The Journal of Neuroscience.

[67]  M. Behrmann,et al.  Correlations between the fMRI BOLD Signal and Visual Perception , 2002, Neuron.

[68]  J. Serences,et al.  Near-Real-Time Feature-Selective Modulations in Human Cortex , 2013, Current Biology.

[69]  Maria Concetta Morrone,et al.  Temporally evolving gain mechanisms of attention in macaque area V4. , 2017, Journal of neurophysiology.

[70]  Thomas A Carlson,et al.  Orientation Decoding in Human Visual Cortex: New Insights from an Unbiased Perspective , 2014, The Journal of Neuroscience.

[71]  John T. Serences,et al.  Computational advances towards linking BOLD and behavior , 2012, Neuropsychologia.

[72]  D. Heeger,et al.  Neuronal basis of contrast discrimination , 1999, Vision Research.

[73]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[74]  Won Mok Shim,et al.  Reconstructing representations of dynamic visual objects in early visual cortex , 2015, Proceedings of the National Academy of Sciences.

[75]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[76]  Justin L. Gardner,et al.  Is cortical vasculature functionally organized? , 2010, NeuroImage.

[77]  D. Heeger,et al.  Spatial attention affects brain activity in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[78]  Keiji Tanaka,et al.  Human Ocular Dominance Columns as Revealed by High-Field Functional Magnetic Resonance Imaging , 2001, Neuron.

[79]  Essa Yacoub,et al.  High-field fMRI unveils orientation columns in humans , 2008, Proceedings of the National Academy of Sciences.

[80]  J. B. Levitt,et al.  Receptive fields and functional architecture of macaque V2. , 1994, Journal of neurophysiology.

[81]  X Hu,et al.  Retrospective estimation and correction of physiological artifacts in fMRI by direct extraction of physiological activity from MR data , 1996, Magnetic resonance in medicine.

[82]  Daniel Hershey,et al.  Blood Oxygenation , 1970, Springer US.

[83]  Nikolaus Kriegeskorte,et al.  How does an fMRI voxel sample the neuronal activity pattern: Compact-kernel or complex spatiotemporal filter? , 2010, NeuroImage.

[84]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[85]  Stefano Fusi,et al.  Why neurons mix: high dimensionality for higher cognition , 2016, Current Opinion in Neurobiology.

[86]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[87]  Pieter R Roelfsema,et al.  Separable Codes for Attention and Luminance Contrast in the Primary Visual Cortex , 2010, The Journal of Neuroscience.

[88]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[89]  Janneke F. M. Jehee,et al.  Sensory uncertainty decoded from visual cortex predicts behavior , 2015, Nature Neuroscience.

[90]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[91]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[92]  Edward Awh,et al.  A Neural Measure of Precision in Visual Working Memory , 2013, Journal of Cognitive Neuroscience.

[93]  John H R Maunsell,et al.  The effect of attention on neuronal responses to high and low contrast stimuli. , 2010, Journal of neurophysiology.

[94]  Justin L. Gardner,et al.  Contrast Adaptation and Representation in Human Early Visual Cortex , 2005, Neuron.

[95]  Geoffrey M Boynton,et al.  Imaging orientation selectivity: decoding conscious perception in V1 , 2005, Nature Neuroscience.

[96]  D. G. Albrecht,et al.  Striate cortex of monkey and cat: contrast response function. , 1982, Journal of neurophysiology.

[97]  Jonas Larsson,et al.  Spatial scale and distribution of neurovascular signals underlying decoding of orientation and eye of origin from fMRI data. , 2017, Journal of neurophysiology.

[98]  J. Serences,et al.  Attention Improves Transfer of Motion Information between V1 and MT , 2014, The Journal of Neuroscience.

[99]  Wim Vanduffel,et al.  The Radial Bias: A Different Slant on Visual Orientation Sensitivity in Human and Nonhuman Primates , 2006, Neuron.

[100]  Scott O Murray,et al.  The effects of spatial attention in early human visual cortex are stimulus independent. , 2008, Journal of vision.

[101]  D. Heeger,et al.  Cross-orientation suppression in human visual cortex. , 2011, Journal of neurophysiology.

[102]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[103]  Hansjörg Scherberger,et al.  Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning , 2016, PLoS Comput. Biol..

[104]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[105]  Scott D. Brown,et al.  The Optimality of Sensory Processing during the Speed–Accuracy Tradeoff , 2012, The Journal of Neuroscience.

[106]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[107]  S. Treue,et al.  Attentional Modulation Strength in Cortical Area MT Depends on Stimulus Contrast , 2002, Neuron.

[108]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[109]  Giedrius T Buracas,et al.  The Effect of Spatial Attention on Contrast Response Functions in Human Visual Cortex , 2007, The Journal of Neuroscience.

[110]  R. Freeman,et al.  Orientation selectivity in the cat's striate cortex is invariant with stimulus contrast , 2004, Experimental Brain Research.

[111]  John H. R. Maunsell,et al.  Coding of image contrast in central visual pathways of the macaque monkey , 1990, Vision Research.

[112]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[113]  Essa Yacoub,et al.  Robust detection of ocular dominance columns in humans using Hahn Spin Echo BOLD functional MRI at 7 Tesla , 2007, NeuroImage.

[114]  D J Heeger,et al.  Robust multiresolution alignment of MRI brain volumes , 2000, Magnetic resonance in medicine.

[115]  Frank Tong,et al.  Radial bias is not necessary for orientation decoding , 2016, NeuroImage.

[116]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[117]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[118]  I. Ohzawa,et al.  The effects of contrast on visual orientation and spatial frequency discrimination: a comparison of single cells and behavior. , 1987, Journal of neurophysiology.