Basing perceptual decisions on the most informative sensory neurons.

Single unit recording studies show that perceptual decisions are often based on the output of sensory neurons that are maximally responsive (or "tuned") to relevant stimulus features. However, when performing a difficult discrimination between two highly similar stimuli, perceptual decisions should instead be based on the activity of neurons tuned away from the relevant feature (off-channel neurons) as these neurons undergo a larger firing rate change and are thus more informative. To test this hypothesis, we measured feature-selective responses in human primary visual cortex (V1) using functional magnetic resonance imaging and show that the degree of off-channel activation predicts performance on a difficult visual discrimination task. Moreover, this predictive relationship between off-channel activation and perceptual acuity is not simply the result of extensive practice with a specific stimulus feature (as in studies of perceptual learning). Instead, relying on the output of the most informative sensory neurons may represent a general, and optimal, strategy for efficiently computing perceptual decisions.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  H. Duvernoy,et al.  Cortical blood vessels of the human brain , 1981, Brain Research Bulletin.

[3]  D. Regan,et al.  Postadaptation orientation discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[6]  W. Newsome,et al.  Microstimulation in visual area MT: effects on direction discrimination performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  R. Snowden Orientation Bandwidth: the and Temporal Frequency , 1992 .

[8]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[9]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[10]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[11]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[12]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[14]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[15]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[16]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[17]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[18]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[19]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[20]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[21]  Stefan Treue,et al.  Different populations of neurons contribute to the detection and discrimination of visual motion , 2001, Vision Research.

[22]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[23]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[24]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[25]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[26]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[27]  Peter E. Latham,et al.  The relevance of Fisher Information for theories of cortical computation and attention , 2001 .

[28]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[29]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[30]  R. Shapley,et al.  Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence , 2002, The Journal of Neuroscience.

[31]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[32]  M. Shadlen,et al.  Microstimulation of visual cortex affects the speed of perceptual decisions , 2003, Nature Neuroscience.

[33]  Emilio Salinas,et al.  Cognitive neuroscience: Flutter Discrimination: neural codes, perception, memory and decision making , 2003, Nature Reviews Neuroscience.

[34]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[35]  N. Logothetis The Underpinnings of the BOLD Functional Magnetic Resonance Imaging Signal , 2003, The Journal of Neuroscience.

[36]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[37]  S. Treue,et al.  Feature-Based Attention Increases the Selectivity of Population Responses in Primate Visual Cortex , 2004, Current Biology.

[38]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[39]  J. Maunsell,et al.  The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4 , 2004, The Journal of Neuroscience.

[40]  W. Newsome,et al.  Representation of an abstract perceptual decision in macaque superior colliculus. , 2004, Journal of neurophysiology.

[41]  G. Boynton Attention and visual perception , 2005, Current Opinion in Neurobiology.

[42]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[43]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[44]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[45]  Moshe Gur,et al.  Cerebral Cortex doi:10.1093/cercor/bhi003 Orientation and Direction Selectivity of Neurons in V1 of Alert Monkeys: Functional Relationships and Laminar Distributions , 2022 .

[46]  Leslie G. Ungerleider,et al.  Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[48]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[49]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[50]  J. Movshon,et al.  A new perceptual illusion reveals mechanisms of sensory decoding , 2007, Nature.

[51]  B. Gillam,et al.  Stereomotion perception for a monocularly camouflaged stimulus. , 2007, Journal of vision.

[52]  J. Movshon,et al.  Integration of sensory evidence in motion discrimination. , 2007, Journal of vision.

[53]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[54]  L. Itti,et al.  Search Goal Tunes Visual Features Optimally , 2007, Neuron.

[55]  Paul E. Downing,et al.  Using multi-voxel pattern analysis of fMRI data to interpret overlapping functional activations , 2007, Trends in Cognitive Sciences.

[56]  G. Boynton,et al.  Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation , 2007, Neuron.

[57]  Jude F. Mitchell,et al.  Differential Attention-Dependent Response Modulation across Cell Classes in Macaque Visual Area V4 , 2007, Neuron.

[58]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[59]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[60]  Johannes Reichold,et al.  The microvascular system of the striate and extrastriate visual cortex of the macaque. , 2008, Cerebral cortex.

[61]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[62]  Masa-aki Sato,et al.  Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders , 2008, Neuron.

[63]  Scott D. Brown,et al.  Domain General Mechanisms of Perceptual Decision Making in Human Cortex , 2009, The Journal of Neuroscience.

[64]  Miranda Scolari,et al.  Estimating the influence of attention on population codes in human visual cortex using voxel-based tuning functions , 2009, NeuroImage.

[65]  J. Serences,et al.  Adaptive Allocation of Attentional Gain , 2009, The Journal of Neuroscience.

[66]  C. Law,et al.  Reinforcement learning can account for associative and perceptual learning on a visual decision task , 2009, Nature Neuroscience.

[67]  Jascha D. Swisher,et al.  Multiscale Pattern Analysis of Orientation-Selective Activity in the Primary Visual Cortex , 2010, The Journal of Neuroscience.