Value-Based Modulations in Human Visual Cortex

Economists and cognitive psychologists have long known that prior rewards bias decision making in favor of options with high expected value. Accordingly, value modulates the activity of sensorimotor neurons involved in initiating movements toward one of two competing decision alternatives. However, little is known about how value influences the acquisition and representation of incoming sensory information or about the neural mechanisms that track the relative value of each available stimulus to guide behavior. Here, fMRI revealed value-related modulations throughout spatially selective areas of the human visual system in the absence of overt saccadic responses (including in V1). These modulations were primarily associated with the reward history of each stimulus and not to self-reported estimates of stimulus value. Finally, subregions of frontal and parietal cortex represent the differential value of competing alternatives and may provide signals to bias spatially selective visual areas in favor of more valuable stimuli.

[1]  P. Glimcher The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[2]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[3]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[4]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[5]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[6]  J. A. Detre,et al.  The Effect of Pacing of Experimental Stimuli on Observed Functional MRI Activity , 1997, NeuroImage.

[7]  Andreas Keil,et al.  Additive effects of emotional content and spatial selective attention on electrocortical facilitation. , 2005, Cerebral cortex.

[8]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[9]  Samuel M. McClure,et al.  BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area , 2008, Science.

[10]  H. Seung,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 581–617 NUMBER 3(NOVEMBER) LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS , 2022 .

[11]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[12]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[13]  P. H. Schiller,et al.  State dependent activity in monkey visual cortex , 2004, Experimental Brain Research.

[14]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[15]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[16]  W. Newsome,et al.  Choosing the greater of two goods: neural currencies for valuation and decision making , 2005, Nature Reviews Neuroscience.

[17]  R. Dolan,et al.  Reward Facilitates Tactile Judgments and Modulates Hemodynamic Responses in Human Primary Somatosensory Cortex , 2008, The Journal of Neuroscience.

[18]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[19]  Jane S. Paulsen Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate , 1996 .

[20]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[21]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[22]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[23]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[24]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[25]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[26]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[27]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[28]  F. Plum Handbook of Physiology. , 1960 .

[29]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[30]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[31]  Shintaro Funahashi,et al.  Reward-period Activity in Primate Dorsolateral Prefrontal and Orbitofrontal Neurons Is Affected by Reward Schedules , 2006, Journal of Cognitive Neuroscience.

[32]  D. Heeger,et al.  Topographic maps of visual spatial attention in human parietal cortex. , 2005, Journal of neurophysiology.

[33]  Á. Pascual-Leone,et al.  Diminishing Risk-Taking Behavior by Modulating Activity in the Prefrontal Cortex: A Direct Current Stimulation Study , 2007, The Journal of Neuroscience.

[34]  O. Hikosaka Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement , 2007, Annals of the New York Academy of Sciences.

[35]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[36]  P. Glimcher,et al.  Action and Outcome Encoding in the Primate Caudate Nucleus , 2007, The Journal of Neuroscience.

[37]  R. Deichmann,et al.  Distinct causal influences of parietal versus frontal areas on human visual cortex: evidence from concurrent TMS-fMRI. , 2008, Cerebral cortex.

[38]  J. Downar,et al.  The Effect of Task Relevance on the Cortical Response to Changes in Visual and Auditory Stimuli: An Event-Related fMRI Study , 2001, NeuroImage.

[39]  S. Yantis,et al.  Spatially selective representations of voluntary and stimulus-driven attentional priority in human occipital, parietal, and frontal cortex. , 2007, Cerebral cortex.

[40]  Kenji Doya,et al.  Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics , 2006, Neural Networks.

[41]  S. Leh,et al.  Fronto-striatal connections in the human brain: A probabilistic diffusion tractography study , 2007, Neuroscience Letters.

[42]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[43]  R. Deichmann,et al.  Concurrent TMS-fMRI and Psychophysics Reveal Frontal Influences on Human Retinotopic Visual Cortex , 2006, Current Biology.

[44]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[45]  J. Maunsell,et al.  State dependent activity in monkey visual cortex , 2004, Experimental Brain Research.

[46]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[47]  Gilles Pourtois,et al.  Dynamics of emotional effects on spatial attention in the human visual cortex. , 2006, Progress in brain research.

[48]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[49]  J. Assad,et al.  Dynamic coding of behaviourally relevant stimuli in parietal cortex , 2002, Nature.

[50]  P. Glimcher Indeterminacy in brain and behavior. , 2005, Annual review of psychology.

[51]  K. Heilman,et al.  Mechanisms underlying hemispatial neglect , 1979, Annals of neurology.

[52]  Michele A. Basso,et al.  Modulation of neuronal activity by target uncertainty , 1997, Nature.

[53]  R. Herrnstein,et al.  Toward a law of response strength. , 1976 .

[54]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[55]  J. Hollerman,et al.  Reward prediction in primate basal ganglia and frontal cortex , 1998, Neuropharmacology.

[56]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[57]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[58]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[59]  Julie A Fiez,et al.  Integrating rewards and cognition in the frontal cortex , 2004, Cognitive, affective & behavioral neuroscience.

[60]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[61]  J. Fuster Memory in the cerebral cortex : an empirical approach to neural networks in the human and nonhuman primate , 1996 .

[62]  Andrew B. Leber,et al.  Coordination of Voluntary and Stimulus-Driven Attentional Control in Human Cortex , 2005, Psychological science.

[63]  D. Munoz,et al.  Saccadic Probability Influences Motor Preparation Signals and Time to Saccadic Initiation , 1998, The Journal of Neuroscience.

[64]  J. Drivera,et al.  Neural response to emotional faces with and without awareness : event-related fMRI in a parietal patient with visual extinction and spatial neglect , 2002 .

[65]  Daeyeol Lee Neural basis of quasi-rational decision making , 2006, Current Opinion in Neurobiology.

[66]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Emotion Facilitates Perception and Potentiates the Perceptual Benefits of Attention , 2022 .

[67]  Peter J. Lang,et al.  Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance , 2005, NeuroImage.

[68]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[69]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[70]  S. Tsujimoto,et al.  Neuronal representation of response-outcome in the primate prefrontal cortex. , 2004, Cerebral cortex.

[71]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[72]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[73]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[74]  D. Heeger,et al.  Spatial attention affects brain activity in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[75]  J Schlag,et al.  Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. , 2000, Journal of neurophysiology.

[76]  Darren R Gitelman,et al.  ILAB: A program for postexperimental eye movement analysis , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[77]  M. Sereno,et al.  Retinotopy and Attention in Human Occipital, Temporal, Parietal, and Frontal Cortex , 2008 .

[78]  M. Corbetta,et al.  An Event-Related Functional Magnetic Resonance Imaging Study of Voluntary and Stimulus-Driven Orienting of Attention , 2005, The Journal of Neuroscience.

[79]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[80]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[81]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[82]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[83]  Daniel C. Krawczyk,et al.  Reward modulation of prefrontal and visual association cortex during an incentive working memory task , 2007, Brain Research.

[84]  John H. R. Maunsell,et al.  Shape selectivity in primate lateral intraparietal cortex , 1998, Nature.

[85]  R. Herrnstein,et al.  Toward a law of response strength. , 1976 .

[86]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[87]  Daphna Joel,et al.  The orbital cortex in rats topographically projects to central parts of the caudate–putamen complex , 2008, Neuroscience Letters.

[88]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[89]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[90]  S. Tsujimoto,et al.  Neuronal activity representing temporal prediction of reward in the primate prefrontal cortex. , 2005, Journal of neurophysiology.

[91]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[92]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[93]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[94]  Nelson A. M. Lemos,et al.  Neuronal Activity in the Primary Somatosensory Thalamocortical Loop Is Modulated by Reward Contingency during Tactile Discrimination , 2007, The Journal of Neuroscience.

[95]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[96]  P Vuilleumier,et al.  Neural response to emotional faces with and without awareness: event-related fMRI in a parietal patient with visual extinction and spatial neglect , 2002, Neuropsychologia.

[97]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[98]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[99]  Leslie G. Ungerleider,et al.  Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[100]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[101]  Luiz Pessoa,et al.  Affective Learning Enhances Visual Detection and Responses in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[102]  J. Driver,et al.  Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[103]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[104]  M. Mesulam A cortical network for directed attention and unilateral neglect , 1981, Annals of neurology.

[105]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..