Brain Hemispheres Selectively Track the Expected Value of Contralateral Options

A main focus in economics is on binary choice situations, in which human agents have to choose between two alternative options. The classical view is that decision making consists of valuating each option, comparing the two expected values, and selecting the higher one. Some neural correlates of option values have been described in animals, but little is known about how they are represented in the human brain: are they integrated into a single center or distributed over different areas? To address this issue, we examined whether the expected values of two options, which were cued by visual symbols and chosen with either the left or right hand, could be distinguished using functional magnetic resonance imaging. The two options were linked to monetary rewards through probabilistic contingencies that subjects had to learn so as to maximize payoff. Learning curves were fitted with a standard computational model that updates, on a trial-by-trial basis, the value of the chosen option in proportion to a reward prediction error. Results show that during learning, left and right option values were specifically expressed in the contralateral ventral prefrontal cortex, regardless of the upcoming choice. We therefore suggest that expected values are represented in a distributed manner that respects the topography of the brain systems elicited by the available options.

[1]  R. Sperry.  Cerebral Organization and Behavior: The split brain behaves in many respects like two separate brains, providing new research possibilities. , 1961, Science.

[2]  Ralph R. Miller,et al.  Assessment of the Rescorla-Wagner model. , 1995 .

[3]  Masataka Watanabe.  Reward expectancy in primate prefrental neurons , 1996, Nature.

[4]  M. Gazzaniga,et al.  Isolation of a right hemisphere cognitive system in a patient with anarchic (alien) hand sign , 1997, Neuropsychologia.

[5]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[6]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[7]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[8]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[9]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[10]  Hagai Bergman,et al.  Stepping out of the box: information processing in the neural networks of the basal ganglia , 2001, Current Opinion in Neurobiology.

[11]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[12]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[13]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[14]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[15]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[16]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[17]  S. Haber.  The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[18]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[19]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[20]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[21]  N. Swindale,et al.  Diffusion tensor fiber tracking shows distinct corticostriatal circuits in humans , 2004, Annals of neurology.

[22]  M. Gazzaniga.  Forty-five years of split-brain research and still going strong , 2005, Nature Reviews Neuroscience.

[23]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[24]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[25]  Axel Cleeremans,et al.  Consciousness: converging insights from connectionist modeling and neuroscience , 2005, Trends in Cognitive Sciences.

[26]  B. Baars.  Global workspace theory of consciousness: toward a cognitive neuroscience of human experience. , 2005, Progress in brain research.

[27]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[28]  D. Hansel,et al.  Competition between Feedback Loops Underlies Normal and Pathological Dynamics in the Basal Ganglia , 2022 .

[29]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[30]  Nikolaus Weiskopf,et al.  Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: A whole-brain analysis at 3 T and 1.5 T , 2006, NeuroImage.

[31]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[32]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[33]  R. Dolan,et al.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans , 2006, Nature.

[34]  Daniel M. Corcos,et al.  Three-dimensional locations and boundaries of motor and premotor cortices as defined by functional brain imaging: A meta-analysis , 2006, NeuroImage.

[35]  J C Houk,et al.  Action selection and refinement in subcortical loops through basal ganglia and cerebellum , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[37]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[38]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[39]  Michael J. Frank,et al.  Understanding decision-making deficits in neurological conditions: insights from models of natural action selection , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[40]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[41]  E. Bézard,et al.  Shaping of Motor Responses by Incentive Values through the Basal Ganglia , 2007, The Journal of Neuroscience.

[42]  G. Loewenstein,et al.  Neural Predictors of Purchases , 2007, Neuron.

[43]  Kevin McCabe,et al.  Neural signature of fictive learning signals in a sequential investment task , 2007, Proceedings of the National Academy of Sciences.

[44]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[45]  David Badre,et al.  Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes , 2008, Trends in Cognitive Sciences.

[46]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[47]  P. Glimcher,et al.  Value Representations in the Primate Striatum during Matching Behavior , 2008, Neuron.

[48]  R. Dolan,et al.  Subliminal Instrumental Conditioning Demonstrated in the Human Brain , 2008, Neuron.

[49]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.