Orbitofrontal Cortex and the Computation of Economic Value

Abstract: Economic choice is the behavior observed when individuals select one of many available options solely based on subjective preferences. Behavioral evidence suggests that economic choice entails two mental processes: values are first assigned to the available options, and a decision is subsequently made between these values. Numerous reports show that lesions to the orbitofrontal cortex (OFC) lead to choice deficits in various domains, and imaging studies indicate that the OFC activates when people make choices. In this chapter, we review evidence from single cell recordings linking the OFC more specifically to valuation. Individual neurons in the OFC encode the value that monkeys assign to different beverages when they choose between them. These neurons encode economic value as a subjective quantity. Most importantly, neurons in the OFC encode economic value per se, not as a modulation of sensory or motor processes. This trait distinguishes the value representation in the OFC from that observed in other brain areas. That OFC neurons encode economic value independently of visuomotor contingencies suggests that economic choice is fundamentally a choice between goods (good‐based model) rather than a choice between actions (action‐based model).

[1]  B. Skinner,et al.  Science and human behavior , 1953 .

[2]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[3]  J. A. McDonald,et al.  Orality, Preference Behavior, and Reinforcement Value of Nonfood Object in Monkeys with Orbital Frontal Lesions , 1969, Science.

[4]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[5]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[6]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[7]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[8]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[9]  E. Rolls,et al.  Hunger Modulates the Responses to Gustatory Stimuli of Single Neurons in the Caudolateral Orbitofrontal Cortex of the Macaque Monkey , 1989, The European journal of neuroscience.

[10]  HERBERT A. SIMON,et al.  The Architecture of Complexity , 1991 .

[11]  G. Ainslie Picoeconomics: The Strategic Interaction of Successive Motivational States within the Person , 1992 .

[12]  A. Karlsen [Selection by consequences]. , 1992, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[13]  A. Damasio,et al.  The return of Phineas Gage: clues about the brain from the skull of a famous patient. , 1994, Science.

[14]  J. Price,et al.  Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey , 1994, The Journal of comparative neurology.

[15]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[16]  A. Damasio Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[17]  R. Joynt Descartes' Error: Emotion, Reason, and the Human Brain , 1995 .

[18]  J. Kagel,et al.  Economic Choice Theory: An Experimental Analysis of Animal Behavior , 1995 .

[19]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[20]  F. Pasquier,et al.  Frontotemporal dementia: its rediscovery. , 1997, European neurology.

[21]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[22]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[23]  Yong Jeong,et al.  Spatial cognition , 2004, Neurology.

[24]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.

[25]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[26]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[27]  S. Pinker How the Mind Works , 1999, Annals of the New York Academy of Sciences.

[28]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[29]  J. Schall,et al.  Performance monitoring by the supplementary eye ® eld , 2000 .

[30]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[31]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[32]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[33]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[34]  D. Ariely,et al.  Beautiful Faces Have Variable Reward Value fMRI and Behavioral Evidence , 2001, Neuron.

[35]  J. Hodges Frontotemporal dementia (Pick’s disease): Clinical features and assessment , 2001, Neurology.

[36]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[37]  M. Rossor Pick’s disease: A clinical overview , 2001, Neurology.

[38]  E. Rolls,et al.  Representation of pleasant and aversive taste in the human brain. , 2001, Journal of neurophysiology.

[39]  M. Allingham Choice Theory: A Very Short Introduction , 2002 .

[40]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[41]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[42]  Colin Camerer Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[43]  G. Glover,et al.  Dissociated neural representations of intensity and valence in human olfaction , 2003, Nature Neuroscience.

[44]  E. Rolls,et al.  Different representations of pleasant and unpleasant odours in the human brain , 2003, The European journal of neuroscience.

[45]  M. Farah,et al.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. , 2003, Brain : a journal of neurology.

[46]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[47]  E T Rolls,et al.  Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices. , 2003, Cerebral cortex.

[48]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[49]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[50]  D. Perrett,et al.  Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness , 2003, Neuropsychologia.

[51]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[52]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[53]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[54]  J. Parkinson,et al.  Dissociable Contributions of the Human Amygdala and Orbitofrontal Cortex to Incentive Motivation and Goal Selection , 2003, The Journal of Neuroscience.

[55]  Joshua W. Brown,et al.  Performance Monitoring by the Anterior Cingulate Cortex During Saccade Countermanding , 2003, Science.

[56]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[57]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[58]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[59]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[60]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[61]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[62]  S. Thorpe,et al.  The orbitofrontal cortex: Neuronal activity in the behaving monkey , 2004, Experimental Brain Research.

[63]  L. Fellows The cognitive neuroscience of human decision making: a review and conceptual framework. , 2004, Behavioral and cognitive neuroscience reviews.

[64]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[65]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[66]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[67]  N. Volkow,et al.  Drug addiction: the neurobiology of behaviour gone awry , 2004, Nature Reviews Neuroscience.

[68]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[69]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[70]  D. Ross Economic Theory and Cognitive Science , 2005 .

[71]  M. Kimura,et al.  Complementary Process to Response Bias in the Centromedian Nucleus of the Thalamus , 2005, Science.

[72]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[73]  Paul Glimcher,et al.  Physiological utility theory and the neuroeconomics of choice , 2005, Games Econ. Behav..

[74]  Michael L. Platt,et al.  Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques , 2005, Current Biology.

[75]  Veit Stuphorn,et al.  Neuroeconomics: Cardinal Utility in the Orbitofrontal Cortex? , 2006, Current Biology.

[76]  J. Morton,et al.  Choosing the Lesser of Two Evils, the Better of Two Goods: Specifying the Roles of Ventromedial Prefrontal Cortex and Dorsal Anterior Cingulate in Object Choice , 2006, The Journal of Neuroscience.

[77]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[78]  D. Zald The Rodent Orbitofrontal Cortex Gets Time and Direction , 2006, Neuron.

[79]  C. Padoa-Schioppa,et al.  Multi-stage mental process for economic choice in capuchins , 2006, Cognition.

[80]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[81]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[82]  L. Fellows Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. , 2006, Brain : a journal of neurology.

[83]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[84]  D. Tranel,et al.  Irrational Economic Decision-Making after Ventromedial Prefrontal Damage: Evidence from the Ultimatum Game , 2007, The Journal of Neuroscience.

[85]  M. Farah,et al.  Cerebral Cortex doi:10.1093/cercor/bhl176 The Role of Ventromedial Prefrontal Cortex in Decision Making: Judgment under Uncertainty or Judgment Per Se? , 2007 .

[86]  K. Dowding Don Ross Economic Theory and Cognitive Science: Microexplanation , 2008, The British Journal for the Philosophy of Science.