Neurobiology of economic choice: a good-based model.

Traditionally the object of economic theory and experimental psychology, economic choice recently became a lively research focus in systems neuroscience. Here I summarize the emerging results and propose a unifying model of how economic choice might function at the neural level. Economic choice entails comparing options that vary on multiple dimensions. Hence, while choosing, individuals integrate different determinants into a subjective value; decisions are then made by comparing values. According to the good-based model, the values of different goods are computed independently of one another, which implies transitivity. Values are not learned as such, but rather computed at the time of choice. Most importantly, values are compared within the space of goods, independent of the sensorimotor contingencies of choice. Evidence from neurophysiology, imaging, and lesion studies indicates that abstract representations of value exist in the orbitofrontal and ventromedial prefrontal cortices. The computation and comparison of values may thus take place within these regions.

[1]  A. Tversky Intransitivity of preferences. , 1969 .

[2]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[3]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[4]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[5]  Christopher D. Adams Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[6]  D. P. O’brien,et al.  A history of economic theory : classic contributions, 1720-1980 , 1990 .

[7]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[8]  A. Tversky,et al.  Context-dependent preferences , 1993 .

[9]  R. Grace Violations of transitivity: Implications for a theory of contextual choice. , 1993, Journal of the experimental analysis of behavior.

[10]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[11]  J. Kagel,et al.  Economic Choice Theory: An Experimental Analysis of Animal Behavior , 1995 .

[12]  J. Andersson,et al.  Functional neuroanatomical correlates of electrodermal activity: a positron emission tomographic study. , 1998, Psychophysiology.

[13]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[14]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[15]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[16]  T. Robbins,et al.  Specific cognitive deficits in mild frontal variant frontotemporal dementia. , 1999, Brain : a journal of neurology.

[17]  G. Schoenbaum,et al.  Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning , 1999, The Journal of Neuroscience.

[18]  J. Price Prefrontal Cortical Networks Related to Visceral Function and Mood , 1999, Annals of the New York Academy of Sciences.

[19]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[20]  J Schlag,et al.  Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. , 2000, Journal of neurophysiology.

[21]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[22]  P. Strick,et al.  Imaging the premotor areas , 2001, Current Opinion in Neurobiology.

[23]  S. Shafir,et al.  Context-dependent violations of rational choice in honeybees (Apis mellifera) and gray jays (Perisoreus canadensis) , 2001, Behavioral Ecology and Sociobiology.

[24]  M. Walton,et al.  The Role of Rat Medial Frontal Cortex in Effort-Based Decision Making , 2002, The Journal of Neuroscience.

[25]  J. Kalaska,et al.  Simultaneous encoding of multiple potential reach directions in dorsal premotor cortex. , 2002, Journal of neurophysiology.

[26]  J. Deakin,et al.  Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement , 2002, Psychopharmacology.

[27]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[28]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[29]  Colin Camerer Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[30]  Amos Tversky,et al.  Preference, Belief, and Similarity: Selected Writings , 2003 .

[31]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[32]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[33]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[34]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[35]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[36]  Geoffrey Schoenbaum,et al.  Different Roles for Orbitofrontal Cortex and Basolateral Amygdala in a Reinforcer Devaluation Task , 2003, The Journal of Neuroscience.

[37]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[38]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[39]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[40]  E T Rolls,et al.  Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. , 2004, Brain : a journal of neurology.

[41]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[42]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[43]  T. Robbins,et al.  Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice , 2004, The Journal of Neuroscience.

[44]  W. Newsome,et al.  Representation of an abstract perceptual decision in macaque superior colliculus. , 2004, Journal of neurophysiology.

[45]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[46]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[47]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[48]  D. Ross Economic Theory and Cognitive Science , 2005 .

[49]  M. Kimura,et al.  Complementary Process to Response Bias in the Centromedian Nucleus of the Thalamus , 2005, Science.

[50]  H. Critchley Neural mechanisms of autonomic, affective, and cognitive integration , 2005, The Journal of comparative neurology.

[51]  Paul Glimcher,et al.  Physiological utility theory and the neuroeconomics of choice , 2005, Games Econ. Behav..

[52]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[53]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[54]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[55]  D. Zald The Rodent Orbitofrontal Cortex Gets Time and Direction , 2006, Neuron.

[56]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[57]  Jonathan D. Cohen,et al.  Imaging valuation models in human choice. , 2006, Annual review of neuroscience.

[58]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[59]  M. Walton,et al.  Separate neural pathways process different decision costs , 2006, Nature Neuroscience.

[60]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[61]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[62]  D. Tranel,et al.  Irrational Economic Decision-Making after Ventromedial Prefrontal Damage: Evidence from the Ultimatum Game , 2007, The Journal of Neuroscience.

[63]  M. Farah,et al.  Cerebral Cortex doi:10.1093/cercor/bhl176 The Role of Ventromedial Prefrontal Cortex in Decision Making: Judgment under Uncertainty or Judgment Per Se? , 2007 .

[64]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[65]  B. Balleine,et al.  Still at the Choice‐Point , 2007, Annals of the New York Academy of Sciences.

[66]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[67]  Cyriel M A Pennartz,et al.  Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. , 2007, Learning & memory.

[68]  J. Bachevalier,et al.  The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates , 2007, The European journal of neuroscience.

[69]  J. Bachevalier,et al.  Measuring reward assessment in a semi-naturalistic context: The effects of selective amygdala, orbital frontal or hippocampal lesions , 2007, Neuroscience.

[70]  C. Padoa-Schioppa Orbitofrontal Cortex and the Computation of Economic Value , 2007, Annals of the New York Academy of Sciences.

[71]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[72]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[73]  M. Platt,et al.  Neural Correlates of Social Target Value in Macaque Parietal Cortex , 2008, Current Biology.

[74]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[75]  Samuel M. McClure,et al.  Anchors, scales and the relative coding of value in the brain , 2008, Current Opinion in Neurobiology.

[76]  Daeyeol Lee,et al.  Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice , 2008, Neuron.

[77]  Steven P. Wise,et al.  Forward frontal fields: phylogeny and fundamental function , 2008, Trends in Neurosciences.

[78]  Timothy E. J. Behrens,et al.  Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli , 2008, The Journal of Neuroscience.

[79]  P. Glimcher,et al.  Value Representations in the Primate Striatum during Matching Behavior , 2008, Neuron.

[80]  K. Dowding Don Ross Economic Theory and Cognitive Science: Microexplanation , 2008, The British Journal for the Philosophy of Science.

[81]  Colin Camerer,et al.  Neuroeconomics: decision making and the brain , 2008 .

[82]  C. Padoa-Schioppa THE SYLLOGISM OF NEURO-ECONOMICS , 2008, Economics and Philosophy.

[83]  W. Schultz,et al.  Influence of Reward Delays on Responses of Dopamine Neurons , 2008, The Journal of Neuroscience.

[84]  C. Büchel,et al.  Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making , 2009, The Journal of Neuroscience.

[85]  P. Glimcher Choice: Towards a Standard Back-pocket Model , 2009 .

[86]  C. Padoa-Schioppa Range-Adapting Representation of Economic Value in the Orbitofrontal Cortex , 2009, The Journal of Neuroscience.

[87]  D. Kumaran,et al.  The Neurobiology of Reference-Dependent Value Computation , 2009, NeuroImage.

[88]  George I. Christopoulos,et al.  Neural Correlates of Value, Risk, and Risk Aversion Contributing to Decision Making under Risk , 2009, The Journal of Neuroscience.

[89]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[90]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[91]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[92]  S. Kennerley,et al.  Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. , 2009, Journal of neurophysiology.

[93]  J. Bachevalier,et al.  Behavioral/systems/cognitive Selective Aspiration or Neurotoxic Lesions of Orbital Frontal Areas 11 and 13 Spared Monkeys' Performance on the Object Discrimination Reversal Task , 2022 .

[94]  Jung Hoon Sul,et al.  Role of Striatum in Updating Values of Chosen Actions , 2009, The Journal of Neuroscience.

[95]  David Gaffan,et al.  Ventrolateral prefrontal cortex is required for performance of a strategy implementation task but not reinforcer devaluation effects in rhesus monkeys , 2009, The European journal of neuroscience.

[96]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[97]  Colin Camerer,et al.  Neural Response to Reward Anticipation under Risk Is Nonlinear in Probabilities , 2009, The Journal of Neuroscience.

[98]  W. Schultz,et al.  Short-Term Temporal Discounting of Reward Value in Human Ventral Striatum , 2009, Journal of neurophysiology.

[99]  M. Rushworth,et al.  General Mechanisms for Making Decisions? This Review Comes from a Themed Issue on Cognitive Neuroscience Edited the Representation of Value and Reward Expectations in Frontal Cortex Reward Prediction Errors and Learning Rates Other Types of Prediction Error , 2022 .

[100]  K. Bär,et al.  The relation of ventromedial prefrontal cortex activity and heart rate fluctuations at rest , 2009, The European journal of neuroscience.

[101]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[102]  C. Daniel Salzman,et al.  The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons , 2009, The Journal of Neuroscience.

[103]  P. Tobler,et al.  Neural Signatures of Intransitive Preferences , 2010, Front. Hum. Neurosci..

[104]  W. Schultz,et al.  Coding of Reward Risk by Orbitofrontal Neurons Is Mostly Distinct from Coding of Reward Value , 2010, Neuron.

[105]  W. Schultz,et al.  Adaptation of Reward Sensitivity in Orbitofrontal Neurons , 2010, The Journal of Neuroscience.

[106]  Antonio Rangel,et al.  Neural computations associated with goal-directed choice , 2010, Current Opinion in Neurobiology.

[107]  J. Price,et al.  Neurocircuitry of Mood Disorders , 2010, Neuropsychopharmacology.

[108]  G. Berns,et al.  BAD TO WORSE , 1975, The Lancet.

[109]  P. Glimcher,et al.  Title: the Neural Representation of Subjective Value under Risk and Ambiguity 1 2 , 2009 .

[110]  Stefan M. Gruenert,et al.  Addiction: A Disorder of Choice , 2010 .

[111]  Antonio Rangel,et al.  Economic choices can be made using only stimulus values , 2010, Proceedings of the National Academy of Sciences.

[112]  Michael C. Dorris,et al.  Modeling the Value of Strategic Actions in the Superior Colliculus , 2009, Front. Behav. Neurosci..

[113]  Joshua D. Greene,et al.  Moral Judgments Recruit Domain-General Valuation Mechanisms to Integrate Representations of Probability and Magnitude , 2010, Neuron.

[114]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.

[115]  Daeyeol Lee,et al.  Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice , 2011, Neuron.

[116]  W Pieter Medendorp,et al.  Three-dimensional transformations for goal-directed action. , 2011, Annual review of neuroscience.

[117]  L. Squire,et al.  The cognitive neuroscience of human memory since H.M. , 2011, Annual review of neuroscience.

[118]  J. Songer,et al.  Vestibular hair cells and afferents: two channels for head motion signals. , 2011, Annual review of neuroscience.

[119]  J. Gold,et al.  Distinct Representations of a Perceptual Decision and the Associated Oculomotor Plan in the Monkey Lateral Intraparietal Area , 2011, The Journal of Neuroscience.

[120]  ปิยดา สมบัติวัฒนา Behavioral Game Theory: Experiments in Strategic Interaction , 2013 .