Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables

A central question in behavioral science is how we select among choice alternatives to obtain consistently the most beneficial outcomes. Three variables are particularly important when making a decision: the potential payoff, the probability of success, and the cost in terms of time and effort. A key brain region in decision making is the frontal cortex as damage here impairs the ability to make optimal choices across a range of decision types. We simultaneously recorded the activity of multiple single neurons in the frontal cortex while subjects made choices involving the three aforementioned decision variables. This enabled us to contrast the relative contribution of the anterior cingulate cortex (ACC), the orbito-frontal cortex, and the lateral prefrontal cortex to the decision-making process. Neurons in all three areas encoded value relating to choices involving probability, payoff, or cost manipulations. However, the most significant signals were in the ACC, where neurons encoded multiplexed representations of the three different decision variables. This supports the notion that the ACC is an important component of the neural circuitry underlying optimal decision making.

[1]  Masataka Watanabe,et al.  Prefrontal and cingulate unit activity during timing behavior in the monkey , 1979, Brain Research.

[2]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[3]  D. Amaral,et al.  Amygdalo‐cortical projections in the monkey (Macaca fascicularis) , 1984, The Journal of comparative neurology.

[4]  E. Rolls,et al.  Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. , 1990, Journal of neurophysiology.

[5]  T. Shallice,et al.  Deficits in strategy application following frontal lobe damage in man. , 1991, Brain : a journal of neurology.

[6]  B. Vogt,et al.  Connections of the Monkey Cingulate Cortex , 1993 .

[7]  P. Goldman-Rakic,et al.  Prefrontal connections of medial motor areas in the rhesus monkey , 1993, The Journal of comparative neurology.

[8]  M. Gabriel,et al.  Neurobiology of Cingulate Cortex and Limbic Thalamus: A Comprehensive Handbook , 1993 .

[9]  P. Strick,et al.  Cingulate Motor Areas , 1993 .

[10]  J. Price,et al.  Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey , 1994, The Journal of comparative neurology.

[11]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[12]  J. Price,et al.  Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys , 1995, The Journal of comparative neurology.

[13]  S. Carmichael,et al.  Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. , 1996, The Journal of comparative neurology.

[14]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[15]  J. Duncan,et al.  Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior , 1996, Cognitive Psychology.

[16]  A. Owen Cognitive planning in humans: Neuropsychological, neuroanatomical and neuropharmacological perspectives , 1997, Progress in Neurobiology.

[17]  A. Kacelnik Normative and descriptive models of decision making: time discounting and risk sensitivity. , 2007, Ciba Foundation symposium.

[18]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[19]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[20]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[21]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[22]  D. Pandya,et al.  Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns , 1999, The European journal of neuroscience.

[23]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[24]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[25]  E. Murray,et al.  Control of Response Selection by Reinforcer Value Requires Interaction of Amygdala and Orbital Prefrontal Cortex , 2000, The Journal of Neuroscience.

[26]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[27]  K. Hikosaka,et al.  Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. , 2000, Cerebral cortex.

[28]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[29]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[30]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[31]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[32]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[33]  K. A. Hadland,et al.  The anterior cingulate and reward-guided selection of actions. , 2003, Journal of neurophysiology.

[34]  G. Schoenbaum,et al.  Encoding Predicted Outcome and Acquired Value in Orbitofrontal Cortex during Cue Sampling Depends upon Input from Basolateral Amygdala , 2003, Neuron.

[35]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[36]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[37]  E. Rolls,et al.  Activity of primate subgenual cingulate cortex neurons is related to sleep. , 2003, Journal of neurophysiology.

[38]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[39]  J. Parkinson,et al.  Dissociable Contributions of the Human Amygdala and Orbitofrontal Cortex to Incentive Motivation and Goal Selection , 2003, The Journal of Neuroscience.

[40]  Joshua W. Brown,et al.  Performance Monitoring by the Anterior Cingulate Cortex During Saccade Countermanding , 2003, Science.

[41]  T. Shallice,et al.  Human cingulate cortex and autonomic control: converging neuroimaging and clinical evidence. , 2003, Brain : a journal of neurology.

[42]  E. Miller,et al.  From rule to response: neuronal processes in the premotor and prefrontal cortex. , 2003, Journal of neurophysiology.

[43]  Ziv M. Williams,et al.  Human anterior cingulate neurons and the integration of monetary reward with motor responses , 2004, Nature Neuroscience.

[44]  D. Gaffan,et al.  Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward , 2004, Experimental Brain Research.

[45]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[46]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[47]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[48]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[49]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[50]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[51]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[52]  S. Zeki,et al.  Neural correlates of beauty. , 2004, Journal of neurophysiology.

[53]  S. Quartz,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[54]  M. Platt,et al.  Risk-sensitive neurons in macaque posterior cingulate cortex , 2005, Nature Neuroscience.

[55]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[56]  M. Roesch,et al.  Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. , 2005, Journal of neurophysiology.

[57]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[58]  Joshua W. Brown,et al.  Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex , 2005, Science.

[59]  K. Saleem,et al.  Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial prefrontal networks in macaque monkeys , 2005, The Journal of comparative neurology.

[60]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[61]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[62]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[63]  Matthew F. S. Rushworth,et al.  Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making , 2006, Neural Networks.

[64]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[65]  M. Walton,et al.  Separate neural pathways process different decision costs , 2006, Nature Neuroscience.

[66]  L. Fellows Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. , 2006, Brain : a journal of neurology.

[67]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[68]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[69]  M. Walton,et al.  A Role for the Macaque Anterior Cingulate Gyrus in Social Valuation , 2006, Science.

[70]  E. Procyk,et al.  Reward encoding in the monkey anterior cingulate cortex. , 2006, Cerebral cortex.

[71]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[72]  J. Wallis Orbitofrontal cortex and its contribution to decision-making. , 2007, Annual review of neuroscience.

[73]  M. Farah,et al.  Cerebral Cortex doi:10.1093/cercor/bhl176 The Role of Ventromedial Prefrontal Cortex in Decision Making: Judgment under Uncertainty or Judgment Per Se? , 2007 .

[74]  Keiji Tanaka,et al.  Medial prefrontal cell activity signaling prediction errors of action values , 2007, Nature Neuroscience.

[75]  B. Balleine,et al.  The Contribution of Orbitofrontal Cortex to Action Selection , 2007, Annals of the New York Academy of Sciences.

[76]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[77]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[78]  E. Procyk,et al.  Expectations, gains, and losses in the anterior cingulate cortex , 2007, Cognitive, affective & behavioral neuroscience.

[79]  Daeyeol Lee,et al.  Functional Specialization of the Primate Frontal Cortex during Decision Making , 2007, The Journal of Neuroscience.

[80]  M. Roesch,et al.  Neuronal Activity Related to Anticipated Reward in Frontal Cortex , 2007, Annals of the New York Academy of Sciences.

[81]  H. Seo,et al.  Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. , 2007, Cerebral cortex.

[82]  C. Padoa-Schioppa,et al.  The representation of economic value in the orbitofrontal cortex is invariant for changes of menu , 2008, Nature Neuroscience.

[83]  Shintaro Funahashi,et al.  Activity of Primate Orbitofrontal and Dorsolateral Prefrontal Neurons: Effect of Reward Schedule on Task-related Activity , 2008, Journal of Cognitive Neuroscience.

[84]  Timothy E. J. Behrens,et al.  Choice, uncertainty and value in prefrontal and cingulate cortex , 2008, Nature Neuroscience.

[85]  D. Zald Orbitofrontal Cortex Contributions to Food Selection and Decision Making , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[86]  S. Kennerley,et al.  Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables , 2009, The European journal of neuroscience.

[87]  Adam Kepecs,et al.  Neural representation of behavioral outcomes in the orbitofrontal cortex , 2009, Current Opinion in Neurobiology.

[88]  Steven C. R. Williams,et al.  N-acetyl aspartate concentration in the anterior cingulate cortex in patients with schizophrenia: A study of clinical and neuropsychological correlates and preliminary exploration of cognitive behaviour therapy effects , 2010, Psychiatry Research: Neuroimaging.

[89]  L. Appelbaum,et al.  “This is Your Brain on Rhetoric”: Research Directions for Neurorhetorics , 2010 .

[90]  W. Schultz,et al.  Coding of Reward Risk by Orbitofrontal Neurons Is Mostly Distinct from Coding of Reward Value , 2010, Neuron.

[91]  Antonio Rangel,et al.  Neural computations associated with goal-directed choice , 2010, Current Opinion in Neurobiology.

[92]  Timothy Edward John Behrens,et al.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[93]  Hauke R. Heekeren,et al.  Neural foundations of risk–return trade-off in investment decisions , 2010, NeuroImage.

[94]  R. Passingham,et al.  Medial frontal cortex: from self-generated action to reflection on one's own performance , 2010, Trends in Cognitive Sciences.

[95]  William H. Alexander,et al.  Computational Models of Performance Monitoring and Cognitive Control , 2010, Top. Cogn. Sci..

[96]  S. Kennerley,et al.  Heterogeneous reward signals in prefrontal cortex , 2010, Current Opinion in Neurobiology.

[97]  I. Daum,et al.  It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations , 2010, Neuropsychologia.

[98]  Stefano Fusi,et al.  Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. , 2010, Annual review of neuroscience.

[99]  Soyoung Q. Park,et al.  The neural code of reward anticipation in human orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[100]  Jung Hoon Sul,et al.  Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making , 2010, Neuron.

[101]  S. Wise,et al.  Interactions between orbital prefrontal cortex and amygdala: advanced cognition, learned responses and instinctive behaviors , 2010, Current Opinion in Neurobiology.

[102]  William H. Alexander,et al.  Competition between learned reward and error outcome predictions in anterior cingulate cortex , 2010, NeuroImage.

[103]  D. Zald,et al.  Reconsidering anhedonia in depression: Lessons from translational neuroscience , 2011, Neuroscience & Biobehavioral Reviews.

[104]  Joshua W. Brown,et al.  Impaired error-likelihood prediction in medial prefrontal cortex in schizophrenia , 2011, NeuroImage.