Neurons in the Rat Anterior Cingulate Cortex Dynamically Encode Cost–Benefit in a Spatial Decision-Making Task

Optimal decision-making often requires an assessment of the costs and benefits associated with each available course of action. Previous studies have shown that lesions to the anterior cingulate cortex (ACC) impair cost–benefit decision-making in laboratory animals, but the neural mechanisms underlying the deficit are not well understood. We recorded from ACC neurons in freely moving rats as they performed a spatial decision-making task whereby, in the baseline configuration “2:6B,” rats could pursue two or six food pellets, the latter obtained by climbing a barrier [high cost, high reward (HCHR)]. In this configuration, the mean percentage of HCHR choices was 69 ± 4%, and a substantial portion of ACC neurons (63%) exhibited significantly higher firing for one goal trajectory versus the other; for 94% of these cells, higher firing was associated with the HCHR option. This HCHR bias was not simply attributable to the larger reward, the barrier, or behavioral preference. In intersession and intrasession manipulations involving at least one barrier (2:6B, 2B:6B, and 2:2B), ACC activity rapidly adapted and was consistently biased toward the economically advantageous option relative to the configuration. Interestingly, when only a difference in reward magnitude was presented (2:6, no barrier, HCHR choices of 84 ± 4%), ACC activity was minimal and nonbiased. One interpretation of our data is that the ACC encodes a relative, integrated cost–benefit representation of available choice options that is biased toward the “better” option in terms of effort/outcome ratio. This representation may be specifically recruited when an assessment of reward and effort is required to optimally perform a task.

[1]  Colin Gemmell,et al.  Deep layer prefrontal cortex unit discharge in a cue-controlled open-field environment in the freely-moving rat , 2002, Behavioural Brain Research.

[2]  E. Koechlin,et al.  Motivation and cognitive control in the human prefrontal cortex , 2009, Nature Neuroscience.

[3]  J. Price,et al.  Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys , 1995, The Journal of comparative neurology.

[4]  Ivan Toni,et al.  Neural dynamics of error processing in medial frontal cortex , 2005, NeuroImage.

[5]  S. Floresco,et al.  Amygdala-prefrontal cortical circuitry regulates effort-based decision making. , 2006, Cerebral cortex.

[6]  J. Price,et al.  Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys , 1995, The Journal of comparative neurology.

[7]  S. Kennerley,et al.  Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables , 2009, The European journal of neuroscience.

[8]  K. A. Hadland,et al.  The Effect of Cingulate Cortex Lesions on Task Switching and Working Memory , 2003, Journal of Cognitive Neuroscience.

[9]  E. Procyk,et al.  Behavioral Shifts and Action Valuation in the Anterior Cingulate Cortex , 2008, Neuron.

[10]  Timothy Edward John Behrens,et al.  Effort-Based Cost–Benefit Valuation and the Human Brain , 2009, The Journal of Neuroscience.

[11]  A. Dale,et al.  Dorsal anterior cingulate cortex: A role in reward-based decision making , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[12]  M. Walton,et al.  Probing human and monkey anterior cingulate cortex in variable environments , 2007, Cognitive, affective & behavioral neuroscience.

[13]  E. Procyk,et al.  Expectations, gains, and losses in the anterior cingulate cortex , 2007, Cognitive, affective & behavioral neuroscience.

[14]  S. Ishii,et al.  Resolution of Uncertainty in Prefrontal Cortex , 2006, Neuron.

[15]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[16]  Matthew F S Rushworth,et al.  Functional Specialization within Medial Frontal Cortex of the Anterior Cingulate for Evaluating Effort-Related Decisions , 2003, The Journal of Neuroscience.

[17]  S. Kennerley,et al.  Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. , 2009, Journal of neurophysiology.

[18]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[19]  B. McNaughton,et al.  Firing characteristics of deep layer neurons in prefrontal cortex in rats performing spatial working memory tasks. , 1998, Cerebral cortex.

[20]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[21]  W. Hauber,et al.  Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making. , 2005, Behavioral neuroscience.

[22]  E. Procyk,et al.  Reward encoding in the monkey anterior cingulate cortex. , 2006, Cerebral cortex.

[23]  Philip K. McGuire,et al.  A Functional Magnetic Resonance Imaging Study of Overt Letter Verbal Fluency Using a Clustered Acquisition Sequence: Greater Anterior Cingulate Activation with Increased Task Demand , 2002, NeuroImage.

[24]  J. Wallis,et al.  Neuronal Mechanisms in Prefrontal Cortex Underlying Adaptive Choice Behavior , 2007, Annals of the New York Academy of Sciences.

[25]  R. Kesner,et al.  The role of the prefrontal cortex in object–place learning: a test of the attribute specificity model , 2003, Behavioural Brain Research.

[26]  L. Swanson The Rat Brain in Stereotaxic Coordinates, George Paxinos, Charles Watson (Eds.). Academic Press, San Diego, CA (1982), vii + 153, $35.00, ISBN: 0 125 47620 5 , 1984 .

[27]  Daniel Durstewitz,et al.  Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex , 2008, Proceedings of the National Academy of Sciences.

[28]  Wolfgang Hauber,et al.  Prefrontostriatal circuitry regulates effort-related decision making. , 2009, Cerebral cortex.

[29]  E. Procyk,et al.  Anterior cingulate activity during routine and non-routine sequential behaviors in macaques , 2000, Nature Neuroscience.

[30]  M. Botvinick Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function , 2007, Cognitive, affective & behavioral neuroscience.

[31]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[32]  E. Save,et al.  Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Jonathan D. Cohen,et al.  Dissociating working memory from task difficulty in human prefrontal cortex , 1997, Neuropsychologia.

[34]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[35]  M. Walton,et al.  Interactions between decision making and performance monitoring within prefrontal cortex , 2004, Nature Neuroscience.

[36]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[37]  C. Summerfield,et al.  Two Mechanisms for Task Switching in the Prefrontal Cortex , 2009, The Journal of Neuroscience.

[38]  M. Walton,et al.  Separate neural pathways process different decision costs , 2006, Nature Neuroscience.

[39]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[40]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[41]  Birte U. Forstmann,et al.  Voluntary Selection of Task Sets Revealed by Functional Magnetic Resonance Imaging , 2006, Journal of Cognitive Neuroscience.

[42]  Michael Colombo,et al.  A lightweight microdrive for single-unit recording in freely moving rats and pigeons. , 2003, Methods.

[43]  R. Vertes,et al.  Anatomical analysis of afferent projections to the medial prefrontal cortex in the rat , 2007, Brain Structure and Function.

[44]  J. Salamone The involvement of nucleus accumbens dopamine in appetitive and aversive motivation , 1994, Behavioural Brain Research.

[45]  M. Walton,et al.  The Role of Rat Medial Frontal Cortex in Effort-Based Decision Making , 2002, The Journal of Neuroscience.