Adaptive Encoding of Outcome Prediction by Prefrontal Cortex Ensembles Supports Behavioral Flexibility

The prefrontal cortex (PFC) is thought to play a critical role in behavioral flexibility by monitoring action–outcome contingencies. How PFC ensembles represent shifts in behavior in response to changes in these contingencies remains unclear. We recorded single-unit activity and local field potentials in the dorsomedial PFC (dmPFC) of male rats during a set-shifting task that required them to update their behavior, among competing options, in response to changes in action–outcome contingencies. As behavior was updated, a subset of PFC ensembles encoded the current trial outcome before the outcome was presented. This novel outcome-prediction encoding was absent in a control task, in which actions were rewarded pseudorandomly, indicating that PFC neurons are not merely providing an expectancy signal. In both control and set-shifting tasks, dmPFC neurons displayed postoutcome discrimination activity, indicating that these neurons also monitor whether a behavior is successful in generating rewards. Gamma-power oscillatory activity increased before the outcome in both tasks but did not differentiate between expected outcomes, suggesting that this measure is not related to set-shifting behavior but reflects expectation of an outcome after action execution. These results demonstrate that PFC neurons support flexible rule-based action selection by predicting outcomes that follow a particular action. SIGNIFICANCE STATEMENT Tracking action–outcome contingencies and modifying behavior when those contingencies change is critical to behavioral flexibility. We find that ensembles of dorsomedial prefrontal cortex neurons differentiate between expected outcomes when action–outcome contingencies change. This predictive mode of signaling may be used to promote a new response strategy at the service of behavioral flexibility.

[1]  B. Moghaddam,et al.  Impact of anxiety on prefrontal cortex encoding of cognitive flexibility , 2017, Neuroscience.

[2]  A. Redish,et al.  Representational changes of latent strategies in rat medial prefrontal cortex precede changes in behaviour , 2016, Nature Communications.

[3]  C. Bondi,et al.  Anxiety Evokes Hypofrontality and Disrupts Rule-Relevant Encoding by Dorsomedial Prefrontal Cortex Neurons , 2016, The Journal of Neuroscience.

[4]  Hiroshi Yamada,et al.  Roles of the Lateral Habenula and Anterior Cingulate Cortex in Negative Outcome Monitoring and Behavioral Adjustment in Nonhuman Primates , 2015, Neuron.

[5]  Michael T. Lippert,et al.  Optogenetic silencing of locus coeruleus activity in mice impairs cognitive flexibility in an attentional set-shifting task , 2015, Front. Behav. Neurosci..

[6]  M. Roesch,et al.  Neural correlates of rules and conflict in medial prefrontal cortex during decision and feedback epochs , 2015, Front. Behav. Neurosci..

[7]  Nicolas W. Schuck,et al.  Medial Prefrontal Cortex Predicts Internally Driven Strategy Shifts , 2015, Neuron.

[8]  Renee Hoch,et al.  Gamma Rhythms Link Prefrontal Interneuron Dysfunction with Cognitive Inflexibility in Dlx5/6 +/− Mice , 2015, Neuron.

[9]  C. H. Donahue,et al.  Dynamic Routing of Task-relevant Signals for Decision Making in Dorsolateral Prefrontal Cortex , 2015, Nature Neuroscience.

[10]  Chris C. Rodgers,et al.  Neural Correlates of Task Switching in Prefrontal Cortex and Primary Auditory Cortex in a Novel Stimulus Selection Task for Rodents , 2014, Neuron.

[11]  S. Wise,et al.  Autonomous Encoding of Irrelevant Goals and Outcomes by Prefrontal Cortex Neurons , 2014, The Journal of Neuroscience.

[12]  Daeyeol Lee,et al.  Cortical Signals for Rewarded Actions and Strategic Exploration , 2013, Neuron.

[13]  M. Roesch,et al.  Neural structures underlying set-shifting: Roles of medial prefrontal cortex and anterior cingulate cortex , 2013, Behavioural Brain Research.

[14]  H. Yin,et al.  Dynamic Changes in Single Unit Activity and Gamma Oscillations in a Thalamocortical Circuit during Rapid Instrumental Learning , 2012, PloS one.

[15]  Eric L. Denovellis,et al.  Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex , 2012, Neuron.

[16]  Mattias P. Karlsson,et al.  Network Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty , 2012, Science.

[17]  E. Eskandar,et al.  Encoding of Both Positive and Negative Reward Prediction Errors by Neurons of the Primate Lateral Prefrontal Cortex and Caudate Nucleus , 2011, The Journal of Neuroscience.

[18]  Emmanuel Procyk,et al.  Coordination of High Gamma Activity in Anterior Cingulate and Lateral Prefrontal Cortical Areas during Adaptation , 2011, The Journal of Neuroscience.

[19]  F. Battaglia,et al.  Oscillations in the prefrontal cortex: a gateway to memory and attention , 2011, Current Opinion in Neurobiology.

[20]  S. Floresco,et al.  Blockade of NMDA GluN2B receptors selectively impairs behavioral flexibility but not initial discrimination learning , 2011, Psychopharmacology.

[21]  B. Moghaddam,et al.  Reduced Neuronal Inhibition and Coordination of Adolescent Prefrontal Cortex during Motivated Behavior , 2011, The Journal of Neuroscience.

[22]  T. Suslow,et al.  Neural correlates of set-shifting: decomposing executive functions in schizophrenia. , 2010, Journal of psychiatry & neuroscience : JPN.

[23]  D. Durstewitz,et al.  Abrupt Transitions between Prefrontal Neural Ensemble States Accompany Behavioral Transitions during Rule Learning , 2010, Neuron.

[24]  Jung Hoon Sul,et al.  Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making , 2010, Neuron.

[25]  S. Kennerley,et al.  Heterogeneous reward signals in prefrontal cortex , 2010, Current Opinion in Neurobiology.

[26]  S. Floresco,et al.  Neural circuits subserving behavioral flexibility and their relevance to schizophrenia , 2009, Behavioural Brain Research.

[27]  E. Miller,et al.  Learning Substrates in the Primate Prefrontal Cortex and Striatum: Sustained Activity Related to Successful Actions , 2009, Neuron.

[28]  C. Pennartz,et al.  Single-Cell and Population Coding of Expected Reward Probability in the Orbitofrontal Cortex of the Rat , 2009, The Journal of Neuroscience.

[29]  Erin L. Rich,et al.  Rat Prefrontal Cortical Neurons Selectively Code Strategy Switches , 2009, The Journal of Neuroscience.

[30]  Adam Kepecs,et al.  Neural representation of behavioral outcomes in the orbitofrontal cortex , 2009, Current Opinion in Neurobiology.

[31]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[32]  Mark Laubach,et al.  Neuronal correlates of post-error slowing in the rat dorsomedial prefrontal cortex. , 2008, Journal of neurophysiology.

[33]  S. Floresco,et al.  Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure , 2008, Behavioural Brain Research.

[34]  Bo Ma,et al.  Protective effects of extract of Coeloglossum viride var. bracteatum on ischemia-induced neuronal death and cognitive impairment in rats , 2008, Behavioural pharmacology.

[35]  E. Procyk,et al.  Behavioral Shifts and Action Valuation in the Anterior Cingulate Cortex , 2008, Neuron.

[36]  M. Ragozzino.  The Contribution of the Medial Prefrontal Cortex, Orbitofrontal Cortex, and Dorsomedial Striatum to Behavioral Flexibility , 2007, Annals of the New York Academy of Sciences.

[37]  J. Wallis,et al.  Neuronal Mechanisms in Prefrontal Cortex Underlying Adaptive Choice Behavior , 2007, Annals of the New York Academy of Sciences.

[38]  M. Roesch,et al.  Neural Correlates of Inflexible Behavior in the Orbitofrontal–Amygdalar Circuit after Cocaine Exposure , 2007, Annals of the New York Academy of Sciences.

[39]  H. Seo,et al.  Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. , 2007, Cerebral cortex.

[40]  B. Moghaddam,et al.  Rule Learning and Reward Contingency Are Associated with Dissociable Patterns of Dopamine Activation in the Rat Prefrontal Cortex, Nucleus Accumbens, and Dorsal Striatum , 2006, The Journal of Neuroscience.

[41]  Keiji Tanaka,et al.  Prefrontal Cell Activities Related to Monkeys' Success and Failure in Adapting to Rule Changes in a Wisconsin Card Sorting Test Analog , 2006, The Journal of Neuroscience.

[42]  S. Floresco,et al.  Multiple Dopamine Receptor Subtypes in the Medial Prefrontal Cortex of the Rat Regulate Set-Shifting , 2006, Neuropsychopharmacology.

[43]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[44]  J. Wallis,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[45]  Bita Moghaddam,et al.  Glutamate receptors in the rat medial prefrontal cortex regulate set-shifting ability. , 2003, Behavioral neuroscience.

[46]  V. Brown,et al.  Medial Frontal Cortex Mediates Perceptual Attentional Set Shifting in the Rat , 2000, The Journal of Neuroscience.

[47]  R. Kesner,et al.  Involvement of the Prelimbic–Infralimbic Areas of the Rodent Prefrontal Cortex in Behavioral Flexibility for Place and Response Learning , 1999, The Journal of Neuroscience.

[48]  P. Mitra,et al.  Analysis of dynamic brain imaging data. , 1998, Biophysical journal.

[49]  Masataka Watanabe.  Reward expectancy in primate prefrental neurons , 1996, Nature.

[50]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[51]  B. Milner.  Effects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes , 1963 .

[52]  Barry J Richmond,et al.  Dynamic changes in representations of preceding and upcoming reward in monkey orbitofrontal cortex. , 2008, Cerebral cortex.

[53]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[54]  M. Vinck,et al.  Source (or Part of the following Source): Type Article Title Learning-associated Gamma-band Phase-locking of Action-outcome Selective Neurons in Orbitofrontal Cortex Author(s) Learning-associated Gamma-band Phase-locking of Action–outcome Selective Neurons in Orbitofrontal Cortex Gamma Oscillations , 2022 .