Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task

To respond adaptively to change organisms must utilize information about recent events and environmental context to select actions that are likely to produce favorable outcomes. We developed a dynamic delayed nonmatching to position task to study the influence of spatial context on event-related activity of medial prefrontal cortex neurons during reinforcement-guided decision-making. We found neurons with responses related to preparation, movement, lever press responses, reinforcement, and memory delays. Combined event-related and video tracking analyses revealed variability in spatial tuning of neurons with similar event-related activity. While all correlated neurons exhibited spatial tuning broadly consistent with relevant task events, for instance reinforcement-related activity concentrated in locations where reinforcement was delivered, some had elevated activity in more specific locations, for instance reinforcement-related activity in one of several locations where reinforcement was delivered. Timing analyses revealed a limited set of distinct response types with activity time-locked to critical behavioral events that represent the temporal organization of dDNMTP trials. Our results suggest that reinforcement-guided decision-making emerges from discrete populations of medial prefrontal neurons that encode information related to planned or ongoing movements and actions and anticipated or actual action-outcomes in conjunction with information about spatial context.

[1]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[2]  S. Mizumori,et al.  Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task , 2001, Behavioural Brain Research.

[3]  Bruce L McNaughton,et al.  Apparent Encoding of Sequential Context in Rat Medial Prefrontal Cortex Is Accounted for by Behavioral Variability , 2006, The Journal of Neuroscience.

[4]  M. Good,et al.  Double dissociation between hippocampal and prefrontal lesions on an operant delayed matching task and a water maze reference memory task , 2006, Behavioural Brain Research.

[5]  R. Mair,et al.  Lesions of the frontal cortex, hippocampus, and intralaminar thalamic nuclei have distinct effects on remembering in rats. , 1998, Behavioral neuroscience.

[6]  B. McNaughton,et al.  Firing characteristics of deep layer neurons in prefrontal cortex in rats performing spatial working memory tasks. , 1998, Cerebral cortex.

[7]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[8]  S. Funahashi.  Prefrontal cortex and working memory processes , 2006, Neuroscience.

[9]  Bruno Poucet,et al.  Searching for spatial unit firing in the prelimbic area of the rat medial prefrontal cortex , 1997, Behavioural Brain Research.

[10]  Min Whan Jung,et al.  Neural Correlates of Interval Timing in Rodent Prefrontal Cortex , 2013, The Journal of Neuroscience.

[11]  A. Poremba,et al.  Neural correlates of auditory recognition memory in primate lateral prefrontal cortex , 2013, Neuroscience.

[12]  Bita Moghaddam,et al.  Preparatory attention relies on dynamic interactions between prelimbic cortex and anterior cingulate cortex. , 2013, Cerebral cortex.

[13]  M. Rushworth,et al.  Organization of action sequences and the role of the pre-SMA. , 2004, Journal of neurophysiology.

[14]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[15]  Wenjun Yan,et al.  Medial prefrontal activity during delay period contributes to learning of a working memory task , 2014, Science.

[16]  C. Barnes,et al.  Differential Activation of Fast-Spiking and Regular-Firing Neuron Populations During Movement and Reward in the Dorsal Medial Frontal Cortex. , 2015, Cerebral cortex.

[17]  Earl K Miller,et al.  The representation of multiple objects in prefrontal neuronal delay activity. , 2007, Cerebral cortex.

[18]  B. Balleine,et al.  Evidence of Action Sequence Chunking in Goal-Directed Instrumental Conditioning and Its Dependence on the Dorsomedial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[19]  Zachary F Mainen,et al.  Preparing and selecting actions with neural populations: toward cortical circuit mechanisms , 2015, Current Opinion in Neurobiology.

[20]  G. Holmes,et al.  Short duration waveforms recorded extracellularly from freely moving rats are representative of axonal activity , 2013, Front. Neural Circuits.

[21]  Dominic Michael Dwyer,et al.  Lesions of the prelimbic prefrontal cortex prevent response conflict produced by action–outcome associations , 2010, Quarterly journal of experimental psychology.

[22]  B. Hayden,et al.  Neurons in Anterior Cingulate Cortex Multiplex Information about Reward and Action , 2010, The Journal of Neuroscience.

[23]  Colin Gemmell,et al.  Deep layer prefrontal cortex unit discharge in a cue-controlled open-field environment in the freely-moving rat , 2002, Behavioural Brain Research.

[24]  J. Aggleton,et al.  A comparison of the effects of medial prefrontal, cingulate cortex, and cingulum bundle lesions on tests of spatial memory: evidence of a double dissociation between frontal and cingulum bundle contributions , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  A. David Redish,et al.  Complex neural codes in rat prelimbic cortex are stable across days on a spatial decision task , 2014, Front. Behav. Neurosci..

[26]  P. Goldman-Rakic.  Cellular basis of working memory , 1995, Neuron.

[27]  A. Nieder,et al.  Comparison of abstract decision encoding in the monkey prefrontal cortex, the presupplementary, and cingulate motor areas. , 2013, Journal of neurophysiology.

[28]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[29]  Bita Moghaddam,et al.  Anterior Cingulate Neurons Represent Errors and Preparatory Attention within the Same Behavioral Sequence , 2009, The Journal of Neuroscience.

[30]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[31]  R. Mair,et al.  Effects of frontal cortex lesions on action sequence learning in the rat , 2007, The European journal of neuroscience.

[32]  E. Save,et al.  Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[33]  L. Chen,et al.  Neuronal responses in the frontal cortico-basal ganglia system during delayed matching-to-sample task: ensemble recording in freely moving rats , 2001, Experimental Brain Research.

[34]  M. Abeles.  Quantification, smoothing, and confidence limits for single-units' histograms , 1982, Journal of Neuroscience Methods.

[35]  J. B. Ranck,et al.  Spatial firing patterns of hippocampal complex-spike cells in a fixed environment , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  R. Mair,et al.  A comparison of the effects of hippocampal or prefrontal cortical lesions on three versions of delayed non-matching-to-sample based on positional or spatial cues , 2000, Behavioural Brain Research.

[37]  Alice Alvernhe,et al.  Tagging items in spatial working memory: A unit-recording study in the rat medial prefrontal cortex , 2010, Behavioural Brain Research.

[38]  Xin Jin,et al.  Basal Ganglia Subcircuits Distinctively Encode the Parsing and Concatenation of Action Sequences , 2014, Nature Neuroscience.

[39]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[40]  H. Groenewegen,et al.  The medial prefrontal cortex in the rat: evidence for a dorso-ventral distinction based upon functional and anatomical characteristics , 2003, Neuroscience & Biobehavioral Reviews.

[41]  J. Tanji,et al.  Role of the lateral prefrontal cortex in executive behavioral control. , 2008, Physiological reviews.

[42]  M. Jung,et al.  Dynamics of Population Code for Working Memory in the Prefrontal Cortex , 2003, Neuron.

[43]  T. Robbins,et al.  Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates , 2004, Neuroscience & Biobehavioral Reviews.

[44]  Bruce L McNaughton,et al.  Selective delay activity in the medial prefrontal cortex of the rat: contribution of sensorimotor information and contingency. , 2007, Journal of neurophysiology.

[45]  Shintaro Funahashi,et al.  Space representation in the prefrontal cortex , 2013, Progress in Neurobiology.

[46]  M. Bar,et al.  The role of the parahippocampal cortex in cognition , 2013, Trends in Cognitive Sciences.

[47]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[48]  Eldon Emberly,et al.  Action and outcome activity state patterns in the anterior cingulate cortex. , 2013, Cerebral cortex.

[49]  I. Daum,et al.  Associations evoked during memory encoding recruit the context‐network , 2009, Hippocampus.

[50]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[51]  Jadin C. Jackson,et al.  Quantitative measures of cluster quality for use in extracellular recordings , 2005, Neuroscience.

[52]  Y. Chudasama.  Animal models of prefrontal-executive function. , 2011, Behavioral neuroscience.

[53]  R. Kesner,et al.  The role of rat dorsomedial prefrontal cortex in working memory for egocentric responses , 2001, Neuroscience Letters.

[54]  D. R. Euston,et al.  The Role of Medial Prefrontal Cortex in Memory and Decision Making , 2012, Neuron.

[55]  Elger L. Abrahamse,et al.  Cognitive and neural foundations of discrete sequence skill: A TMS study , 2014, Neuropsychologia.

[56]  Mark Laubach,et al.  Working with memory: evidence for a role for the medial prefrontal cortex in performance monitoring during spatial delayed alternation. , 2012, Journal of neurophysiology.

[57]  S. Grillner,et al.  The basal ganglia downstream control of brainstem motor centres—an evolutionarily conserved strategy , 2015, Current Opinion in Neurobiology.

[58]  R. Vertes,et al.  Anatomical analysis of afferent projections to the medial prefrontal cortex in the rat , 2007, Brain Structure and Function.

[59]  D. Durstewitz,et al.  Contextual encoding by ensembles of medial prefrontal cortex neurons , 2012, Proceedings of the National Academy of Sciences.

[60]  R. Kesner,et al.  An analysis of rat prefrontal cortex in mediating executive function , 2011, Neurobiology of Learning and Memory.

[61]  L. Swanson.  The Rat Brain in Stereotaxic Coordinates, George Paxinos, Charles Watson (Eds.). Academic Press, San Diego, CA (1982), vii + 153, $35.00, ISBN: 0 125 47620 5 , 1984 .