Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice

Correlates of value are routinely observed in the prefrontal cortex (PFC) during reward-guided decision making. In previous work (Hunt et al., 2015), we argued that PFC correlates of chosen value are a consequence of varying rates of a dynamical evidence accumulation process. Yet within PFC, there is substantial variability in chosen value correlates across individual neurons. Here we show that this variability is explained by neurons having different temporal receptive fields of integration, indexed by examining neuronal spike rate autocorrelation structure whilst at rest. We find that neurons with protracted resting temporal receptive fields exhibit stronger chosen value correlates during choice. Within orbitofrontal cortex, these neurons also sustain coding of chosen value from choice through the delivery of reward, providing a potential neural mechanism for maintaining predictions and updating stored values during learning. These findings reveal that within PFC, variability in temporal specialisation across neurons predicts involvement in specific decision-making computations. DOI: http://dx.doi.org/10.7554/eLife.18937.001

[1]  D. Amit.  The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[2]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[3]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[4]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[5]  Xiao-Jing Wang.  Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[6]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[7]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[8]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[9]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[10]  G. Elston.  Cortex, cognition and the cell: new insights into the pyramidal neuron and prefrontal function. , 2003, Cerebral cortex.

[11]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[12]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[13]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[14]  David J. Freedman,et al.  Experience-dependent representation of visual categories in parietal cortex , 2006, Nature.

[15]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[16]  D. Bryan,et al.  A New Perspective on the Role of Finance , 2006 .

[17]  M. Walton,et al.  Separate neural pathways process different decision costs , 2006, Nature Neuroscience.

[18]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[19]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.

[20]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[21]  Keiji Tanaka,et al.  Medial prefrontal cell activity signaling prediction errors of action values , 2007, Nature Neuroscience.

[22]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[23]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[24]  Huaixing Wang,et al.  A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[25]  Daeyeol Lee,et al.  Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice , 2008, Neuron.

[26]  Timothy E. J. Behrens,et al.  Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli , 2008, The Journal of Neuroscience.

[27]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[28]  A. Zaitsev,et al.  Interneuron diversity in layers 2-3 of monkey prefrontal cortex. , 2009, Cerebral cortex.

[29]  S. Kennerley,et al.  Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables , 2009, The European journal of neuroscience.

[30]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[31]  Steven W Kennerley,et al.  Encoding of Gustatory Working Memory by Orbitofrontal Neurons , 2009, The Journal of Neuroscience.

[32]  H. Seo,et al.  Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game , 2009, Journal of Neuroscience.

[33]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[34]  Antonio Rangel,et al.  Neural computations associated with goal-directed choice , 2010, Current Opinion in Neurobiology.

[35]  Timothy Edward John Behrens,et al.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[36]  S. Kennerley,et al.  Heterogeneous reward signals in prefrontal cortex , 2010, Current Opinion in Neurobiology.

[37]  Hidehiko Komatsu,et al.  Differential Temporal Storage Capacity in the Baseline Activity of Neurons in Macaque 2 Frontal Eye Field and Area V4 3 4 Division of Sensory and Cognitive Information Abbreviated Title: Temporal Storage in Visual and Visual-motor Areas , 2022 .

[38]  Timothy Edward John Behrens,et al.  Separable Learning Systems in the Macaque Brain and the Role of Orbitofrontal Cortex in Contingent Learning , 2010, Neuron.

[39]  W. Vanduffel,et al.  Functional Heterogeneity of Macaque Lateral Intraparietal Neurons , 2011, The Journal of Neuroscience.

[40]  L. Fellows,et al.  Double Dissociation of Stimulus-Value and Action-Value Learning in Humans with Orbitofrontal or Anterior Cingulate Cortex Damage , 2011, The Journal of Neuroscience.

[41]  H. Seo,et al.  A reservoir of time constants for memory traces in cortical neurons , 2011, Nature Neuroscience.

[42]  Timothy E. J. Behrens,et al.  Double dissociation of value computations in orbitofrontal and anterior cingulate neurons , 2011, Nature Neuroscience.

[43]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[44]  John M. Pearson,et al.  Neuronal basis of sequential foraging decisions in a patchy environment , 2011, Nature Neuroscience.

[45]  Eric L. Denovellis,et al.  Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex , 2012, Neuron.

[46]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[47]  Xiao-Jing Wang.  Neural dynamics and circuit mechanisms of decision-making , 2012, Current Opinion in Neurobiology.

[48]  C. Constantinidis,et al.  Neurons with inverted tuning during the delay periods of working memory tasks in the dorsal prefrontal and posterior parietal cortex. , 2012, Journal of neurophysiology.

[49]  J. Morrison,et al.  NMDA Receptors Subserve Persistent Neuronal Firing during Working Memory in Dorsolateral Prefrontal Cortex , 2013, Neuron.

[50]  Steven W Kennerley,et al.  Single-Neuron Mechanisms Underlying Cost-Benefit Analysis in Frontal Cortex , 2013, The Journal of Neuroscience.

[51]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[52]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[53]  Jay A. Hennig,et al.  Signal Multiplexing and Single-Neuron Computations in Lateral Intraparietal Area During Decision-Making , 2013, The Journal of Neuroscience.

[54]  Etienne Koechlin,et al.  Foundations of human reasoning in the prefrontal cortex , 2014, Science.

[55]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[56]  C. H. Donahue,et al.  Neural correlates of strategic reasoning during competitive games , 2014, Science.

[57]  T. Shibata,et al.  Discharge-rate persistence of baseline activity during fixation reflects maintenance of memory-period activity in the macaque posterior parietal cortex. , 2014, Cerebral cortex.

[58]  C. Padoa-Schioppa,et al.  Integration of Multiple Determinants in the Neuronal Computation of Economic Values , 2014, The Journal of Neuroscience.

[59]  G. Schoenbaum,et al.  Lateral orbitofrontal neurons acquire responses to upshifted, downshifted, or blocked cues during unblocking , 2015, eLife.

[60]  Timothy E. J. Behrens,et al.  Capturing the temporal evolution of choice across prefrontal cortex , 2015, eLife.

[61]  Bingni W. Brunton,et al.  Distinct relationships of parietal and prefrontal cortices to evidence accumulation , 2014, Nature.

[62]  Michael J. Wolff,et al.  Decoding Rich Spatial Information with High Temporal Resolution , 2015, Trends in Cognitive Sciences.

[63]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[64]  Yang Dan,et al.  Cell-Type-Specific Activity in Prefrontal Cortex during Goal-Directed Behavior , 2015, Neuron.

[65]  Matthew F.S. Rushworth,et al.  Contrasting Roles for Orbitofrontal Cortex and Amygdala in Credit Assignment and Learning in Macaques , 2015, Neuron.

[66]  M. Shadlen,et al.  A Neural Implementation of Wald’s Sequential Probability Ratio Test , 2015, Neuron.

[67]  C. Padoa-Schioppa,et al.  A neuro-computational model of economic decisions. , 2015, Journal of neurophysiology.

[68]  C. Honey,et al.  Processing Timescales as an Organizing Principle for Primate Cortex , 2015, Neuron.

[69]  Joshua W. Brown,et al.  Neural Mechanisms of Credit Assignment in a Multicue Environment , 2016, The Journal of Neuroscience.

[70]  Timothy Edward John Behrens,et al.  Reward-Guided Learning with and without Causal Attribution , 2016, Neuron.

[71]  Emmanuel Procyk,et al.  Specific frontal neural dynamics contribute to decisions to check , 2016, Nature Communications.