Signatures of optimal inference during learning in rat prefrontal cortex

Perception and decision rely on internal models of the world. In primary sensory areas of cortex, joint activity of neural populations likely represents the statistical structure of the external environment. Unknown is whether internal neural models are a general computational principle of cortex, extending to learning, higher-order cortices, and actions. We tested that generality by examining changes of population activity patterns from rat prefrontal cortex in the course of learning rules in a maze. The statistical distributions of activity patterns converged between waking and slow-wave sleep during rule learning. Changes were greatest for patterns predicting correct choice and expressed at the choice point. Together, our results are consistent with the convergence over learning of inferred (in waking) and prior (in sleep) expectations of a task derived from an internal model. The construction and use of an internal model may be a recurring theme of cortical computation.

[1]  A. Thomson,et al.  Functional Maps of Neocortical Local Circuitry , 2007, Front. Neurosci..

[2]  Mehdi Khamassi,et al.  Coherent Theta Oscillations and Reorganization of Spike Timing in the Hippocampal- Prefrontal Network upon Learning , 2010, Neuron.

[3]  R. Kesner,et al.  Involvement of the Prelimbic–Infralimbic Areas of the Rodent Prefrontal Cortex in Behavioral Flexibility for Place and Response Learning , 1999, The Journal of Neuroscience.

[4]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[5]  David Kappel,et al.  Network Plasticity as Bayesian Inference , 2015, PLoS Comput. Biol..

[6]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[7]  D. R. Muir,et al.  Functional organization of excitatory synaptic strength in primary visual cortex , 2015, Nature.

[8]  Stefan Habenschuss,et al.  Stochastic Computations in Cortical Microcircuit Models , 2013, PLoS Comput. Biol..

[9]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[10]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[11]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[12]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[13]  Michael J. Berry,et al.  Searching for Collective Behavior in a Large Network of Sensory Neurons , 2013, PLoS Comput. Biol..

[14]  M. Carandini,et al.  Population Rate Dynamics and Multineuron Firing Patterns in Sensory Cortex , 2012, The Journal of Neuroscience.

[15]  Cristina Savin,et al.  How (not) to assess the importance of correlations for the matching of spontaneous and evoked activity , 2013 .

[16]  M. Khamassi,et al.  Replay of rule-learning related neural patterns in the prefrontal cortex during sleep , 2009, Nature Neuroscience.

[17]  B. McNaughton,et al.  Packet-based communication in the cortex , 2015, Nature Reviews Neuroscience.

[18]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[19]  Stefano Fusi,et al.  Hippocampal-prefrontal input supports spatial encoding in working memory , 2015, Nature.

[20]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[21]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[22]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[23]  G. Shepherd,et al.  The neocortical circuit: themes and variations , 2015, Nature Neuroscience.

[24]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[25]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[26]  Erin L. Rich,et al.  Prelimbic/Infralimbic Inactivation Impairs Memory for Multiple Task Switches, But Not Flexible Selection of Familiar Tasks , 2007, The Journal of Neuroscience.

[27]  Stefano Panzeri,et al.  Correcting for the sampling bias problem in spike train information measures. , 2007, Journal of neurophysiology.

[28]  M. Moser,et al.  A prefrontal–thalamo–hippocampal circuit for goal-directed spatial navigation , 2015, Nature.

[29]  Ronen Segev,et al.  A thesaurus for a neural population code , 2015, eLife.

[30]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[31]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[32]  M. Jung,et al.  Dynamics of Population Code for Working Memory in the Prefrontal Cortex , 2003, Neuron.

[33]  Mark D. Humphries,et al.  Population-wide distributions of neural activity during perceptual decision-making , 2013, Progress in neurobiology.