Top-down control: A unified principle of cortical learning

Cognitive control of the brain flexibly maps incoming sensory information onto execution of actions appropriate for the current goal. Learning is a process that enables the brain to estimate current states of the world by extracting its spatiotemporal structure and generate goal-directed motor outputs through selective association of events or movement refinement. Accumulating evidence suggests that top-down control from higher-order brain areas modulates downstream neural activity and changes local computations that are critical for the execution of learned behavior. Recent technological advances in multi-site recordings and optogenetic approaches are beginning to reveal more direct evidence of top-down cognitive control by monitoring and perturbing activity of top-down inputs and observing its causal consequences on behavior and downstream neural dynamics. Here I highlight that learning-related changes in neural circuits in distinct domains of learning converge onto a unified principle; namely recruitment of top-down control whether it involves sensory, motor or offline learning. Recruitment of top-down control may reflect experience-dependent adaptation and integration of internal models for refined state estimation and goal-directed optimal behavior.

[1]  S. Wise,et al.  Neural Substrates of Intermanual Transfer of a Newly Acquired Motor Skill , 2007, Current Biology.

[2]  W. Gan,et al.  REM sleep selectively prunes and maintains new synapses in development and learning , 2017, Nature Neuroscience.

[3]  Ashesh K Dhawale,et al.  The Role of Variability in Motor Learning. , 2017, Annual review of neuroscience.

[4]  Á. Pascual-Leone,et al.  Awareness Modifies the Skill-Learning Benefits of Sleep , 2004, Current Biology.

[5]  Ju Lu,et al.  REPETITIVE MOTOR LEARNING INDUCES COORDINATED FORMATION OF CLUSTERED DENDRITIC SPINES IN VIVO , 2012, Nature.

[6]  Y. Dudai The neurobiology of consolidations, or, how stable is the engram? , 2004, Annual review of psychology.

[7]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[8]  M. Mignard,et al.  Paths of information flow through visual cortex. , 1991, Science.

[9]  G. Tononi,et al.  Sleep and the Price of Plasticity: From Synaptic and Cellular Homeostasis to Memory Consolidation and Integration , 2014, Neuron.

[10]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[11]  Giulio Tononi,et al.  Ultrastructural evidence for synaptic scaling across the wake/sleep cycle , 2017, Science.

[12]  Shawn R. Olsen,et al.  Gain control by layer six in cortical circuits of vision , 2012, Nature.

[13]  Mark T. Harnett,et al.  Nonlinear dendritic integration of sensory and motor input during an active sensing task , 2012, Nature.

[14]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[15]  Takaki Komiyama,et al.  Learning in the Rodent Motor Cortex. , 2017, Annual review of neuroscience.

[16]  Shawn R. Olsen,et al.  Translaminar Inhibitory Cells Recruited by Layer 6 Corticothalamic Neurons Suppress Visual Cortex , 2014, Neuron.

[17]  Ian R. Wickersham,et al.  The Stimulus Selectivity and Connectivity of Layer Six Principal Cells Reveals Cortical Microcircuits Underlying Visual Processing , 2014, Neuron.

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  G. Tononi,et al.  Sleep and wake modulate spine turnover in the adolescent mouse cortex , 2011, Nature Neuroscience.

[20]  A. Yamanaka,et al.  Top-down cortical input during NREM sleep consolidates perceptual memory , 2016, Science.

[21]  Georg B. Keller,et al.  Learning Enhances Sensory and Multiple Non-sensory Representations in Primary Visual Cortex , 2015, Neuron.

[22]  C. Gilbert,et al.  Learning to see: experience and attention in primary visual cortex , 2001, Nature Neuroscience.

[23]  S. Manita,et al.  A Top-Down Cortical Circuit for Accurate Sensory Perception , 2015, Neuron.

[24]  Takaki Komiyama,et al.  Subtype-specific plasticity of inhibitory circuits in motor cortex during motor learning , 2015, Nature Neuroscience.

[25]  Y. Dan,et al.  Long-range and local circuits for top-down modulation of visual cortex processing , 2014, Science.

[26]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[27]  T. Komiyama,et al.  Circuit Mechanisms of Sensorimotor Learning , 2016, Neuron.

[28]  T. Komiyama,et al.  Transformation of Cortex-wide Emergent Properties during Motor Learning , 2017, Neuron.

[29]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[30]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[31]  Zoubin Ghahramani,et al.  Perspectives and problems in motor learning , 2001, Trends in Cognitive Sciences.

[32]  Akhilesh Pandey,et al.  Homer1a drives homeostatic scaling-down of excitatory synapses during sleep , 2017, Science.

[33]  D. Hassabis,et al.  Neuroscience-Inspired Artificial Intelligence , 2017, Neuron.

[34]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[35]  H. Hioki,et al.  Hippocampal ripples down-regulate synapses , 2018, Science.

[36]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[37]  Takaki Komiyama,et al.  Learning enhances the relative impact of top-down processing in the visual cortex , 2015, Nature Neuroscience.

[38]  S. E. Kwon,et al.  Sensory and decision-related activity propagate in a cortical feedback loop during touch perception , 2016, Nature Neuroscience.

[39]  Mark Laubach,et al.  Top-Down Control of Motor Cortex Ensembles by Dorsomedial Prefrontal Cortex , 2006, Neuron.

[40]  J. Hobson,et al.  Visual discrimination learning requires sleep after training , 2000, Nature Neuroscience.

[41]  G. Deuschl,et al.  Sleep consolidates the effector-independent representation of a motor skill , 2010, Neuroscience.

[42]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[43]  Tanuj Gulati,et al.  Neural reactivations during sleep determine network credit assignment , 2017, Nature Neuroscience.

[44]  Yoshikazu Isomura,et al.  Two distinct layer-specific dynamics of cortical ensembles during learning of a motor task , 2014, Nature Neuroscience.

[45]  W. Gan,et al.  Sleep promotes branch-specific formation of dendritic spines after learning , 2014, Science.

[46]  C. Clopath,et al.  The emergence of functional microcircuits in visual cortex , 2013, Nature.

[47]  J. Fuster,et al.  Functional interactions between inferotemporal and prefrontal cortex in a cognitive task , 1985, Brain Research.

[48]  G. Tononi,et al.  Cortical Firing and Sleep Homeostasis , 2009, Neuron.

[49]  C. Gilbert,et al.  Top-down influences on visual processing , 2013, Nature Reviews Neuroscience.

[50]  Simon X. Chen,et al.  Emergence of reproducible spatiotemporal activity during motor learning , 2014, Nature.

[51]  S. Klein,et al.  Complete Transfer of Perceptual Learning across Retinal Locations Enabled by Double Training , 2008, Current Biology.

[52]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[53]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[54]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[55]  R. Stickgold,et al.  Practice with Sleep Makes Perfect Sleep-Dependent Motor Skill Learning , 2002, Neuron.

[56]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[57]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[58]  M. Laubach,et al.  Layer-Specific Somatosensory Cortical Activation During Active Tactile Discrimination , 2004, Science.

[59]  C. Gilbert,et al.  Generation of end-inhibition in the visual cortex via interlaminar connections , 1986, Nature.

[60]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[61]  Balázs Rózsa,et al.  Single-cell–initiated monosynaptic tracing reveals layer-specific cortical network modules , 2015, Science.

[62]  Georg B. Keller,et al.  A Sensorimotor Circuit in Mouse Cortex for Visual Flow Predictions , 2017, Neuron.

[63]  C. Petersen,et al.  Reward-Based Learning Drives Rapid Sensory Signals in Medial Prefrontal Cortex and Dorsal Hippocampus Necessary for Goal-Directed Behavior , 2018, Neuron.

[64]  Gonzalo H. Otazu,et al.  Cortical Feedback Decorrelates Olfactory Bulb Output in Awake Mice , 2015, Neuron.

[65]  Tsai-Wen Chen,et al.  A Map of Anticipatory Activity in Mouse Motor Cortex , 2017, Neuron.

[66]  D. R. Muir,et al.  Functional organization of excitatory synaptic strength in primary visual cortex , 2015, Nature.

[67]  M. Sahani,et al.  Distinct learning-induced changes in stimulus selectivity and interactions of GABAergic interneuron classes in visual cortex , 2018, Nature Neuroscience.

[68]  William E. Allen,et al.  Global Representations of Goal-Directed Behavior in Distinct Cell Types of Mouse Neocortex , 2017, Neuron.

[69]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[70]  Brett J. Graham,et al.  Anatomy and function of an excitatory network in the visual cortex , 2016, Nature.