A Neural Population Mechanism for Rapid Learning

Long-term learning of language, mathematics, and motor skills likely requires cortical plasticity, but behavior often requires much faster changes, sometimes even after single errors. Here, we propose one neural mechanism to rapidly develop new motor output without altering the functional connectivity within or between cortical areas. We tested cortico-cortical models relating the activity of hundreds of neurons in the premotor (PMd) and primary motor (M1) cortices throughout adaptation to reaching movement perturbations. We found a signature of learning in the "output-null" subspace of PMd with respect to M1 reflecting the ability of premotor cortex to alter preparatory activity without directly influencing M1. The output-null subspace planning activity evolved with adaptation, yet the "output-potent" mapping that captures information sent to M1 was preserved. Our results illustrate a population-level cortical mechanism to progressively adjust the output from one brain area to its downstream structures that could be exploited for rapid behavioral adaptation.

[1]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[2]  Sarah E. Criscimagna-Hemminger,et al.  Cerebellar Contributions to Reach Adaptation and Learning Sensory Consequences of Action , 2012, The Journal of Neuroscience.

[3]  M. Ahissar,et al.  Dependence of cortical plasticity on correlated activity of single neurons and on behavioral context. , 1992, Science.

[4]  J. Donoghue,et al.  Strengthening of horizontal cortical connections following skill learning , 1998, Nature Neuroscience.

[5]  Lee E. Miller,et al.  Linear-Nonlinear-Time-Warp-Poisson models of neural activity , 2018 .

[6]  Christian Ethier,et al.  Cortical population activity within a preserved neural manifold underlies multiple motor behaviors , 2018, Nature Communications.

[7]  Stephen I. Ryu,et al.  Motor Cortical Visuomotor Feedback Activity Is Initially Isolated from Downstream Targets in Output-Null Neural State Space Dimensions , 2017, Neuron.

[8]  Matthew G Perich,et al.  Altered tuning in primary motor cortex does not account for behavioral adaptation during force field learning , 2017, Experimental Brain Research.

[9]  Vincent S. Huang,et al.  Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models , 2011, Neuron.

[10]  Stephen G Lisberger,et al.  Interaction of plasticity and circuit organization during the acquisition of cerebellum-dependent motor learning , 2013, eLife.

[11]  Konrad Paul Kording,et al.  Premotor and Motor Cortices Encode Reward , 2016, PloS one.

[12]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[13]  John W Krakauer,et al.  Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. , 2009, Journal of neurophysiology.

[14]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  P. Strick,et al.  An unfolded map of the cerebellar dentate nucleus and its projections to the cerebral cortex. , 2003, Journal of neurophysiology.

[16]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[17]  C. H. Bailey,et al.  Morphological basis of short-term habituation in Aplysia , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[19]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[20]  J. Krakauer,et al.  Adaptation to Visuomotor Transformations: Consolidation, Interference, and Forgetting , 2005, The Journal of Neuroscience.

[21]  Konrad P. Körding,et al.  Linear-nonlinear-time-warp-poisson models of neural activity , 2018, Journal of Computational Neuroscience.

[22]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[23]  E. Bizzi,et al.  Neuronal correlates of movement dynamics in the dorsal and ventral premotor area in the monkey , 2005, Experimental Brain Research.

[24]  Nan Zheng,et al.  Synaptic Inhibition, Excitation, and Plasticity in Neurons of the Cerebellar Nuclei , 2010, The Cerebellum.

[25]  Lee E. Miller,et al.  Neural Manifolds for the Control of Movement , 2017, Neuron.

[26]  Martina Mittlböck,et al.  Pseudo R-squared measures for Poisson regression models with over- or underdispersion , 2003, Comput. Stat. Data Anal..

[27]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[28]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[29]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[30]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[31]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[32]  Mackenzie W. Mathis,et al.  Somatosensory Cortex Plays an Essential Role in Forelimb Motor Adaptation in Mice , 2017, Neuron.

[33]  R. Shadmehr,et al.  Neural correlates of motor memory consolidation. , 1997, Science.

[34]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[35]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[36]  Lee E Miller,et al.  Inferring functional connections between neurons , 2008, Current Opinion in Neurobiology.

[37]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[38]  Konrad Paul Kording,et al.  Single reach plans in dorsal premotor cortex during a two-target task , 2018, Nature Communications.

[39]  Devika Narain,et al.  Flexible Sensorimotor Computations through Rapid Reconfiguration of Cortical Dynamics , 2018, Neuron.

[40]  Konrad Paul Kording,et al.  Role of expected reward in frontal eye field during natural scene search. , 2016, Journal of neurophysiology.

[41]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[42]  C. H. Bailey,et al.  Morphological basis of long-term habituation and sensitization in Aplysia. , 1983, Science.

[43]  Matthew T. Kaufman,et al.  The Largest Response Component in the Motor Cortex Reflects Movement Timing but Not Movement Type , 2016, eNeuro.

[44]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.

[45]  Matthew T. Kaufman,et al.  Supplementary materials for : Cortical activity in the null space : permitting preparation without movement , 2014 .

[46]  David M. Huberdeau,et al.  The Influence of Movement Preparation Time on the Expression of Visuomotor Learning and Savings , 2015, The Journal of Neuroscience.

[47]  J. Kleim,et al.  Cortical Synaptogenesis and Motor Map Reorganization Occur during Late, But Not Early, Phase of Motor Skill Learning , 2004, The Journal of Neuroscience.

[48]  Christian K. Machens,et al.  Behavioral / Systems / Cognitive Functional , But Not Anatomical , Separation of “ What ” and “ When ” in Prefrontal Cortex , 2009 .

[49]  David M. Huberdeau,et al.  Dual-process decomposition in human sensorimotor adaptation , 2015, Current Opinion in Neurobiology.

[50]  Stephen I. Ryu,et al.  Trial-by-Trial Motor Cortical Correlates of a Rapidly Adapting Visuomotor Internal Model , 2017, The Journal of Neuroscience.

[51]  P. Celnik,et al.  Dissociating the roles of the cerebellum and motor cortex during adaptive learning: the motor cortex retains what the cerebellum learns. , 2011, Cerebral cortex.

[52]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[53]  Eve Marder,et al.  Successful Reconstruction of a Physiological Circuit with Known Connectivity from Spiking Activity Alone , 2013, PLoS Comput. Biol..

[54]  K. Shenoy,et al.  Neural Population Dynamics Underlying Motor Learning Transfer , 2018, Neuron.

[55]  P. Strick,et al.  Subdivisions of primary motor cortex based on cortico-motoneuronal cells , 2009, Proceedings of the National Academy of Sciences.

[56]  J. Krakauer,et al.  Consolidation of motor memory , 2006, Trends in Neurosciences.

[57]  John P. Cunningham,et al.  Reorganization between preparatory and movement population responses in motor cortex , 2016, Nature Communications.

[58]  Hugo L. Fernandes,et al.  Primary motor cortical discharge during force field adaptation reflects muscle-like dynamics. , 2013, Journal of neurophysiology.

[59]  P. Strick,et al.  Motor areas in the frontal lobe of the primate , 2002, Physiology & Behavior.

[60]  D. Durstewitz,et al.  Abrupt Transitions between Prefrontal Neural Ensemble States Accompany Behavioral Transitions during Rule Learning , 2010, Neuron.

[61]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[62]  Joshua I Glaser,et al.  Population coding of conditional probability distributions in dorsal premotor cortex , 2017, Nature Communications.

[63]  M. Hallett,et al.  Rapid plasticity of human cortical movement representation induced by practice. , 1998, Journal of neurophysiology.

[64]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.