Learning by neural reassociation

Behavior is driven by coordinated activity across a population of neurons. Learning requires the brain to change the neural population activity produced to achieve a given behavioral goal. How does population activity reorganize during learning? We studied intracortical population activity in the primary motor cortex of rhesus macaques during short-term learning in a brain–computer interface (BCI) task. In a BCI, the mapping between neural activity and behavior is exactly known, enabling us to rigorously define hypotheses about neural reorganization during learning. We found that changes in population activity followed a suboptimal neural strategy of reassociation: animals relied on a fixed repertoire of activity patterns and associated those patterns with different movements after learning. These results indicate that the activity patterns that a neural population can generate are even more constrained than previously thought and might explain why it is often difficult to quickly learn to a high level of proficiency.Learning is ubiquitous in everyday life, yet it is unclear how neurons change their activity together during learning. Golub and colleagues show that short-term learning relies on a fixed neural repertoire, which limits behavioral improvement.

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[3]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[4]  Dragan F. Dimitrov,et al.  Reversible large-scale modification of cortical networks during neuroprosthetic control , 2011, Nature Neuroscience.

[5]  K. Shenoy,et al.  Neural Population Dynamics Underlying Motor Learning Transfer , 2018, Neuron.

[6]  Robert E Kass,et al.  Latent Inputs Improve Estimates of Neural Encoding in Motor Cortex , 2010, The Journal of Neuroscience.

[7]  Byron M. Yu,et al.  Internal models for interpreting neural population activity during sensorimotor control , 2015, eLife.

[8]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[9]  D. Sternad,et al.  Variability in motor learning: relocating, channeling and reducing noise , 2009, Experimental Brain Research.

[10]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[11]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[12]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[13]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[14]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[15]  Stephen G Lisberger,et al.  Learning on multiple timescales in smooth pursuit eye movements. , 2010, Journal of neurophysiology.

[16]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[17]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[18]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[19]  Byron M. Yu,et al.  Brain–computer interfaces for dissecting cognitive processes underlying sensorimotor control , 2016, Current Opinion in Neurobiology.

[20]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[21]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[22]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[23]  G. Laurent,et al.  Transient Dynamics versus Fixed Points in Odor Representations by Locust Antennal Lobe Projection Neurons , 2005, Neuron.

[24]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[25]  Wilsaan M. Joiner,et al.  Long-term retention explained by a model of short-term learning in the adaptive control of reaching. , 2008, Journal of neurophysiology.

[26]  E. Vaadia,et al.  Preparatory activity in motor cortex reflects learning of local visuomotor skills , 2003, Nature Neuroscience.

[27]  E. Vaadia,et al.  The Neuronal Basis of Long-Term Sensorimotor Learning , 2011, The Journal of Neuroscience.

[28]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[29]  S. Wise,et al.  Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  Aaron C. Koralek,et al.  Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills , 2012, Nature.

[31]  Aaron C. Koralek,et al.  Volitional modulation of optically recorded calcium signals during neuroprosthetic learning , 2014, Nature Neuroscience.

[32]  Spencer Kellis,et al.  From thought to action: The brain–machine interface in posterior parietal cortex , 2019, Proceedings of the National Academy of Sciences.

[33]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[34]  Michael S. Brainard,et al.  Learning the microstructure of successful behavior , 2011, Nature Neuroscience.

[35]  D. Durstewitz,et al.  Abrupt Transitions between Prefrontal Neural Ensemble States Accompany Behavioral Transitions during Rule Learning , 2010, Neuron.

[36]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[37]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[38]  Hagai Bergman,et al.  Acquisition and generalization of visuomotor transformations by nonhuman primates , 2005, Experimental Brain Research.

[39]  L. Abbott,et al.  Two layers of neural variability , 2012, Nature Neuroscience.

[40]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[41]  Stephen I. Helms Tillery,et al.  Uniform and Non-uniform Perturbations in Brain-Machine Interface Task Elicit Similar Neural Strategies , 2016, Front. Syst. Neurosci..

[42]  R. Andersen,et al.  Volitional Control of Neural Activity Relies on the Natural Motor Repertoire , 2013, Current Biology.

[43]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[44]  A. Schwartz,et al.  Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex. , 2012, Journal of neurophysiology.

[45]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.

[46]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[47]  Stephen I. Helms Tillery,et al.  Uniform and Non-uniform Perturbations in Brain-Machine Interface Task Elicit Similar Neural Strategies. , 2016 .

[48]  Jose M. Carmena,et al.  Emergence of Coordinated Neural Dynamics Underlies Neuroprosthetic Learning and Skillful Control , 2017, Neuron.

[49]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[50]  Hamed Rahmani.  Factor-Analysis Methods for Higher-Performance Neural Prostheses , 2015 .

[51]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[52]  Tomasz Górski,et al.  Bridging Single Neuron Dynamics to Global Brain States , 2019, Front. Syst. Neurosci..

[53]  Matthew T. Kaufman,et al.  Supplementary materials for : Cortical activity in the null space : permitting preparation without movement , 2014 .

[54]  Timothy Q. Gentner,et al.  Associative Learning Enhances Population Coding by Inverting Interneuronal Correlation Patterns , 2013, Neuron.