Reversible large-scale modification of cortical networks during neuroprosthetic control

Brain-machine interfaces (BMIs) provide a framework for studying cortical dynamics and the neural correlates of learning. Neuroprosthetic control has been associated with tuning changes in specific neurons directly projecting to the BMI (hereafter referred to as direct neurons). However, little is known about the larger network dynamics. By monitoring ensembles of neurons that were either causally linked to BMI control or indirectly involved, we found that proficient neuroprosthetic control is associated with large-scale modifications to the cortical network in macaque monkeys. Specifically, there were changes in the preferred direction of both direct and indirect neurons. Notably, with learning, there was a relative decrease in the net modulation of indirect neural activity in comparison with direct activity. These widespread differential changes in the direct and indirect population activity were markedly stable from one day to the next and readily coexisted with the long-standing cortical network for upper limb control. Thus, the process of learning BMI control is associated with differential modification of neural populations based on their specific relation to movement control.

[1]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[2]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[3]  E. Fetz,et al.  Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. , 1973, Journal of neurophysiology.

[4]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[5]  Paul B. Johnson,et al.  Making arm movements within different parts of space: dynamic aspects in the primate motor cortex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. , 1997, Journal of neurophysiology.

[7]  S. Wise,et al.  Changes in motor cortical activity during visuomotor adaptation , 1998, Experimental Brain Research.

[8]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[9]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[10]  E. Bizzi,et al.  Cortical correlates of learning in monkeys adapting to a new dynamical environment. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[11]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[12]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[13]  E. Bizzi,et al.  Neuronal Correlates of Kinematics-to-Dynamics Transformation in the Supplementary Motor Area , 2002, Neuron.

[14]  S. Meagher Instant neural control of a movement signal , 2002 .

[15]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[16]  Jerald D. Kralik,et al.  Chronic, multisite, multielectrode recordings in macaque monkeys , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[17]  E. Vaadia,et al.  Preparatory activity in motor cortex reflects learning of local visuomotor skills , 2003, Nature Neuroscience.

[18]  F. A. Wilson,et al.  Functional stability of dorsolateral prefrontal neurons. , 2004, Journal of neurophysiology.

[19]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[20]  Eilon Vaadia,et al.  Learning-Induced Improvement in Encoding and Decoding of Specific Movement Directions by Neurons in the Primary Motor Cortex , 2004, PLoS biology.

[21]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[23]  Kevin L. Briggman,et al.  Optical Imaging of Neuronal Populations During Decision-Making , 2005, Science.

[24]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[25]  Miriam Zacksenhouse,et al.  Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface , 2005, The Journal of Neuroscience.

[26]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[27]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[28]  E. Fetz Volitional control of neural activity: implications for brain–computer interfaces , 2007, The Journal of physiology.

[29]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[30]  M. Schieber,et al.  Rapid Changes in Throughput from Single Motor Cortex Neurons to Muscle Activity , 2007, Science.

[31]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[32]  John P. Cunningham,et al.  Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex , 2007, The Journal of Neuroscience.

[33]  Robert A. Legenstein,et al.  A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback , 2008, PLoS Comput. Biol..

[34]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[35]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[36]  Stephen Grossberg,et al.  Assessing the Function of Motor Cortex: Single-Neuron Models of How Neural Response Is Modulated by Limb Biomechanics , 2008, Neuron.

[37]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[38]  D. Katz,et al.  Learning-Related Plasticity of Temporal Coding in Simultaneously Recorded Amygdala–Cortical Ensembles , 2008, The Journal of Neuroscience.

[39]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[40]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[41]  Dragan F. Dimitrov,et al.  Cortical Representation of Ipsilateral Arm Movements in Monkey and Man , 2009, The Journal of Neuroscience.

[42]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[43]  Karunesh Ganguly,et al.  Neural Correlates of Skill Acquisition with a Cortical Brain–Machine Interface , 2010, Journal of motor behavior.

[44]  E. Vaadia,et al.  Neuronal Correlates of Memory Formation in Motor Cortex after Adaptation to Force Field , 2010, The Journal of Neuroscience.

[45]  J. Kalaska,et al.  Learning to Move Machines with the Mind , 2022 .