Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex.

Brain-computer interfaces (BCIs) provide a defined link between neural activity and devices, allowing a detailed study of the neural adaptive responses generating behavioral output. We trained monkeys to perform two-dimensional center-out movements of a computer cursor using a BCI. We then applied a perturbation by randomly selecting a subset of the recorded units and rotating their directional contributions to cursor movement by a consistent angle. Globally, this perturbation mimics a visuomotor transformation, and in the first part of this article we characterize the psychophysical indications of motor adaptation and compare them with known results from adaptation of natural reaching movements. Locally, however, only a subset of the neurons in the population actually contributes to error, allowing us to probe for signatures of neural adaptation that might be specific to the subset of neurons we perturbed. One compensation strategy would be to selectively adapt the subset of cells responsible for the error. An alternate strategy would be to globally adapt the entire population to correct the error. Using a recently developed mathematical technique that allows us to differentiate these two mechanisms, we found evidence of both strategies in the neural responses. The dominant strategy we observed was global, accounting for ∼86% of the total error reduction. The remaining 14% came from local changes in the tuning functions of the perturbed units. Interestingly, these local changes were specific to the details of the applied rotation: in particular, changes in the depth of tuning were only observed when the percentage of perturbed cells was small. These results imply that there may be constraints on the network's adaptive capabilities, at least for perturbations lasting only a few hundreds of trials.

[1]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[2]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.

[3]  D. Rasmusson,et al.  Reorganization of raccoon somatosensory cortex following removal of the fifth digit , 1982, The Journal of comparative neurology.

[4]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[6]  D. J. Felleman,et al.  Topographic reorganization of somatosensory cortical areas 3b and 1 in adult monkeys following restricted deafferentation , 1983, Neuroscience.

[7]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[8]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[12]  Donald Robertson,et al.  Plasticity of frequency organization in auditory cortex of guinea pigs with partial unilateral deafness , 1989, The Journal of comparative neurology.

[13]  Gert Cauwenberghs,et al.  A Fast Stochastic Error-Descent Algorithm for Supervised Learning and Optimization , 1992, NIPS.

[14]  J. Kaas,et al.  Neuroplasticity of the adult primate auditory cortex following cochlear hearing loss. , 1993, The American journal of otology.

[15]  C Ghez,et al.  Learning of scaling factors and reference axes for reaching movements. , 1996, Neuroreport.

[16]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. , 1997, Journal of neurophysiology.

[17]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. II. Activity of individual cells in dorsal premotor cortex and parietal area 5. , 1997, Journal of neurophysiology.

[18]  S. Wise,et al.  Changes in motor cortical activity during visuomotor adaptation , 1998, Experimental Brain Research.

[19]  J. Kalaska,et al.  Changes in the temporal pattern of primary motor cortex activity in a directional isometric force versus limb movement task. , 1998, Journal of neurophysiology.

[20]  B. Weber,et al.  Context-dependent force coding in motor and premotor cortical areas , 1999, Experimental Brain Research.

[21]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[22]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[23]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[24]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[25]  Bagrat Amirikian,et al.  Directional tuning profiles of motor cortical cells , 2000, Neuroscience Research.

[26]  B Wallace,et al.  Calibration and Alignment are Separable: Evidence From Prism Adaptation , 2001, Journal of motor behavior.

[27]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[28]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[29]  G. M. Redding,et al.  Strategie Calibration and Spatial Alignment: A Model From Prism Adaptation , 2002, Journal of motor behavior.

[30]  J. Kaas Sensory loss and cortical reorganization in mature primates. , 2002, Progress in brain research.

[31]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[32]  E. Vaadia,et al.  Preparatory activity in motor cortex reflects learning of local visuomotor skills , 2003, Nature Neuroscience.

[33]  J. Fritz,et al.  Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex , 2003, Nature Neuroscience.

[34]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[35]  J. T. Massey,et al.  Cognitive spatial-motor processes , 2004, Experimental Brain Research.

[36]  Hagai Bergman,et al.  Acquisition and generalization of visuomotor transformations by nonhuman primates , 2005, Experimental Brain Research.

[37]  T. Ebner,et al.  Scaling of the metrics of visually-guided arm movements during motor learning in primates , 1991, Experimental Brain Research.

[38]  J. Fritz,et al.  Differential Dynamic Plasticity of A1 Receptive Fields during Multiple Spectral Tasks , 2005, The Journal of Neuroscience.

[39]  P. Viviani,et al.  Error parsing in visuomotor pointing reveals independent processing of amplitude and direction. , 2005, Journal of neurophysiology.

[40]  Ian M Franks,et al.  Updating of an internal model without proprioception: a deafferentation study , 2006, Neuroreport.

[41]  Patrick J Drew,et al.  Models and properties of power-law adaptation in neural systems. , 2006, Journal of neurophysiology.

[42]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[43]  Emilio Bizzi,et al.  Disruption of Primary Motor Cortex before Learning Impairs Memory of Movement Dynamics , 2006, The Journal of Neuroscience.

[44]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[45]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[46]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[47]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[48]  M. Schieber,et al.  Rapid Changes in Throughput from Single Motor Cortex Neurons to Muscle Activity , 2007, Science.

[49]  Robert Oostenveld,et al.  ON THE DEVELOPMENT OF A BRAIN-COMPUTER INTERFACE SYSTEM USING HIGH-DENSITY MAGNETOENCEPHALOGRAM SIGNALS FOR REAL-TIME CONTROL OF A ROBOT ARM , 2007 .

[50]  Reza Shadmehr,et al.  Impairment of Retention But Not Acquisition of a Visuomotor Skill Through Time-Dependent Disruption of Primary Motor Cortex , 2007, The Journal of Neuroscience.

[51]  Richard A Andersen,et al.  Decoding Trajectories from Posterior Parietal Cortex Ensembles , 2008, The Journal of Neuroscience.

[52]  T. Bonhoeffer,et al.  Massive restructuring of neuronal circuits during functional reorganization of adult visual cortex , 2008, Nature Neuroscience.

[53]  Wilsaan M. Joiner,et al.  Adaptive Control of Saccades via Internal Feedback , 2008, The Journal of Neuroscience.

[54]  Xiaolin Liu,et al.  Contributions of online visual feedback to the learning and generalization of novel finger coordination patterns. , 2008, Journal of neurophysiology.

[55]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[56]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[57]  G. Cantor On the Relations between , 2008 .

[58]  Robert E. Kass,et al.  2009 Special Issue: Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms , 2009 .

[59]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[60]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[61]  John W Krakauer,et al.  Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. , 2009, Journal of neurophysiology.

[62]  Jose M. Carmena,et al.  Learning in Closed-Loop Brain–Machine Interfaces: Modeling and Experimental Validation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[63]  Wolfgang Maass,et al.  A Reward-Modulated Hebbian Learning Rule Can Explain Experimentally Observed Network Reorganization in a Brain Control Task , 2010, The Journal of Neuroscience.

[64]  Britne A. Shabbott,et al.  Learning a visuomotor rotation: simultaneous visual and proprioceptive information is crucial for visuomotor remapping , 2010, Experimental Brain Research.

[65]  Carolee J Winstein,et al.  Neural Correlates of the Contextual Interference Effect in Motor Learning: A Transcranial Magnetic Stimulation Investigation , 2010, Journal of motor behavior.

[66]  Robert E Kass,et al.  Latent Inputs Improve Estimates of Neural Encoding in Motor Cortex , 2010, The Journal of Neuroscience.

[67]  Maura Casadio,et al.  Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. , 2011, Journal of neurophysiology.

[68]  E. Vaadia,et al.  The Neuronal Basis of Long-Term Sensorimotor Learning , 2011, The Journal of Neuroscience.

[69]  W. Wheeler,et al.  Dissociation between hand motion and population vectors from neural activity in motor cortex , 2022 .