Interfacing With the Computational Brain

Neuroscience is just beginning to understand the neural computations that underlie our remarkable capacity to learn new motor tasks. Studies of natural movements have emphasized the importance of concepts such as dimensionality reduction within hierarchical levels of redundancy, optimization of behavior in the presence of sensorimotor noise and internal models for predictive control. These concepts also provide a framework for understanding the improvements in performance seen in myoelectric-controlled interface and brain-machine interface paradigms. Recent experiments reveal how volitional activity in the motor system combines with sensory feedback to shape neural representations and drives adaptation of behavior. By elucidating these mechanisms, a new generation of intelligent interfaces can be designed to exploit neural plasticity and restore function after neurological injury.

[1]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[3]  D. Wolpert Computational approaches to motor control , 1997, Trends in Cognitive Sciences.

[4]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[5]  E. Fetz,et al.  Correlations between the same motor cortex cells and arm muscles during a trained task, free behavior, and natural sleep in the macaque monkey. , 2007, Journal of neurophysiology.

[6]  E E Fetz,et al.  Corticomotoneuronal cells contribute to long‐latency stretch reflexes in the rhesus monkey. , 1984, The Journal of physiology.

[7]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[8]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[9]  P. Morasso Spatial control of arm movements , 2004, Experimental Brain Research.

[10]  Miguel A. L. Nicolelis,et al.  A Brain-Machine Interface Instructed by Direct Intracortical Microstimulation , 2009, Front. Integr. Neurosci..

[11]  S. Scott,et al.  Comparison of neural responses in primary motor cortex to transient and continuous loads during posture. , 2009, Journal of neurophysiology.

[12]  G. Rizzolatti,et al.  Seven Years of Recording from Monkey Cortex with a Chronically Implanted Multiple Microelectrode , 2010, Front. Neuroeng..

[13]  M. Schieber Constraints on somatotopic organization in the primary motor cortex. , 2001, Journal of neurophysiology.

[14]  Lee E. Miller,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[15]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[16]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[17]  Daniel M Wolpert,et al.  Optimal control of redundant muscles in step-tracking wrist movements. , 2005, Journal of neurophysiology.

[18]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[19]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[20]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[21]  E. Fetz,et al.  Long-term motor cortex plasticity induced by an electronic neural implant , 2006, Nature.

[22]  Michael J. Kahana,et al.  Techniques and devices to restore cognition , 2008, Behavioural Brain Research.

[23]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[24]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[25]  Dragan F. Dimitrov,et al.  Reversible large-scale modification of cortical networks during neuroprosthetic control , 2011, Nature Neuroscience.

[26]  Emanuel Todorov,et al.  Cosine Tuning Minimizes Motor Errors , 2002, Neural Computation.

[27]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[28]  R. Caminiti,et al.  Cortical mechanisms for online control of hand movement trajectory: the role of the posterior parietal cortex. , 2009, Cerebral cortex.

[29]  W. T. Thach Correlation of neural discharge with pattern and force of muscular activity, joint position, and direction of intended next movement in motor cortex and cerebellum. , 1978, Journal of neurophysiology.

[30]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[31]  G. Rizzolatti,et al.  Two different streams form the dorsal visual system: anatomy and functions , 2003, Experimental Brain Research.

[32]  M. M. Morrow,et al.  Direct comparison of the task-dependent discharge of M1 in hand space and muscle space. , 2007, Journal of neurophysiology.

[33]  E. Fetz Movement control: Are movement parameters recognizably coded in the activity of single neurons? , 1992 .

[34]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[35]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  E. Fetz,et al.  Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. , 1973, Journal of neurophysiology.

[38]  Nicholas G Hatsopoulos,et al.  Incorporating Feedback from Multiple Sensory Modalities Enhances Brain–Machine Interface Control , 2010, The Journal of Neuroscience.

[39]  Dawn M. Taylor,et al.  Extraction algorithms for cortical control of arm prosthetics , 2001, Current Opinion in Neurobiology.

[40]  Shamim Nemati,et al.  Biomimetic Brain Machine Interfaces for the Control of Movement , 2007, The Journal of Neuroscience.

[41]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[42]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[43]  S. Meagher Instant neural control of a movement signal , 2002 .

[44]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[45]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[46]  E. Fetz,et al.  Operant Conditioning of Specific Patterns of Neural and Muscular Activity , 1971, Science.

[47]  T. Aflalo,et al.  Partial tuning of motor cortex neurons to final posture in a free-moving paradigm. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[48]  M. Nicolelis,et al.  Optimizing a Linear Algorithm for Real-Time Robotic Control using Chronic Cortical Ensemble Recordings in Monkeys , 2004, Journal of Cognitive Neuroscience.

[49]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[50]  James M. Rebesco,et al.  Enhanced detection threshold for in vivo cortical stimulation produced by Hebbian conditioning , 2011, Journal of neural engineering.

[51]  E. Todorov Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[52]  Peter E. Latham,et al.  Narrow Versus Wide Tuning Curves: What's Best for a Population Code? , 1999, Neural Computation.

[53]  M. Nicolelis,et al.  Cortical Modulations Increase in Early Sessions with Brain-Machine Interface , 2007, PloS one.

[54]  Jerald D. Kralik,et al.  Techniques for long-term multisite neuronal ensemble recordings in behaving animals. , 2001, Methods.

[55]  J. Kalaska,et al.  Learning to Move Machines with the Mind , 2022 .

[56]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[57]  Miriam Zacksenhouse,et al.  Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface , 2005, The Journal of Neuroscience.

[58]  Andrew Jackson,et al.  Learning a Novel Myoelectric-Controlled Interface Task , 2008, Journal of neurophysiology.

[59]  Janet L. Taylor,et al.  Voluntary Motor Output Is Altered by Spike-Timing-Dependent Changes in the Human Corticospinal Pathway , 2009, The Journal of Neuroscience.

[60]  Liam Paninski,et al.  Population decoding of motor cortical activity using a generalized linear model with hidden states , 2010, Journal of Neuroscience Methods.

[61]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[62]  J.P. Donoghue,et al.  Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[63]  E. Fetz,et al.  Compact movable microwire array for long-term chronic unit recording in cerebral cortex of primates. , 2007, Journal of neurophysiology.

[64]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[65]  S. Scott Inconvenient Truths about neural processing in primary motor cortex , 2008, The Journal of physiology.

[66]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[67]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[68]  J. V. Basmajian,et al.  Control and Training of Individual Motor Units , 1963, Science.

[69]  Wei Wu,et al.  Evidence against a single coordinate system representation in the motor cortex , 2006, Experimental Brain Research.

[70]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.