A dynamical systems view of motor preparation: implications for neural prosthetic system design.

Neural prosthetic systems aim to help disabled patients suffering from a range of neurological injuries and disease by using neural activity from the brain to directly control assistive devices. This approach in effect bypasses the dysfunctional neural circuitry, such as an injured spinal cord. To do so, neural prostheses depend critically on a scientific understanding of the neural activity that drives them. We review here several recent studies aimed at understanding the neural processes in premotor cortex that precede arm movements and lead to the initiation of movement. These studies were motivated by hypotheses and predictions conceived of within a dynamical systems perspective. This perspective concentrates on describing the neural state using as few degrees of freedom as possible and on inferring the rules that govern the motion of that neural state. Although quite general, this perspective has led to a number of specific predictions that have been addressed experimentally. It is hoped that the resulting picture of the dynamical role of preparatory and movement-related neural activity will be particularly helpful to the development of neural prostheses, which can themselves be viewed as dynamical systems under the control of the larger dynamical system to which they are attached.

[1]  Michael J. Black,et al.  Assistive technology and robotic control using motor cortex ensemble‐based neural interface systems in humans with tetraplegia , 2007, The Journal of physiology.

[2]  W. Kristan,et al.  Rhythmic swimming activity in neurones of the isolated nerve cord of the leech. , 1976, The Journal of experimental biology.

[3]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[4]  Robert E. Kass,et al.  2009 Special Issue: Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms , 2009 .

[5]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[6]  E. Fetz Movement control: Are movement parameters recognizably coded in the activity of single neurons? , 1992 .

[7]  Byron M. Yu,et al.  Evidence for smooth and inertial dynamics in the evolution of neural state , 2008 .

[8]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[9]  A. Riehle,et al.  The predictive value for performance speed of preparatory changes in neuronal activity of the monkey motor and premotor cortex , 1993, Behavioural Brain Research.

[10]  K. Kurata,et al.  Distribution of neurons with set- and movement-related activity before hand and foot movements in the premotor cortex of rhesus monkeys , 2004, Experimental Brain Research.

[11]  K. Shenoy,et al.  Delay of movement caused by disruption of cortical preparatory activity. , 2007, Journal of neurophysiology.

[12]  R.R. Harrison,et al.  HermesC: Low-Power Wireless Neural Recording System for Freely Moving Primates , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Ming Yin,et al.  Listening to Brain Microcircuits for Interfacing With External World—Progress in Wireless Implantable Microelectronic Neuroengineering Devices , 2010, Proceedings of the IEEE.

[14]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[15]  Newsome William Ensemble activity underlying movement preparation in prearcuate cortex , 2010 .

[16]  Krishna V Shenoy,et al.  Human cortical prostheses: lost in translation? , 2009, Neurosurgical focus.

[17]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[18]  Matthew T. Kaufman,et al.  An optogenetic toolbox designed for primates , 2011, Nature Neuroscience.

[19]  S. Wise,et al.  A neurophysiological study of the premotor cortex in the rhesus monkey. , 1984, Brain : a journal of neurology.

[20]  R.R. Harrison,et al.  Wireless Neural Recording With Single Low-Power Integrated Circuit , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[22]  M Sahani,et al.  Modelling low-dimensional dynamics in recorded spiking populations , 2011 .

[23]  Teresa H. Y. Meng,et al.  Model-based neural decoding of reaching movements: a maximum likelihood approach , 2004, IEEE Transactions on Biomedical Engineering.

[24]  E. Fetz,et al.  Long-term motor cortex plasticity induced by an electronic neural implant , 2006, Nature.

[25]  Mark M. Churchland,et al.  Supplemental Data A Central Source of Movement Variability , 2006 .

[26]  E. Fetz Volitional control of neural activity: implications for brain–computer interfaces , 2007, The Journal of physiology.

[27]  R. Lemon,et al.  The involvement of monkey premotor cortex neurones in preparation of visually cued arm movements , 1985, Behavioural Brain Research.

[28]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[29]  J. Tanji,et al.  Anticipatory activity of motor cortex neurons in relation to direction of an intended movement. , 1976, Journal of neurophysiology.

[30]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[31]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[32]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[33]  J. Kalaska,et al.  Covariation of primate dorsal premotor cell activity with direction and amplitude during a memorized-delay reaching task. , 2000, Journal of neurophysiology.

[34]  R. Andersen,et al.  Selecting the signals for a brain–machine interface , 2004, Current Opinion in Neurobiology.

[35]  Andrew Jackson,et al.  An autonomous implantable computer for neural recording and stimulation in unrestrained primates , 2005, Journal of Neuroscience Methods.

[36]  S. O'Driscoll,et al.  Neurons to Silicon: Implantable Prosthesis Processor , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[37]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[38]  J. Kalaska From intention to action: motor cortex and the control of reaching movements. , 2009, Advances in experimental medicine and biology.

[39]  Stephen I. Ryu,et al.  Low-dimensional neural features predict muscle EMG signals , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[40]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[41]  C. Ghez,et al.  Discrete and continuous planning of hand movements and isometric force trajectories , 1997, Experimental Brain Research.

[42]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[43]  Byron M. Yu,et al.  Extracting Dynamical Structure Embedded in Neural Activity , 2005, NIPS.

[44]  Sten Grillner,et al.  Biological Pattern Generation: The Cellular and Computational Logic of Networks in Motion , 2006, Neuron.

[45]  S.I. Ryu,et al.  An extensible infrastructure for fully automated spike sorting during online experiments , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[46]  Byron M. Yu,et al.  Factor-analysis methods for higher-performance neural prostheses. , 2009, Journal of neurophysiology.

[47]  A. Aertsen,et al.  Dynamic Encoding of Movement Direction in Motor Cortical Neurons , 2009, The Journal of Neuroscience.

[48]  E. Todorov Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[49]  Mark Churchland,et al.  Firing rate oscillations underlie motor cortex responses during reaching in monkey , 2011 .

[50]  Vikash Gilja,et al.  Toward optimal target placement for neural prosthetic devices. , 2008, Journal of neurophysiology.

[51]  Travis DeWolf,et al.  Cortical preparatory activity avoids causing movement by remaining in a muscle-neutral space , 2011 .

[52]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[53]  A. Schwartz,et al.  Work toward real-time control of a cortical neural prothesis. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[54]  K. Anderson Targeting recovery: priorities of the spinal cord-injured population. , 2004, Journal of neurotrauma.

[55]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[56]  Richard A Andersen,et al.  Decoding Trajectories from Posterior Parietal Cortex Ensembles , 2008, The Journal of Neuroscience.

[57]  B L Day,et al.  Delay in the execution of voluntary movement by electrical or magnetic brain stimulation in intact man. Evidence for the storage of motor programs in the brain. , 1989, Brain : a journal of neurology.

[58]  Nicholas A Steinmetz,et al.  Changes in the response rate and response variability of area V4 neurons during the preparation of saccadic eye movements. , 2010, Journal of neurophysiology.

[59]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[60]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[61]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[62]  Hansjörg Scherberger,et al.  Neural control of motor prostheses , 2009, Current Opinion in Neurobiology.

[63]  John P. Donoghue,et al.  Bridging the Brain to the World: A Perspective on Neural Interface Systems , 2008, Neuron.

[64]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[65]  Jacob G. Bernstein,et al.  Millisecond-Timescale Optical Control of Neural Dynamics in the Nonhuman Primate Brain , 2009, Neuron.

[66]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[67]  Vikash Gilja,et al.  Long-term Stability of Neural Prosthetic Control Signals from Silicon Cortical Arrays in Rhesus Macaque Motor Cortex , 2010 .

[68]  Michael J. Black,et al.  systems in humans with tetraplegia Assistive technology and robotic control using MI ensemble-based neural interface Physiology in Press , 2007 .

[69]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[70]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[71]  S. Scott Inconvenient Truths about neural processing in primary motor cortex , 2008, The Journal of physiology.

[72]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[73]  Paul Cisek,et al.  Preparing for speed. Focus on "Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reach". , 2006, Journal of neurophysiology.

[74]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[75]  Byron M. Yu,et al.  Roles of monkey premotor neuron classes in movement preparation and execution. , 2010, Journal of neurophysiology.

[76]  Reid R. Harrison,et al.  The Design of Integrated Circuits to Observe Brain Activity , 2008, Proceedings of the IEEE.

[77]  S. Wise The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[78]  A. Riehle,et al.  Monkey primary motor and premotor cortex: single-cell activity related to prior information about direction and extent of an intended movement. , 1989, Journal of neurophysiology.

[79]  Michael J. Black,et al.  Closed-loop neural control of cursor motion using a Kalman filter , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[80]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[81]  Steven M Chase,et al.  Control of a brain–computer interface without spike sorting , 2009, Journal of neural engineering.

[82]  E. Fetz,et al.  Compact movable microwire array for long-term chronic unit recording in cerebral cortex of primates. , 2007, Journal of neurophysiology.

[83]  Leigh R Hochberg Turning thought into action. , 2008, The New England journal of medicine.

[84]  Kevin L. Briggman,et al.  Optical Imaging of Neuronal Populations During Decision-Making , 2005, Science.

[85]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[86]  Krishna V. Shenoy,et al.  Challenges and Opportunities for Next-Generation Intracortically Based Neural Prostheses , 2011, IEEE Transactions on Biomedical Engineering.

[87]  Dawn M. Taylor,et al.  Intuitive prosthetic limb control , 2007, The Lancet.

[88]  John Cunningham,et al.  Extracting rotational structure from motor cortical data , 2011 .

[89]  S. Krishna High-performance continuous neural cursor control enabled by a feedback control perspective , 2010 .

[90]  Vikash Gilja,et al.  Autonomous head-mounted electrophysiology systems for freely behaving primates , 2010, Current Opinion in Neurobiology.

[91]  J. Kalaska,et al.  Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. , 2000, Journal of neurophysiology.

[92]  Jody Record,et al.  UNH Senior Receives Prestigious National Science Foundation Graduate Research Fellowship , 2011 .

[93]  Yoon-Kyu Song,et al.  Wireless, high-bandwidth recordings from non-human primate motor cortex using a scalable 16-Ch implantable microsystem , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[94]  J. Kalaska,et al.  Learning to Move Machines with the Mind , 2022 .

[95]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[96]  Jose M Carmena,et al.  Invasive or noninvasive: understanding brain-machine interface technology. , 2010, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[97]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[98]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[99]  Jose M. Carmena,et al.  Learning in Closed-Loop Brain–Machine Interfaces: Modeling and Experimental Validation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[100]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[101]  Eilon Vaadia,et al.  Trial-to-Trial Variability of Single Cells in Motor Cortices Is Dynamically Modified during Visuomotor Adaptation , 2009, The Journal of Neuroscience.

[102]  A B Schwartz,et al.  Direct cortical representation of drawing. , 1994, Science.

[103]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[104]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[105]  Afsheen Afshar,et al.  Free-paced high-performance brain-computer interfaces. , 2007, Journal of neural engineering.

[106]  S. Scott,et al.  Cortical control of reaching movements , 1997, Current Opinion in Neurobiology.

[107]  V. Gilja,et al.  Signal Processing Challenges for Neural Prostheses , 2008, IEEE Signal Processing Magazine.

[108]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[109]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[110]  E Donchin,et al.  Studies of Squeezing: Handedness, Responding Hand, Response Force, and Asymmetry of Readiness Potential , 1974, Science.

[111]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[112]  E. Evarts TEMPORAL PATTERNS OF DISCHARGE OF PYRAMIDAL TRACT NEURONS DURING SLEEP AND WAKING IN THE MONKEY. , 1964, Journal of neurophysiology.

[113]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[114]  S. Meagher Instant neural control of a movement signal , 2002 .

[115]  V. Jayaraman,et al.  Intensity versus Identity Coding in an Olfactory System , 2003, Neuron.

[116]  Andrew B. Schwartz Useful Signals From Motor Cortex , 2005 .

[117]  Teresa H. Y. Meng,et al.  HermesB: A Continuous Neural Recording System for Freely Behaving Primates , 2007, IEEE Transactions on Biomedical Engineering.

[118]  Gopal Santhanam,et al.  Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reach. , 2006, Journal of neurophysiology.

[119]  Nicholas G Hatsopoulos,et al.  The science of neural interface systems. , 2009, Annual review of neuroscience.

[120]  D. Rosenbaum Human movement initiation: specification of arm, direction, and extent. , 1980, Journal of experimental psychology. General.

[121]  Byron M. Yu,et al.  Neural Decoding for Motor and Communication Prostheses , 2010 .

[122]  John P. Cunningham,et al.  Neural prosthetic systems: Current problems and future directions , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[123]  R.R. Harrison,et al.  A Low-Power Integrated Circuit for a Wireless 100-Electrode Neural Recording System , 2006, IEEE Journal of Solid-State Circuits.

[124]  J. Donoghue,et al.  Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia , 2008, The Journal of Neuroscience.

[125]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.