A neural network that finds a naturalistic solution for the production of muscle activity

It remains an open question how neural responses in motor cortex relate to movement. We explored the hypothesis that motor cortex reflects dynamics appropriate for generating temporally patterned outgoing commands. To formalize this hypothesis, we trained recurrent neural networks to reproduce the muscle activity of reaching monkeys. Models had to infer dynamics that could transform simple inputs into temporally and spatially complex patterns of muscle activity. Analysis of trained models revealed that the natural dynamical solution was a low-dimensional oscillator that generated the necessary multiphasic commands. This solution closely resembled, at both the single-neuron and population levels, what was observed in neural recordings from the same monkeys. Notably, data and simulations agreed only when models were optimized to find simple solutions. An appealing interpretation is that the empirically observed dynamics of motor cortex may reflect a simple solution to the problem of generating temporally patterned descending commands.

[1]  E. Evarts,et al.  Relation of pyramidal tract activity to force exerted during voluntary movement. , 1968, Journal of neurophysiology.

[2]  J. Tanji,et al.  Anticipatory activity of motor cortex neurons in relation to direction of an intended movement. , 1976, Journal of neurophysiology.

[3]  E. Fetz,et al.  Postspike facilitation of forelimb muscle activity by primate corticomotoneuronal cells. , 1980, Journal of neurophysiology.

[4]  S. Wise,et al.  A neurophysiological study of the premotor cortex in the rhesus monkey. , 1984, Brain : a journal of neurology.

[5]  R. Lemon,et al.  Selective facilitation of different hand muscles by single corticospinal neurones in the conscious monkey. , 1986, The Journal of physiology.

[6]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[7]  F. Mussa-Ivaldi,et al.  Do neurons in the motor cortex encode movement direction? An alternative hypothesis , 1988, Neuroscience Letters.

[8]  E. Fetz Movement control: Are movement parameters recognizably coded in the activity of single neurons? , 1992 .

[9]  K. Doya,et al.  Bifurcations in the learning of recurrent neural networks , 1992, [Proceedings] 1992 IEEE International Symposium on Circuits and Systems.

[10]  Eberhard E. Fetz,et al.  Cortical mechanisms controlling limb movement , 1993, Current Opinion in Neurobiology.

[11]  A B Schwartz,et al.  Direct cortical representation of drawing. , 1994, Science.

[12]  Terence D. Sanger,et al.  Theoretical Considerations for the Analysis of Population Coding in Motor Cortex , 1994, Neural Computation.

[13]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[14]  E. Todorov Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[15]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[16]  Emanuel Todorov,et al.  Cosine Tuning Minimizes Motor Errors , 2002, Neural Computation.

[17]  M. M. Morrow,et al.  Prediction of muscle activity by populations of sequentially recorded primary motor cortex neurons. , 2003, Journal of neurophysiology.

[18]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[19]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[20]  Nicholas G Hatsopoulos,et al.  Encoding in the motor cortex: was evarts right after all? Focus on "motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks". , 2005, Journal of neurophysiology.

[21]  Eberhard E. Fetz,et al.  Dynamic Neural Network Models of the Premotoneuronal Circuitry Controlling Wrist Movements in Primates , 2005, Journal of Computational Neuroscience.

[22]  P. Strick,et al.  Muscle representation in the macaque motor cortex: an anatomical perspective. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[24]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[25]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[26]  T. Aflalo,et al.  Relationship between Unconstrained Arm Movements and Single-Neuron Firing in the Macaque Motor Cortex , 2007, The Journal of Neuroscience.

[27]  Eduardo D. Sontag,et al.  Computational Aspects of Feedback in Neural Circuits , 2006, PLoS Comput. Biol..

[28]  M. Schieber,et al.  Partial reconstruction of muscle activity from a pruned network of diverse motor cortex neurons. , 2007, Journal of neurophysiology.

[29]  S. Scott Inconvenient Truths about neural processing in primary motor cortex , 2008, The Journal of physiology.

[30]  Stephen Grossberg,et al.  Assessing the Function of Motor Cortex: Single-Neuron Models of How Neural Response Is Modulated by Limb Biomechanics , 2008, Neuron.

[31]  J. Kalaska From intention to action: motor cortex and the control of reaching movements. , 2009, Advances in experimental medicine and biology.

[32]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[33]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[34]  Byron M. Yu,et al.  Roles of monkey premotor neuron classes in movement preparation and execution. , 2010, Journal of neurophysiology.

[35]  Pascal Vincent,et al.  Learning invariant features through local space contraction , 2011, ArXiv.

[36]  Ilya Sutskever,et al.  Learning Recurrent Neural Networks with Hessian-Free Optimization , 2011, ICML.

[37]  D. Buonomano,et al.  Complexity without chaos: Plasticity within random recurrent networks generates robust timing and motor control , 2012, 1210.2104.

[38]  Haim Sompolinsky,et al.  How the Brain Generates Movement , 2012, Neural Computation.

[39]  Daniel W Moran,et al.  Strategy-Dependent Encoding of Planned Arm Movements in the Dorsal Premotor Cortex , 2012, Science.

[40]  Ilya Sutskever,et al.  Training Deep and Recurrent Networks with Hessian-Free Optimization , 2012, Neural Networks: Tricks of the Trade.

[41]  Mark M. Churchland,et al.  The roles of monkey M1 neuron classes in movement preparation and execution , 2013, Journal of neurophysiology.

[42]  M. Sahani,et al.  Cortical control of arm movements: a dynamical systems perspective. , 2013, Annual review of neuroscience.

[43]  David Sussillo,et al.  Opening the Black Box: Low-Dimensional Dynamics in High-Dimensional Recurrent Neural Networks , 2013, Neural Computation.

[44]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[45]  T. Lillicrap,et al.  Preference Distributions of Primary Motor Cortex Neurons Reflect Control Solutions Optimized for Limb Biomechanics , 2013, Neuron.

[46]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[47]  Terrence J Sejnowski,et al.  Computing reaching dynamics in motor cortex with Cartesian spatial coordinates. , 2013, Journal of neurophysiology.

[48]  J. Andrew Pruszynski,et al.  Goal-Dependent Modulation of Fast Feedback Responses in Primary Motor Cortex , 2014, The Journal of Neuroscience.

[49]  W. Gerstner,et al.  Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements , 2014, Neuron.

[50]  Matthew T. Kaufman,et al.  Supplementary materials for : Cortical activity in the null space : permitting preparation without movement , 2014 .

[51]  Mark M Churchland,et al.  A Dynamical Basis Set for Generating Reaches. , 2014, Cold Spring Harbor symposia on quantitative biology.

[52]  Hansjörg Scherberger,et al.  Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning , 2016, PLoS Comput. Biol..