A spiking neural model of adaptive arm control

We present a spiking neuron model of the motor cortices and cerebellum of the motor control system. The model consists of anatomically organized spiking neurons encompassing premotor, primary motor, and cerebellar cortices. The model proposes novel neural computations within these areas to control a nonlinear three-link arm model that can adapt to unknown changes in arm dynamics and kinematic structure. We demonstrate the mathematical stability of both forms of adaptation, suggesting that this is a robust approach for common biological problems of changing body size (e.g. during growth), and unexpected dynamic perturbations (e.g. when moving through different media, such as water or mud). To demonstrate the plausibility of the proposed neural mechanisms, we show that the model accounts for data across 19 studies of the motor control system. These data include a mix of behavioural and neural spiking activity, across subjects performing adaptive and static tasks. Given this proposed characterization of the biological processes involved in motor control of the arm, we provide several experimentally testable predictions that distinguish our model from previous work.

[1]  Darcy M. Griffin,et al.  Corticomotoneuronal cells are “functionally tuned” , 2015, Science.

[2]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[3]  S. Scott.  Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[4]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[5]  Tadashi Yamazaki,et al.  A Computational Mechanism for Unified Gain and Timing Control in the Cerebellum , 2012, PloS one.

[6]  Frederico A. C. Azevedo,et al.  Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled‐up primate brain , 2009, The Journal of comparative neurology.

[7]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[8]  J. Mink.  THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[9]  M. Graziano.  The organization of behavioral repertoire in motor cortex. , 2006, Annual review of neuroscience.

[10]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[11]  K. Doya.  Complementary roles of basal ganglia and cerebellum in learning and motor control , 2000, Current Opinion in Neurobiology.

[12]  J. F. Soechting,et al.  Effect of target size on spatial and temporal characteristics of a pointing movement in man , 2004, Experimental Brain Research.

[13]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[14]  Bente Pakkenberg,et al.  The size distribution of neurons in the motor cortex in amyotrophic lateral sclerosis , 2005, Journal of anatomy.

[15]  Mitsuo Kawato,et al.  A computational model of four regions of the cerebellum based on feedback-error learning , 2004, Biological Cybernetics.

[16]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[17]  Claes von Hofsten,et al.  Eye, Head and Trunk Control: The Foundation for Manual Development 1 The responsibility was shared equally between the authors. 1 , 1998, Neuroscience & Biobehavioral Reviews.

[18]  C. Eliasmith,et al.  The use and abuse of large-scale brain models , 2014, Current Opinion in Neurobiology.

[19]  Paul Cisek,et al.  Neural activity in primary motor and dorsal premotor cortex in reaching tasks with the contralateral versus ipsilateral arm. , 2003, Journal of neurophysiology.

[20]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Robert M. Sanner,et al.  A mathematical model of the adaptive control of human arm motions , 1999, Biological Cybernetics.

[22]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[24]  S. Schaal.  Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[25]  Chien Chern Cheah,et al.  Adaptive Tracking Control for Robots with Unknown Kinematic and Dynamic Properties , 2006, Int. J. Robotics Res..

[26]  Oussama Khatib,et al.  Whole-Body Dynamic Behavior and Control of Human-like Robots , 2004, Int. J. Humanoid Robotics.

[27]  C. M. Place.  Dynamical Systems: Differential Equations, Maps, and Chaotic Behaviour , 1992 .

[28]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[29]  Richard S. J. Frackowiak,et al.  A Blueprint for Movement: Functional and Anatomical Representations in the Human Motor System , 1999, The Journal of Neuroscience.

[30]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[31]  J. Doyon,et al.  Contributions of the basal ganglia and functionally related brain structures to motor learning , 2009, Behavioural Brain Research.

[32]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[33]  R. Shadmehr,et al.  Motor disorder in Huntington's disease begins as a dysfunction in error feedback control , 2000, Nature.

[34]  Emanuel Todorov,et al.  Compositionality of optimal control laws , 2009, NIPS.

[35]  Chris Eliasmith,et al.  Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems , 2004, IEEE Transactions on Neural Networks.

[36]  Chris Eliasmith,et al.  Solving the Problem of Negative Synaptic Weights in Cortical Models , 2008, Neural Computation.

[37]  Thomas A. McMahon,et al.  Muscles, Reflexes, and Locomotion , 1984 .

[38]  Chris Eliasmith,et al.  How to Build a Brain: A Neural Architecture for Biological Cognition , 2013 .

[39]  Stuart Bennett,et al.  A History of Control Engineering 1930-1955 , 1993 .

[40]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[41]  Chris Eliasmith,et al.  Fine-Tuning and the Stability of Recurrent Neural Networks , 2011, PloS one.

[42]  R. Shadmehr,et al.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. , 2005, Journal of neurophysiology.

[43]  Suguru Arimoto,et al.  On control of reaching movements for musculo-skeletal redundant arm model , 2009 .

[44]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  J. Slotine,et al.  On the Adaptive Control of Robot Manipulators , 1987 .

[46]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[47]  C. Eliasmith,et al.  Dynamic Behaviour of a Spiking Model of Action Selection in the Basal Ganglia Neural Structure , 2010 .

[48]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[49]  S. Wise.  The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[50]  T DeWolf,et al.  The neural optimal control hierarchy for motor control , 2011, Journal of neural engineering.

[51]  Angelo Arleo,et al.  Internal Models in the Cerebellum: A Coupling Scheme for Online and Offline Learning in Procedural Tasks , 2010, SAB.

[52]  Emanuel Todorov,et al.  General duality between optimal control and estimation , 2008, 2008 47th IEEE Conference on Decision and Control.

[53]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[54]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[55]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. II. A neural model of the intermediate cerebellum , 1998, The European journal of neuroscience.

[56]  M. Kawato,et al.  Internal forward models in the cerebellum: fMRI study on grip force and load force coupling. , 2003, Progress in brain research.

[57]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[58]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.

[59]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[60]  Oussama Khatib,et al.  Controlling articulated robots in task-space with spiking silicon neurons , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.