Integration of paired spiking cerebellar models for voluntary movement adaptation in a closed-loop neuro-robotic experiment. A simulation study

Motor control is a very important feature in the human brain to achieve optimal performance in motor tasks. The biological basis of this feature can be better understood by emulating the cerebellar mechanisms of learning. The cerebellum plays a key role in implementing fine motor control, since it extracts the information about movements from sensory-motor signals, stores it by means of internal models and uses them to adapt to the environment. The hypothesis is that different internal models could work both independently and dependently. So far, there have been a few studies that aimed to prove their dependency; however, this hypothesis has not been widely used in robot control. The purpose of this work is to build paired spiking cerebellar models and to incorporate them into a biologically plausible composite robotic control architecture for movement adaptation. This is achieved by combining feedback error learning and cerebellar internal models theories. Thus the control architecture is composed of cerebellar feed-forward and recurrent loops for torque-based control of a robot. The spiking cerebellar models are able to correct and improve the performance of the two-degrees of freedom robot module Fable by providing both adaptive torque corrections and sensory corrections to the reference generated by the trajectory planner. Simulations are carried out in the Neurorobotics platform of the Human Brain Project. Results show that the contribution provided by cerebellar learning leads to an optimization of the performance with errors being reduced by 30% compared with the case where the cerebellar contribution is not applied.

[1]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[2]  Ali A. Minai,et al.  A modular neural model of motor synergies , 2012, Neural Networks.

[3]  Stephen G. Lisberger,et al.  Links from complex spikes to local plasticity and motor learning in the cerebellum of awake-behaving monkeys , 2008, Nature Neuroscience.

[4]  Reza Shadmehr,et al.  Encoding of error and learning to correct that error by the Purkinje cells of the cerebellum , 2018, Nature Neuroscience.

[5]  伊藤 正男 The cerebellum : brain for an implicit self , 2012 .

[6]  J. Izawa,et al.  The cerebro-cerebellum: Could it be loci of forward models? , 2016, Neuroscience Research.

[7]  Timothy J Ebner,et al.  Climbing Fibers Control Purkinje Cell Representations of Behavior , 2017, The Journal of Neuroscience.

[8]  Timothy J. Ebner,et al.  Cerebellum and Internal Models , 2021, Handbook of the Cerebellum and Cerebellar Disorders.

[9]  Silvia Tolu,et al.  Adaptive cerebellar Spiking Model Embedded in the Control Loop: Context Switching and Robustness against noise , 2011, Int. J. Neural Syst..

[10]  Alessandra Pedrocchi,et al.  Spiking Neural Network With Distributed Plasticity Reproduces Cerebellar Learning in Eye Blink Conditioning Paradigms , 2016, IEEE Transactions on Biomedical Engineering.

[11]  Eduardo Ros,et al.  Distributed Circuit Plasticity: New Clues for the Cerebellar Mechanisms of Learning , 2016, The Cerebellum.

[12]  Eduardo Ros,et al.  Fast convergence of learning requires plasticity between inferior olive and deep cerebellar nuclei in a manipulation task: a closed-loop robotic simulation , 2014, Front. Comput. Neurosci..

[13]  Paolo Dario,et al.  A comparison between two bio-inspired adaptive models of Vestibulo-Ocular Reflex (VOR) implemented on the iCub robot , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[14]  R. Chris Miall,et al.  Cerebellum: Anatomy and Function , 2013 .

[15]  Masao Ito Control of mental activities by internal models in the cerebellum , 2008, Nature Reviews Neuroscience.

[16]  John Porrill,et al.  Recurrent Cerebellar Loops Simplify Adaptive Control of Redundant and Nonlinear Motor Systems , 2007, Neural Computation.

[17]  Eduardo Ros,et al.  Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network , 2014, PloS one.

[18]  Alexander Peyser,et al.  Nest 2.12.0 , 2017 .

[19]  J. Albus A Theory of Cerebellar Function , 1971 .

[20]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[21]  Angelo Arleo,et al.  Coupling internal cerebellar models enhances online adaptation and supports offline consolidation in sensorimotor tasks , 2013, Front. Comput. Neurosci..

[22]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[23]  S. Schaal,et al.  Robotics and Neuroscience , 2014, Current Biology.

[24]  Silvia Tolu,et al.  A comprehensive gaze stabilization controller based on cerebellar internal models , 2017, Bioinspiration & biomimetics.

[25]  Stefan Schaal,et al.  Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks , 2001, Neural Networks.

[26]  Silvia Tolu,et al.  Adaptive and Predictive Control of a Simulated Robot arm , 2013, Int. J. Neural Syst..

[27]  Silvia Tolu,et al.  Bio-inspired adaptive feedback error learning architecture for motor control , 2012, Biological Cybernetics.

[28]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[29]  James V. Stone,et al.  Decorrelation control by the cerebellum achieves oculomotor plant compensation in simulated vestibulo-ocular reflex , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[30]  Alessandra Pedrocchi,et al.  Control of a Humanoid NAO Robot by an Adaptive Bioinspired Cerebellar Module in 3D Motion Tasks , 2019, Comput. Intell. Neurosci..

[31]  Dominik Endres,et al.  Learning from the past: A reverberation of past errors in the cerebellar climbing fiber signal , 2018, PLoS biology.

[32]  Rüdiger Dillmann,et al.  Connecting Artificial Brains to Robots in a Comprehensive Simulation Framework: The Neurorobotics Platform , 2017, Front. Neurorobot..

[33]  M BOUCHER,et al.  [Physiology of the cerebellum]. , 1956, Lyon medical.

[34]  David Johan Christensen,et al.  Fable II: Design of a modular robot for creative learning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).