Integrated neural and robotic simulations. Simulation of cerebellar neurobiological substrate for an object-oriented dynamic model abstraction process

Experimental studies of the Central Nervous System (CNS) at multiple organization levels aim at understanding how information is represented and processed by the brain's neurobiological substrate. The information processed within different neural subsystems is neurocomputed using distributed and dynamic patterns of neural activity. These emerging patterns can be hardly understood by merely taking into account individual cell activities. Studying how these patterns are elicited in the CNS under specific behavioral tasks has become a groundbreaking research topic in system neuroscience. This methodology of synthetic behavioral experimentation is also motivated by the concept of embodied neuroscience, according to which the primary goal of the CNS is to solve/facilitate the body-environment interaction.With the aim to bridge the gap between system neuroscience and biological control, this paper presents how the CNS neural structures can be connected/integrated within a body agent; in particular, an efficient neural simulator based on EDLUT (Ros et?al., 2006) has been integrated within a simulated robotic environment to facilitate the implementation of object manipulating closed loop experiments (action-perception loop). This kind of experiment allows the study of the neural abstraction process of dynamic models that occurs within our neural structures when manipulating objects.The neural simulator, communication interfaces, and a robot platform have been efficiently integrated enabling real time simulations. The cerebellum is thought to play a crucial role in human-body interaction with a primary function related to motor control which makes it the perfect candidate to start building an embodied nervous system as illustrated in the simulations performed in this work. We integrated EDLUT neural simulator within a simulated robotic environment.As an embodiment example, we implemented a cerebelar-like structure controlling a simulated arm.The neural robotic simulator combines signals in analog/spike domains.Neural simulator, interface, and robotic platform operate conjointly in real time.

[1]  A. Georgopoulos,et al.  Modular organization of directionally tuned cells in the motor cortex: Is there a short-range order? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Michele Giugliano,et al.  Event-Driven Simulation of Spiking Neurons with Stochastic Dynamics , 2003, Neural Computation.

[3]  Alin Albu-Schäffer,et al.  The DLR lightweight robot: design and control concepts for robots in human environments , 2007, Ind. Robot.

[4]  Patrick van der Smagt.  Benchmarking cerebellar control Robotics and Autonomous Systems 32 (2000) 237-251 , 2000 .

[5]  Masao Ito.  The Cerebellum And Neural Control , 1984 .

[6]  Tadashi Yamazaki,et al.  The cerebellum as a liquid state machine , 2007, Neural Networks.

[7]  Thierry Nieus,et al.  A Realistic Large-Scale Model of the Cerebellum Granular Layer Predicts Circuit Spatio-Temporal Filtering Properties , 2009, Front. Cell. Neurosci..

[8]  Egidio D'Angelo,et al.  Distributed cerebellar plasticity implements adaptable gain control in a manipulation task: a closed-loop robotic simulation , 2013, Front. Neural Circuits.

[9]  Shigeru Tanaka,et al.  A spiking network model for passage-of-time representation in the cerebellum , 2007, The European journal of neuroscience.

[10]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[11]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[12]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[13]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[14]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[15]  Silvia Tolu,et al.  Adaptive cerebellar Spiking Model Embedded in the Control Loop: Context Switching and Robustness against noise , 2011, Int. J. Neural Syst..

[16]  Tadashi Yamazaki,et al.  Neural Modeling of an Internal Clock , 2005, Neural Computation.

[17]  E. D’Angelo,et al.  Beyond parallel fiber LTD: the diversity of synaptic and non-synaptic plasticity in the cerebellum , 2001, Nature Neuroscience.

[18]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. I. Distributed inverse dynamics control , 1998, The European journal of neuroscience.

[19]  Patrick van der Smagt.  Benchmarking cerebellar control , 2000, Robotics Auton. Syst..

[20]  Eduardo Ros,et al.  Event-Driven Simulation Scheme for Spiking Neural Networks Using Lookup Tables to Characterize Neuronal Dynamics , 2006, Neural Computation.

[21]  Tamar Flash,et al.  Computational approaches to motor control , 2001, Current Opinion in Neurobiology.

[22]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[23]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[24]  Nicholas T. Carnevale,et al.  ModelDB: A Database to Support Computational Neuroscience , 2004, Journal of Computational Neuroscience.

[25]  Hong Liu,et al.  A mechatronics approach to the design of light-weight arms and multifingered hands , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[26]  Nicholas V. Swindale,et al.  Orientation tuning curves: empirical description and estimation of parameters , 1998, Biological Cybernetics.

[27]  Benjamin Schrauwen,et al.  Accelerating Event-Driven Simulation of Spiking Neurons with Multiple Synaptic Time Constants , 2009, Neural Computation.

[28]  John Porrill,et al.  Adaptive-filter Models of the Cerebellum: Computational Analysis , 2008, The Cerebellum.

[29]  M. Ito,et al.  Adaptive modification of the vestibulo-ocular reflex in rabbits affected by visual inputs and its possible neuronal mechanisms. , 1979, Progress in brain research.

[30]  Eduardo Ros,et al.  Cerebellarlike Corrective Model Inference Engine for Manipulation Tasks , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Christophe Sabourin,et al.  Robustness of the dynamic walk of a biped robot subjected to disturbing external forces by using CMAC neural networks , 2005, Robotics Auton. Syst..

[32]  Eduardo Ros,et al.  Cerebellar Input Configuration Toward Object Model Abstraction in Manipulation Tasks , 2011, IEEE Transactions on Neural Networks.

[33]  Eduardo Ros,et al.  Event and Time Driven Hybrid Simulation of Spiking Neural Networks , 2011, IWANN.

[34]  Reza Shadmehr,et al.  Internal models of limb dynamics and the encoding of limb state , 2005, Journal of neural engineering.

[36]  B. Schrauwen,et al.  BSA, a fast and accurate spike train encoding scheme , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[37]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[38]  James S. Albus,et al.  Data Storage in the Cerebellar Model Articulation Controller (CMAC) , 1975 .

[39]  Dieter Jaeger,et al.  Coding of tactile response properties in the rat deep cerebellar nuclei. , 2005, Journal of neurophysiology.

[40]  Heiko Hoffmann,et al.  Sensor-assisted adaptive motor control under continuously varying context , 2007, ICINCO-ICSO.

[41]  A. Bastian.  Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[42]  J. Albus.  A Theory of Cerebellar Function , 1971 .

[43]  John Porrill,et al.  Cerebellar Motor Learning: When Is Cortical Plasticity Not Enough? , 2007, PLoS Comput. Biol..

[44]  D. Jaeger,et al.  Responses to tactile stimulation in deep cerebellar nucleus neurons result from recurrent activation in multiple pathways. , 2008, Journal of neurophysiology.

[45]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[46]  Lloyd Watts,et al.  Event-Driven Simulation of Networks of Spiking Neurons , 1993, NIPS.

[47]  Silvia Tolu,et al.  Bio-inspired adaptive feedback error learning architecture for motor control , 2012, Biological Cybernetics.

[48]  Silvia Tolu,et al.  Event-driven simulation of cerebellar granule cells , 2008, Biosyst..

[49]  T. Makino.  A Discrete-Event Neural Network Simulator for General Neuron Models , 2003, Neural Computing & Applications.

[50]  John Porrill,et al.  The cerebellum as an adaptive filter: a general model? , 2010, Functional neurology.

[51]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[52]  Kenneth R. Boff,et al.  Engineering data compendium. Human perception and performance. User's guide , 1988 .

[53]  Guru Basava Raj.  Adaptive Prediction and Control of a Process , 1991, 1991 American Control Conference.

[54]  Jacques Gautrais,et al.  SpikeNET: A simulator for modeling large networks of integrate and fire neurons , 1999, Neurocomputing.

[55]  Tadashi Yamazaki,et al.  A Computational Mechanism for Unified Gain and Timing Control in the Cerebellum , 2012, PloS one.

[56]  M. Ito.  Synaptic plasticity in the cerebellar cortex and its role in motor learning. , 1993, The Canadian journal of neurological sciences. Le journal canadien des sciences neurologiques.

[57]  Silvia Tolu,et al.  Adaptive and Predictive Control of a Simulated Robot arm , 2013, Int. J. Neural Syst..

[58]  P. Dean,et al.  The cerebellar microcircuit as an adaptive filter: experimental and computational evidence , 2010, Nature Reviews Neuroscience.

[59]  Shigeru Tanaka,et al.  Computational Models of Timing Mechanisms in the Cerebellar Granular Layer , 2009, The Cerebellum.

[60]  Chen K. Tham,et al.  Reinforcement learning of multiple tasks using a hierarchical CMAC architecture , 1995, Robotics Auton. Syst..

[61]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[62]  Yosef Yarom,et al.  A model of the olivo-cerebellar system as a temporal pattern generator , 2008, Trends in Neurosciences.

[63]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[64]  Eduardo Ros,et al.  From Sensors to Spikes: Evolving Receptive Fields to Enhance Sensorimotor Information in a Robot-Arm , 2012, Int. J. Neural Syst..

[65]  J. Eccles.  Circuits in the cerebellar control of movement. , 1967, Proceedings of the National Academy of Sciences of the United States of America.

[66]  Wei Zhang,et al.  Long-Term Depression at the Mossy Fiber–Deep Cerebellar Nucleus Synapse , 2006, The Journal of Neuroscience.

[67]  Ilya A. Rybak,et al.  Neurobiological and neurorobotic approaches to control architectures for a humanoid motor system , 2001, Robotics Auton. Syst..

[68]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[69]  T. Bliss,et al.  Distributed synergistic plasticity and cerebellar learning , 2012 .

[70]  A. Barto,et al.  Models of the cerebellum and motor learning , 1996 .

[71]  Jonathan D Victor,et al.  Spike train metrics , 2005, Current Opinion in Neurobiology.

[72]  Y Uno,et al.  Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. , 1999, Journal of neurophysiology.

[73]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[74]  S. Schultz.  Principles of Neural Science, 4th ed. , 2001 .

[75]  Darran Yates.  Neurodevelopmental disorders: Getting with the reprogram , 2011, Nature Reviews Neuroscience.

[76]  Masao Ito.  Control of mental activities by internal models in the cerebellum , 2008, Nature Reviews Neuroscience.

[77]  Zhenyu Gao,et al.  Distributed synergistic plasticity and cerebellar learning , 2012, Nature Reviews Neuroscience.

[78]  Florentin Wörgötter,et al.  Adaptive, Fast Walking in a Biped Robot under Neuronal Control and Learning , 2007, PLoS Comput. Biol..

[79]  J. Voogd,et al.  Single Purkinje cell can innervate multiple classes of projection neurons in the cerebellar nuclei of the rat: A light microscopic and ultrastructural triple‐tracer study in the rat , 1998, The Journal of comparative neurology.

[80]  A G Barto,et al.  Prediction of complex two-dimensional trajectories by a cerebellar model of smooth pursuit eye movement. , 1997, Journal of neurophysiology.

[81]  Yosef Yarom,et al.  Invariant phase structure of olivo-cerebellar oscillations and its putative role in temporal pattern generation , 2009, Proceedings of the National Academy of Sciences.

[82]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. II. A neural model of the intermediate cerebellum , 1998, The European journal of neuroscience.

[83]  K. Doya,et al.  Electrophysiological properties of inferior olive neurons: A compartmental model. , 1999, Journal of neurophysiology.

[84]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.