A cerebellar model for predictive motor control tested in a brain-based device.

The cerebellum is known to be critical for accurate adaptive control and motor learning. We propose here a mechanism by which the cerebellum may replace reflex control with predictive control. This mechanism is embedded in a learning rule (the delayed eligibility trace rule) in which synapses onto a Purkinje cell or onto a cell in the deep cerebellar nuclei become eligible for plasticity only after a fixed delay from the onset of suprathreshold presynaptic activity. To investigate the proposal that the cerebellum is a general-purpose predictive controller guided by a delayed eligibility trace rule, a computer model based on the anatomy and dynamics of the cerebellum was constructed. It contained components simulating cerebellar cortex and deep cerebellar nuclei, and it received input from a middle temporal visual area and the inferior olive. The model was incorporated in a real-world brain-based device (BBD) built on a Segway robotic platform that learned to traverse curved paths. The BBD learned which visual motion cues predicted impending collisions and used this experience to avoid path boundaries. During learning, the BBD adapted its velocity and turning rate to successfully traverse various curved paths. By examining neuronal activity and synaptic changes during this behavior, we found that the cerebellar circuit selectively responded to motion cues in specific receptive fields of simulated middle temporal visual areas. The system described here prompts several hypotheses about the relationship between perception and motor control and may be useful in the development of general-purpose motor learning systems for machines.

[1]  Masao Ito,et al.  Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells , 1982, The Journal of physiology.

[2]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  G. Edelman Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[5]  W. Reichardt,et al.  Computational structure of a biological motion-detection system as revealed by local detector analysis in the fly's nervous system. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[6]  G. Edelman,et al.  Synthetic neural modeling applied to a real-world artifact. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[7]  T J Sejnowski,et al.  A Model for Encoding Multiple Object Motions and Self-Motion in Area MST of Primate Visual Cortex , 1998, The Journal of Neuroscience.

[8]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[9]  Markus Lappe,et al.  A model of the combination of optic flow and extraretinal eye movement signals in primate extrastriate visual cortex: Neural model of self-motion from optic flow and extraretinal cues , 1998, Neural Networks.

[10]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[11]  S. Grossberg,et al.  A neural model of motion processing and visual navigation by cortical area MST. , 1999, Cerebral cortex.

[12]  Wilson S. Geisler,et al.  Motion streaks provide a spatial code for motion direction , 1999, Nature.

[13]  M. Mauk,et al.  Cerebellar function: Coordination, learning or timing? , 2000, Current Biology.

[14]  E. D’Angelo,et al.  Beyond parallel fiber LTD: the diversity of synaptic and non-synaptic plasticity in the cerebellum , 2001, Nature Neuroscience.

[15]  M. Kawato,et al.  Computational studies on acquisition and adaptation of ocular following responses based on cerebellar synaptic plasticity. , 2002, Journal of neurophysiology.

[16]  C. Scudder Role of the Fastigial Nucleus in Controlling Horizontal Saccades during Adaptation , 2002, Annals of the New York Academy of Sciences.

[17]  M. Mauk,et al.  Trying to Understand the Cerebellum Well Enough to Build One , 2002, Annals of the New York Academy of Sciences.

[18]  W. M. Keck,et al.  Machine Psychology : Autonomous Behavior , Perceptual Categorization and Conditioning in a Brain-based Device , 2002 .

[19]  Olaf Sporns,et al.  Neuromodulation and plasticity in an autonomous robot , 2002, Neural Networks.

[20]  Frank Bremmer,et al.  Neural correlates of implied motion , 2003, Nature.

[21]  E. Chichilnisky,et al.  Temporal Resolution of Ensemble Visual Motion Signals in Primate Retina , 2003, The Journal of Neuroscience.

[22]  Mitsuo Kawato,et al.  A computational model of four regions of the cerebellum based on feedback-error learning , 2004, Biological Cybernetics.

[23]  Juyang Weng,et al.  Developmental Robotics: Theory and Experiments , 2004, Int. J. Humanoid Robotics.

[24]  M. Häusser,et al.  Integration of quanta in cerebellar granule cells during sensory processing , 2004, Nature.

[25]  G. Edelman,et al.  Visual binding through reentrant connectivity and dynamic synchronization in a brain-based device. , 2004, Cerebral cortex.

[26]  Stephen G. Lisberger,et al.  The Representation of Time for Motor Learning , 2005, Neuron.

[27]  Gerald M Edelman,et al.  Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Megan R. Carey,et al.  Instructive signals for motor learning from visual cortical area MT , 2005, Nature Neuroscience.

[29]  Mark D. Humphries,et al.  A robot model of the basal ganglia: Behavior and intrinsic processing , 2006, Neural Networks.

[30]  Auke Jan Ijspeert,et al.  Simulation and robotics studies of salamander locomotion , 2007, Neuroinformatics.