Sensory Prediction or Motor Control? Application of Marr–Albus Type Models of Cerebellar Function to Classical Conditioning

Marr–Albus adaptive filter models of the cerebellum have been applied successfully to a range of sensory and motor control problems. Here we analyze their properties when applied to classical conditioning of the nictitating membrane response in rabbits. We consider a system-level model of eyeblink conditioning based on the anatomy of the eyeblink circuitry, comprising an adaptive filter model of the cerebellum, a comparator model of the inferior olive and a linear dynamic model of the nictitating membrane plant. To our knowledge, this is the first model that explicitly includes all these principal components, in particular the motor plant that is vital for shaping and timing the behavioral response. Model assumptions and parameters were systematically investigated to disambiguate basic computational capacities of the model from features requiring tuning of properties and parameter values. Without such tuning, the model robustly reproduced a range of behaviors related to sensory prediction, by displaying appropriate trial-level associative learning effects for both single and multiple stimuli, including blocking and conditioned inhibition. In contrast, successful reproduction of the real-time motor behavior depended on appropriate specification of the plant, cerebellum and comparator models. Although some of these properties appear consistent with the system biology, fundamental questions remain about how the biological parameters are chosen if the cerebellar microcircuit applies a common computation to many distinct behavioral tasks. It is possible that the response profiles in classical conditioning of the eyeblink depend upon operant contingencies that have previously prevailed, for example in naturally occurring avoidance movements.

[1]  M. Garwicz,et al.  Evidence for a GABA-mediated cerebellar inhibition of the inferior olive in the cat , 2004, Experimental Brain Research.

[2]  A R Gibson,et al.  Red nucleus stimulation inhibits within the inferior olive. , 1998, Journal of neurophysiology.

[3]  Germund Hesslow,et al.  Cerebellum and conditioned reflexes , 1998, Trends in Cognitive Sciences.

[4]  C. Yeo,et al.  The Effect of Kainic Acid Lesions of the Cerebellar Cortex on the Conditioned Nictitating Membrane Response in the Rabbit , 1992, The European journal of neuroscience.

[5]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[6]  Germund Hesslow Inhibition of inferior olivary transmission by mesencephalic stimulation in the cat , 1986, Neuroscience Letters.

[7]  W. Regehr,et al.  Inhibitory Regulation of Electrically Coupled Neurons in the Inferior Olive Is Mediated by Asynchronous Release of GABA , 2009, Neuron.

[8]  W. T. Thach,et al.  Purkinje cell activity during motor learning , 1977, Brain Research.

[9]  M. Mauk,et al.  Inhibition of climbing fibres is a signal for the extinction of conditioned eyelid responses , 2002, Nature.

[10]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[11]  M. Mauk,et al.  Learning-dependent timing of Pavlovian eyelid responses: differential conditioning using multiple interstimulus intervals. , 1992, Behavioral neuroscience.

[12]  C. Yeo,et al.  Acquisition of Eyeblink Conditioning Is Critically Dependent on Normal Function in Cerebellar Cortical Lobule HVI , 2001, The Journal of Neuroscience.

[13]  Stephen Grossberg,et al.  A neural model of timed response learning in the cerebellum , 1994, Neural Networks.

[14]  Christopher H. Yeo,et al.  Trigeminal Inputs to Eyeblink Motoneurons in the Rabbit , 1996, Experimental Neurology.

[15]  Germund Hesslow,et al.  The Functional Anatomy of Skeletal Conditioning , 2002 .

[16]  J. P. Welsh,et al.  Changes in the motor pattern of learned and unlearned responses following cerebellar lesions: A kinematic analysis of the nictitating membrane reflex , 1992, Neuroscience.

[17]  J. Bloedel,et al.  Cerebellar Dysfunction Explains the Extinction-Like Abolition of Conditioned Eyeblinks After NBQX Injections in the Inferior Olive , 2008, The Journal of Neuroscience.

[18]  P. Gilbert A theory of memory that explains the function and structure of the cerebellum. , 1974, Brain research.

[19]  Richard F. Thompson In search of memory traces. , 2005, Annual review of psychology.

[20]  C. Evinger,et al.  Role of cerebellum in adaptive modification of reflex blinks. , 1997, Learning & memory.

[21]  J. Rawson,et al.  Evidence that Climbing Fibers Control an Intrinsic Spike Generator in Cerebellar Purkinje Cells , 2004, The Journal of Neuroscience.

[22]  J. Porrill,et al.  Recruitment in Retractor Bulbi Muscle During Eyeblink Conditioning: EMG Analysis and Common-Drive Model , 2009, Journal of neurophysiology.

[23]  James V. Stone,et al.  Recurrent cerebellar architecture solves the motor-error problem , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[24]  Javier F. Medina,et al.  Timing Mechanisms in the Cerebellum: Testing Predictions of a Large-Scale Computer Simulation , 2000, The Journal of Neuroscience.

[25]  G. Andersson,et al.  Inferior olive excitability after high frequency climbing fibre activation in the cat , 2004, Experimental Brain Research.

[26]  G. Hesslow,et al.  Inhibition of the inferior olive during conditioned responses in the decerebrate ferret , 1996, Experimental Brain Research.

[27]  D. Nicholson,et al.  Addition of inhibition in the olivocerebellar system and the ontogeny of a motor memory , 2003, Nature Neuroscience.

[28]  Jinhu Xiong,et al.  The human red nucleus and lateral cerebellum in supporting roles for sensory information processing , 2000, Human brain mapping.

[29]  Richard F. Thompson,et al.  Sensorimotor learning and the cerebellum , 1991 .

[30]  G. Hesslow,et al.  Feedback control of Purkinje cell activity by the cerebello‐olivary pathway , 2004, The European journal of neuroscience.

[31]  N. Mackintosh The psychology of animal learning , 1974 .

[32]  Christopher H. Yeo,et al.  Memory Consolidation in the Cerebellar Cortex , 2010, PloS one.

[33]  P. Dean,et al.  The cerebellar microcircuit as an adaptive filter: experimental and computational evidence , 2010, Nature Reviews Neuroscience.

[34]  R. Sutton,et al.  Simulation of the classically conditioned nictitating membrane response by a neuron-like adaptive element: Response topography, neuronal firing, and interstimulus intervals , 1986, Behavioural Brain Research.

[35]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[36]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[37]  J. W. Moore,et al.  Altering the synchrony of stimulus trace processes: tests of a neural-network model , 1991, Biological Cybernetics.

[38]  J. W. Moore,et al.  Adaptively timed conditioned responses and the cerebellum: A neural network approach , 1989, Biological Cybernetics.

[39]  I. Pavlov,et al.  Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex , 2010, Annals of Neurosciences.

[40]  G. Hesslow,et al.  Acquisition, Extinction, and Reacquisition of a Cerebellar Cortical Memory Trace , 2007, The Journal of Neuroscience.

[41]  Germund Hesslow,et al.  Cerebellar control of the inferior olive , 2008, The Cerebellum.

[42]  Richard F. Thompson Neuronal substrates of simple associative learning: classical conditioning , 1983, Trends in Neurosciences.

[43]  Dean V. Buonomano,et al.  Neural Network Model of the Cerebellum: Temporal Discrimination and the Timing of Motor Responses , 1999, Neural Computation.

[44]  J. R. Bloedel,et al.  Inferior olivary inactivation abolishes conditioned eyeblinks: Extinction or cerebellar malfunction? , 2007, Behavioural Brain Research.

[45]  C. Evinger,et al.  Cerebellar Modulation of Trigeminal Reflex Blinks: Interpositus Neurons , 2006, The Journal of Neuroscience.

[46]  R. F. Thompson,et al.  Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. , 1998, Science.

[47]  C. Ekerot,et al.  Parallel fiber receptive fields: a key to understanding cerebellar operation and learning , 2008, The Cerebellum.

[48]  Karen D. Davis,et al.  Modulatory influences of red nucleus stimulation on the somatosensory responses of cat trigeminal subnucleus oralis neurons , 1986, Experimental Neurology.

[49]  M. Glickstein,et al.  Classical conditioning of the nictitating membrane response of the rabbit , 2004, Experimental Brain Research.

[50]  B G Schreurs,et al.  Kinetic and frequency-domain properties of reflex and conditioned eyelid responses in the rabbit. , 2000, Journal of neurophysiology.

[51]  J. Steinmetz,et al.  Dorsal accessory inferior olive activity diminishes during acquisition of the rabbit classically conditioned eyelid response , 1991, Brain Research.

[52]  Masao Ito Cerebellar circuitry as a neuronal machine , 2006, Progress in Neurobiology.

[53]  R. Llinás,et al.  GABAergic modulation of complex spike activity by the cerebellar nucleoolivary pathway in rat. , 1996, Journal of neurophysiology.

[54]  Kirk N. Olsen,et al.  Scalar timing varies with response magnitude in classical conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus). , 2009, Behavioral neuroscience.

[55]  D. Zee,et al.  Effects of ablation of flocculus and paraflocculus of eye movements in primate. , 1981, Journal of neurophysiology.

[56]  J. W. Moore,et al.  Adaptive timing in neural networks: The conditioned response , 1988, Biological Cybernetics.

[57]  M. Ito Cerebellar control of the vestibulo-ocular reflex--around the flocculus hypothesis. , 1982, Annual review of neuroscience.

[58]  John Porrill,et al.  Recurrent Cerebellar Loops Simplify Adaptive Control of Redundant and Nonlinear Motor Systems , 2007, Neural Computation.

[59]  N. Donegan,et al.  A model of Pavlovian eyelid conditioning based on the synaptic organization of the cerebellum. , 1997, Learning & memory.

[60]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[61]  J. Albus A Theory of Cerebellar Function , 1971 .

[62]  P. Dean,et al.  Evidence from retractor bulbi EMG for linearized motor control of conditioned nictitating membrane responses. , 2007, Journal of neurophysiology.

[63]  F. Bengtsson,et al.  Cerebellar inhibition of inferior olivary transmission in the decerebrate ferret , 2005, Experimental Brain Research.

[64]  S. Grossberg,et al.  Metabotropic Glutamate Receptor Activation in Cerebellar Purkinje Cells as Substrate for Adaptive Timing of the Classically Conditioned Eye-Blink Response , 1996, The Journal of Neuroscience.

[65]  Shigeru Tanaka,et al.  A spiking network model for passage-of-time representation in the cerebellum , 2007, The European journal of neuroscience.

[66]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[67]  James V. Stone,et al.  Decorrelation control by the cerebellum achieves oculomotor plant compensation in simulated vestibulo-ocular reflex , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[68]  Germund Hesslow,et al.  Simple and Complex Spike Firing Patterns in Purkinje Cells During Classical Conditioning , 2008, The Cerebellum.

[69]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[70]  G. Hesslow,et al.  Extinction of conditioned blink responses by cerebello-olivary pathway stimulation , 2007, Neuroreport.

[71]  Javier F. Medina,et al.  Computer simulation of cerebellar information processing , 2000, Nature Neuroscience.