Adaptively timed conditioned responses and the cerebellum: A neural network approach

Conditioned responses often reflect knowledge about the timing of a US. This knowledge is manifested in the dependance of response topography on the CS-US interval employed in training. A neural network model and set of learning rules capable of simulating temporally adaptive features of conditioned responses is reviewed, and simulations are presented. In addition, we present a neural network implementation of the model which is designed to reconcile empirical studies of long-term synaptic depression in the cerebellum with neurobiological evidence from studies of the classically conditioned nictitating membrane response of the rabbit.

[1]  C. L. Hull.  The goal-gradient hypothesis and maze learning. , 1932 .

[2]  F. Logan.  A micromolar approach to behavior theory. , 1956, Psychological review.

[3]  A. Scheibel,et al.  Structural substrates for integrative patterns in the brain stem reticular core. , 1958 .

[4]  Boneau Ca.  The interstimulus interval and the latency of the conditioned eyelid response. , 1958, Journal of experimental psychology.

[5]  Efficiency of the Conditioned Eyelid Response , 1965, Science.

[6]  V. Braitenberg.  Is the cerebellar cortex a biological clock in the millisecond range? , 1967, Progress in brain research.

[7]  L. Kamin.  Attention-like processes in classical conditioning , 1967 .

[8]  J. Theios,et al.  Effect of CS-US interval shift on classical conditioning of the nictitating membrane in the rabbit. , 1967, Journal of comparative and physiological psychology.

[9]  I. Martin,et al.  Shape of the conditioned eyelid response. , 1968, Psychological review.

[10]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[11]  R. Snider.  Neurobiology of cerebellar evolution and development , 1971 .

[12]  J. Albus.  A Theory of Cerebellar Function , 1971 .

[13]  J. W. Moore,et al.  Blocking of the rabbit's conditioned nictitating membrane response in Kamin's two-stage paradigm. , 1973, Journal of experimental psychology.

[14]  J S Buchwald,et al.  Classical conditioning with auditory discrimination of the eye blink in decerebrate cats. , 1977, Science.

[15]  J. R. Millenson,et al.  Classical conditioning of the rabbit's nictitating membrane response under fixed and mixed CS-US intervals , 1977 .

[16]  P. W. Frey,et al.  The eye blink as a time-locked response: implications for serial and second-order conditioning. , 1979, Journal of experimental psychology. Animal behavior processes.

[17]  W. F. Hill,et al.  Mechanisms of Learning and Motivation: A Memorial Volume to Jerzy Konorski , 1980 .

[18]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[19]  Masao Ito,et al.  Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells , 1982, The Journal of physiology.

[20]  JOHN W. Moore,et al.  A brain stem region essential for the classically conditioned but not unconditioned nictitating membrane response , 1982, Physiology & Behavior.

[21]  Rosa H. Huang,et al.  Projections from the cochlear nucleus to the cerebellum , 1982, Brain Research.

[22]  D. Alkon.  Calcium-mediated reduction of ionic currents: a biophysical memory trace. , 1984, Science.

[23]  M. Glickstein,et al.  Discrete lesions of the cerebellar cortex abolish the classically conditioned nictitating membrane response of the rabbit , 1984, Behavioural Brain Research.

[24]  Masao Ito.  The Cerebellum And Neural Control , 1984 .

[25]  G. A. Clark,et al.  Effects of lesions of cerebellar nuclei on conditioned behavioral and hippocampal neuronal responses , 1984, Brain Research.

[26]  LESIONS OF CEREBELLAR LOBULUS SIMPLEX ABOLISH THE CLASSICALLY-CONDITIONED NICTITATING-MEMBRANE RESPONSE OF THE RABBIT , 1984 .

[27]  M. M. Patterson,et al.  Differential effects of hippocampectomy on classically conditioned rabbit nictitating membrane response related to interstimulus interval. , 1985, Behavioral neuroscience.

[28]  Dieter Menne.  Theoretical Limits of Time Resolution in Narrow Band Neurons , 1985 .

[29]  D H Perkel,et al.  The function of dendritic spines: a review of theoretical issues. , 1985, Behavioral and neural biology.

[30]  D. Zipser.  A model of hippocampal learning during classical conditioning. , 1986, Behavioral neuroscience.

[31]  THE CEREBELLUM AND NEURAL CONTROL. First Edition. By Maseo Ito. Published by Raven Press, New York. 580 pages. $75.00 , 1986, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[32]  R. Sutton,et al.  Simulation of the classically conditioned nictitating membrane response by a neuron-like adaptive element: Response topography, neuronal firing, and interstimulus intervals , 1986, Behavioural Brain Research.

[33]  M. Kano,et al.  Quisqualate receptors are specifically involved in cerebellar synaptic plasticity , 1987, Nature.

[34]  J. Byrne,et al.  Single-cell neuronal model for associative learning. , 1987, Journal of neurophysiology.

[35]  W. N. Ross,et al.  Mapping calcium transients in the dendrites of Purkinje cells from the guinea‐pig cerebellum in vitro. , 1987, The Journal of physiology.

[36]  M. Sakurai.  Synaptic modification of parallel fibre‐Purkinje cell transmission in in vitro guinea‐pig cerebellar slices. , 1987, The Journal of physiology.

[37]  C. Yeo.  Cerebellum and Classical Conditioning , 1987 .

[38]  J. W. Moore,et al.  Purkinje Cell Activity and the Conditioned Nictitating Membrane Response , 1987 .

[39]  M. Kano,et al.  Mode of induction of long-term depression at parallel fibre—Purkinje cell synapses in rabbit cerebellar cortex , 1988, Neuroscience Research.

[40]  F. Crépel,et al.  Activation of protein kinase C induces a long-term depression of glutamate sensitivity of cerebellar Purkinje cells. An in vitro study , 1988, Brain Research.

[41]  B G Schreurs.  Stimulation of the spinal trigeminal nucleus supports classical conditioning of the rabbit's nictitating membrane response. , 1988, Behavioral neuroscience.

[42]  JOHN W. Moore,et al.  Conditioning and the cerebellum , 1988 .

[43]  D. Tank,et al.  Spatially resolved calcium dynamics of mammalian Purkinje cells in cerebellar slice. , 1988, Science.

[44]  JOHN W. Moore,et al.  The hippocampus and the classically conditioned nictitating membrane response: A real-time attentional-associative model , 1988, Psychobiology.

[45]  J. Harvey,et al.  Asymmetric uptake of 2-deoxy-d-[14C]glucose in the dorsal cochlear nucleus during Pavlovian conditioning in the rabbit , 1988, Brain Research.

[46]  A. Klopf.  A neuronal model of classical conditioning , 1988 .

[47]  R. Llinás,et al.  Electrophysiology of guinea‐pig cerebellar nuclear cells in the in vitro brain stem‐cerebellar preparation. , 1988, The Journal of physiology.

[48]  D. Haines.  Evidence of intracerebellar collateralization of nucleocortical cell processes in a prosimian primate (Galago): A fluorescence retrograde study , 1988, The Journal of comparative neurology.

[49]  G. R. Wells,et al.  Visual projections to the pontine nuclei in the rabbit: Orthograde and retrograde tracing studies with WGA‐HRP , 1989, The Journal of comparative neurology.

[50]  Stephen Grossberg,et al.  Neural dynamics of adaptive timing and temporal discrimination during associative learning , 1989, Neural Networks.

[51]  S. Amari,et al.  Dynamic Interactions in Neural Networks: Models and Data , 1988, Research Notes in Neural Computing.

[52]  JOHN W. Moore,et al.  Effects of hippocampal manipulations on the classically conditioned nictitating membrane response: Simulations by an attentional-associative model , 1989, Behavioural Brain Research.

[53]  John E. Desmond.  Temporally Adaptive Conditioned Response: Representation of the Stimulus , 1989 .

[54]  M. Ito,et al.  Long-term depression. , 1989, Annual review of neuroscience.

[55]  G. Lynch,et al.  The neurobiology of learning and memory , 1989, Cognition.

[56]  JOHN W. Moore,et al.  Single-unit activity in red nucleus during the classically conditioned rabbit nictitating membrane response , 1991, Neuroscience Research.

[57]  J. W. Moore,et al.  Adaptive timing in neural networks: The conditioned response , 1988, Biological Cybernetics.

[58]  J. W. Moore,et al.  Cerebellar Purkinje cell activity related to the classically conditioned nictitating membrane response , 2004, Experimental Brain Research.

[59]  G. Tesauro,et al.  Simple neural models of classical conditioning , 1986, Biological Cybernetics.

[60]  E. Mugnaini,et al.  The length of parallel fibers in the cat cerebellar cortex. An experimental light and electron microscopic study , 1976, Experimental Brain Research.

[61]  R. F. Thompson,et al.  Reacquisition of classical conditioning after removal of cerebellar cortex , 2004, Experimental Brain Research.

[62]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[63]  J. W. Moore,et al.  Dorsolateral pontine tegmentum and the classically conditioned nictitating membrane response: analysis of CR-related single-unit activity , 2004, Experimental Brain Research.

[64]  E. Dietrichs,et al.  Cerebellar cortical afferents from the red nucleus in the cat , 2004, Experimental Brain Research.

[65]  E. Mugnaini,et al.  The GABAergic cerebello-olivary projection in the rat , 2005, Anatomy and Embryology.

[66]  The anatomical basis of attention. , .