A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences

Abstract We present models that learn context-dependent oculomotor behavior in (1) conditional visual discrimination and (2) sequence reproduction tasks, based on the following three principles: (1) Visual input and efferent copies of motor output produce patterns of activity in cortex. (2) Cortex influences the saccade system in part via corticostriatal projections. (3) A reinforcement learning mechanism modifies corticostriatal synapses to link patterns of cortical activity to the correct saccade responses during trial-and-error learning. Our conditional visual discrimination model learns to associate visual cues with the corresponding saccades to one of two left-right targets. A visual cue produces patterns of neuronal activity in inferotemporal cortex (IT) that projects to the oculomotor region of the striatum. Initially random saccadic "guesses," when directed to the correct target for the current cue, result in increased synaptic strength between the cue-related IT cells and the striatal cells that participate in the correct saccade, increasing the probability that this cue will later elicit the correct saccade. We show that the model generates "inhibitory gradients" on the striatum as the substrate for spatial generalization. Our sequence reproduction model learns, when presented with temporal sequences of spatial targets, to reproduce the corresponding sequence of saccades. At any point in the execution of a saccade sequence, the current pattern of activity in pre-frontal cortex (PFC), combined with visual input and the motor efferent copy of the previous saccade, produces a new pattern of activity in PFC to be associated with the next saccade. Like IT, PFC also projects to the oculomotor region of the striatum. Correct guesses for the subsequent saccade in the sequence results in strengthening of corticostriatal synapses between active PFC cells and striatal cells involved in the correct saccade. The sequence is thus reproduced as a concatenation of associations. We compare the results of this model with data previously obtained in the monkey and discuss the nature of cortical representations of spatiotemporal information.

[1]  M. Arbib.  Memory limitations of stimulus-response models. , 1969 .

[2]  H Niki,et al.  Prefrontal unit activity during delayed alternation in the monkey. I. Relation to direction of response. , 1974, Brain research.

[3]  H Niki,et al.  Prefrontal unit activity during delayed alternation in the monkey. II. Relation to absolute versus relative direction of response. , 1974, Brain research.

[4]  R. Didday.  A model of visuomotor mechanisms in the frog optic tectum , 1976 .

[5]  M. Azuma,et al.  Prefrontal neuronal activity during gazing at a light spot in the monkey , 1977, Brain Research.

[6]  S. Thorpe,et al.  Responses of striatal neurons in the behaving monkey. 1. Head of the caudate nucleus , 1983, Behavioural Brain Research.

[7]  Elsevier Biomedical Press.  RESPONSES OF STRIATAL NEURONS IN THE BEHAVING MONKEY. 1. HEAD OF THE CAUDATE NUCLEUS , 1983 .

[8]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. , 1983, Journal of neurophysiology.

[9]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades. , 1983, Journal of neurophysiology.

[10]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Michael E. Goldberg,et al.  Physiology of the frontal eye fields , 1984, Trends in Neurosciences.

[12]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus , 1985, Brain Research.

[13]  C. Cotman,et al.  Distribution of N-methyl-D-aspartate-sensitive L-[3H]glutamate-binding sites in rat brain , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  T. D. Lee,et al.  Influence of practice schedule on testing schema theory predictions in adults. , 1985, Journal of motor behavior.

[15]  G. Levi,et al.  Dopamine decreases cell excitability in rat striatal neurons by pre- and postsynaptic mechanisms , 1985, Brain Research.

[16]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spinal/tecto-diencephalic neurons , 1985, Brain Research.

[17]  P. Goldman-Rakic,et al.  Organization of the nigrothalamocortical system in the rhesus monkey , 1985, The Journal of comparative neurology.

[18]  R. Wurtz,et al.  Modification of saccadic eye movements by GABA-related substances. I. Effect of muscimol and bicuculline in monkey superior colliculus. , 1985, Journal of neurophysiology.

[19]  P. Goldman-Rakic,et al.  Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  R. Wurtz,et al.  Modification of saccadic eye movements by GABA-related substances. II. Effects of muscimol in monkey substantia nigra pars reticulata. , 1985, Journal of neurophysiology.

[21]  D L Sparks,et al.  Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. , 1986, Physiological reviews.

[22]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[23]  M. Goldberg,et al.  Functional properties of corticotectal neurons in the monkey's frontal eye field. , 1987, Journal of neurophysiology.

[24]  S Dehaene,et al.  Neural networks that learn temporal sequences by selection. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[25]  C. Scudder.  A new local feedback model of the saccadic burst generator. , 1988, Journal of neurophysiology.

[26]  M E Goldberg,et al.  Frontal eye field efferents in the macaque monkey: I. Subcortical pathways and topography of striatal and thalamic terminal fields , 1988, The Journal of comparative neurology.

[27]  C. Bruce,et al.  Frontal eye field efferents in the macaque monkey: II. Topography of terminal fields in midbrain and pons , 1988, The Journal of comparative neurology.

[28]  R. Wise,et al.  Brain dopamine and reward. , 1989, Annual review of psychology.

[29]  R. Sutton,et al.  Connectionist Learning for Control: An Overview , 1989 .

[30]  O Hikosaka,et al.  Functional properties of monkey caudate neurons. II. Visual and auditory responses. , 1989, Journal of neurophysiology.

[31]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[32]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[33]  W. Schultz.  Neurophysiology of Basal Ganglia , 1989 .

[34]  J. Joseph,et al.  Role of the dorsolateral prefrontal cortex in organizing visually guided behavior. , 1989, Brain, behavior and evolution.

[35]  M. Moscovitch,et al.  Memory for temporal order and conditional associative-learning in patients with Parkinson's disease , 1990, Neuropsychologia.

[36]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions , 1990, Trends in Neurosciences.

[37]  Michael A. Arbib,et al.  Complex temporal sequence learning based on short-term memory , 1990 .

[38]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[39]  A. Carlsson,et al.  Interactions between glutamatergic and monoaminergic systems within the basal ganglia-implications for schizophrenia and Parkinson's disease , 1990, Trends in Neurosciences.

[40]  A. D. Smith,et al.  The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones , 1990, Trends in Neurosciences.

[41]  A. Graybiel.  Neurotransmitters and neuromodulators in the basal ganglia , 1990, Trends in Neurosciences.

[42]  T. Robbins,et al.  Effects of dopamine depletion from the caudate-putamen and nucleus accumbens septi on the acquisition and performance of a conditional discrimination task , 1990, Behavioural Brain Research.

[43]  J. Fuster.  Inferotemporal units in selective visual attention and short-term memory. , 1990, Journal of neurophysiology.

[44]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[45]  W. Schultz,et al.  Responses of monkey midbrain dopamine neurons during delayed alternation performance , 1991, Brain Research.

[46]  Michael I. Jordan,et al.  A more biologically plausible learning rule for neural networks. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[47]  S. Wise,et al.  Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  S. Young,et al.  Terminal excitability of the corticostriatal pathway. II. Regulation by glutamate receptor stimulation , 1991, Brain Research.

[49]  Keiji Tanaka,et al.  Coding visual images of objects in the inferotemporal cortex of the macaque monkey. , 1991, Journal of neurophysiology.

[50]  T. Robbins,et al.  Dissociable roles of the ventral, medial and lateral striatum on the acquisition and performance of a complex visual stimulus-response habit , 1991, Behavioural Brain Research.

[51]  J. Changeux,et al.  The Wisconsin Card Sorting Test: theoretical analysis and modeling in a neuronal network. , 1991, Cerebral cortex.

[52]  D. Pandya,et al.  Prefrontostriatal connections in relation to cortical architectonic organization in rhesus monkeys , 1991, The Journal of comparative neurology.

[53]  S. Young,et al.  Terminal excitability of the corticostrial pathway. I. Regulation by dopamine receptor stimulation , 1991, Brain Research.

[54]  R. Desimone.  Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[55]  P. Calabresi,et al.  Long‐term Potentiation in the Striatum is Unmasked by Removing the Voltage‐dependent Magnesium Block of NMDA Receptor Channels , 1992, The European journal of neuroscience.

[56]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[57]  T. W. Berger,et al.  Functionally distinct subpopulations of striatal neurons are differentially regulated by gabaergic and dopaminergic inputs—II. In vitro analysis , 1992, Neuroscience.

[58]  P. Calabresi,et al.  Long-term synaptic depression in the striatum: physiological and pharmacological characterization , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[59]  Peter Ford Dominey,et al.  A cortico-subcortical model for generation of spatially accurate sequential saccades. , 1992, Cerebral cortex.

[60]  T. W. Berger,et al.  Functionally distinct subpopulations of striatal neurons are differentially regulated by gabaergic and dopaminergic inputs—I. In vivo analysis , 1992, Neuroscience.

[61]  J. Marshall,et al.  Elevated NMDA receptors in parkinsonian striatum. , 1992, Neuroreport.

[62]  Michael A. Arbib,et al.  A Model of Primate Visual-Motor Conditional Learning , 1992, Adapt. Behav..

[63]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  J. Walsh,et al.  Synaptic activation of N-methyl-d-aspartate receptors induces short-term potentiation at excitatory synapses in the striatum of the rat , 1993, Neuroscience.

[65]  Peter Ford Dominey,et al.  Analogical Transfer in Sequence Learning. , 1995, Annals of the New York Academy of Sciences.