Reward Value-Contingent Changes of Visual Responses in the Primate Caudate Tail Associated with a Visuomotor Skill

A goal-directed action aiming at an incentive outcome, if repeated, becomes a skill that may be initiated automatically. We now report that the tail of the caudate nucleus (CDt) may serve to control a visuomotor skill. Monkeys looked at many fractal objects, half of which were always associated with a large reward (high-valued objects) and the other half with a small reward (low-valued objects). After several daily sessions, they developed a gaze bias, looking at high-valued objects even when no reward was associated. CDt neurons developed a response bias, typically showing stronger responses to high-valued objects. In contrast, their responses showed no change when object values were reversed frequently, although monkeys showed a strong gaze bias, looking at high-valued objects in a goal-directed manner. The biased activity of CDt neurons may be transmitted to the oculomotor region so that animals can choose high-valued objects automatically based on stable reward experiences.

[1]  Lance M. Optican,et al.  Unix-based multiple-process system, for real-time data acquisition and control , 1982 .

[2]  Leslie G. Ungerleider,et al.  Transient subcortical connections of inferior temporal areas TE and TEO in infant macaque monkeys , 1995, The Journal of comparative neurology.

[3]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[4]  J. Wickens,et al.  Neural mechanisms of reward-related motor learning , 2003, Current Opinion in Neurobiology.

[5]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[6]  Robert B. Ammons,et al.  Long-term retention of perceptual-motor skills. , 1958 .

[7]  G. V. Van Hoesen,et al.  Widespread corticostriate projections from temporal cortex of the rhesus monkey , 1981, The Journal of comparative neurology.

[8]  O. Hikosaka,et al.  Long-term retention of motor skill in macaque monkeys and humans , 2002, Experimental Brain Research.

[9]  Ilya E. Monosov,et al.  What and Where Information in the Caudate Tail Guides Saccades to Visual Objects , 2012, The Journal of Neuroscience.

[10]  S. Gerber,et al.  Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex , 2008 .

[11]  J. DiCarlo,et al.  Neuronal Learning of Invariant Object Representation in the Ventral Visual Stream Is Not Dependent on Reward , 2012, The Journal of Neuroscience.

[12]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[13]  C. Bruce,et al.  Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements. , 1985, Journal of neurophysiology.

[14]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[15]  O. Hikosaka,et al.  Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia , 2012, The Journal of Neuroscience.

[16]  M. Mishkin,et al.  Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[17]  George Paxinos,et al.  The Mouse Brain in Stereotaxic Coordinates , 2001 .

[18]  E. Yeterian,et al.  Cortico-striate projections in the rhesus monkey: The organization of certain cortico-caudate connections , 1978, Brain Research.

[19]  K Watanabe,et al.  Neural information transferred from the putamen to the globus pallidus during learned movement in the monkey. , 1996, Journal of neurophysiology.

[20]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. , 1989, Journal of neurophysiology.

[21]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[22]  M. Mishkin,et al.  Learning increases stimulus salience in anterior inferior temporal cortex of the macaque. , 2001, Journal of neurophysiology.

[23]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[24]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[25]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[26]  J. Adams.  Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. , 1987 .

[27]  Leslie G. Ungerleider,et al.  Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido‐nigral complex in the monkey , 1990, The Journal of comparative neurology.

[28]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[29]  G. Orban,et al.  Comparative mapping of higher visual areas in monkeys and humans , 2004, Trends in Cognitive Sciences.

[30]  Keiji Tanaka,et al.  Reward Association Affects Neuronal Responses to Visual Stimuli in Macaque TE and Perirhinal Cortices , 2006, The Journal of Neuroscience.

[31]  K. Newell.  Motor skill acquisition. , 1991, Annual review of psychology.

[32]  R B AMMONS,et al.  Long-term retention of perceptualmotor skills. , 1958, Journal of experimental psychology.

[33]  A. Graybiel,et al.  Temporal and spatial characteristics of tonically active neurons of the primate's striatum. , 1995, Journal of neurophysiology.

[34]  M. Mishkin,et al.  Monkeys with combined amygdalo-hippocampal lesions succeed in object discrimination learning despite 24-hour intertrial intervals. , 1984, Behavioral neuroscience.

[35]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[36]  G. Logan.  Skill and automaticity: Relations, implications, and future directions. , 1985 .

[37]  Steven Yantis,et al.  Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing , 2012, Attention, Perception, & Psychophysics.

[38]  L. Chelazzi,et al.  Learning to Attend and to Ignore Is a Matter of Gains and Losses , 2009, Psychological science.

[39]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[40]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[41]  M. Mishkin,et al.  Responses of cells in the tail of the caudate nucleus during visual discrimination learning. , 1995, Journal of neurophysiology.

[42]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[43]  Benjamin O. Turner,et al.  Cortical and basal ganglia contributions to habit learning and automaticity , 2010, Trends in Cognitive Sciences.

[44]  O. Hikosaka,et al.  Learning of sequential movements in the monkey: process of learning and retention of memory. , 1995, Journal of neurophysiology.

[45]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[46]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[47]  E. T. Rolls,et al.  Responses of striatal neurons in the behaving monkey. 2. Visual processing in the caudal neostriatum , 1984, Brain Research.

[48]  Y. Miyashita.  Inferior temporal cortex: where visual perception meets memory. , 1993, Annual review of neuroscience.

[49]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[50]  J. Theeuwes,et al.  Reward grabs the eye: Oculomotor capture by rewarding stimuli , 2012, Vision Research.

[51]  Yasushi Miyashita,et al.  Generation of fractal patterns for probing the visual memory , 1991, Neuroscience Research.