Modulation of saccadic eye movements by predicted reward outcome

Abstract. Reward is a primary goal of behavior and is crucial for survival of animals. To explore the mechanisms underlying such reward-oriented behavior, we devised a memory-guided saccade task in which only one fixed direction out of four was rewarded, which was called the one-direction-rewarded task (1DR). As the rewarded direction was changed in four blocks, saccades in a given direction were rewarded in one block (constituting reward-oriented behavior), but non-rewarded in the other blocks (non-reward-oriented behavior). As a control, an all-directions-rewarded task (ADR) was used. Using these tasks, we found that the parameters of saccades changed depending on whether or not the saccade was followed by reward. (1) The mean saccadic peak velocity was higher and the mean saccade latency was shorter in the rewarded condition than in the non-rewarded condition. (2) The mean saccade amplitude showed no difference in two out of three monkeys. (3) The variations of saccadic velocity, latency and amplitude were smaller in the rewarded condition. (4) Within a block of 1DR, the saccade velocity remained high in the rewarded condition, but decreased gradually in the non-rewarded condition; it decreased only slightly in ADR. The saccade latency showed the opposite pattern of change, but less clearly. (5) The saccades in the non-rewarded condition tended to have slower velocities and longer latencies in the trials shortly after a rewarded trial. (6) The ratio of error trials was much higher in the non-rewarded condition than the rewarded condition. (7) The errors, which were due to premature or incorrect saccades, showed unique spatiotemporal patterns that would reflect the competition between the cognitive and motivational processes. These results provide important constraints to the neuronal mechanism underlying reward-oriented behavior because it must satisfy these rules.

[1]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[2]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[3]  J. Konorski.  Integrative activity of the brain , 1967 .

[4]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. , 1983, Journal of neurophysiology.

[5]  R. Wurtz,et al.  Modification of saccadic eye movements by GABA-related substances. I. Effect of muscimol and bicuculline in monkey superior colliculus. , 1985, Journal of neurophysiology.

[6]  J. V. Gisbergen,et al.  A parametric analysis of human saccades in different experimental paradigms , 1987, Vision Research.

[7]  M E Goldberg,et al.  Frontal eye field efferents in the macaque monkey: I. Subcortical pathways and topography of striatal and thalamic terminal fields , 1988, The Journal of comparative neurology.

[8]  O Hikosaka,et al.  Functional properties of monkey caudate neurons. II. Visual and auditory responses. , 1989, Journal of neurophysiology.

[9]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[10]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. , 1989, Journal of neurophysiology.

[11]  A. D. Smith,et al.  The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones , 1990, Trends in Neurosciences.

[12]  J Schlag,et al.  Primate supplementary eye field. II. Comparative aspects of connections with the thalamus, corpus striatum, and related forebrain nuclei , 1991, The Journal of comparative neurology.

[13]  A. Graybiel,et al.  Distributed but convergent ordering of corticostriatal projections: analysis of the frontal eye field and the supplementary eye field in the macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  O. Hikosaka,et al.  Visual and oculomotor functions of monkey subthalamic nucleus. , 1992, Journal of neurophysiology.

[15]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[17]  Andrew G. Barto,et al.  Reinforcement learning control , 1994, Current Opinion in Neurobiology.

[18]  G. Rizzolatti,et al.  Spatial attention-determined modifications in saccade trajectories. , 1995, Neuroreport.

[19]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[20]  K. Nakayama,et al.  Priming of popout: II. Role of position , 1996 .

[21]  B. Richmond,et al.  Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. , 1996, Journal of neurophysiology.

[22]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[23]  B. Richmond,et al.  Neuronal Signals in the Monkey Ventral Striatum Related to Progress through a Predictable Series of Trials , 1998, The Journal of Neuroscience.

[24]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[25]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[26]  Okihide Hikosaka,et al.  Presaccadic omnidirectional burst activity in the basal interstitial nucleus in the monkey cerebellum , 1998, Experimental Brain Research.

[27]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[28]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.