The relative influences of priors and sensory evidence on an oculomotor decision variable during perceptual learning.

Choice behavior on simple sensory-motor tasks can exhibit trial-to-trial dependencies. For perceptual tasks, these dependencies reflect the influence of prior trials on choices that are also guided by sensory evidence, which is often independent across trials. Here we show that the relative influences of prior trials and sensory evidence on choice behavior can be shaped by training, such that prior influences are strongest when perceptual sensitivity to the relevant sensory evidence is weakest and then decline steadily as sensitivity improves. We trained monkeys to decide the direction of random-dot motion and indicate their decision with an eye movement. We characterized sequential dependencies by relating current choices to weighted averages of prior choices. We then modeled behavior as a drift-diffusion process, in which the weighted average of prior choices provided an additive offset to a decision variable that integrated incoming motion evidence to govern choice. The average magnitude of offset within individual training sessions declined steadily as the quality of the integrated motion evidence increased over many months of training. The trial-by-trial magnitude of offset was correlated with signals related to developing commands that generate the oculomotor response but not with neural activity in either the middle temporal area, which represents information about the motion stimulus, or the lateral intraparietal area, which represents the sensory-motor conversion. The results suggest that training can shape the relative contributions of expectations based on prior trends and incoming sensory evidence to select and prepare visually guided actions.

[1]  Maurice Merleau-Ponty Phenomenology of Perception , 1964 .

[2]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[3]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[4]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[5]  R. Remington Analysis of sequential effects in choice reaction times. , 1969, Journal of experimental psychology.

[6]  N. Kirby Sequential effects in two-choice reaction time: automatic facilitation or subjective expectancy? , 1976, Journal of experimental psychology. Human perception and performance.

[7]  R. Cowie Optimal foraging in great tits (Parus major) , 1977, Nature.

[8]  James L. McClelland,et al.  Phenomenology of perception. , 1978, Science.

[9]  D. Laming Choice reaction performance following an error , 1979 .

[10]  L E Mays,et al.  Saccades are spatially, not retinocentrically, coded. , 1980, Science.

[11]  R. Herrnstein,et al.  CHAPTER 5 – Melioration and Behavioral Allocation1 , 1980 .

[12]  W Vaughan,et al.  Melioration, matching, and maximization. , 1981, Journal of the experimental analysis of behavior.

[13]  J. Staddon,et al.  Limits to action, the allocation of individual behavior , 1982 .

[14]  Lance M. Optican,et al.  Unix-based multiple-process system, for real-time data acquisition and control , 1982 .

[15]  F. Ashby A biased random walk model for two choice reaction times , 1983 .

[16]  E. Soetens,et al.  Expectancy or Automatic Facilitation? Separating Sequential Effects in Two-Choice Reaction Time , 1985 .

[17]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[18]  M. Davison,et al.  The matching law: A research review. , 1988 .

[19]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[21]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[22]  P. Kop Reinforcement, choice and response strength , 1990 .

[23]  W. Newsome,et al.  Microstimulation in visual area MT: effects on direction discrimination performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  W. Merigan,et al.  Motion perception following lesions of the superior temporal sulcus in the monkey. , 1994, Cerebral cortex.

[26]  P. Killeen Mathematical principles of reinforcement , 1994 .

[27]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[28]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[29]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[30]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[31]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[32]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[33]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[34]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[35]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[36]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[37]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[38]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[39]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[40]  D. Bonett,et al.  Sample size requirements for estimating pearson, kendall and spearman correlations , 2000 .

[41]  Joaquín M. Fuster,et al.  Executive frontal functions , 2000, Experimental Brain Research.

[42]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[43]  S. Sternberg,et al.  Separate modifiability, mental modules, and the use of pure and composite measures to reveal them. , 2001, Acta psychologica.

[44]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[45]  J. Tanji,et al.  Behavioral planning in the prefrontal cortex , 2001, Current Opinion in Neurobiology.

[46]  W T Newsome,et al.  Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task. , 2001, Journal of neurophysiology.

[47]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[48]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[49]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[50]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[51]  J. Tenenbaum,et al.  Generalization, similarity, and Bayesian inference. , 2001, The Behavioral and brain sciences.

[52]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[53]  Jonathan D. Cohen,et al.  Mechanisms underlying dependencies of performance on stimulus history in a two-alternative forced-choice task , 2002, Cognitive, affective & behavioral neuroscience.

[54]  David R. Anderson,et al.  Bayesian Methods in Cosmology: Model selection and multi-model inference , 2009 .

[55]  M. Platt,et al.  Neural correlates of decisions , 2002, Current Opinion in Neurobiology.

[56]  W Todd Maddox,et al.  Toward a unified theory of decision criterion learning in perceptual categorization. , 2002, Journal of the experimental analysis of behavior.

[57]  H. Pashler STEVENS' HANDBOOK OF EXPERIMENTAL PSYCHOLOGY , 2002 .

[58]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[59]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[60]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[61]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[62]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[63]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[64]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[65]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[66]  E. Rolls The functions of the orbitofrontal cortex , 1999, Brain and Cognition.

[67]  J Schlag,et al.  Interactions between natural and electrically evoked saccades , 2004, Experimental Brain Research.

[68]  D. Barraclough,et al.  Reinforcement learning and decision making in monkeys during a competitive game. , 2004, Brain research. Cognitive brain research.

[69]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[70]  H. Seung,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 581–617 NUMBER 3(NOVEMBER) LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS , 2022 .

[71]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[72]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[73]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[74]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[75]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[76]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[77]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[78]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[79]  J I Gold,et al.  On diffusion processes with variable drift rates as models for decision making during learning , 2008, New journal of physics.

[80]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[81]  Luke Bloy,et al.  A method for localizing microelectrode trajectories in the macaque brain using MRI , 2009, Journal of Neuroscience Methods.

[82]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[83]  D. Parkinson,et al.  Bayesian Methods in Cosmology: Model selection and multi-model inference , 2009 .

[84]  S. Snyder,et al.  Separate Signals for Target Selection and Movement Specification in the Superior Colliculus , 2022 .