Integrated Bayesian models of learning and decision making for saccadic eye movements☆

The neurophysiology of eye movements has been studied extensively, and several computational models have been proposed for decision-making processes that underlie the generation of eye movements towards a visual stimulus in a situation of uncertainty. One class of models, known as linear rise-to-threshold models, provides an economical, yet broadly applicable, explanation for the observed variability in the latency between the onset of a peripheral visual target and the saccade towards it. So far, however, these models do not account for the dynamics of learning across a sequence of stimuli, and they do not apply to situations in which subjects are exposed to events with conditional probabilities. In this methodological paper, we extend the class of linear rise-to-threshold models to address these limitations. Specifically, we reformulate previous models in terms of a generative, hierarchical model, by combining two separate sub-models that account for the interplay between learning of target locations across trials and the decision-making process within trials. We derive a maximum-likelihood scheme for parameter estimation as well as model comparison on the basis of log likelihood ratios. The utility of the integrated model is demonstrated by applying it to empirical saccade data acquired from three healthy subjects. Model comparison is used (i) to show that eye movements do not only reflect marginal but also conditional probabilities of target locations, and (ii) to reveal subject-specific learning profiles over trials. These individual learning profiles are sufficiently distinct that test samples can be successfully mapped onto the correct subject by a naïve Bayes classifier. Altogether, our approach extends the class of linear rise-to-threshold models of saccadic decision making, overcomes some of their previous limitations, and enables statistical inference both about learning of target locations across trials and the decision-making process within trials.

[1]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[2]  A. Chauvin,et al.  Control of sensorimotor variability by consequences. , 2007, Journal of neurophysiology.

[3]  M. Platt,et al.  Neural correlates of decisions , 2002, Current Opinion in Neurobiology.

[4]  T. H. HAWKINS The Primary Working Group , 1963, Nature.

[5]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[6]  W Todd Maddox,et al.  Toward a unified theory of decision criterion learning in perceptual categorization. , 2002, Journal of the experimental analysis of behavior.

[7]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[8]  Carpenter,et al.  PII: S0042-6989(01)00059-1 , 2001 .

[9]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[10]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[11]  R. Ratcliff Putting noise into neurophysiological models of simple decision making , 2001, Nature Neuroscience.

[12]  W. Newsome,et al.  Deciding about motion: linking perception to action , 1997, Journal of Comparative Physiology A.

[13]  Casimir J. H. Ludwig,et al.  The Temporal Impulse Response Underlying Saccadic Decisions , 2005, The Journal of Neuroscience.

[14]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[15]  R. Carpenter,et al.  Contrast, Probability, and Saccadic Latency Evidence for Independence of Detection and Decision , 2004, Current Biology.

[16]  Karl J. Friston,et al.  Synaptic Plasticity and Dysconnection in Schizophrenia , 2006, Biological Psychiatry.

[17]  R. Carpenter,et al.  Saccadic countermanding: a comparison of central and peripheral stop signals , 2001, Vision Research.

[18]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[19]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[20]  Jeffrey D. Schall,et al.  Relationship of presaccadic activity in frontal eye field and supplementary eye field to saccade initiation in macaque: Poisson spike train analysis , 2004, Experimental Brain Research.

[21]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[22]  B A J Reddi,et al.  Accuracy, information, and response time in a saccadic decision task. , 2003, Journal of neurophysiology.

[23]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  T. Minka Bayesian inference, entropy, and the multinomial distribution , 2003 .

[25]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[26]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[27]  P. Glimcher The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[28]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[29]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[30]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[31]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[32]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[33]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[34]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[35]  P. Glimcher Making choices: the neurophysiology of visual-saccadic decision making , 2001, Trends in Neurosciences.

[36]  K. H. Britten,et al.  Neuronal mechanisms of motion perception. , 1990, Cold Spring Harbor symposia on quantitative biology.

[37]  D. Luce,et al.  Detection and Recognition " ' , 2006 .

[38]  B A Reddi Decision making: The two stages of neuronal judgement , 2001, Current Biology.

[39]  Grice Gr,et al.  Stimulus intensity and response evocation. , 1968 .

[40]  R. Carpenter,et al.  The influence of urgency on decision time , 2000, Nature Neuroscience.

[41]  Burkhart Fischer,et al.  Saccadic eye movements of dyslexic adult subjects , 1993, Neuropsychologia.

[42]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[43]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[44]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[45]  R. Carpenter,et al.  Countermanding saccades in humans , 1999, Vision Research.

[46]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  R. H. S. Carpenter,et al.  Reply to 'Putting noise into neurophysiological models of simple decision making' , 2001, Nature Neuroscience.

[48]  Scott A. McDonald,et al.  LATER predicts saccade latency distributions in reading , 2007, Experimental Brain Research.

[49]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[50]  Eugene Galanter,et al.  Handbook of mathematical psychology: I. , 1963 .

[51]  David A. Robinson,et al.  Models of the saccadic eye movement control system , 1973, Kybernetik.

[52]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[53]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[54]  B. Anderson Neglect as a disorder of prior probability , 2008, Neuropsychologia.

[55]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[57]  R H S Carpenter,et al.  The time course of stimulus expectation in a saccadic decision task. , 2007, Journal of neurophysiology.

[58]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[59]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[60]  Kiyoshi Kurata,et al.  Influences of motor instructions on the reaction times of saccadic eye movements , 2004, Neuroscience Research.

[61]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[62]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[63]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[64]  Antigona Martinez,et al.  Neural correlates of refixation saccades and antisaccades in normal and schizophrenia subjects , 2002, Biological Psychiatry.

[65]  Darren R Gitelman,et al.  ILAB: A program for postexperimental eye movement analysis , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[66]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[67]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[68]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[69]  J. Gold,et al.  The Neurophysiology of Decision Making as a Window on Cognition , 2003 .

[70]  A. Jacobs,et al.  The effects of target discriminability and retinal eccentricity on saccade latencies: An analysis in terms of variable-criterion theory , 1990, Psychological research.

[71]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[72]  Hiroyuki Nakahara,et al.  Extended LATER model can account for trial-by-trial variability of both pre- and post-processes , 2006, Neural Networks.

[73]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[74]  H. Seung,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 581–617 NUMBER 3(NOVEMBER) LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS , 2022 .

[75]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[76]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[77]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[78]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[79]  J. Schall,et al.  Role of frontal eye fields in countermanding saccades: visual, movement, and fixation activity. , 1998, Journal of neurophysiology.

[80]  N. P. Bichot,et al.  Dissociation of visual discrimination from saccade programming in macaque frontal eye field. , 1997, Journal of neurophysiology.

[81]  R H S Carpenter,et al.  Task switching as a two-stage decision process. , 2006, Journal of neurophysiology.

[82]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[83]  I. Hooge,et al.  The timing of sequences of saccades in visual search , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[84]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[85]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[86]  J. Schall Neural correlates of decision processes: neural and mental chronometry , 2003, Current Opinion in Neurobiology.

[87]  Michele A. Basso,et al.  Modulation of neuronal activity by target uncertainty , 1997, Nature.

[88]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[89]  S. Sternberg Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[90]  Emery N Brown,et al.  Bayesian analysis of interleaved learning and response bias in behavioral experiments. , 2007, Journal of neurophysiology.