Context-Gated Statistical Learning and Its Role in Visual-Saccadic Decisions

Adaptive behavior in a nonstationary world requires humans to learn and track the statistics of the environment. We examined the mechanisms of adaptation in a nonstationary environment in the context of visual-saccadic inhibition of return (IOR). IOR is adapted to the likelihood that return locations will be refixated in the near future. We examined 2 potential learning mechanisms underlying adaptation: (a) a local tracking or priming mechanism that facilitates behavior that is consistent with recent experience and (b) a mechanism that supports retrieval of knowledge of the environmental statistics based on the contextual features of the environment. Participants generated sequences of 2 saccadic eye movements in conditions where the probability that the 2nd saccade was directed back to the previously fixated location varied from low (.17) to high (.50). In some conditions, the contingency was signaled by a contextual cue (the shape of the movement cue). Adaptation occurred in the absence of contextual signals but was more pronounced in the presence of contextual cues. Adaptation even occurred when different contingencies were randomly intermixed, showing the parallel formation of multiple associations between context and statistics. These findings are accounted for by an evidence accumulation framework in which the resting baseline of decision alternatives is adjusted on a trial-by-trial basis. This baseline tracks the subjective prior beliefs about the behavioral relevance of the different alternatives and is updated on the basis of the history of recent events and the contextual features of the current environment.

[1]  D. Shanks,et al.  Learning in a changing environment. , 2010, Journal of experimental psychology. General.

[2]  Iain D Gilchrist,et al.  Probabilistic cuing in large-scale environmental search. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Simon Farrell,et al.  Influence of environmental statistics on inhibition of saccadic return , 2009, Proceedings of the National Academy of Sciences.

[4]  Matt Jones,et al.  Sequential Effects Reflect Parallel Learning of Multiple Environmental Regularities , 2022 .

[5]  Casimir J. H. Ludwig,et al.  The mechanism underlying inhibition of saccadic return , 2009, Cognitive Psychology.

[6]  J. Henderson,et al.  Facilitation of return during scene viewing , 2009 .

[7]  Michael D. Dodd,et al.  Novelty Is Not Always the Best Policy , 2009, Psychological science.

[8]  Scott D. Brown,et al.  Detecting and predicting changes , 2009, Cognitive Psychology.

[9]  Jonathan D. Cohen,et al.  Sequential effects: Superstition or rational behavior? , 2008, NIPS.

[10]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[11]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[12]  R. Carpenter,et al.  Directional Prediction by the Saccadic System , 2008, Current Biology.

[13]  Jadin C. Jackson,et al.  Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. , 2007, Psychological review.

[14]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[15]  Stephan Lewandowsky,et al.  Knowledge partitioning in categorization: Boundary conditions , 2006, Memory & cognition.

[16]  Iain D Gilchrist,et al.  Target location probability effects in visual search: an effect of sequential dependencies. , 2006, Journal of experimental psychology. Human perception and performance.

[17]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[18]  Aaron C. Courville,et al.  Bayesian theories of conditioning in a changing world , 2006, Trends in Cognitive Sciences.

[19]  R H S Carpenter,et al.  Changes in expectation consequent on experience, modeled by a simple, forgetful neural circuit. , 2006, Journal of vision.

[20]  W. T. Maddox,et al.  Recency effects as a window to generalization: separating decisional and perceptual sequential effects in category learning. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Michael C. Mozer,et al.  Top-Down Control of Visual Attention: A Rational Account , 2005, NIPS.

[22]  B. Scholl,et al.  The Automaticity of Visual Statistical Learning Statistical Learning , 2005 .

[23]  H. Seung,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 581–617 NUMBER 3(NOVEMBER) LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS , 2022 .

[24]  M. Behrmann,et al.  Spatial probability as an attentional cue in visual search , 2005, Perception & psychophysics.

[25]  Miguel P Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2005, Psychological science.

[26]  I. Hooge,et al.  Inhibition of return is not a foraging facilitator in saccadic search and free viewing , 2005, Vision Research.

[27]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[28]  M. Bouton Context and behavioral processes in extinction. , 2004, Learning & memory.

[29]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[30]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[31]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[32]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[33]  A. Samuel,et al.  Inhibition of return: A graphical meta-analysis of its time course and an empirical test of its temporal and spatial properties , 2003, Psychonomic bulletin & review.

[34]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[35]  Ken Nakayama,et al.  A primitive memory system for the deployment of transient attention , 2003, Perception & psychophysics.

[36]  Winston R. Sieck,et al.  Learning myopia: an adaptive recency effect in category learning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[37]  Jillian H. Fecteau,et al.  Exploring the consequences of the previous trial , 2003, Nature Reviews Neuroscience.

[38]  J. Schall Neural correlates of decision processes: neural and mental chronometry , 2003, Current Opinion in Neurobiology.

[39]  Shelley Channon,et al.  Relationship between priming and recognition in deterministic and probabilistic sequence learning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[40]  L. Jiménez Attention and implicit learning , 2003 .

[41]  Jonathan D. Cohen,et al.  Mechanisms underlying dependencies of performance on stimulus history in a two-alternative forced-choice task , 2002, Cognitive, affective & behavioral neuroscience.

[42]  Marlene Behrmann,et al.  Probability Cuing of Target Location Facilitates Visual Search Implicitly in Normal Participants and Patients with Hemispatial Neglect , 2002, Psychological science.

[43]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[44]  K Nakayama,et al.  Rapid, Object-Based Learning in the Deployment of Transient Attention , 2001, Perception.

[45]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[46]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[47]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[48]  R. Carpenter,et al.  Express saccades: is bimodality a result of the order of stimulus presentation? , 2001, Vision Research.

[49]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[50]  I. Hooge,et al.  Inhibition of saccade return (ISR): spatio-temporal properties of saccade programming , 2000, Vision Research.

[51]  R. Klein,et al.  Visual and motor effects in inhibition of return. , 2000, Journal of experimental psychology. Human perception and performance.

[52]  Raymond Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[53]  S. Lewandowsky,et al.  Knowledge partitioning: Context-dependent use of expertise , 2000, Memory & cognition.

[54]  D R Shanks,et al.  Evaluating the relationship between explicit and implicit knowledge in a sequential reaction time task. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[55]  R. Klein,et al.  Inhibition of Return is a Foraging Facilitator in Visual Search , 1999 .

[56]  Robert M. McPeek,et al.  Saccades require focal attention and are facilitated by a short-term memory system , 1999, Vision Research.

[57]  Axel Cleeremans,et al.  Implicit learning: news from the front , 1998, Trends in Cognitive Sciences.

[58]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[59]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[60]  R. H. S. Carpenter,et al.  Neural computation of log likelihood in control of saccadic eye movements , 1995, Nature.

[61]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[62]  Peder J. Johnson,et al.  Assessing implicit learning with indirect tests: Determining what is learned about sequence structure. , 1994 .

[63]  G. Logan Toward an instance theory of automatization. , 1988 .

[64]  Philip L. Smith,et al.  The accumulator model of two-choice discrimination , 1988 .

[65]  R Ratcliff,et al.  Continuous versus discrete information processing modeling accumulation of partial information. , 1988, Psychological review.

[66]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[67]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[68]  E. Maylor,et al.  Inhibitory component of externally controlled covert orienting in visual space. , 1985, Journal of experimental psychology. Human perception and performance.

[69]  J. Stern Theoretical and applied aspects of eye movement research A. G. Gale and F. Johnson, (Elsevier Science Publishers B.V., Amsterdam, 1984) pp. xiii + 565, Dfl. 185 , 1985, Biological Psychology.

[70]  E. Soetens,et al.  Expectancy or Automatic Facilitation? Separating Sequential Effects in Two-Choice Reaction Time , 1985 .

[71]  D. A. King,et al.  Contextual control of the extinction of conditioned fear: tests for the associative value of the context. , 1983, Journal of experimental psychology. Animal behavior processes.

[72]  B. Tversky,et al.  Categories of environmental scenes , 1983, Cognitive Psychology.

[73]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[74]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[75]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[76]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[77]  S. Link,et al.  A sequential theory of psychological discrimination , 1975 .

[78]  N. Kirby,et al.  Sequential effects of serial reaction time. , 1972 .

[79]  R. Remington Analysis of sequential effects in choice reaction times. , 1969, Journal of experimental psychology.

[80]  A. Reber Implicit learning of artificial grammars , 1967 .

[81]  D. LaBerge A recruitment theory of simple behavior , 1962 .

[82]  P. Bertelson Sequential Redundancy and Speed in a Serial Two-Choice Responding Task , 1961 .

[83]  M. Jarvik,et al.  Probability learning and a negative recency effect in the serial anticipation of alternative symbols. , 1951, Journal of experimental psychology.

[84]  D. Blei,et al.  Context, learning, and extinction. , 2010, Psychological review.

[85]  D. Shanks Learning: from association to cognition. , 2010, Annual review of psychology.

[86]  W. Sturm,et al.  Neuropsychological assessment , 2007, Journal of Neurology.

[87]  Thomas L. Griffiths,et al.  A more rational model of categorization , 2006 .

[88]  Andrew Heathcote,et al.  A ballistic model of choice response time. , 2005, Psychological review.

[89]  R. Atkinson,et al.  STORAGE AND RETRIEVAL PROCESSES IN LONG-TERM MEMORY 1 , 2005 .

[90]  M. Davison,et al.  Choice in a variable environment: visit patterns in the dynamics of choice. , 2004, Journal of the experimental analysis of behavior.

[91]  Marvin M. Chun,et al.  Contextual cueing: Reciprocal influences between attention and implicit learning. , 2003 .

[92]  M. Davison,et al.  Choice in a variable environment: every reinforcer counts. , 2000, Journal of the experimental analysis of behavior.

[93]  K. Nakayama,et al.  Priming of popout: II. Role of position , 1996 .

[94]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[95]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[96]  Jonathan Vaughan,et al.  Saccades Directed at Previously Attended Locations in Space , 1984 .

[97]  M. Posner,et al.  Components of visual orienting , 1984 .

[98]  Don G. Bouwhuis,et al.  Control of language processes , 1984 .

[99]  A. Luria Higher Cortical Functions in Man , 1980, Springer US.

[100]  A. Dickinson,et al.  Classical conditioning in animals. , 1978, Annual review of psychology.

[101]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[102]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[103]  Richard C. Atkinson,et al.  Search and retrieval processes in long-term memory , 1968 .

[104]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[105]  H. Harris,et al.  The Rat , 1958, Nature.