Incremental implicit learning of bundles of statistical patterns

Forming an accurate representation of a task environment often takes place incrementally as the information relevant to learning the representation only unfolds over time. This incremental nature of learning poses an important problem: it is usually unclear whether a sequence of stimuli consists of only a single pattern, or multiple patterns that are spliced together. In the former case, the learner can directly use each observed stimulus to continuously revise its representation of the task environment. In the latter case, however, the learner must first parse the sequence of stimuli into different bundles, so as to not conflate the multiple patterns. We created a video-game statistical learning paradigm and investigated (1) whether learners without prior knowledge of the existence of multiple "stimulus bundles" - subsequences of stimuli that define locally coherent statistical patterns - could detect their presence in the input and (2) whether learners are capable of constructing a rich representation that encodes the various statistical patterns associated with bundles. By comparing human learning behavior to the predictions of three computational models, we find evidence that learners can handle both tasks successfully. In addition, we discuss the underlying reasons for why the learning of stimulus bundles occurs even when such behavior may seem irrational.

[1]  M. Chun,et al.  Top-Down Attentional Guidance Based on Implicit Learning of Visual Covariation , 1999 .

[2]  C. Gallistel,et al.  The Perception of Probability , 2022 .

[3]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[4]  D. Blei,et al.  Context, learning, and extinction. , 2010, Psychological review.

[5]  J. McQueen,et al.  The specificity of perceptual learning in speech processing , 2005, Perception & psychophysics.

[6]  R. Aslin Infant learning: Historical, conceptual, and methodological challenges. , 2014, Infancy : the official journal of the International Society on Infant Studies.

[7]  Chigusa Kurumada,et al.  Pragmatic interpretation of contrastive prosody: It looks like speech adaptation , 2012, CogSci.

[8]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[9]  K. Lloyd,et al.  Context-dependent decision-making: a simple Bayesian model , 2013, Journal of The Royal Society Interface.

[10]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[11]  James R. Brockmole,et al.  Short Article: Recognition and Attention Guidance during Contextual Cueing in Real-World Scenes: Evidence from Eye Movements , 2006, Quarterly journal of experimental psychology.

[12]  Marvin M. Chun,et al.  How is spatial context learning integrated over signal versus noise? A primacy effect in contextual cueing , 2007, Visual cognition.

[13]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[14]  Adam N. Sanborn,et al.  Bridging Levels of Analysis for Probabilistic Models of Cognition , 2012 .

[15]  Jonathan D. Cohen,et al.  Sequential effects: Superstition or rational behavior? , 2008, NIPS.

[16]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[17]  Scott D. Brown,et al.  Detecting and predicting changes , 2009, Cognitive Psychology.

[18]  A. Samuel,et al.  Perceptual adjustments to multiple speakers , 2007 .

[19]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[20]  Leyre Castro,et al.  Surprise and change: Variations in the strength of present and absent cues in causal learning , 2005, Learning & behavior.

[21]  D. A. King,et al.  Contextual control of the extinction of conditioned fear: tests for the associative value of the context. , 1983, Journal of experimental psychology. Animal behavior processes.

[22]  Bradley C. Love,et al.  Short-term gains, long-term pains: How cues about state aid learning in dynamic environments , 2009, Cognition.

[23]  Joshua B Tenenbaum,et al.  Theory-based causal induction. , 2009, Psychological review.

[24]  Richard N. Aslin,et al.  Changing Structures in Midstream: Learning Along the Statistical Garden Path , 2009, Cogn. Sci..

[25]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[26]  Adam N Sanborn,et al.  Rational approximations to rational models: alternative algorithms for category learning. , 2010, Psychological review.

[27]  Sarah C. Creel,et al.  Heeding the voice of experience: The role of talker variation in lexical access , 2008, Cognition.

[28]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[29]  Dave F. Kleinschmidt,et al.  Re-examining selective adaptation: Fatiguing feature detectors, or distributional learning? , 2016, Psychonomic bulletin & review.

[30]  K. Doya,et al.  Parallel neural networks for learning sequential procedures , 1999, Trends in Neurosciences.

[31]  D. Norris,et al.  Perceptual learning in speech , 2003, Cognitive Psychology.

[32]  F. J. Anscombe,et al.  Graphs in Statistical Analysis , 1973 .

[33]  D. Shanks,et al.  Learning in a changing environment. , 2010, Journal of experimental psychology. General.

[34]  A. Samuel,et al.  First Impressions and Last Resorts , 2008, Psychological science.

[35]  Timothy E. J. Behrens,et al.  Perceptual Classification in a Rapidly Changing Environment , 2011, Neuron.

[36]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[37]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[38]  R. Aslin,et al.  Learning bundles of stimuli renders stimulus order as a cue, not a confound , 2014, Proceedings of the National Academy of Sciences.

[39]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[40]  Dave F. Kleinschmidt,et al.  Robust speech perception: recognize the familiar, generalize to the similar, and adapt to the novel. , 2015, Psychological review.

[41]  A. Tversky,et al.  Judgment under Uncertainty , 1982 .

[42]  A. Samuel,et al.  Perceptual learning for speech: Is there a return to normal? , 2005, Cognitive Psychology.

[43]  B. Love,et al.  Putting the psychology back into psychological models: Mechanistic versus rational approaches , 2008, Memory & cognition.

[44]  Alex Kacelnik,et al.  Rational Choice, Context Dependence, and the Value of Information in European Starlings (Sturnus vulgaris) , 2011, Science.

[45]  Robert C. Wilson,et al.  Inferring Relevance in a Changing World , 2012, Front. Hum. Neurosci..

[46]  Chigusa Kurumada,et al.  Rapid adaptation in online pragmatic interpretation of contrastive prosody , 2014, CogSci.

[47]  Chip Gerfen,et al.  Speech Segmentation in a Simulated Bilingual Environment: A Challenge for Statistical Learning? , 2009, Language learning and development : the official journal of the Society for Language Development.

[48]  T. Jaeger,et al.  Alignment as a consequence of expectation adaptation: Syntactic priming is affected by the prime’s prediction error given both prior and recent experience , 2013, Cognition.

[49]  D. Aldous Exchangeability and related topics , 1985 .

[50]  Refractor Vision , 2000, The Lancet.

[51]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[52]  R. Rescorla,et al.  Reinstatement of fear to an extinguished conditioned stimulus. , 1975, Journal of experimental psychology. Animal behavior processes.

[53]  Miguel P Eckstein,et al.  Object co-occurrence serves as a contextual cue to guide and facilitate visual search in a natural viewing environment. , 2011, Journal of vision.

[54]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[55]  Peter Bossaerts,et al.  Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings , 2011, PLoS Comput. Biol..

[56]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[57]  Judith Degen,et al.  Talker-specificity and adaptation in quantifier interpretation. , 2016, Journal of memory and language.

[58]  Ting Qian,et al.  Rapid Expectation Adaptation during Syntactic Comprehension , 2013, PloS one.

[59]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[60]  James L. McClelland,et al.  Learning the structure of event sequences. , 1991, Journal of experimental psychology. General.

[61]  Roger Ratcliff,et al.  Methods for Dealing With Reaction Time Outliers , 1992 .

[62]  A. Baddeley,et al.  Context-dependent memory in two natural environments: on land and underwater. , 1975 .

[63]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[64]  Sasha R. X. Dall,et al.  Interruptions to foraging and learning in a changing environment , 1999, Animal Behaviour.

[65]  M. Bar-eli,et al.  Twenty years of “hot hand” research: Review and critique , 2006 .

[66]  Benjamin Zinszer,et al.  When to Hold and When to Fold: Detecting Structural Changes in Statistical Learning , 2013, CogSci.

[67]  Richard N. Aslin,et al.  Learning to Represent a Multi-Context Environment: More than Detecting Changes , 2012, Front. Psychology.

[68]  Jan Churan,et al.  Perceptual compression of visual space during eye-head gaze shifts. , 2011, Journal of vision.

[69]  Ralph R. Miller,et al.  Spontaneous recovery of excitation and inhibition. , 2009, Journal of experimental psychology. Animal behavior processes.

[70]  John M. Pearson,et al.  Neuronal basis of sequential foraging decisions in a patchy environment , 2011, Nature Neuroscience.

[71]  E. Koechlin,et al.  Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making , 2012, PLoS biology.

[72]  Yuki Kamide Learning individual talkers’ structural preferences , 2012, Cognition.