Sequential effects in response time reveal learning mechanisms and event representations.

Binary choice tasks, such as 2-alternative forced choice, show a complex yet consistent pattern of sequential effects, whereby responses and response times depend on the detailed pattern of prior stimuli going back at least 5 trials. We show this pattern is well explained by simultaneous incremental learning of 2 simple statistics of the trial sequence: the base rate and the repetition rate. Both statistics are learned by the same basic associative mechanism, but they contribute different patterns of sequential effects because they entail different representations of the trial sequence. Subtler aspects of the data that are not explained by these 2 learning processes alone are explained by their interaction, via learning from joint error correction. Specifically, the cue-competition mechanism that has explained classic findings in animal learning (e.g., blocking) appears to operate on learning of sequence statistics. We also find that learning of the base rate and repetition rate are dissociated into response and stimulus processing, respectively, as indicated by event-related potentials, manipulations of stimulus discriminability, and reanalysis of past experiments that eliminated stimuli or prior responses. Thus, sequential effects in these tasks appear to be driven by learning the response base rate and the stimulus repetition rate. Connections are discussed between these findings and previous research attempting to separate stimulus- and response-based sequential effects, and research using sequential effects to determine mental representations. We conclude that sequential effects offer a powerful means for uncovering representations and learning mechanisms.

[1]  Garner Wr An informational analysis of absolute judgments of loudness. , 1953 .

[2]  R. Shepard Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space , 1957 .

[3]  W. K. Estes,et al.  Theory of learning with constant, variable, or contingent probabilities of reinforcement , 1957 .

[4]  J. Engler Marginal and conditional stimulus and response probabilities in verbal conditioning. , 1958, Journal of experimental psychology.

[5]  P. Bertelson Sequential Redundancy and Speed in a Serial Two-Choice Responding Task , 1961 .

[6]  P. Bertelson,et al.  Serial Choice Reaction-time as a Function of Response versus Signal-and-Response Repetition , 1965, Nature.

[7]  R. Spehlmann The averaged electrical responses to diffuse and to patterned light in the human. , 1965, Electroencephalography and clinical neurophysiology.

[8]  E. G. Sauer,et al.  Mechanisms Of Animal Behavior , 1966 .

[9]  B Gambino,et al.  Role of event runs in probability learning. , 1967, Psychological review.

[10]  A. Reber Implicit learning of artificial grammars , 1967 .

[11]  L. Kamin Attention-like processes in classical conditioning , 1967 .

[12]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[13]  G. Lockhead,et al.  Sequential effects in absolute judgments of loudness , 1968 .

[14]  Donald R. Barr,et al.  Using Confidence Intervals to Test Hypotheses , 1969 .

[15]  N. Mackintosh,et al.  Mechanisms of animal discrimination learning , 1971 .

[16]  Lawrence M. Ward,et al.  Response system processes in absolute judgment , 1971 .

[17]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[18]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[19]  Ronald G. Marteniuk,et al.  An informational analysis of absolute judgments of torque , 1974 .

[20]  W. A. Wickelgren Single-trace fragility theory of memory dynamics , 1974, Memory & cognition.

[21]  D. M. Green,et al.  The response ratio hypothesis for magnitude estimation , 1974 .

[22]  N. Squires,et al.  The effect of stimulus sequence on the waveform of the cortical event-related potential. , 1976, Science.

[23]  N. Kirby Sequential effects in two-choice reaction time: automatic facilitation or subjective expectancy? , 1976, Journal of experimental psychology. Human perception and performance.

[24]  R. Luce,et al.  Sequential effects in judgments of loudness , 1977 .

[25]  Bryan Rodgers,et al.  What does a Man do after he Makes an Error? An Analysis of Response Programming , 1977 .

[26]  P. Rabbitt,et al.  The Changing Pattern of Perceptual Analytic Strategies and Response Selection with Practice in a Two-Choice Reaction time task , 1978, The Quarterly journal of experimental psychology.

[27]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[28]  L. Boer,et al.  Sequential effects in two-choice reaction time: Subjective expectancy and automatic after- effect at short response-stimulus intervals☆ , 1980 .

[29]  P. Petzold Distance effects on sequential dependencies in categorical judgments. , 1981, Journal of experimental psychology. Human perception and performance.

[30]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[31]  M. Treisman,et al.  American Psychological Association, Inc, A Theory of Criterion Setting With an Application to Sequential Dependencies , 2022 .

[32]  M. Posner,et al.  Components of visual orienting , 1984 .

[33]  E. Soetens,et al.  Expectancy or Automatic Facilitation? Separating Sequential Effects in Two-Choice Reaction Time , 1985 .

[34]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[35]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[36]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[37]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[38]  L. Mulder,et al.  Use of partial stimulus information in response processing. , 1988, Journal of experimental psychology. Human perception and performance.

[39]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[40]  M. Coles Modern mind-brain reading: psychophysiology, physiology, and cognition. , 1989, Psychophysiology.

[41]  Kunkel Jm,et al.  Spontaneous subclavain vein thrombosis: a successful combined approach of local thrombolytic therapy followed by first rib resection. , 1989 .

[42]  J. Krebs,et al.  Starlings exploiting patches: the effect of recent experience on foraging decisions , 1990, Animal Behaviour.

[43]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[44]  D. Cross,et al.  Sequential Effects in Magnitude Scaling: Models and Theory , 1990 .

[45]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[46]  James L. McClelland,et al.  Learning the structure of event sequences. , 1991, Journal of experimental psychology. General.

[47]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[48]  Harold Pashler,et al.  Procedural learning: II. Intertrial repetition effects in speeded-choice tasks. , 1991 .

[49]  L A Real,et al.  Animal choice behavior and the evolution of cognitive architecture , 1991, Science.

[50]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[51]  R. Hogarth,et al.  Order effects in belief updating: The belief-adjustment model , 1992, Cognitive Psychology.

[52]  D. Gentner,et al.  Respects for similarity , 1993 .

[53]  W. Estes Toward a Statistical Theory of Learning. , 1994 .

[54]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[55]  Joseph Dien,et al.  Issues in the application of the average reference: Review, critiques, and recommendations , 1998 .

[56]  Jeff Miller,et al.  Jackknife-based method for measuring LRP onset latency differences. , 1998, Psychophysiology.

[57]  E. Soetens Localizing sequential effects in serial choice reaction time with the information reduction procedure , 1998 .

[58]  M. Junghöfer,et al.  The polar average reference effect: a bias in estimating the head surface integral in EEG recording , 1999, Clinical Neurophysiology.

[59]  D. Willingham,et al.  Implicit motor sequence learning is represented in response locations , 2000, Memory & cognition.

[60]  Jacob Feldman,et al.  Minimization of Boolean complexity in human concept learning , 2000, Nature.

[61]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[62]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[63]  Jeff Miller,et al.  Using the jackknife-based scoring method for measuring LRP onset effects in factorial designs. , 2001, Psychophysiology.

[64]  P. Hare Advance Online Publication , 2002, Nature Medicine.

[65]  Jonathan D. Cohen,et al.  Mechanisms underlying dependencies of performance on stimulus history in a two-alternative forced-choice task , 2002, Cognitive, affective & behavioral neuroscience.

[66]  Nick Chater,et al.  Sequence effects in categorization of simple perceptual stimuli. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[67]  Jonathan D. Cohen,et al.  A computational model of anterior cingulate function in speeded response tasks: Effects of frequency, sequence, and conflict , 2002, Cognitive, affective & behavioral neuroscience.

[68]  I. Jentzsch,et al.  Functional localization and mechanisms of sequential effects in serial reaction time tasks , 2002, Perception & psychophysics.

[69]  M. Masson Using confidence intervals for graphically based data interpretation. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[70]  N. Chater,et al.  Simplicity: a unifying principle in cognitive science? , 2003, Trends in Cognitive Sciences.

[71]  Winston R. Sieck,et al.  Learning myopia: an adaptive recency effect in category learning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[72]  Gregory R. Lockhead,et al.  Absolute Judgments Are Relative: A Reinterpretation of Some Psychophysical Ideas , 2004 .

[73]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[74]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[75]  Gordon D. A. Brown,et al.  Absolute identification by relative judgment. , 2005, Psychological review.

[76]  Cynthia S. Sahm,et al.  Past trials influence perception of ambiguous motion quartets through pattern completion. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Stimulus Generalization in Category Learning , 2005 .

[78]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[79]  D. Tucker,et al.  Spatial sampling and filtering of EEG with spline Laplacians to estimate cortical potentials , 2005, Brain Topography.

[80]  W. T. Maddox,et al.  Recency effects as a window to generalization: separating decisional and perceptual sequential effects in category learning. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[81]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[82]  Matt Jones,et al.  Optimal Response Initiation: Why Recent Experience Matters , 2008, NIPS.

[83]  B. Love,et al.  Putting the psychology back into psychological models: Mechanistic versus rational approaches , 2008, Memory & cognition.

[84]  Jonathan D. Cohen,et al.  Sequential effects: Superstition or rational behavior? , 2008, NIPS.

[85]  Andrew Heathcote,et al.  An integrated model of choices and response times in absolute identification. , 2008, Psychological review.

[86]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[87]  Matt Jones A Reinforcement-and-Generalization Model of Sequential Effects in Identification Learning , 2009 .

[88]  KongFatt Wong-Lin,et al.  Sequential Effects in Two-Choice Reaction Time Tasks: Decomposition and Synthesis of Mechanisms , 2009, Neural Computation.

[89]  Matt Jones,et al.  Sequential Effects Reflect Parallel Learning of Multiple Environmental Regularities , 2022 .

[90]  Rolf Ulrich,et al.  Why jackknifing yields good latency estimates. , 2009, Psychophysiology.

[91]  Ed Vul,et al.  Predicting the Optimal Spacing of Study: A Multiscale Context Model of Memory , 2009, NIPS.

[92]  R. Ratcliff,et al.  Evaluating the unequal-variance and dual-process explanations of zROC slopes with response time data and the diffusion model , 2012, Cognitive Psychology.

[93]  Jonathan D. Nelson,et al.  How Embodied Is Perceptual Decision Making? Evidence for Separate Processing of Perceptual and Motor Decisions , 2013, The Journal of Neuroscience.

[94]  Anne G E Collins,et al.  Cognitive control over learning: creating, clustering, and generalizing task-set structure. , 2013, Psychological review.

[95]  Matthew H. Wilder,et al.  The persistent impact of incidental experience , 2012, Psychonomic bulletin & review.

[96]  Ehtibar N Dzhafarov,et al.  Unfalsifiability and mutual translatability of major modeling schemes for choice reaction time. , 2014, Psychological review.