Toward a common representational framework for adaptation.

We develop a computational model-the adaptive representation model (ARM)-for relating 2 classic theories of learning dynamics: instance and strength theory. Within the model, we show how the principles of instance and strength theories can be instantiated, so that the validity of their assumptions can be tested against experimental data. We show how under some conditions, models embodying instance representations can be considered a special case of a strength-based representation. We discuss a number of mechanisms for producing adaptive behaviors in dynamic environments, and detail how they may be instantiated within ARM. To evaluate the relative strengths of the proposed mechanisms, we construct a suite of 10 model variants, and fit them to single-trial choice response time data from three experiments. The first experiment involves dynamic shifts in the frequency of category exposure, the second experiment involves shifts in the means of the category distributions, and the third experiment involves shifts in both the mean and variance of the category distributions. We evaluate model performance by assessing model fit, penalized for complexity, at both the individual and aggregate levels. We show that the mechanisms of prediction error and lateral inhibition are strong contributors to the successes of the model variants considered here. Our results suggest that the joint distribution of choice and response time can be thought of as an emergent property of an evolving representation mapping stimulus attributes to their appropriate response assignment. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

[1]  Gordon D. A. Brown,et al.  Absolute identification by relative judgment. , 2005, Psychological review.

[2]  Yves Lacouture,et al.  A mapping model of bow effects in absolute identification , 1995 .

[3]  Michael J. Kahana,et al.  Foundations of Human Memory , 2012 .

[4]  Brandon M. Turner,et al.  A dynamic stimulus-driven model of signal detection. , 2011, Psychological review.

[5]  Chris Donkin,et al.  A Power-Law Model of Psychological Memory Strength in Short- and Long-Term Recognition , 2012, Psychological science.

[6]  R. Nosofsky Exemplar-Based Accounts of Relations Between Classification, Recognition, and Typicality , 1988 .

[7]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[8]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[9]  T. Palmeri Exemplar similarity and the development of automaticity. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[10]  I. J. Myung,et al.  Tutorial on maximum likelihood estimation , 2003 .

[11]  R. Nosofsky,et al.  The structure of short-term memory scanning: an investigation using response time distribution models , 2012, Psychonomic Bulletin & Review.

[12]  G. Logan Shapes of reaction-time distributions and shapes of learning curves: a test of the instance theory of automaticity. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[14]  Marc W Howard,et al.  A context-based theory of recency and contiguity in free recall. , 2008, Psychological review.

[15]  E. Wagenmakers,et al.  Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis , 2009, Psychonomic bulletin & review.

[16]  T. Palmeri An exemplar of model-based cognitive neuroscience , 2014, Trends in Cognitive Sciences.

[17]  R. Ratcliff,et al.  Modeling confidence and response time in recognition memory. , 2009, Psychological review.

[18]  L. Rips Similarity, typicality, and categorization , 1989 .

[19]  Andrew Heathcote,et al.  Drawing conclusions from choice response time models: A tutorial using the linear ballistic accumulator , 2011 .

[20]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[21]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[22]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[23]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[24]  John R. Anderson,et al.  The dynamics of scaling: a memory-based anchor model of category rating and absolute identification. , 2005, Psychological review.

[25]  William K. Estes,et al.  Classification and cognition , 1994 .

[26]  G. Logan The CODE theory of visual attention: an integration of space-based and object-based attention. , 1996, Psychological review.

[27]  G. Logan Toward an instance theory of automatization. , 1988 .

[28]  W. T. Maddox,et al.  Recency effects as a window to generalization: separating decisional and perceptual sequential effects in category learning. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[29]  J. D. Smith,et al.  Comparing prototype-based and exemplar-based accounts of category learning and attentional allocation. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[30]  R. Shiffrin,et al.  A model for recognition memory: REM—retrieving effectively from memory , 1997, Psychonomic bulletin & review.

[31]  S C McKinley,et al.  Investigations of exemplar and decision bound models in large, ill-defined category structures. , 1995, Journal of experimental psychology. Human perception and performance.

[32]  A. A. J. Marley,et al.  A fixed rehearsal capacity interpretation of limits on absolute identification performance , 1984 .

[33]  Andrew Heathcote,et al.  A ballistic model of choice response time. , 2005, Psychological review.

[34]  G. Logan Repetition priming and automaticity: Common underlying mechanisms? , 1990, Cognitive Psychology.

[35]  J. Wixted,et al.  On the Form of Forgetting , 1991 .

[36]  Sean M. Polyn,et al.  A context maintenance and retrieval model of organizational processes in free recall. , 2009, Psychological review.

[37]  James L. McClelland,et al.  Elsevier Editorial System(tm) for Journal of Memory and Language Manuscript Draft Title: Differentiating the Differentiation Models: a Comparison of the Retrieving Effectively from Memory Model (rem) and the Subjective Likelihood Model (slim) Differentiating the Differentiation Models: a Comparison , 2022 .

[38]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[39]  John M. Pearson,et al.  Fictive Reward Signals in the Anterior Cingulate Cortex , 2009, Science.

[40]  Jiyun Li,et al.  Theoretical developments in decision field theory: comment on Tsetsos, Usher, and Chater (2010). , 2010, Psychological review.

[41]  R. Nosofsky An Exemplar-Based Random-Walk Model of Speeded Categorization and Absolute Judgment , 2019, Choice, Decision, and Measurement: Essays in Honor of R. Duncan Luce.

[42]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[43]  G. Logan Skill and automaticity: Relations, implications, and future directions. , 1985 .

[44]  Edgar C Merkle,et al.  An application of the poisson race model to confidence calibration. , 2006, Journal of experimental psychology. General.

[45]  S. Jay Samuels,et al.  Toward a theory of automatic information processing in reading , 1974 .

[46]  R. Nosofsky American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[47]  Edward E. Smith,et al.  Similarity- versus rule-based categorization , 1994, Memory & cognition.

[48]  Shayne Loft,et al.  Slow down and remember to remember! A delay theory of prospective memory costs. , 2015, Psychological review.

[49]  R. Levy An Integrated Model , 2016 .

[50]  James L. McClelland Stochastic interactive processes and the effect of context on perception , 1991, Cognitive Psychology.

[51]  M. Humphreys,et al.  A context noise model of episodic word recognition. , 2001, Psychological review.

[52]  Shane T. Mueller,et al.  Decision noise: An explanation for observed violations of signal detection theory , 2008, Psychonomic bulletin & review.

[53]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[54]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[55]  Scott D. Brown,et al.  Detecting and predicting changes , 2009, Cognitive Psychology.

[56]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[57]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[58]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[59]  M. Peruggia,et al.  Was it a car or a cat I saw? An Analysis of Response Times for Word Recognition , 2002 .

[60]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[61]  M. Treisman,et al.  American Psychological Association, Inc, A Theory of Criterion Setting With an Application to Sequential Dependencies , 2022 .

[62]  R. Nosofsky,et al.  Effects of similarity and practice on speeded classification response times and accuracies: Further tests of an exemplar-retrieval model , 1999, Memory & cognition.

[63]  J. Pearce Similarity and discrimination: a selective review and a connectionist model. , 1994, Psychological review.

[64]  M. Steinhauser,et al.  Distinguishing response conflict and task conflict in the Stroop task: evidence from ex-Gaussian distribution analysis. , 2009, Journal of experimental psychology. Human perception and performance.

[65]  Michael Diaz,et al.  Signal detection with criterion noise: applications to recognition memory. , 2009, Psychological review.

[66]  Wasserman,et al.  Bayesian Model Selection and Model Averaging. , 2000, Journal of mathematical psychology.

[67]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[68]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[69]  W. Vanpaemel,et al.  Prior sensitivity in theory testing: An apologia for the Bayes factor , 2010 .

[70]  Trisha Van Zandt,et al.  Roc curves and confidence judgments in recognition memory , 2000 .

[71]  Marius Usher,et al.  Testing Multi-Alternative Decision Models with Non-Stationary Evidence , 2011, Front. Neurosci..

[72]  Brandon M. Turner,et al.  Journal of Mathematical Psychology a Tutorial on Approximate Bayesian Computation , 2022 .

[73]  Yves Lacouture,et al.  The Roles of Stimulus and Response Set Size in the Identification and Categorisation of Unidimensional Stimuli , 1998 .

[74]  A. Criss The consequences of differentiation in episodic memory: Similarity and the strength based mirror effect , 2006 .

[75]  G. Bower,et al.  Evaluating an adaptive network model of human learning , 1988 .

[76]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[77]  R. Ratcliff,et al.  Aging, practice, and perceptual tasks: a diffusion model analysis. , 2006, Psychology and aging.

[78]  S. Link,et al.  A sequential theory of psychological discrimination , 1975 .

[79]  James L. McClelland,et al.  Hick's law in a stochastic race model with speed-accuracy tradeoffs , 2002 .

[80]  M. Steyvers,et al.  The dynamics of experimentally induced criterion shifts. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[81]  John Kay,et al.  The Hare and the Tortoise , 2006 .

[82]  Scott D. Brown,et al.  The power law repealed: The case for an exponential law of practice , 2000, Psychonomic bulletin & review.

[83]  Christian N. L. Olivers,et al.  Intertrial priming stemming from ambiguity: A new account of priming in visual search , 2006 .

[84]  W. Ma,et al.  Factorial comparison of working memory models. , 2014, Psychological review.

[85]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[86]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[87]  Amy H Criss,et al.  Differentiation and response bias in episodic memory: evidence from reaction time distributions. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[88]  Jay I. Myung,et al.  Optimal experimental design for model discrimination. , 2009, Psychological review.

[89]  Hui Li,et al.  The Improved Training Algorithm of Back Propagation Neural Network with Self-adaptive Learning Rate , 2009, 2009 International Conference on Computational Intelligence and Natural Computing.

[90]  R. Anders,et al.  The shifted Wald distribution for response time data analysis. , 2016, Psychological methods.

[91]  Brandon M. Turner,et al.  Hierarchical Approximate Bayesian Computation , 2013, Psychometrika.

[92]  Stephen W. Link,et al.  The Wave Theory of Difference and Similarity , 2020 .

[93]  John P O'Doherty,et al.  Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[94]  I. J. Myung,et al.  Toward an explanation of the power law artifact: Insights from response surface analysis , 2000, Memory & cognition.

[95]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[96]  John Jonides,et al.  Maintenance rehearsal: a two-component analysis , 1984 .

[97]  T. Zandt,et al.  Time-dependent Poisson counter models of response latency in simple judgment. , 2000, The British journal of mathematical and statistical psychology.

[98]  Yves Lacouture,et al.  Choice and response time processes in the identification and categorization of unidimensional stimuli , 2004, Perception & psychophysics.

[99]  Natalie L. Denburg,et al.  The Role of the Ventromedial Prefrontal Cortex in Purchase Intent Among Older Adults , 2016, Front. Aging Neurosci..

[100]  Marc W Howard,et al.  Neural Scaling Laws for an Uncertain World , 2016, Psychological review.