A memory-based account of retrospective revaluation.

We adapt an instance model of human memory, Minerva 2, to simulate retrospective revaluation. In the account, memory preserves the events of individual trials in separate traces. A probe presented to memory contacts all traces in parallel and causes each to become active. The information retrieved from memory is the sum of the activated traces. Learning is modelled as a process of cued-recall; encoding is modelled as a process of differential encoding of unexpected features in the probe (i.e., expectancy-encoding). The model captures three examples of retrospective revaluation: backward blocking, recovery from blocking, and backward conditioned inhibition. The work integrates an understanding of human memory and complex associative learning.

[1]  H. V. Restorff.  Über die Wirkung von Bereichsbildungen im Spurenfeld , 1933 .

[2]  L. Kamin.  Predictability, surprise, attention, and conditioning , 1967 .

[3]  R. Rescorla.  Conditioned inhibition of fear resulting from negative CS-US contingencies. , 1969, Journal of comparative and physiological psychology.

[4]  R. Rescorla.  Summation and retardation tests of latent inhibition. , 1971, Journal of comparative and physiological psychology.

[5]  R. Rescorla.  A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[6]  N. Mackintosh.  A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[7]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[8]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[9]  J. Pearce,et al.  A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980 .

[10]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[11]  Ralph R. Miller,et al.  Information processing in animals : memory mechanisms , 1983 .

[12]  Douglas L. Hintzman,et al.  MINERVA 2: A simulation model of human memory , 1984 .

[13]  Ralph R. Miller,et al.  Information processing in animals : conditioned inhibition , 1985 .

[14]  P. Dodwell,et al.  Recognition of Vector Patterns under Transformations: Local and Global Determinants , 1985 .

[15]  D. Shanks.  Forward and Backward Blocking in Human Contingency Judgement , 1985 .

[16]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[17]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[18]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986 .

[19]  L. Brooks.  Decentralized control of categorization: The role of prior processing episodes. , 1987 .

[20]  G. Logan.  Toward an instance theory of automatization. , 1988 .

[21]  Douglas L. Hintzman,et al.  Recognition and recall in MINERVA 2: Analysis of the 'recognition-failure' paradigm. , 1987 .

[22]  Cognition Edited B Modelling.  Modelling Cognition , 1987 .

[23]  Ralph R. Miller,et al.  The comparator hypothesis: A response rule for the expression of associations. , 1988 .

[24]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[25]  U. Neisser.  Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization , 1989 .

[26]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[27]  E. Wasserman,et al.  Cue Competition in Causality Judgments: The Role of Nonpresentation of Compound Stimulus Elements , 1994 .

[28]  R. R. Miller,et al.  Biological significance in forward and backward blocking: resolution of a discrepancy between animal conditioning and human causal judgment. , 1996, Journal of experimental psychology. General.

[29]  A. Dickinson,et al.  Within Compound Associations Mediate the Retrospective Revaluation of Causality Judgements , 1996, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[30]  J. Kruschke.  Base rates in category learning. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[31]  Steven E. Clark,et al.  A familiarity-based account of confidence-accuracy inversions in recognition memory. , 1997 .

[32]  S. Goldinger.  Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[33]  E. Hirshman,et al.  True and False Recognition in MINERVA2: Explanations from a Global Matching Perspective , 1998 .

[34]  D J Mewhort,et al.  Modeling lexical decision and word naming as a retrieval process. , 1999, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[35]  A. Dickinson,et al.  Episodic memory: what can animals remember about their past? , 1999, Trends in Cognitive Sciences.

[36]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[37]  A. Blaisdell,et al.  Recovery from blocking achieved by extinguishing the blocking CS , 1999 .

[38]  L D Williams,et al.  The source of feelings of familiarity: the discrepancy-attribution hypothesis. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[39]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.

[40]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[41]  Ralph R. Miller,et al.  Contrasting Acquisition-Focused and Performance-Focused Models of Acquired Behavior , 2001 .

[42]  J. Hare,et al.  The squirrel that cried wolf: reliability detection by juvenile Richardson's ground squirrels (Spermophilus richardsonii) , 2001, Behavioral Ecology and Sociobiology.

[43]  The discrepancy-attribution hypothesis: I. The heuristic basis of feelings of familiarity. , 2001 .

[44]  J. Kruschke.  Toward a unified model of attention in associative learning , 2001 .

[45]  B. W. Whittlesea,et al.  The discrepancy-attribution hypothesis: II. Expectation, uncertainty, surprise, and feelings of familiarity. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[47]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[48]  R. E. Blaser,et al.  Backward blocking in honeybees , 2004, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[49]  Klaus G. Melchers,et al.  Within-compound associations in retrospective revaluation and in direct learning: a challenge for comparator theory. , 2004, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[50]  Erik W. Moody,et al.  Memory processes in classical conditioning , 2004, Neuroscience & Biobehavioral Reviews.

[51]  Philip A. Higham,et al.  Opposition logic and neural network models in artificial grammar learning , 2004, Consciousness and Cognition.

[52]  P. Kwantes.  Using context to build semantics , 2005, Psychonomic bulletin & review.

[53]  S. Ghirlanda.  Retrospective revaluation as simple associative learning. , 2005, Journal of experimental psychology. Animal behavior processes.

[54]  A. Dickinson,et al.  Simulations of a modified SOP model applied to retrospective revaluation of human causal learning , 2005 .

[55]  Ralph R. Miller,et al.  Reasoning rats: forward blocking in Pavlovian animal conditioning is sensitive to constraints of causal inference. , 2006, Journal of experimental psychology. General.

[56]  A. Neal,et al.  Why people underestimate y when extrapolating in linear functions. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[57]  J. Fagot,et al.  Evidence for large long-term memory capacities in baboons and pigeons and its implications for learning and the evolution of cognition , 2006, Proceedings of the National Academy of Sciences.

[58]  Joseph P. Huston,et al.  Wistar rats show episodic-like memory for unique experiences , 2006, Neurobiology of Learning and Memory.

[59]  Aaron C. Courville,et al.  The pigeon as particle filter , 2007, NIPS 2007.

[60]  Steven C Stout,et al.  Sometimes-competing retrieval (SOCR): a formalization of the comparator hypothesis. , 2007, Psychological review.

[61]  G. Urcelay,et al.  Pavlovian backward conditioned inhibition in humans: Summation and retardation tests , 2008, Behavioural Processes.

[62]  Randall K. Jamieson,et al.  Applying an Exemplar Model to the Artificial-Grammar Task: Inferring Grammaticality from Similarity , 2009, Quarterly journal of experimental psychology.

[63]  Randall K. Jamieson,et al.  Applying an exemplar model to the serial reaction-time task: Anticipating from experience , 2009, Quarterly journal of experimental psychology.

[64]  Douglas J. K. Mewhort,et al.  Applying an exemplar model to the artificial-grammar task: String completion and performance on individual items , 2010, Quarterly journal of experimental psychology.

[65]  Randall K. Jamieson,et al.  Global similarity predicts dissociation of classification and recognition: evidence questioning the implicit-explicit learning distinction in amnesia. , 2010, Journal of experimental psychology. Learning, memory, and cognition.