MAC/FAC: A Model of Similarity-Based Retrieval

We present a model of similarity-based retrieval that attempts to capture three seemingly contradictory psychological phenomena: (a) structural commonalities are weighed more heavily than surface commonalities in similarity judgments for items in working memory; (b) in retrieval, superficial similarity is more important than structural similarity; and yet (c) purely structural (analogical) remindings e sometimes experienced. Our model, MAC/FAC, explains these phenomena in terms of a two-stage process. The first stage uses a computationally cheap, non-structural matcher to filter candidate long-term memory items. It uses content vectors, a redundant encoding of structured representations whose dot product estimates how well the corresponding structural representations will match. The second stage uses SME (structure-mapping engine) to compute structural matches on the handful of items found by the first stage. We show the utility of the MAC/FAC model through a series of computational experiments: (a) We demonstrate that MAC/FAC can model patterns of access found in psychological data; (b) we argue via sensitivity analyses that these simulation results rely on the theory; and (c) we compare the performance of MAC/FAC with ARCS, an alternate model of similarity-based retrieval, and demonstrate that MAC/FAC explains the data better than ARCS. Finally, we discuss limitations and possible extensions of the model, relationships with other recent retrieval models, and place MAC/FAC in the context of other recent work on the nature of similarity.

[1]  R. Ratcliff,et al.  Similarity information versus relational information: Differences in the time course of retrieval , 1989, Cognitive Psychology.

[2]  D. Gentner Metaphor as Structure Mapping: The Relational Shift. , 1988 .

[3]  Lawrence W. Barsalou,et al.  The instability of graded structure: implications for the nature of concepts , 1987 .

[4]  Brian Falkenhainer,et al.  An Examination of the Third Stage in the Analogy Process: Verification-based Analogical Learning , 1987, IJCAI.

[5]  Dedre Gentner,et al.  Mechanisms of Analogical Learning. , 1987 .

[6]  Robert L. Goldstone,et al.  Time Course of Comparison , 1994 .

[7]  Patrick Henry Winston,et al.  Learning New Principles from Precedents and Exercises , 1982, Artif. Intell..

[8]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[9]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[10]  G. Halford Analogical Reasoning and Conceptual Complexity in Cognitive Development , 1992 .

[11]  R. Sternberg Advances in the psychology of human intelligence , 1982 .

[12]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[13]  Mark T. Keane,et al.  The Incremental Analogy Machine: A Computational Model of Analogy , 1988, EWSL.

[14]  D. Gentner,et al.  Structural Alignment during Similarity Comparisons , 1993, Cognitive Psychology.

[15]  L. Rips Similarity, typicality, and categorization , 1989 .

[16]  Stephen K. Reed,et al.  The role of analogy in transfer between similar problem states , 1974 .

[17]  John R. Anderson,et al.  The effects of category generalizations and instance similarity on schema abstraction. , 1981 .

[18]  Brian Falkenhainer,et al.  Learning from physical analogies: A study in analogy and the explanation process , 1989 .

[19]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[20]  S. Glucksberg,et al.  Understanding Metaphorical Comparisons: Beyond Similarity. , 1990 .

[21]  Lauretta M. Reeves,et al.  The Role of Content and Abstract Information in Analogical Transfer , 1994 .

[22]  Garrison W. Cottrell,et al.  Lexical Ambiguity Resolution: Perspectives from Psycholinguistics, Neuropsychology, and Artificial Intelligence , 1988 .

[23]  L. R. Novick Analogical Transfer: Processes and Individual Differences , 1988 .

[24]  David L. Waltz,et al.  Toward memory-based reasoning , 1986, CACM.

[25]  P. Smolensky On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[26]  Brian J. Reiser,et al.  Access and Use of Previous Solutions in a Problem Solving Situation , 1988 .

[27]  Dedre Gentner,et al.  Systematicity as a Selection Constraint in Analogical Mapping , 1991, Cogn. Sci..

[28]  Janet L. Kolodner,et al.  Retrieval and organizational strategies in conceptual memory: a computer model , 1980 .

[29]  Mark T. Keane On Retrieving Analogues When Solving Problems , 1987 .

[30]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[31]  Douglas L Medin,et al.  The Psychology of Learning and Motivation: Volume 30 , 1993 .

[32]  Paul Thagard,et al.  Analogical Mapping by Constraint Satisfaction , 1989, Cogn. Sci..

[33]  Christopher K. Riesbeck,et al.  Inside Case-Based Reasoning , 1989 .

[34]  Karl Halvor Teigen,et al.  To be convincing or to be right: A question of preciseness: K.J. Gilhooly, M.T.G. Keane, R.H. Logie and G. Erdös (eds.), Lines of Thinking (Wiley, Chichester, 1990) 299–313 , 1990 .

[35]  D. Gentner,et al.  Splitting the Differences: A Structural Alignment View of Similarity , 1993 .

[36]  L. Smith Young children's understanding of attributes and dimensions: a comparison of conceptual and linguistic measures. , 1984, Child development.

[37]  M. Bassok,et al.  Judging a book by its cover: Interpretative effects of content on problem-solving transfer , 1995, Memory & cognition.

[38]  R. Siegler Children's Thinking : What Develops? , 1978 .

[39]  D. Gentner,et al.  Systematicity as a selection constraint in analogical mapping , 1991 .

[40]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[41]  Trent E. Lange,et al.  Dynamic Memories: Analysis of an Integrated Comprehension and Episodic Memory Retrieval Model , 1993, IJCAI.

[42]  James P. Byrnes,et al.  Perspectives on language and thought : interrelations in development , 1991 .

[43]  James A. Hendler,et al.  Massively parallel support for a case-based planning system , 1993 .

[44]  N. Chater,et al.  Proceedings of the fourteenth annual conference of the cognitive science society , 1992 .

[45]  Brian Falkenhainer,et al.  The Structure-Mapping Engine * , 2003 .

[46]  W. Freeman Second Commentary: On the proper treatment of connectionism by Paul Smolensky (1988) - Neuromachismo Rekindled , 1989 .

[47]  Kenneth D. Forbus,et al.  Incremental Structure-Mapping , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[48]  Dedre Gentner,et al.  The Verb Mutability Effect: Studies of the Combinatorial Semantics of Nouns and Verbs , 1990 .

[49]  Stephen K. Reed,et al.  A structure-mapping model for word problems. , 1987 .

[50]  Dedre Gentner,et al.  Analogical Inference and Analogical Access. , 1987 .

[51]  D. Gentner,et al.  Respects for similarity , 1993 .

[52]  D. Gentner,et al.  PSYCHOLOGICAL SCIENCE Research Article STRUCTURAL ALIGNMENT IN COMPARISON: No Difference Without Similarity , 2022 .

[53]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[54]  Brian H. Ross,et al.  Remindings in learning and instruction , 1989 .

[55]  T. E. Lange,et al.  Below the Surface: Analogical Similarity and Retrieval Competition in Reminding , 1994, Cognitive Psychology.

[56]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[57]  D. Medin,et al.  Comments on part I: psychological essentialism , 1989 .

[58]  D. Gentner,et al.  Language and the career of similarity. , 1991 .

[59]  L. R. Novick Analogical transfer, problem similarity, and expertise. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[60]  R. Ratcliff,et al.  Time course of item and associative information: implications for global memory models. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[61]  John Clement,et al.  METHODS FOR EVALUATING THE VALIDITY OF HYPOTHESIZED ANALOGIES , 1986 .

[62]  Arthur B. Markman,et al.  Analogy - Watershed or Waterloo? Structural Alignment and the Development of Connectionist Models of Cognition , 1992, NIPS.

[63]  Kenneth D. Forbus,et al.  Learning Physical Domains: Toward a Theoretical Framework. , 1986 .

[64]  Laura R. Novick,et al.  Component processes in analogical transfer: Mapping, pattern completion, and adaptation. , 1994 .

[65]  Arthur B. Markman,et al.  Analogy-- Watershed or Waterloo? Structural alignment and the development of connectionist models of analogy , 1992, NIPS 1992.

[66]  F. Keil Concepts, Kinds, and Cognitive Development , 1989 .

[67]  Dedre Gentner,et al.  Evidence for Relational Selectivity in the Interpretation of Analogy and Metaphor , 1988 .

[68]  Douglas L. Hintzman,et al.  MINERVA 2: A simulation model of human memory , 1984 .

[69]  Mark T. Keane Analogical mechanisms , 2004, Artificial Intelligence Review.

[70]  M. Chi Knowledge structures and memory development. , 1978 .

[71]  S. Carey Conceptual Change in Childhood , 1985 .

[72]  K. Holyoak,et al.  Overcoming contextual limitations on problem-solving transfer. , 1989 .

[73]  John A. Barnden,et al.  On the connectionist implementation of analogy and working memory matching. , 1994 .

[74]  S. Read,et al.  This reminds me of the time when …: Expectation failures in reminding and explanation , 1991 .

[75]  Stephen K. Reed,et al.  Selecting analogous problems: Similarity versus inclusiveness , 1990, Memory & cognition.

[76]  Brian Falkenhainer,et al.  Analogical Processing: A Simulation and Empirical Corroboration , 1987, AAAI.

[77]  Kenneth D. Forbus,et al.  Similarity-based cognitive architecture , 1991, SGAR.

[78]  Dedre Gentner,et al.  Analogical mapping during similarity judgments , 1988 .

[79]  L. Barsalou Context-independent and context-dependent information in concepts , 1982, Memory & cognition.

[80]  Mark H. Burstein A Model of Learning by Incremental Analogical Reasoning and Debugging , 1983, AAAI.

[81]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[82]  John R. Anderson,et al.  The effects of information order and learning mode on schema abstraction , 1984, Memory & cognition.

[83]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[84]  Mark T. Keane Analogical problem solving , 1988 .

[85]  Fenguangzhai Song CD , 1992 .

[86]  Brian Falkenhainer,et al.  The Structure-Mapping Engine: Algorithm and Examples , 1989, Artif. Intell..

[87]  Michael J. Pazzani,et al.  Indexing strategies for goal specific retrieval of cases , 1997 .

[88]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[89]  K. Branting,et al.  Building Explanations from Rules and Structured Cases , 1991, Int. J. Man Mach. Stud..

[90]  Ann L. Brown Analogical learning and transfer: what develops? , 1989 .

[91]  A. Ortony,et al.  Similarity and Analogical Reasoning , 1991 .

[92]  Robert L. Goldstone,et al.  Relational similarity and the nonindependence of features in similarity judgments , 1991, Cognitive Psychology.

[93]  D. Gentner Structure‐Mapping: A Theoretical Framework for Analogy* , 1983 .

[94]  Dedre Gentner,et al.  Some interesting differences between nouns and verbs , 1981 .

[95]  Literatus G. E. D. , 1893 .

[96]  R. Ratcliff,et al.  Memory connections between thematically similar episodes. , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[97]  Kristian J. Hammond,et al.  CHEF: A Model of Case-Based Planning , 1986, AAAI.

[98]  Lynne M. Reder,et al.  Strategic control of retrieval strategies. , 1988 .

[99]  D. Medin,et al.  The specific character of abstract thought: Categorization, problem-solving, and induction: Volume 5 , 1989 .

[100]  B. Ross This is like that: The use of earlier problems and the separation of similarity effects. , 1987 .

[101]  M. Humphreys,et al.  Different Ways to Cue a Coherent Memory System: A Theory for Episodic, Semantic, and Procedural Tasks. , 1989 .

[102]  Kenneth D. Forbus,et al.  Structural Evaluation of Analogies : What Counts? , 1989 .

[103]  B. Ross Remindings and their effects in learning a cognitive skill , 1984, Cognitive Psychology.

[104]  Moshe Burstein,et al.  Concept formatio n by incremental analogica l reasoning and debugging , 1983 .

[105]  K. Holyoak,et al.  Surface and structural similarity in analogical transfer , 1987, Memory & cognition.

[106]  Dedre Gentner,et al.  ANALOGICAL REMINDING: A GOOD MATCH IS HARD TO FIND. , 1985 .

[107]  C. Clement,et al.  The Effects of Manifest Relational Similarity on Analog Retrieval , 1994 .

[108]  K. VanLehn Mind Bugs: The Origins of Procedural Misconceptions , 1990 .

[109]  Robert L. Goldstone Similarity, interactive activation, and mapping , 1994 .

[110]  Kenneth D. Forbus,et al.  The Roles of Similarity in Transfer: Separating Retrievability From Inferential Soundness , 1993, Cognitive Psychology.

[111]  Keith J. Holyoak,et al.  If Saddam is Hitler then who is George Bush? Analogical mapping between systems of social roles , 1992 .

[112]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[113]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[114]  J. Metcalfe,et al.  Novelty monitoring, metacognition, and control in a composite holographic associative recall model: implications for Korsakoff amnesia. , 1993, Psychological review.