An emergent approach to analogical inference

In recent years, a growing number of researchers have proposed that analogy is a core component of human cognition. According to the dominant theoretical viewpoint, analogical reasoning requires a specific suite of cognitive machinery, including explicitly coded symbolic representations and a mapping or binding mechanism that operates over these representations. Here we offer an alternative approach: we find that analogical inference can emerge naturally and spontaneously from a relatively simple, error-driven learning mechanism without the need to posit any additional analogy-specific machinery. The results also parallel findings from the developmental literature on analogy, demonstrating a shift from an initial reliance on surface feature similarity to the use of relational similarity later in training. Variants of the model allow us to consider and rule out alternative accounts of its performance. We conclude by discussing how these findings can potentially refine our understanding of the processes that are required to perform analogical inference.

[1]  James A. Reggia,et al.  Emergent latent symbol systems in recurrent neural networks , 2012, Connect. Sci..

[2]  John E. Hummel,et al.  Getting symbols out of a neural architecture , 2011, Connect. Sci..

[3]  D. Gentner,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECTS OF ALIGNABILITY ON MEMORY , 2022 .

[4]  Joseph Jay Williams,et al.  The role of explanation in discovery and generalization: evidence from category learning , 2010, ICLS.

[5]  Dedre Gentner,et al.  Psychology in Cognitive Science: 1978-2038 , 2010, Top. Cogn. Sci..

[6]  J. Elman Distributed representations, simple recurrent networks, and grammatical structure , 1991, Machine Learning.

[7]  Dedre Gentner,et al.  Mechanisms of Analogical Learning. , 1987 .

[8]  James L. McClelland,et al.  When a bad metaphor may not be a victimless crime: The role of metaphor in social policy , 2009 .

[9]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[10]  F. Keil Concepts, Kinds, and Cognitive Development , 1989 .

[11]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[12]  K. Holyoak,et al.  Mental Leaps: Analogy in Creative Thought , 1994 .

[13]  Dedre Gentner,et al.  LEARNING ANALOGICAL REASONING , 2008 .

[14]  S. Pinker,et al.  The past and future of the past tense , 2002, Trends in Cognitive Sciences.

[15]  K. Dunbar HOW SCIENTISTS REALLY REASON: SCIENTIFIC REASONING IN REAL-WORLD LABORATORIES , 1995 .

[16]  B. Rossion,et al.  Fixation Patterns During Recognition of Personally Familiar and Unfamiliar Faces , 2010, Front. Psychology.

[17]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[18]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[19]  James L. McClelland,et al.  Dynamical and connectionist approaches to development: toward a future of mutually beneficial co-evolution , 2009 .

[20]  Kenneth D. Forbus,et al.  Computational models of analogy. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[21]  Megan J. Bulloch,et al.  What makes relational reasoning smart? Revisiting the perceptual-to-relational shift in the development of generalization. , 2009, Developmental science.

[22]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[23]  S. Carey The Origin of Concepts , 2000 .

[24]  Derek C. Penn,et al.  Darwin's mistake: Explaining the discontinuity between human and nonhuman minds , 2008, Behavioral and Brain Sciences.

[25]  David J. Chalmers,et al.  High-level perception, representation, and analogy: a critique of artificial intelligence methodology , 1992, J. Exp. Theor. Artif. Intell..

[26]  Rochel Gelman,et al.  First Principles Organize Attention to and Learning About Relevant Data: Number and the Animate-Inanimate Distinction as Examples , 1990, Cogn. Sci..

[27]  D. Gentner Metaphor as Structure Mapping: The Relational Shift. , 1988 .

[28]  James L. McClelland,et al.  Rules or connections in past-tense inflections: what does the evidence rule out? , 2002, Trends in Cognitive Sciences.

[29]  Laura R. Novick,et al.  Component processes in analogical transfer: Mapping, pattern completion, and adaptation. , 1994 .

[30]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[31]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[32]  D. Gentner,et al.  The analogical mind : perspectives from cognitive science , 2001 .

[33]  James L. McClelland,et al.  A single-system account of semantic and lexical deficits in five semantic dementia patients , 2008, Cognitive neuropsychology.

[34]  Milena Mutafchieva,et al.  Does the Family Analogy Help Young Children To Do Relational Mapping ? , 2007 .

[35]  James L. McClelland,et al.  Précis of Semantic Cognition: A Parallel Distributed Processing Approach , 2008, Behavioral and Brain Sciences.

[36]  K. Holyoak,et al.  Surface and structural similarity in analogical transfer , 1987, Memory & cognition.

[37]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[38]  Dedre Gentner,et al.  Bootstrapping the Mind: Analogical Processes and Symbol Systems , 2010, Cogn. Sci..

[39]  Theodore L. Brown Making Truth: METAPHOR IN SCIENCE , 2003 .

[40]  D. Gentner,et al.  Relational language and the development of relational mapping , 2005, Cognitive Psychology.

[41]  Leonidas A. A. Doumas,et al.  Analogy and conceptual change in childhood , 2008, Behavioral and Brain Sciences.

[42]  Dedre Gentner,et al.  Systematicity as a Selection Constraint in Analogical Mapping , 1991, Cogn. Sci..

[43]  Esther Thelen,et al.  Dynamic Systems Theories , 2007 .

[44]  Caitlin M. Fausey,et al.  Constructing Agency: The Role of Language , 2010, Front. Psychology.

[45]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[46]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[47]  Leonidas A A Doumas,et al.  A theory of the discovery and predication of relational concepts. , 2008, Psychological review.

[48]  James L. McClelland,et al.  ‘Words or Rules’ cannot exploit the regularity in exceptions , 2002, Trends in Cognitive Sciences.

[49]  R. Gelman First Principles Organize Attention to and Learning About Relevant Data: Number and the Animate‐Inanimate Distinction as Examples , 1990 .

[50]  Z. Chen,et al.  Children's analogical problem solving: the effects of superficial, structural, and procedural similarity. , 1996, Journal of experimental child psychology.

[51]  James L. McClelland Emergence in Cognitive Science , 2010, Top. Cogn. Sci..

[52]  James L. McClelland,et al.  Considerations arising from a complementary learning systems perspective on hippocampus and neocortex , 1996, Hippocampus.

[53]  John E. Hummel,et al.  Relational Reasoning in a Neurally Plausible Cognitive Architecture , 2005 .

[54]  Joshua B. Tenenbaum,et al.  Structured models of semantic cognition , 2008, Behavioral and Brain Sciences.

[55]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[56]  Robert M. French,et al.  The Subtlety of Sameness: A Theory and Computer Model of Analogy-Making , 1995 .

[57]  John E. Hummel,et al.  Symbolic Versus Associative Learning , 2010, Cogn. Sci..

[58]  Dedre Gentner,et al.  Why we’re so smart , 2003 .

[59]  K. Dunbar How scientists think: On-line creativity and conceptual change in science. , 1997 .

[60]  Tim van Gelder,et al.  Compositionality: A Connectionist Variation on a Classical Theme , 1990, Cogn. Sci..

[61]  Gary Lupyan,et al.  Language is not Just for Talking , 2007, Psychological science.

[62]  J. Hodges Memory, Amnesia and the Hippocampal System , 1995 .

[63]  D. Gentner,et al.  More evidence for a relational shift in the development of analogy: Children's performance on a causal-mapping task , 1998 .

[64]  L. Boroditsky Does Language Shape Thought?: Mandarin and English Speakers' Conceptions of Time , 2001, Cognitive Psychology.

[65]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[66]  Rogers P. Hall,et al.  Computational Approaches to Analogical Reasoning: A Comparative Analysis , 1989, Artif. Intell..

[67]  K. Holyoak,et al.  A symbolic-connectionist theory of relational inference and generalization. , 2003, Psychological review.

[68]  James L. McClelland,et al.  Generalization Through the Recurrent Interaction of Episodic Memories , 2012, Psychological review.

[69]  Melody Dye,et al.  The Effects of Feature-Label-Order and Their Implications for Symbolic Learning , 2010, Cogn. Sci..

[70]  D. Gentner,et al.  Language and the career of similarity. , 1991 .

[71]  Arthur B. Markman,et al.  Analogy - Watershed or Waterloo? Structural Alignment and the Development of Connectionist Models of Cognition , 1992, NIPS.

[72]  Daniel C. Krawczyk,et al.  A Neurocomputational Model of Analogical Reasoning and its Breakdown in Frontotemporal Lobar Degeneration , 2004, Journal of Cognitive Neuroscience.

[73]  Melanie Mitchell,et al.  The Copycat project: a model of mental fluidity and analogy-making , 1995 .

[74]  John E. Hummel,et al.  The Proper Treatment of Symbols in a Connectionist Architecture , 2000 .

[75]  Usha Goswami,et al.  Transitive Relational Mappings in Three‐ and Four‐Year‐Olds: The Analogy of Goldilocks and the Three Bears , 1995 .

[76]  James L. McClelland,et al.  Toward a New Grand Theory of Development? Connectionism and Dynamic Systems Theory Reconsidered , 2009 .

[77]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[78]  D. Mareschal,et al.  Analogy as relational priming: The challenge of self-reflection , 2008, Behavioral and Brain Sciences.

[79]  I. Rooij,et al.  Connectionist semantic systematicity , 2009, Cognition.

[80]  R. French The computational modeling of analogy-making , 2002, Trends in Cognitive Sciences.

[81]  Gary F. Marcus,et al.  Concepts, correlations, and some challenges for connectionist cognition , 2008, Behavioral and Brain Sciences.

[82]  Peter Szolovits,et al.  What Is a Knowledge Representation? , 1993, AI Mag..

[83]  Michael J. Spivey,et al.  The Continuity Of Mind , 2008 .

[84]  Sabina Pauen,et al.  The effects of a family analogy on class inclusion reasoning by young children , 2005 .

[85]  Refractor Vision , 2000, The Lancet.

[86]  D. Gentner,et al.  Language in Mind: Advances in the Study of Language and Thought , 2003 .

[87]  David E. Rumelhart,et al.  Brain style computation: learning and generalization , 1990 .

[88]  Kenneth D. Forbus,et al.  MAC/FAC: A Model of Similarity-Based Retrieval , 1995, Cogn. Sci..

[89]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[90]  Brian F. Bowdle,et al.  Informativity and Asymmetry in Comparisons , 1997, Cognitive Psychology.

[91]  John E. Hummel,et al.  Distributed representations of structure: A theory of analogical access and mapping. , 1997 .

[92]  Ann L. Brown Analogical learning and transfer: what develops? , 1989 .

[93]  Dedre Gentner,et al.  Relational Language Helps Children Reason Analogically , 2009 .

[94]  A. Ortony,et al.  Similarity and Analogical Reasoning , 1991 .

[95]  Arthur B. Markman,et al.  Analogical inferences are central to analogy , 2008, Behavioral and Brain Sciences.

[96]  David J. Chalmers,et al.  Syntactic Transformations on Distributed Representations , 1990 .

[97]  James L. McClelland,et al.  A connectionist model of a continuous developmental transition in the balance scale task , 2009, Cognition.

[98]  John E. Hummel,et al.  No way to start a space program: Associationism as a launch pad for analogical reasoning , 2008, Behavioral and Brain Sciences.

[99]  R. O’Reilly,et al.  Modeling Hippocampal and Neocortical Contributions to RecognitionMemory , 2000 .

[100]  James L. McClelland,et al.  How Language Affects Thought in a Connectionist Model , 2007 .

[101]  Mark F. St. John,et al.  The Story Gestalt: A Model of Knowledge-Intensive Processes in Text Comprehension , 1992, Cogn. Sci..

[102]  Charles Cole,et al.  Fluid concepts and creative analogies: Computer models of the fundamental mechanisms of thought , 1996 .

[103]  James L. McClelland,et al.  Learning and Applying Contextual Constraints in Sentence Comprehension , 1990, Artif. Intell..

[104]  Gabriella Vigliocco,et al.  Integrating experiential and distributional data to learn semantic representations. , 2009, Psychological review.

[105]  Hans Welling,et al.  Four Mental Operations in Creative Cognition: The Importance of Abstraction , 2007 .

[106]  Melanie Mitchell,et al.  Analogy-making as perception - a computer model , 1993, Neural network modeling and connectionism.

[107]  Brian Falkenhainer,et al.  The Structure-Mapping Engine: Algorithm and Examples , 1989, Artif. Intell..

[108]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[109]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[110]  U. Goswami Analogical reasoning in children , 1993 .

[111]  Dedre Gentner,et al.  The Place of Analogy in Cognition , 2002 .

[112]  Stephen J. Flusberg,et al.  A Connectionist Approach to Embodied Conceptual Metaphor , 2010, Front. Psychology.

[113]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[114]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[115]  James L. McClelland,et al.  Mechanisms of Sentence Processing: Assigning Roles to Constituents of Sentences , 1986 .

[116]  Arthur B. Markman,et al.  Analogy-- Watershed or Waterloo? Structural alignment and the development of connectionist models of analogy , 1992, NIPS 1992.

[117]  S. Pinker,et al.  Combination and structure, not gradedness, is the issue , 2002, Trends in Cognitive Sciences.

[118]  Richard M. Lerner,et al.  Theoretical models of human development , 2006 .

[119]  K. Dunbar,et al.  How analogies are generated: The roles of structural and superficial similarity , 2000, Memory & cognition.

[120]  G. Marcus The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[121]  James L. McClelland The Place of Modeling in Cognitive Science , 2009, Top. Cogn. Sci..

[122]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[123]  H. Eichenbaum A cortical–hippocampal system for declarative memory , 2000, Nature Reviews Neuroscience.