Probabilistic Analogical Mapping with Semantic Relation Networks

The human ability to flexibly reason with cross-domain analogies depends on mechanisms for identifying relations between concepts and for mapping concepts and their relations across analogs. We present a new computational model of analogical mapping, based on semantic relation networks constructed from distributed representations of individual concepts and of relations between concepts. Through comparisons with human performance in a new analogy experiment with 1,329 participants, as well as in four classic studies, we demonstrate that the model accounts for a broad range of phenomena involving analogical mapping by both adults and children. The key insight is that rich semantic representations of individual concepts and relations, coupled with a generic prior favoring isomorphic mappings, yield human-like analogical mapping.

[1]  A. Healy,et al.  Learning of nondomain facts in high- and low-knowledge domains. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Dedre Gentner,et al.  Bootstrapping the Mind: Analogical Processes and Symbol Systems , 2010, Cogn. Sci..

[3]  K. Holyoak,et al.  Mental Leaps: Analogy in Creative Thought , 1994 .

[4]  Sudeep Bhatia,et al.  Transformer networks of human conceptual knowledge. , 2020, Psychological review.

[5]  Yixin Zhu,et al.  Learning Perceptual Inference by Contrasting , 2019, NeurIPS.

[6]  Jianfeng Gao,et al.  HUBERT Untangles BERT to Improve Transfer across NLP Tasks , 2019, ArXiv.

[7]  Andrei Cimpian,et al.  Preschool children’s use of cues to generic meaning , 2008, Cognition.

[8]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[9]  Keith J. Holyoak,et al.  Conceptual and procedural distinctions between fractions and decimals: A cross-national comparison , 2016, Cognition.

[10]  S. Phillips A reconstruction theory of relational schema induction , 2021, PLoS computational biology.

[11]  Derek C. Penn,et al.  Darwin's mistake: Explaining the discontinuity between human and nonhuman minds , 2008, Behavioral and Brain Sciences.

[12]  Micah B. Goldwater,et al.  The empirical case for role-governed categories , 2011, Cognition.

[13]  Michalis Vazirgiannis,et al.  GoWvis: A Web Application for Graph-of-Words-based Text Visualization and Summarization , 2016, ACL.

[14]  K. Holyoak,et al.  Mathematical problem solving by analogy. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Christian Biemann,et al.  Simple Co-Occurrence Statistics Reproducibly Predict Association Ratings , 2018, Cogn. Sci..

[16]  Melanie Mitchell,et al.  The Copycat project: a model of mental fluidity and analogy-making , 1995 .

[17]  Laura R. Novick,et al.  Component processes in analogical transfer: Mapping, pattern completion, and adaptation. , 1994 .

[18]  Charles Kemp,et al.  The discovery of structural form , 2008, Proceedings of the National Academy of Sciences.

[19]  Dedre Gentner,et al.  Systematicity as a Selection Constraint in Analogical Mapping , 1991, Cogn. Sci..

[20]  K. Holyoak Analogy and Relational Reasoning , 2012 .

[21]  Felix Hill,et al.  Measuring abstract reasoning in neural networks , 2018, ICML.

[22]  Kenneth D. Forbus,et al.  The Roles of Similarity in Transfer: Separating Retrievability From Inferential Soundness , 1993, Cognitive Psychology.

[23]  T. E. Lange,et al.  Below the Surface: Analogical Similarity and Retrieval Competition in Reminding , 1994, Cognitive Psychology.

[24]  Yizhen Zhang,et al.  Connecting concepts in the brain by mapping cortical representations of semantic relations , 2019, bioRxiv.

[25]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[26]  D. Gentner,et al.  Language and the career of similarity. , 1991 .

[27]  K. Holyoak,et al.  The Oxford handbook of thinking and reasoning , 2012 .

[28]  Keith J. Holyoak,et al.  The Pragmatics of Analogical Transfer , 1985 .

[29]  Francisco Pereira,et al.  A comparative evaluation of off-the-shelf distributed semantic representations for modelling behavioural data , 2016, Cognitive neuropsychology.

[30]  Daniel C. Krawczyk,et al.  A Neurocomputational Model of Analogical Reasoning and its Breakdown in Frontotemporal Lobar Degeneration , 2004, Journal of Cognitive Neuroscience.

[31]  Paul Thagard,et al.  Analogical Mapping by Constraint Satisfaction , 1989, Cogn. Sci..

[32]  François Clémentz Internal, Formal and Thin Relations , 2014 .

[33]  S. Phillips,et al.  Processing capacity defined by relational complexity: implications for comparative, developmental, and cognitive psychology. , 1998, The Behavioral and brain sciences.

[34]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[35]  P. Wolff Direct causation in the linguistic coding and individuation of causal events , 2003, Cognition.

[36]  D. Gentner,et al.  Structural Alignment during Similarity Comparisons , 1993, Cognitive Psychology.

[37]  K. Holyoak,et al.  Pragmatics in Analogical Mapping , 1996, Cognitive Psychology.

[38]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[39]  Ying Nian Wu,et al.  Emergence of analogy from relation learning , 2019, Proceedings of the National Academy of Sciences.

[40]  Dedre Gentner,et al.  Analogy Generation in Science Experts and Novices , 2021, Cogn. Sci..

[41]  Robert L. Goldstone,et al.  Time Course of Comparison , 1994 .

[42]  Kenneth D. Forbus,et al.  MAC/FAC: A Model of Similarity-Based Retrieval , 1995, Cogn. Sci..

[43]  T. G. Evans A program for the solution of a class of geometric-analogy intelligence-test questions , 1964 .

[44]  Felix Hill,et al.  Learning to Make Analogies by Contrasting Abstract Relational Structure , 2019, ICLR.

[45]  Mark T. Keane,et al.  The Incremental Analogy Machine: A Computational Model of Analogy , 1988, EWSL.

[46]  Gilles Richard,et al.  Classifying and completing word analogies by machine learning , 2021, Int. J. Approx. Reason..

[47]  Leonidas A A Doumas,et al.  A theory of the discovery and predication of relational concepts. , 2008, Psychological review.

[48]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[49]  Alan Yuille,et al.  Visual analogy: Deep learning versus compositional models , 2021, ArXiv.

[50]  Arthur B. Markman,et al.  Role-governed categories , 2001, J. Exp. Theor. Artif. Intell..

[51]  Barbara A. Spellman,et al.  If Saddam is Hitler then who is George Bush? Analogical mapping between systems of social roles , 1992 .

[52]  Alan L. Yuille,et al.  Seeing the Meaning: Vision Meets Semantics in Solving Pictorial Analogy Problems , 2019, CogSci.

[53]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[54]  J. Hummel,et al.  Relation learning in a neurocomputational architecture supports cross-domain transfer , 2019, CogSci.

[55]  K. Holyoak,et al.  Children's development of analogical reasoning: insights from scene analogy problems. , 2006, Journal of experimental child psychology.

[56]  J. Laird,et al.  The Nature of “Intelligence” and the Principles of Cognition , 1923, Nature.

[57]  Peter D. Turney The Latent Relation Mapping Engine: Algorithm and Experiments , 2008, J. Artif. Intell. Res..

[58]  Peter D. Turney Domain and Function: A Dual-Space Model of Semantic Relations and Compositions , 2012, J. Artif. Intell. Res..

[59]  Robert L. Goldstone,et al.  Using relations within conceptual systems to translate across conceptual systems , 2002, Cognition.

[60]  K. Holyoak,et al.  Predicting patterns of similarity among abstract semantic relations. , 2021, Journal of experimental psychology. Learning, memory, and cognition.

[61]  Keith J Holyoak,et al.  The role of causal models in analogical inference. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[62]  Robert L. Goldstone Similarity, interactive activation, and mapping , 1994 .

[63]  Keith J. Holyoak The Spider's Thread , 2019 .

[64]  Serena Chen,et al.  Transference in social perception: the role of chronic accessibility in significant-other representations. , 1995, Journal of personality and social psychology.

[65]  Dawn Chen,et al.  Generative Inferences Based on Learned Relations. , 2017, Cognitive science.

[66]  Michael C. Frank,et al.  Do graded representations support abstract thought? , 2020, Current Opinion in Behavioral Sciences.

[67]  R. Ratcliff,et al.  Memory connections between thematically similar episodes. , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[68]  Nancy Kanwisher,et al.  Toward a universal decoder of linguistic meaning from brain activation , 2018, Nature Communications.

[69]  SUZANNE KEMMER,et al.  The grammar of causatives and the conceptual structure of events , 1994 .

[70]  S. Carey,et al.  Population differences in performance on Relational Match to Sample (RMTS) sometimes reflect differences in inductive biases alone , 2021, Current Opinion in Behavioral Sciences.

[71]  Saif Mohammad,et al.  SemEval-2012 Task 2: Measuring Degrees of Relational Similarity , 2012, *SEMEVAL.

[72]  Tal Linzen,et al.  Issues in evaluating semantic spaces using word analogies , 2016, RepEval@ACL.

[73]  Giyoo Hatano,et al.  Young Children's Spontaneous Personification as Analogy. , 1987 .

[74]  Daniel C. Krawczyk,et al.  Structural constraints and object similarity in analogical mapping and inference , 2004 .

[75]  Alfio Gliozzo,et al.  Learning Relational Representations by Analogy using Hierarchical Siamese Networks , 2018, NAACL.

[76]  Sudeep Bhatia Associative Judgment and Vector Space Semantics , 2017, Psychological review.

[77]  B. Ross Distinguishing Types of Superficial Similarities: Different Effects on the Access and Use of Earlier Problems , 1989 .

[78]  K. Holyoak,et al.  A System for Relational Reasoning in Human Prefrontal Cortex , 1999 .

[79]  K. Holyoak,et al.  Emergence of relational reasoning , 2021, Current Opinion in Behavioral Sciences.

[80]  C. Hoerl Causal reasoning , 2011 .

[81]  K. Holyoak,et al.  Cognitive Supports for Analogies in the Mathematics Classroom , 2007, Science.

[82]  B. Love,et al.  Beyond common features: The role of roles in determining similarity , 2007, Cognitive Psychology.

[83]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .

[84]  Dedre Gentner,et al.  Systematicity and Surface Similarity in the Development of Analogy , 1986, Cogn. Sci..

[85]  M. Scheerer,et al.  Problem Solving , 1967, Nature.

[86]  K. Holyoak,et al.  Surface and structural similarity in analogical transfer , 1987, Memory & cognition.

[87]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[88]  Keith J Holyoak,et al.  Metaphor Comprehension: A Critical Review of Theories and Evidence , 2018, Psychological bulletin.

[89]  K. Holyoak,et al.  Relational Integration in the Human Brain: A Review and Synthesis , 2020, Journal of Cognitive Neuroscience.

[90]  John R. Anderson,et al.  Human memory: An adaptive perspective. , 1989 .

[91]  Alan L. Yuille,et al.  Ideal Observers for Detecting Motion: Correspondence Noise , 2005, NIPS.

[92]  T. E. Lange,et al.  Remote analogical reminding , 1996, Memory & cognition.

[93]  Sudeep Bhatia,et al.  Similarity Judgment Within and Across Categories: A Comprehensive Model Comparison , 2020, Cogn. Sci..

[94]  L. R. Novick Analogical transfer, problem similarity, and expertise. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[95]  Brian Falkenhainer,et al.  The Structure-Mapping Engine: Algorithm and Examples , 1989, Artif. Intell..

[96]  Russell Richie,et al.  Distributed semantic representations for modeling human judgment , 2019, Current Opinion in Behavioral Sciences.

[97]  Robert J. Sternberg,et al.  Component Processes in Analogical Reasoning. , 1977 .

[98]  Kenneth D. Forbus,et al.  Modeling Visual Problem Solving as Analogical Reasoning , 2017, Psychological review.

[99]  K. Dunbar,et al.  Analogy use in naturalistic settings: The influence of audience, emotion, and goals , 2001, Memory & cognition.

[100]  Patrick Henry Winston,et al.  Learning and reasoning by analogy , 1980, CACM.

[101]  Joshua C. Peterson,et al.  Parallelograms revisited: Exploring the limitations of vector space models for simple analogies , 2020, Cognition.

[102]  Christian D. Schunn,et al.  The Impact of Analogies on Creative Concept Generation: Lessons From an In Vivo Study in Engineering Design , 2015, Cogn. Sci..

[103]  Keith J. Holyoak,et al.  Semantic alignment across whole-number arithmetic and rational numbers: evidence from a Russian perspective , 2018 .

[104]  Máximo Trench,et al.  The Role of Surface Similarity in Analogical Retrieval: Bridging the Gap Between the Naturalistic and the Experimental Traditions , 2015, Cogn. Sci..

[105]  K. Holyoak,et al.  A symbolic-connectionist theory of relational inference and generalization. , 2003, Psychological review.

[106]  Dawn Chen,et al.  Bayesian analogy with relational transformations. , 2012, Psychological review.

[107]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[108]  Peter D. Turney Distributional Semantics Beyond Words: Supervised Learning of Analogy and Paraphrase , 2013, TACL.

[109]  Felix Hill,et al.  SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation , 2014, CL.

[110]  K. Holyoak,et al.  Development of analogical problem-solving skill. , 1984, Child development.

[111]  Sunanda Mitra Adaptive pattern recognition by self-organizing neural networks , 1994, Other Conferences.

[112]  Caren M. Walker,et al.  Context shapes early diversity in abstract thought , 2019, Proceedings of the National Academy of Sciences.

[113]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[114]  Miriam Bassok,et al.  Adding Apples and Oranges: Alignment of Semantic and Formal Knowledge , 1998, Cognitive Psychology.

[115]  R. Morrison,et al.  A computational account of children's analogical reasoning: balancing inhibitory control in working memory and relational representation. , 2011, Developmental science.

[116]  K. Dunbar,et al.  How analogies are generated: The roles of structural and superficial similarity , 2000, Memory & cognition.

[117]  Kenneth D. Forbus,et al.  Extending SME to Handle Large-Scale Cognitive Modeling , 2017, Cogn. Sci..

[118]  Micah B. Goldwater,et al.  Categorizing entities by common role , 2011, Psychonomic bulletin & review.

[119]  Geoffrey Zweig,et al.  Combining Heterogeneous Models for Measuring Relational Similarity , 2013, NAACL.

[120]  John E. Hummel,et al.  Distributed representations of structure: A theory of analogical access and mapping. , 1997 .

[121]  R. Chaffin,et al.  Cognitive and Psychometric Analysis of Analogical Problem Solving , 1990 .

[122]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[123]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[124]  K. Holyoak,et al.  Analogical and category-based inference: a theoretical integration with Bayesian causal models. , 2010, Journal of experimental psychology. General.

[125]  M. Lassaline,et al.  Structural alignment in induction and similarity. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[126]  Mark T. Keane On Retrieving Analogues When Solving Problems , 1987 .

[127]  K. Holyoak,et al.  Causal learning and inference as a rational process: the new synthesis. , 2011, Annual review of psychology.

[128]  R. Anders,et al.  The Relational Luring Effect: Retrieval of Relational Information During Associative Recognition , 2017, Journal of experimental psychology. General.

[129]  Robert L. Goldstone,et al.  Relational similarity and the nonindependence of features in similarity judgments , 1991, Cognitive Psychology.

[130]  John E. Hummel,et al.  Computational Models of Higher Cognition , 2012 .

[131]  Jeffrey N. Chiang,et al.  Distributed Code for Semantic Relations Predicts Neural Similarity during Analogical Reasoning , 2020, Journal of Cognitive Neuroscience.

[132]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[133]  Hongjing Lu,et al.  Verbal analogy problem sets: An inventory of testing materials , 2020, Behavior research methods.

[134]  B. Ross This is like that: The use of earlier problems and the separation of similarity effects. , 1987 .

[135]  Linda B. Smith,et al.  Cross-cultural differences in cognitive development: attention to relations and objects. , 2012, Journal of experimental child psychology.

[136]  D. Klahr,et al.  Scientific Thinking and Reasoning , 2012 .

[137]  Graduated Assignment Graph Matching for Realtime Matching of Image Wireframes , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[138]  J. Bain,et al.  Induction of Relational Schemas: Common Processes in Reasoning and Complex Learning , 1998, Cognitive Psychology.

[139]  Micah B. Goldwater,et al.  Learning of role-governed and thematic categories. , 2016, Acta psychologica.

[140]  S. Phillips,et al.  Relational knowledge: the foundation of higher cognition , 2010, Trends in Cognitive Sciences.

[141]  Graeme S Halford,et al.  Acquisition of structured knowledge without instruction: the relational schema induction paradigm. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[142]  R. Morrison,et al.  Young children's analogical reasoning across cultures: similarities and differences. , 2010, Journal of experimental child psychology.

[143]  Joshua C. Peterson,et al.  Capturing human categorization of natural images by combining deep networks and cognitive models , 2020, Nature Communications.

[144]  S. Gelman,et al.  Generics license 30-month-olds' inferences about the atypical properties of novel kinds. , 2016, Developmental psychology.