Joint Learning of Entity and Type Embeddings for Analogical Reasoning with Entities

Two situations can be considered analogous if they share a common pattern. Analogical reasoning is the task of finding analogies and inferencing missing terms in them. Since natural language is ambiguous, as the same word can refer to different entities, the use of disambiguated entities from Knowledge Graphs for analogical reasoning might bring to better results. Also, entities have types, i.e. classes, in an ontology, from which they inherit characteristics and properties. In this work we focus on a method to represent entities and their types in a joint vector space to do analogical reasoning. We experiment our representations on a dataset that contains analogies on entities and we show that extending the entity representations with information coming from the types improves analogical reasoning results.

[1]  Paul Thagard,et al.  Analogical Mapping by Constraint Satisfaction , 1989, Cogn. Sci..

[2]  Zhiyuan Liu,et al.  Topical Word Embeddings , 2015, AAAI.

[3]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[4]  Hinrich Schütze,et al.  Multi-level Representations for Fine-Grained Typing of Knowledge Base Entities , 2017, EACL.

[5]  D. Gentner Analogical Reasoning, Psychology of , 2006 .

[6]  Kai-Wei Chang,et al.  Typed Tensor Decomposition of Knowledge Bases for Relation Extraction , 2014, EMNLP.

[7]  Jayant Krishnamurthy Finding analogies in semantic networks using the singular value decomposition , 2009 .

[8]  Raphaël Troncy,et al.  NERD: A Framework for Unifying Named Entity Recognition and Disambiguation Extraction Tools , 2012, EACL.

[9]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[10]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[11]  K. Holyoak Analogy and Relational Reasoning , 2012 .

[12]  Annalina Caputo,et al.  Learning to Rank Entity Relatedness Through Embedding-Based Features , 2016, NLDB.

[13]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[14]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[15]  Jane Yung-jen Hsu,et al.  Bridging Common Sense Knowledge Bases with Analogy by Graph Similarity , 2010, Collaboratively-Built Knowledge Sources and AI.

[16]  Douglas Summers-Stay Deductive and Analogical Reasoning on a Semantically Embedded Knowledge Graph , 2017, AGI.

[17]  Mark Dredze,et al.  Improving Lexical Embeddings with Semantic Knowledge , 2014, ACL.

[18]  Hans-Peter Kriegel,et al.  A Three-Way Model for Collective Learning on Multi-Relational Data , 2011, ICML.