Measuring Entity Relatedness via Entity and Text Joint Embedding

As unique identifiers of objects and basic components of knowledge graphs, entities are crucial to many natural language processing related works, such as entity linking and question answering, in which the estimation of entity relatedness is required. Current entity relatedness measures either consider entities as words, which neglects the rich semantics entities contain, or are integrated into extrinsic applications, which fail to evaluate the intrinsic effectiveness. In this work, we propose E5, an effective entity relatedness measure taking into account of entity description text in a neural embedding manner. We first jointly map words and entities to the same high-dimensional vector space, the output of which is utilized as the input for the following joint entity and text embedding training. The well-trained entity and text embedding network is then leveraged to measure similarity between entities and entity descriptions, which in combination with a graph structure based method, constitute the eventual entity relatedness measure. The experimental results validate the usefulness of E5.

[1]  James P. Callan,et al.  Explicit Semantic Ranking for Academic Search via Knowledge Graph Embedding , 2017, WWW.

[2]  Raphaël Troncy,et al.  GERBIL: General Entity Annotator Benchmarking Framework , 2015, WWW.

[3]  Zhiyuan Liu,et al.  Representation Learning for Measuring Entity Relatedness with Rich Information , 2015, IJCAI.

[4]  Soumen Chakrabarti,et al.  A Two-Stage Framework for Computing Entity Relatedness in Wikipedia , 2017, CIKM.

[5]  Sergey V. Sukhov,et al.  Knowledge Fusion in Feedforward Artificial Neural Networks , 2017, Neural Processing Letters.

[6]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[7]  Gerhard Weikum,et al.  KORE: keyphrase overlap relatedness for entity disambiguation , 2012, CIKM.

[8]  Salvatore Orlando,et al.  Learning relatedness measures for entity linking , 2013, CIKM.

[9]  Yidong Chen,et al.  Co-training for Implicit Discourse Relation Recognition Based on Manual and Distributed Features , 2017, Neural Processing Letters.

[10]  Taher H. Haveliwala Topic-sensitive PageRank , 2002, IEEE Trans. Knowl. Data Eng..

[11]  Hinrich Schütze,et al.  CoSimRank: A Flexible & Efficient Graph-Theoretic Similarity Measure , 2014, ACL.

[12]  Larry P. Heck,et al.  Leveraging Deep Neural Networks and Knowledge Graphs for Entity Disambiguation , 2015, ArXiv.

[13]  Paul Buitelaar,et al.  Wikipedia-Based Distributional Semantics for Entity Relatedness , 2014, AAAI Fall Symposia.

[14]  Licheng Jiao,et al.  Learning to Rank with Ensemble Ranking SVM , 2014, Neural Processing Letters.

[15]  Jiuyang Tang,et al.  Collective List-Only Entity Linking: A Graph-Based Approach , 2018, IEEE Access.

[16]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[17]  Michael R. Lyu,et al.  Aggregated Temporal Tensor Factorization Model for Point-of-Interest Recommendation , 2016, Neural Processing Letters.

[18]  Hiroyuki Shindo,et al.  Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation , 2016, CoNLL.

[19]  Michael Granitzer,et al.  Robust and Collective Entity Disambiguation through Semantic Embeddings , 2016, SIGIR.

[20]  Yang Wang,et al.  Efficient structure similarity searches: a partition-based approach , 2018, The VLDB Journal.

[21]  Ian H. Witten,et al.  An effective, low-cost measure of semantic relatedness obtained from Wikipedia links , 2008 .

[22]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[23]  Liqing Zhang,et al.  Content-Based Image Retrieval Using Iterative Search , 2017, Neural Processing Letters.

[24]  Evgeniy Gabrilovich,et al.  Computing Semantic Relatedness Using Wikipedia-based Explicit Semantic Analysis , 2007, IJCAI.

[25]  Hiroyuki Shindo,et al.  Learning Distributed Representations of Texts and Entities from Knowledge Base , 2017, TACL.

[26]  Chi-Keong Goh,et al.  Evolutionary Multi-task Learning for Modular Knowledge Representation in Neural Networks , 2018, Neural Processing Letters.

[27]  Dinggang Shen,et al.  Late Fusion Incomplete Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.