Putting RDF2vec in Order

The RDF2vec method for creating node embeddings on knowledge graphs is based on word2vec, which, in turn, is agnostic towards the position of context words. In this paper, we argue that this might be a shortcoming when training RDF2vec, and show that using a word2vec variant which respects order yields considerable performance gains especially on tasks where entities of different classes are involved.

[1]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[2]  Heiko Paulheim,et al.  More is not Always Better: The Negative Impact of A-box Materialization on RDF2vec Knowledge Graph Embeddings , 2020, CIKM.

[3]  Chengsheng Mao,et al.  KG-BERT: BERT for Knowledge Graph Completion , 2019, ArXiv.

[4]  Heiko Paulheim,et al.  RDF2Vec Light - A Lightweight Approachfor Knowledge Graph Embeddings , 2020, SEMWEB.

[5]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[6]  Heiko Paulheim,et al.  A Collection of Benchmark Datasets for Systematic Evaluations of Machine Learning on the Semantic Web , 2016, SEMWEB.

[7]  Heiko Paulheim,et al.  Biased graph walks for RDF graph embeddings , 2017, WIMS.

[8]  Michael Cochez,et al.  GEval: A Modular and Extensible Evaluation Framework for Graph Embedding Techniques , 2020, ESWC.

[9]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[10]  Filip De Turck,et al.  Walk Extraction Strategies for Node Embeddings with RDF2Vec in Knowledge Graphs , 2020, DEXA Workshops.

[11]  Heiko Paulheim,et al.  Global RDF Vector Space Embeddings , 2017, SEMWEB.

[12]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[13]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[14]  Heiko Paulheim,et al.  RDF2Vec: RDF graph embeddings and their applications , 2019, Semantic Web.

[15]  Wang Ling,et al.  Two/Too Simple Adaptations of Word2Vec for Syntax Problems , 2015, NAACL.