Hybrid-TE: Hybrid Translation-Based Temporal Knowledge Graph Embedding

Knowledge graph embedding has become a promising method for knowledge graph completion. In this work, we propose Hybrid-TE, a hybrid translation-based temporal knowledge graph embedding, which combines two translation models TransD and HyTE for modeling both temporal and multirelational facts. Benefiting from two underlying models, Hybrid-TE first builds entity and relation embeddings in separate vector space for modelling multi-relational facts, and then explicitly learns time information by translational embedding on timespecific hyperplanes. We observe that a simple combination of two models does not lead to a satisfactory predictive precision. We therefore propose to project a triplet to all time-specific hyperplanes on which it is temporally valid. Besides, we also explore extra negative relation samplings that differ from positive samplings in relations. We conduct extensive experiments with real datasets on link prediction, relation prediction and temporal scope prediction. Experiments show significant improvements over previous time-insensitive or time-aware models.

[1]  Jun Zhao,et al.  Knowledge Graph Embedding via Dynamic Mapping Matrix , 2015, ACL.

[2]  Gerhard Weikum,et al.  WWW 2007 / Track: Semantic Web Session: Ontologies ABSTRACT YAGO: A Core of Semantic Knowledge , 2022 .

[3]  Pedro A. Szekely,et al.  Recurrent Event Network for Reasoning over Temporal Knowledge Graphs , 2019, ArXiv.

[4]  Partha Talukdar,et al.  HyTE: Hyperplane-based Temporally aware Knowledge Graph Embedding , 2018, EMNLP.

[5]  Michael Günther,et al.  Introducing Wikidata to the Linked Data Web , 2014, SEMWEB.

[6]  Julien Leblay,et al.  Deriving Validity Time in Knowledge Graph , 2018, WWW.

[7]  Zhendong Mao,et al.  Knowledge Graph Embedding: A Survey of Approaches and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[8]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[9]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[10]  Zhifang Sui,et al.  Towards Time-Aware Knowledge Graph Completion , 2016, COLING.

[11]  Zhifang Sui,et al.  Encoding Temporal Information for Time-Aware Link Prediction , 2016, EMNLP.

[12]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[13]  Volker Tresp,et al.  Predicting the co-evolution of event and Knowledge Graphs , 2015, 2016 19th International Conference on Information Fusion (FUSION).

[14]  Le Song,et al.  Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphs , 2017, ICML.

[15]  Danqi Chen,et al.  Learning New Facts From Knowledge Bases With Neural Tensor Networks and Semantic Word Vectors , 2013, ICLR.