Learn from Relational Correlations and Periodic Events for Temporal Knowledge Graph Reasoning

Reasoning on temporal knowledge graphs (TKGR), aiming to infer missing events along the timeline, has been widely studied to alleviate incompleteness issues in TKG, which is composed of a series of KG snapshots at different timestamps. Two types of information, i.e., intra-snapshot structural information and inter-snapshot temporal interactions, mainly contribute to the learned representations for reasoning in previous models. However, these models fail to leverage (1) semantic correlations between relationships for the former information and (2) the periodic temporal patterns along the timeline for the latter one. Thus, such insufficient mining manners hinder expressive ability, leading to sub-optimal performances. To address these limitations, we propose a novel reasoning model, termed RPC, which sufficiently mines the information underlying the Relational correlations and Periodic patterns via two novel Correspondence units, i.e., relational correspondence unit (RCU) and periodic correspondence unit (PCU). Concretely, relational graph convolutional network (RGCN) and RCU are used to encode the intra-snapshot graph structural information for entities and relations, respectively. Besides, the gated recurrent units (GRU) and PCU are designed for sequential and periodic inter-snapshot temporal interactions, separately. Moreover, the model-agnostic time vectors are generated by time2vector encoders to guide the time-dependent decoder for fact scoring. Extensive experiments on six benchmark datasets show that RPC outperforms the state-of-the-art TKGR models, and also demonstrate the effectiveness of two novel strategies in our model.

[1]  Jianxin Li,et al.  Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignment , 2023, WWW.

[2]  Huawei Shen,et al.  Predicting the Silent Majority on Graphs: Knowledge Transferable Graph Neural Network , 2023, WWW.

[3]  Yue Liu,et al.  Hard Sample Aware Network for Contrastive Deep Graph Clustering , 2022, AAAI.

[4]  Jian Wang,et al.  Knowledge-Enhanced Dual Graph Neural Network for Robust Medicine Recommendation , 2022, IEEE International Conference on Bioinformatics and Biomedicine.

[5]  Xiang Ao,et al.  Along the Time: Timeline-traced Embedding for Temporal Knowledge Graph Completion , 2022, International Conference on Information and Knowledge Management.

[6]  Jiaming Wu,et al.  Embedding Global and Local Influences for Dynamic Graphs , 2022, CIKM.

[7]  Jeff Z. Pan,et al.  Relational Message Passing for Fully Inductive Knowledge Graph Completion , 2022, 2023 IEEE 39th International Conference on Data Engineering (ICDE).

[8]  Ee-Peng Lim,et al.  Explanation Guided Contrastive Learning for Sequential Recommendation , 2022, CIKM.

[9]  Huawei Shen,et al.  Company-as-Tribe: Company Financial Risk Assessment on Tribe-Style Graph with Hierarchical Graph Neural Networks , 2022, Knowledge Discovery and Data Mining.

[10]  Kuan-Ching Li,et al.  Local Sample-weighted Multiple Kernel Clustering with Consensus Discriminative Graph , 2022, IEEE transactions on neural networks and learning systems.

[11]  Shiliang Sun,et al.  TiRGN: Time-Guided Recurrent Graph Network with Local-Global Historical Patterns for Temporal Knowledge Graph Reasoning , 2022, IJCAI.

[12]  Shengsheng Qian,et al.  Knowledge-Enhanced Attributed Multi-Task Learning for Medicine Recommendation , 2022, ACM Trans. Inf. Syst..

[13]  J. Guo,et al.  Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning , 2022, ACL.

[14]  C. Faloutsos,et al.  EvoKG: Jointly Modeling Event Time and Network Structure for Reasoning over Temporal Knowledge Graphs , 2022, WSDM.

[15]  En Zhu,et al.  Deep Graph Clustering via Dual Correlation Reduction , 2021, AAAI.

[16]  Ke Liang,et al.  MKA: A Scalable Medical Knowledge-Assisted Mechanism for Generative Models on Medical Conversation Tasks , 2021, Computational and mathematical methods in medicine.

[17]  Zhen Han,et al.  TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting , 2021, EMNLP.

[18]  Peng Zhang,et al.  HIP Network: Historical Information Passing Network for Extrapolation Reasoning on Temporal Knowledge Graph , 2021, IJCAI.

[19]  Meng Liu,et al.  Inductive Representation Learning in Temporal Networks via Mining Neighborhood and Community Influences , 2021, SIGIR.

[20]  Jiafeng Guo,et al.  Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs , 2021, ACL.

[21]  Jens Lehmann,et al.  Temporal Knowledge Graph Completion using a Linear Temporal Regularizer and Multivector Embeddings , 2021, NAACL.

[22]  Xueqi Cheng,et al.  Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning , 2021, SIGIR.

[23]  M. Coates,et al.  TIE: A Framework for Embedding-based Incremental Temporal Knowledge Graph Completion , 2021, SIGIR.

[24]  Jiajun Chen,et al.  Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphs , 2021, AAAI.

[25]  Yunpu Ma,et al.  Learning Neural Ordinary Equations for Forecasting Future Links on Temporal Knowledge Graphs , 2021, EMNLP.

[26]  Changjun Fan,et al.  Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networks , 2020, AAAI.

[27]  Jieren Cheng,et al.  Deep Fusion Clustering Network , 2020, AAAI.

[28]  Ariel Felner,et al.  Multi-Directional Heuristic Search , 2020, IJCAI.

[29]  Adriana Kovashka,et al.  Story Completion with Explicit Modeling of Commonsense Knowledge , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  G. Obozinski,et al.  Tensor Decompositions for temporal knowledge base completion , 2020, ICLR.

[31]  Stephan Günnemann,et al.  Graph Hawkes Neural Network for Forecasting on Temporal Knowledge Graphs , 2020, AKBC.

[32]  Jens Lehmann,et al.  Temporal Knowledge Graph Completion Based on Time Series Gaussian Embedding , 2019, SEMWEB.

[33]  William L. Hamilton,et al.  Inductive Relation Prediction by Subgraph Reasoning , 2019, ICML.

[34]  Sanjay Thakur,et al.  Time2Vec: Learning a Vector Representation of Time , 2019, ArXiv.

[35]  Hongyuan Zha,et al.  DyRep: Learning Representations over Dynamic Graphs , 2019, ICLR.

[36]  Xiang Ren,et al.  Recurrent Event Network: Autoregressive Structure Inference over Temporal Knowledge Graphs , 2019, EMNLP.

[37]  Bowen Zhou,et al.  End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion , 2018, AAAI.

[38]  Zhou Yu,et al.  Incorporating Structured Commonsense Knowledge in Story Completion , 2018, AAAI.

[39]  Pietro Cavallo,et al.  Relational Graph Attention Networks , 2018, ArXiv.

[40]  Mathias Niepert,et al.  Learning Sequence Encoders for Temporal Knowledge Graph Completion , 2018, EMNLP.

[41]  Zhiyuan Liu,et al.  Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrieval , 2018, ACL.

[42]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[43]  Le Song,et al.  Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphs , 2017, ICML.

[44]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[45]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[46]  Xavier Bresson,et al.  Structured Sequence Modeling with Graph Convolutional Recurrent Networks , 2016, ICONIP.

[47]  Gary G. Yen,et al.  Minimum Manhattan Distance Approach to Multiple Criteria Decision Making in Multiobjective Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[48]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[49]  J. Gower Properties of Euclidean and non-Euclidean distance matrices , 1985 .

[50]  Yue Liu,et al.  Relational Symmetry based Knowledge Graph Contrastive Learning , 2022, ArXiv.

[51]  Yue Liu,et al.  Reasoning over Different Types of Knowledge Graphs: Static, Temporal and Multi-Modal , 2022, ArXiv.

[52]  Volker Tresp,et al.  Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs , 2021, ICLR.

[53]  Sharon Heidenreich Completion , 2019, Englisch für Architekten und Bauingenieure - English for Architects and Civil Engineers.

[54]  Partha Talukdar,et al.  HyTE: Hyperplane-based Temporally aware Knowledge Graph Embedding , 2018, EMNLP.

[55]  Miguel E. Rodríguez,et al.  Temporal Reasoning Over Event Knowledge Graphs , 2018 .