Weakly Supervised Entity Alignment with Positional Inspiration

The current success of entity alignment (EA) is still mainly based on large-scale labeled anchor links. However, the refined annotation of anchor links still consumes a lot of manpower and material resources. As a result, an increasing number of works based on active learning, few-shot learning, or other deep network learning techniques have been developed to address the performance bottleneck caused by a lack of labeled data. These works focus either on the strategy of choosing more informative labeled data or on the strategy of model training, while it remains opaque why existing popular EA models (e.g., GNN-based models) fail the EA task with limited labeled data. To overcome this issue, this paper analyzes the problem of weakly supervised EA from the perspective of model design and proposes a novel weakly supervised learning framework, Position Enhanced Entity Alignment (PEEA). Besides absorbing structural and relational information, PEEA aims to increase the connections between far-away entities and labeled ones by incorporating positional information into the representation learning with a Position Attention Layer (PAL). To fully utilize the limited anchor links, we further introduce a novel position encoding method that considers both anchor links and relational information from a global view. The proposed position encoding will be fed into PEEA as additional entity features. Extensive experiments on public datasets demonstrate the effectiveness of PEEA.

[1]  Deepak Chaurasiya,et al.  RePS: Relation, Position and Structure aware Entity Alignment , 2022, WWW.

[2]  Jens Lehmann,et al.  Time-aware Graph Neural Network for Entity Alignment between Temporal Knowledge Graphs , 2022, EMNLP.

[3]  Jiuyang Tang,et al.  Reinforced Active Entity Alignment , 2021, CIKM.

[4]  Vijay Prakash Dwivedi,et al.  Graph Neural Networks with Learnable Structural and Positional Representations , 2021, ICLR.

[5]  Guido Zuccon,et al.  ActiveEA: Active Learning for Neural Entity Alignment , 2021, EMNLP.

[6]  Qi Qi,et al.  Deep graph alignment network , 2021, Neurocomputing.

[7]  Hanghang Tong,et al.  Balancing Consistency and Disparity in Network Alignment , 2021, KDD.

[8]  Yuanbin Wu,et al.  Are Negative Samples Necessary in Entity Alignment?: An Approach with High Performance, Scalability and Robustness , 2021, CIKM.

[9]  Carl Yang,et al.  On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs , 2021, CIKM.

[10]  Jiaoyan Chen,et al.  OntoEA: Ontology-guided Entity Alignment via Joint Knowledge Graph Embedding , 2021, FINDINGS.

[11]  Man Lan,et al.  Boosting the Speed of Entity Alignment 10 ×: Dual Attention Matching Network with Normalized Hard Sample Mining , 2021, WWW.

[12]  Xavier Bresson,et al.  A Generalization of Transformer Networks to Graphs , 2020, ArXiv.

[13]  Zhonghai Wu,et al.  Relation-Aware Neighborhood Matching Model for Entity Alignment , 2020, AAAI.

[14]  Juan-Zi Li,et al.  Exploring and Evaluating Attributes, Values, and Structure for Entity Alignment , 2020, Conference on Empirical Methods in Natural Language Processing.

[15]  Nigel Collier,et al.  Visual Pivoting for (Unsupervised) Entity Alignment , 2020, AAAI.

[16]  Wenting Wang,et al.  Relational Reflection Entity Alignment , 2020, CIKM.

[17]  Xiang Zhao,et al.  Degree-Aware Alignment for Entities in Tail , 2020, SIGIR.

[18]  Yansong Feng,et al.  Neighborhood Matching Network for Entity Alignment , 2020, ACL.

[19]  Zheng-Yu Niu,et al.  Knowledge Graph Grounded Goal Planning for Open-Domain Conversation Generation , 2020, AAAI.

[20]  Wei Hu,et al.  A benchmarking study of embedding-based entity alignment for knowledge graphs , 2020, Proc. VLDB Endow..

[21]  Xing Xie,et al.  A Survey on Knowledge Graph-Based Recommender Systems , 2020, IEEE Transactions on Knowledge and Data Engineering.

[22]  Volker Tresp,et al.  Active Learning for Entity Alignment , 2020, ECIR.

[23]  Wenting Wang,et al.  MRAEA: An Efficient and Robust Entity Alignment Approach for Cross-lingual Knowledge Graph , 2020, WSDM.

[24]  Wei Hu,et al.  Knowledge Graph Alignment Network with Gated Multi-hop Neighborhood Aggregation , 2019, AAAI.

[25]  Jaewoo Kang,et al.  Graph Transformer Networks , 2019, NeurIPS.

[26]  Chengjiang Li,et al.  Semi-supervised Entity Alignment via Joint Knowledge Embedding Model and Cross-graph Model , 2019, EMNLP.

[27]  Wei Hu,et al.  TransEdge: Translating Relation-Contextualized Embeddings for Knowledge Graphs , 2019, SEMWEB.

[28]  Jimmy J. Lin,et al.  Aligning Cross-Lingual Entities with Multi-Aspect Information , 2019, EMNLP.

[29]  Bruno Ribeiro,et al.  On the Equivalence between Positional Node Embeddings and Structural Graph Representations , 2019, ICLR.

[30]  Rui Zhang,et al.  Entity Alignment between Knowledge Graphs Using Attribute Embeddings , 2019, AAAI.

[31]  Jure Leskovec,et al.  Position-aware Graph Neural Networks , 2019, ICML.

[32]  Wei Hu,et al.  Learning to Exploit Long-term Relational Dependencies in Knowledge Graphs , 2019, ICML.

[33]  Lu Yu,et al.  Semi-Supervised Entity Alignment via Knowledge Graph Embedding with Awareness of Degree Difference , 2019, WWW.

[34]  Steven Skiena,et al.  Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignment , 2018, IJCAI.

[35]  Hang Yin,et al.  A loan application fraud detection method based on knowledge graph and neural network , 2018, ICIAI '18.

[36]  Guillaume Lample,et al.  Word Translation Without Parallel Data , 2017, ICLR.

[37]  Zhiyuan Liu,et al.  Iterative Entity Alignment via Joint Knowledge Embeddings , 2017, IJCAI.

[38]  Wei Hu,et al.  Cross-Lingual Entity Alignment via Joint Attribute-Preserving Embedding , 2017, SEMWEB.

[39]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[40]  Carlo Zaniolo,et al.  Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignment , 2016, IJCAI.

[41]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[42]  Marco Cuturi,et al.  Sinkhorn Distances: Lightspeed Computation of Optimal Transport , 2013, NIPS.

[43]  Christos Faloutsos,et al.  Fast Random Walk with Restart and Its Applications , 2006, Sixth International Conference on Data Mining (ICDM'06).

[44]  Vijay Prakash Dwivedi,et al.  Benchmarking Graph Neural Networks , 2023, J. Mach. Learn. Res..

[45]  Dan Roth,et al.  Cross-lingual Entity Alignment with Incidental Supervision , 2021, EACL.

[46]  Zhichun Wang,et al.  Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks , 2018, EMNLP.