Robust Attributed Graph Alignment via Joint Structure Learning and Optimal Transport

—Graph alignment, which aims at identifying cor- responding entities across multiple networks, has been widely applied in various domains. As the graphs to be aligned are usu- ally constructed from different sources, the inconsistency issues of structures and features between two graphs are ubiquitous in real-world applications. Most existing methods follow the “embed-then-cross-compare” paradigm, which computes node embeddings in each graph and then processes node correspondences based on cross-graph embedding comparison. However, we find these methods are unstable and sub-optimal when structure or feature inconsistency appears. To this end, we propose SLOTAlign, an unsupervised graph alignment framework that jointly performs Structure Learning and Optimal Transport Alignment. We convert graph alignment to an optimal transport problem between two intra-graph matrices without the requirement of cross-graph comparison. We further incorporate multi-view structure learning to enhance graph representation power and reduce the effect of structure and feature inconsistency inherited across graphs. Moreover, an alternating scheme based algorithm has been developed to address the joint optimization problem in SLOTAlign, and the provable convergence result is also established. Finally, we conduct extensive experiments on six unsupervised graph alignment datasets and the DBP15K knowledge graph (KG) alignment benchmark dataset. The proposed SLOTAlign shows superior performance and strongest robustness over seven unsupervised graph alignment methods and five specialized KG alignment methods. 1

[1]  Jie Yin,et al.  Conflict-Aware Pseudo Labeling via Optimal Transport for Entity Alignment , 2022, 2022 IEEE International Conference on Data Mining (ICDM).

[2]  Lei Chen,et al.  Robust Network Enhancement From Flawed Networks , 2022, IEEE Transactions on Knowledge and Data Engineering.

[3]  Ruoming Jin,et al.  Unsupervised Adversarial Network Alignment with Reinforcement Learning , 2021, ACM Trans. Knowl. Discov. Data.

[4]  Jianheng Tang,et al.  Rethinking Graph Neural Networks for Anomaly Detection , 2022, ICML.

[5]  Jia Li,et al.  Uncertainty-aware Pseudo Label Refinery for Entity Alignment , 2022, WWW.

[6]  E. Kharlamov,et al.  SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs , 2022, WWW.

[7]  Wei Wang,et al.  On entity alignment at scale , 2022, The VLDB Journal.

[8]  Jiuyang Tang,et al.  An Experimental Study of State-of-the-Art Entity Alignment Approaches , 2020, IEEE Transactions on Knowledge and Data Engineering.

[9]  Daniel Matthew Cer,et al.  Language-agnostic BERT Sentence Embedding , 2020, ACL.

[10]  J. Blanchet,et al.  Fast and Provably Convergent Algorithms for Gromov-Wasserstein in Graph Learning , 2022, ArXiv.

[11]  Yueting Li,et al.  Deconvolutional Networks on Graph Data , 2021, NeurIPS.

[12]  Panagiotis Karras,et al.  Boosting Graph Alignment Algorithms , 2021, CIKM.

[13]  Junzhou Huang,et al.  Unsupervised Large-Scale Social Network Alignment via Cross Network Embedding , 2021, CIKM.

[14]  Yuanbin Wu,et al.  From Alignment to Assignment: Frustratingly Simple Unsupervised Entity Alignment , 2021, EMNLP.

[15]  Paris A. Karakasis,et al.  Joint Graph Embedding and Alignment with Spectral Pivot , 2021, KDD.

[16]  Hanghang Tong,et al.  Balancing Consistency and Disparity in Network Alignment , 2021, KDD.

[17]  Baihua Zheng,et al.  LargeEA: Aligning Entities for Large-scale Knowledge Graphs , 2021, Proc. VLDB Endow..

[18]  A. Bronstein,et al.  GRASP: Graph Alignment through Spectral Signatures , 2021, APWeb/WAIM.

[19]  Hanghang Tong,et al.  Attent: Active Attributed Network Alignment , 2021, WWW.

[20]  Hanghang Tong,et al.  BRIGHT: A Bridging Algorithm for Network Alignment , 2021, WWW.

[21]  Nicolas Courty,et al.  Online Graph Dictionary Learning , 2021, ICML.

[22]  Hong Cheng,et al.  Mask-GVAE: Blind Denoising Graphs via Partition , 2021, WWW.

[23]  Hongyuan Zha,et al.  Learning Graphons via Structured Gromov-Wasserstein Barycenters , 2020, AAAI.

[24]  Nigel Collier,et al.  Visual Pivoting for (Unsupervised) Entity Alignment , 2020, AAAI.

[25]  Samir Chowdhury,et al.  Generalized Spectral Clustering via Gromov-Wasserstein Learning , 2020, AISTATS.

[26]  Jiejun Xu,et al.  Deep Adversarial Network Alignment , 2019, CIKM.

[27]  Jundong Li,et al.  Unsupervised Graph Alignment with Wasserstein Distance Discriminator , 2021, KDD.

[28]  Rémi Gribonval,et al.  Graph Diffusion Wasserstein Distances , 2020, ECML/PKDD.

[29]  Wenting Wang,et al.  Relational Reflection Entity Alignment , 2020, CIKM.

[30]  Danai Koutra,et al.  CONE-Align: Consistent Network Alignment with Proximity-Preserving Node Embedding , 2020, CIKM.

[31]  Wei Hu,et al.  A benchmarking study of embedding-based entity alignment for knowledge graphs , 2020, Proc. VLDB Endow..

[32]  Nils M. Kriege,et al.  Deep Graph Matching Consensus , 2020, ICLR.

[33]  Zhoujun Li,et al.  Partially Shared Adversarial Learning For Semi-supervised Multi-platform User Identity Linkage , 2019, CIKM.

[34]  G. Karypis,et al.  Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks. , 2019 .

[35]  Hanghang Tong,et al.  Attributed Network Alignment: Problem Definitions and Fast Solutions , 2019, IEEE Transactions on Knowledge and Data Engineering.

[36]  Rui Zhang,et al.  Entity Alignment between Knowledge Graphs Using Attribute Embeddings , 2019, AAAI.

[37]  Wenbing Huang,et al.  Unsupervised Adversarial Graph Alignment with Graph Embedding , 2019, ArXiv.

[38]  Yuzhong Qu,et al.  Multi-view Knowledge Graph Embedding for Entity Alignment , 2019, IJCAI.

[39]  Marco Cuturi,et al.  Computational Optimal Transport: With Applications to Data Science , 2019 .

[40]  Nicolas Courty,et al.  Sliced Gromov-Wasserstein , 2019, NeurIPS.

[41]  Lawrence Carin,et al.  Scalable Gromov-Wasserstein Learning for Graph Partitioning and Matching , 2019, NeurIPS.

[42]  Stefanie Jegelka,et al.  Learning Generative Models across Incomparable Spaces , 2019, ICML.

[43]  Jingping Bi,et al.  Cross-Network Embedding for Multi-Network Alignment , 2019, WWW.

[44]  Kilian Q. Weinberger,et al.  Simplifying Graph Convolutional Networks , 2019, ICML.

[45]  Hongyuan Zha,et al.  Gromov-Wasserstein Learning for Graph Matching and Node Embedding , 2019, ICML.

[46]  Nicolas Courty,et al.  Optimal Transport for structured data with application on graphs , 2018, ICML.

[47]  Nicolas Courty,et al.  Fused Gromov-Wasserstein distance for structured objects: theoretical foundations and mathematical properties , 2018, Algorithms.

[48]  Xiaoming Zhang,et al.  Distribution Distance Minimization for Unsupervised User Identity Linkage , 2018, CIKM.

[49]  Mark Heimann,et al.  HashAlign: Hash-Based Alignment of Multiple Graphs , 2018, PAKDD.

[50]  J. Leskovec,et al.  Network enhancement as a general method to denoise weighted biological networks , 2018, Nature Communications.

[51]  Lei Liu,et al.  DeepLink: A Deep Learning Approach for User Identity Linkage , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[52]  Mark Heimann,et al.  REGAL: Representation Learning-based Graph Alignment , 2018, CIKM.

[53]  Wei Hu,et al.  Cross-Lingual Entity Alignment via Joint Attribute-Preserving Embedding , 2017, SEMWEB.

[54]  Jure Leskovec,et al.  Predicting multicellular function through multi-layer tissue networks , 2017, Bioinform..

[55]  Jinhui Xu,et al.  Novel Geometric Approach for Global Alignment of PPI Networks , 2017, AAAI.

[56]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[57]  Seyed Hamed Hassani,et al.  PROPER: global protein interaction network alignment through percolation matching , 2016, BMC Bioinformatics.

[58]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[59]  Jing Xiao,et al.  User Identity Linkage by Latent User Space Modelling , 2016, KDD.

[60]  Vladimir G. Kim,et al.  Entropic metric alignment for correspondence problems , 2016, ACM Trans. Graph..

[61]  Li Liu,et al.  Aligning Users across Social Networks Using Network Embedding , 2016, IJCAI.

[62]  Xiaolong Jin,et al.  Predict Anchor Links across Social Networks via an Embedding Approach , 2016, IJCAI.

[63]  Philip S. Yu,et al.  COSNET: Connecting Heterogeneous Social Networks with Local and Global Consistency , 2015, KDD.

[64]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[65]  Marco Cuturi,et al.  Sinkhorn Distances: Lightspeed Computation of Optimal Transport , 2013, NIPS.

[66]  Jure Leskovec,et al.  Learning to Discover Social Circles in Ego Networks , 2012, NIPS.

[67]  Facundo Mémoli,et al.  Gromov–Wasserstein Distances and the Metric Approach to Object Matching , 2011, Found. Comput. Math..

[68]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[69]  Jie Tang,et al.  ArnetMiner: extraction and mining of academic social networks , 2008, KDD.

[70]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[71]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..