Network Alignment With Holistic Embeddings

Network alignment is the task of identifying topologically and semantically similar node pairs that represent the same identity. This problem plays an important role in various application domains ranging from social network analysis to bioinformatic network interactions. However, existing alignment models either cannot handle large-scale graphs or fail to leverage different types of network information or modalities. In this paper, we propose a novel end-to-end alignment framework that can leverage different modalities to compare and align network nodes in an efficient way. More precisely, in order to exploit the richness of the network context, our model constructs multiple embeddings for each node, each of which captures one modality or type of network information. We then design a late-fusion mechanism to combine the learned embeddings based on the importance of the underlying information. Our fusion mechanism allows our model to be adapted to various type of structures of the input network. Experimental results show that our technique outperforms state-of-the-art approaches in terms of accuracy on real and synthetic datasets, while being robust against various noise factors.

[1]  Aaron Clauset,et al.  Evaluating Overfit and Underfit in Models of Network Community Structure , 2018, IEEE Transactions on Knowledge and Data Engineering.

[2]  Giorgios Kollias,et al.  Network Similarity Decomposition (NSD): A Fast and Scalable Approach to Network Alignment , 2012, IEEE Transactions on Knowledge and Data Engineering.

[3]  Reza Zafarani,et al.  User Identity Linkage across Online Social Networks: A Review , 2017, SKDD.

[4]  Elisa Bertino,et al.  Privacy-Preserving User Profile Matching in Social Networks , 2020, IEEE Transactions on Knowledge and Data Engineering.

[5]  Xiaolong Jin,et al.  Predict Anchor Links across Social Networks via an Embedding Approach , 2016, IJCAI.

[6]  Jörn Altmann,et al.  Effect of homophily on network formation , 2017, Commun. Nonlinear Sci. Numer. Simul..

[7]  Zhaohui Wu,et al.  Deep Learning of Graphs with Ngram Convolutional Neural Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[8]  Philip S. Yu,et al.  Heterogeneous Information Network Embedding for Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[9]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[10]  Mark Heimann,et al.  REGAL: Representation Learning-based Graph Alignment , 2018, CIKM.

[11]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[12]  Bonnie Berger,et al.  Global alignment of multiple protein interaction networks with application to functional orthology detection , 2008, Proceedings of the National Academy of Sciences.

[13]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[14]  A. Rbnyi ON THE EVOLUTION OF RANDOM GRAPHS , 2001 .

[15]  Nguyen Quoc Viet Hung,et al.  A comparative study on network alignment techniques , 2020, Expert Syst. Appl..

[16]  Philip S. Yu,et al.  Bag Constrained Structure Pattern Mining for Multi-Graph Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[17]  Ying Wang,et al.  Algorithms for Large, Sparse Network Alignment Problems , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[18]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[19]  Ken-ichi Kawarabayashi,et al.  Representation Learning on Graphs with Jumping Knowledge Networks , 2018, ICML.

[20]  Xin Liu,et al.  Evaluation of Community Detection Methods , 2018, IEEE Transactions on Knowledge and Data Engineering.

[21]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[22]  Alan C. Evans,et al.  BigBrain: An Ultrahigh-Resolution 3D Human Brain Model , 2013, Science.

[23]  Fumiko Kano Glückstad Terminological Ontology and Cognitive Processes in Translation , 2010, PACLIC.

[24]  Wenbing Huang,et al.  Unsupervised Adversarial Graph Alignment with Graph Embedding , 2019, ArXiv.

[25]  Danai Koutra,et al.  BIG-ALIGN: Fast Bipartite Graph Alignment , 2013, 2013 IEEE 13th International Conference on Data Mining.

[26]  Hassan Naderi,et al.  An Attribute-Specific Ranking Method Based on Language Models for Keyword Search over Graphs , 2020, IEEE Transactions on Knowledge and Data Engineering.

[27]  Shahin Mohammadi,et al.  Low Rank Spectral Network Alignment , 2018, WWW.

[28]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[29]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[30]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[31]  Zi Huang,et al.  Joint Event-Partner Recommendation in Event-Based Social Networks , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[32]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[33]  Bonnie Berger,et al.  IsoRankN: spectral methods for global alignment of multiple protein networks , 2009, Bioinform..

[34]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[35]  Lei Liu,et al.  DeepLink: A Deep Learning Approach for User Identity Linkage , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[36]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[37]  Eneko Agirre,et al.  Learning bilingual word embeddings with (almost) no bilingual data , 2017, ACL.

[38]  Quoc Viet Hung Nguyen,et al.  Entity Alignment for Knowledge Graphs With Multi-Order Convolutional Networks , 2020, IEEE Transactions on Knowledge and Data Engineering.

[39]  Matthias Weidlich,et al.  Adaptive Network Alignment with Unsupervised and Multi-order Convolutional Networks , 2020, 2020 IEEE 36th International Conference on Data Engineering (ICDE).

[40]  Quoc Viet Hung Nguyen,et al.  Structural representation learning for network alignment with self-supervised anchor links , 2021, Expert Syst. Appl..

[41]  Daeyoung Kim,et al.  ChronoGraph: Enabling Temporal Graph Traversals for Efficient Information Diffusion Analysis over Time , 2020, IEEE Transactions on Knowledge and Data Engineering.

[42]  Li Liu,et al.  Aligning Users across Social Networks Using Network Embedding , 2016, IJCAI.

[43]  Lejian Liao,et al.  Structural Representation Learning for User Alignment Across Social Networks , 2020, IEEE Transactions on Knowledge and Data Engineering.

[44]  Lei Chen,et al.  NSCaching: Simple and Efficient Negative Sampling for Knowledge Graph Embedding , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[45]  Zhichun Wang,et al.  Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks , 2018, EMNLP.

[46]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[47]  Lorena Otero-Cerdeira,et al.  Ontology matching: A literature review , 2015, Expert Syst. Appl..