Fast Network Alignment via Graph Meta-Learning

Network alignment (NA) – i.e., linking entities from different networks (also known as identity linkage) – is a fundamental problem in many application domains. Recent advances in deep graph learning have inspired various auspicious approaches for tackling the NA problem. However, most of the existing works suffer from efficiency and generalization, due to complexities and redundant computations.We approach the NA from a different perspective, tackling it via meta-learning in a semi-supervised manner, and propose an effective and efficient approach called Meta-NA – a novel, conceptually simple, flexible, and general framework. Specifically, we reformulate NA as a one-shot classification problem and address it with a graph meta-learning framework. Meta-NA exploits the meta-metric learning from known anchor nodes to obtain latent priors for linking unknown anchor nodes. It contains multiple sub-networks corresponding to multiple graphs, learning a unified metric space, where one can easily link entities across different graphs. In addition to the performance lift, Meta-NA greatly improves the anchor linking generalization, significantly reduces the computational overheads, and is easily extendable to multi-network alignment scenarios. Extensive experiments conducted on three real-world datasets demonstrate the superiority of Meta-NA over several state-of-the-art baselines in terms of both alignment accuracy and learning efficiency.

[1]  Sebastian Thrun,et al.  Learning to Learn , 1998, Springer US.

[2]  Yong Li,et al.  DPLink: User Identity Linkage via Deep Neural Network From Heterogeneous Mobility Data , 2019, WWW.

[3]  Wei Xie,et al.  Unsupervised User Identity Linkage via Factoid Embedding , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[4]  Jianxi Fan,et al.  TransLink: User Identity Linkage across Heterogeneous Social Networks via Translating Embeddings , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[5]  Philip S. Yu,et al.  COSNET: Connecting Heterogeneous Social Networks with Local and Global Consistency , 2015, KDD.

[6]  Nicholas Jing Yuan,et al.  Little Is Much: Bridging Cross-Platform Behaviors through Overlapped Crowds , 2016, AAAI.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Fan Zhou,et al.  Disentangled Network Alignment with Matching Explainability , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[9]  Ji Geng,et al.  Meta-GNN: On Few-shot Node Classification in Graph Meta-learning , 2019, CIKM.

[10]  Hongxia Jin,et al.  Controllable Information Sharing for User Accounts Linkage across Multiple Online Social Networks , 2014, CIKM.

[11]  Reza Zafarani,et al.  User Identity Linkage across Online Social Networks: A Review , 2017, SKDD.

[12]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[14]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[15]  Xiang-Yang Li,et al.  De-anonymizing social networks and inferring private attributes using knowledge graphs , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[16]  Qiang Yang,et al.  Transfer Meets Hybrid: A Synthetic Approach for Cross-Domain Collaborative Filtering with Text , 2019, WWW.

[17]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[18]  Hong Yu,et al.  Meta Networks , 2017, ICML.

[19]  Charu C. Aggarwal,et al.  Meta Diagram Based Active Social Networks Alignment , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[20]  Vito Latora,et al.  Structural reducibility of multilayer networks , 2015, Nature Communications.

[21]  Bonnie Berger,et al.  Global alignment of multiple protein interaction networks with application to functional orthology detection , 2008, Proceedings of the National Academy of Sciences.

[22]  Jingping Bi,et al.  Cross-Network Embedding for Multi-Network Alignment , 2019, WWW.

[23]  Zhoujun Li,et al.  Adversarial Learning for Weakly-Supervised Social Network Alignment , 2019, AAAI.

[24]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[25]  Li Liu,et al.  Aligning Users across Social Networks Using Network Embedding , 2016, IJCAI.

[26]  Wei Chen,et al.  Effective and Efficient User Account Linkage across Location Based Social Networks , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[27]  Jing Xiao,et al.  User Identity Linkage by Latent User Space Modelling , 2016, KDD.

[28]  Philip S. Yu,et al.  Integrated Anchor and Social Link Predictions across Social Networks , 2015, IJCAI.

[29]  Tao Xiang,et al.  Learning to Compare: Relation Network for Few-Shot Learning , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[31]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[32]  Kilian Q. Weinberger,et al.  Simplifying Graph Convolutional Networks , 2019, ICML.

[33]  Hugo Larochelle,et al.  Optimization as a Model for Few-Shot Learning , 2016, ICLR.

[34]  Mike Tyers,et al.  BioGRID: a general repository for interaction datasets , 2005, Nucleic Acids Res..

[35]  Reza Zafarani,et al.  Connecting users across social media sites: a behavioral-modeling approach , 2013, KDD.

[36]  Luca Bertinetto,et al.  Learning feed-forward one-shot learners , 2016, NIPS.

[37]  Sree Hari Krishnan Parthasarathi,et al.  Exploiting innocuous activity for correlating users across sites , 2013, WWW.

[38]  Xiaoping Zhou,et al.  Cross-Platform Identification of Anonymous Identical Users in Multiple Social Media Networks , 2016, IEEE Transactions on Knowledge and Data Engineering.

[39]  Dawn Xiaodong Song,et al.  On the Feasibility of Internet-Scale Author Identification , 2012, 2012 IEEE Symposium on Security and Privacy.

[40]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[41]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[42]  Philip S. Yu,et al.  Inferring anchor links across multiple heterogeneous social networks , 2013, CIKM.

[43]  Chunyan Feng,et al.  User identity linkage across social networks via linked heterogeneous network embedding , 2018, World Wide Web.

[44]  Daan Wierstra,et al.  Meta-Learning with Memory-Augmented Neural Networks , 2016, ICML.

[45]  Danai Koutra,et al.  BIG-ALIGN: Fast Bipartite Graph Alignment , 2013, 2013 IEEE 13th International Conference on Data Mining.

[46]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[47]  Lei Liu,et al.  DeepLink: A Deep Learning Approach for User Identity Linkage , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[48]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[49]  Philip S. Yu,et al.  PCT: Partial Co-Alignment of Social Networks , 2016, WWW.

[50]  Chun Chen,et al.  Mapping Users across Networks by Manifold Alignment on Hypergraph , 2014, AAAI.

[51]  Xianfeng Tang,et al.  Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Prediction , 2019, WWW.

[52]  Yong Cao,et al.  CoLink: An Unsupervised Framework for User Identity Linkage , 2018, AAAI.

[53]  Philip S. Yu,et al.  Link Prediction across Aligned Networks with Sparse and Low Rank Matrix Estimation , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[54]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.