Towards Improving Embedding Based Models of Social Network Alignment via Pseudo Anchors

Social network alignment aims at aligning person identities across social networks. Embedding based models have been shown effective for the alignment where the structural proximity preserving objective is typically adopted for the model training. With the observation that “overly-close” user embeddings are unavoidable for such models causing alignment inaccuracy, we propose a novel learning framework which tries to enforce the resulting embeddings to be more widely apart among the users via the introduction of carefully implanted pseudo anchors. We further proposed a meta-learning algorithm to guide the updating of the pseudo anchor embeddings during the learning process. The proposed intervention via the use of pseudo anchors and meta-learning allows the learning framework to be applicable to a wide spectrum of network alignment methods. We have incorporated the proposed learning framework into several state-of-the-art models. Our experimental results demonstrate its efficacy where the methods with the pseudo anchors implanted can outperform their counterparts without pseudo anchors by a fairly large margin, especially when there only exist very few labeled anchors.

[1]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[2]  Philip S. Yu,et al.  Multiple Anonymized Social Networks Alignment , 2015, 2015 IEEE International Conference on Data Mining.

[3]  Xiaoming Zhang,et al.  Distribution Distance Minimization for Unsupervised User Identity Linkage , 2018, CIKM.

[4]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[5]  Tingyang Xu,et al.  DropEdge: Towards Deep Graph Convolutional Networks on Node Classification , 2020, ICLR.

[6]  Xiaoyong Du,et al.  Structure Based User Identification across Social Networks , 2018, IEEE Transactions on Knowledge and Data Engineering.

[7]  Reza Zafarani,et al.  User Identity Linkage across Online Social Networks: A Review , 2017, SKDD.

[8]  Reza Zafarani,et al.  Connecting users across social media sites: a behavioral-modeling approach , 2013, KDD.

[9]  Philip S. Yu,et al.  Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphs , 2021, AAAI.

[10]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[11]  Hyperbolic User Identity Linkage across Social Networks , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[12]  Li Sun,et al.  MASTER: across Multiple social networks, integrate Attribute and STructure Embedding for Reconciliation , 2018, IJCAI.

[13]  Philip S. Yu,et al.  Integrated Anchor and Social Link Predictions across Social Networks , 2015, IJCAI.

[14]  Sree Hari Krishnan Parthasarathi,et al.  Exploiting innocuous activity for correlating users across sites , 2013, WWW.

[15]  Jingping Bi,et al.  Cross-Network Embedding for Multi-Network Alignment , 2019, WWW.

[16]  Zhoujun Li,et al.  Adversarial Learning for Weakly-Supervised Social Network Alignment , 2019, AAAI.

[17]  Li Liu,et al.  Aligning Users across Social Networks Using Network Embedding , 2016, IJCAI.

[18]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[19]  Xiaolong Jin,et al.  Predict Anchor Links across Social Networks via an Embedding Approach , 2016, IJCAI.

[20]  Yan Wang,et al.  ProNE: Fast and Scalable Network Representation Learning , 2019, IJCAI.

[21]  Chun Chen,et al.  Mapping Users across Networks by Manifold Alignment on Hypergraph , 2014, AAAI.

[22]  Peng Zhang,et al.  Nonlinear Dimensionality Reduction by Locally Linear Inlaying , 2009, IEEE Transactions on Neural Networks.

[23]  Katarzyna Musial,et al.  Multi-level Graph Convolutional Networks for Cross-platform Anchor Link Prediction , 2020, KDD.

[24]  Jian Li,et al.  NetSMF: Large-Scale Network Embedding as Sparse Matrix Factorization , 2019, WWW.

[25]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[26]  Alice H. Oh,et al.  How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervision , 2022, ICLR.

[27]  Mark Heimann,et al.  REGAL: Representation Learning-based Graph Alignment , 2018, CIKM.

[28]  Jia Wu,et al.  Deep Active Learning for Anchor User Prediction , 2019, IJCAI.

[29]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[30]  Li Sun,et al.  Reconciling Multiple Social Networks Effectively and Efficiently: An Embedding Approach , 2021, IEEE Transactions on Knowledge and Data Engineering.

[31]  Zhongbao Zhang,et al.  BANANA: when Behavior ANAlysis meets social Network Alignment , 2020, IJCAI.

[32]  Wei Xie,et al.  Unsupervised User Identity Linkage via Factoid Embedding , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[33]  Mark Heimann,et al.  CONE-Align: Consistent Network Alignment with Proximity-Preserving Node Embedding , 2020, CIKM.

[34]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[35]  Lei Liu,et al.  DeepLink: A Deep Learning Approach for User Identity Linkage , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[36]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[37]  Fan Zhou,et al.  Disentangled Network Alignment with Matching Explainability , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[38]  Jiuxin Cao,et al.  Multi-level Hyperedge Distillation for Social Linking Prediction on Sparsely Observed Networks , 2021, WWW.

[39]  Philip S. Yu,et al.  Perfect: A Hyperbolic Embedding for Joint User and Community Alignment , 2020, 2020 IEEE International Conference on Data Mining (ICDM).

[40]  Hongzhi Yin,et al.  Where are we in embedding spaces? , 2021, KDD.

[41]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[42]  Yong Cao,et al.  CoLink: An Unsupervised Framework for User Identity Linkage , 2018, AAAI.

[43]  Zhoujun Li,et al.  Partially Shared Adversarial Learning For Semi-supervised Multi-platform User Identity Linkage , 2019, CIKM.

[44]  Philip S. Yu,et al.  Inferring anchor links across multiple heterogeneous social networks , 2013, CIKM.

[45]  Danai Koutra,et al.  BIG-ALIGN: Fast Bipartite Graph Alignment , 2013, 2013 IEEE 13th International Conference on Data Mining.

[46]  Nicholas Jing Yuan,et al.  Little Is Much: Bridging Cross-Platform Behaviors through Overlapped Crowds , 2016, AAAI.

[47]  Lejian Liao,et al.  Structural Representation Learning for User Alignment Across Social Networks , 2020, IEEE Transactions on Knowledge and Data Engineering.

[48]  Jun Hu,et al.  ABNE: An Attention-Based Network Embedding for User Alignment Across Social Networks , 2019, IEEE Access.

[49]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[50]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[51]  Jian Li,et al.  Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec , 2017, WSDM.

[52]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[53]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[54]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.