MultiSAGE: a multiplex embedding algorithm for inter-layer link prediction

Research on graph representation learning has received great attention in recent years. However, most of the studies so far have focused on the embedding of single-layer graphs. The few studies dealing with the problem of representation learning of multilayer structures rely on the strong hypothesis that the inter-layer links are known, and this limits the range of possible applications. Here we propose MultiSAGE, a generalization of the GraphSAGE algorithm that allows to embed multiplex networks. We show that MultiSAGE is capable to reconstruct both the intra-layer and the inter-layer connectivity, outperforming GraphSAGE, which has been designed for simple graphs. Next, through a comprehensive experimental analysis, we shed light also on the performance of the embedding, both in simple and in multiplex networks, showing that either the density of the graph or the randomness of the links strongly influences the quality of the embedding.

[1]  Maoguo Gong,et al.  Heuristic 3D Interactive Walks for Multilayer Network Embedding , 2020, IEEE Transactions on Knowledge and Data Engineering.

[2]  Shuiwang Ji,et al.  Towards Deeper Graph Neural Networks , 2020, KDD.

[3]  Chang Zhou,et al.  Understanding Negative Sampling in Graph Representation Learning , 2020, KDD.

[4]  Martin Grohe,et al.  word2vec, node2vec, graph2vec, X2vec: Towards a Theory of Vector Embeddings of Structured Data , 2020, PODS.

[5]  Philip S. Yu,et al.  A Survey on Knowledge Graphs: Representation, Acquisition, and Applications , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Davide Bacciu,et al.  A Gentle Introduction to Deep Learning for Graphs , 2019, Neural Networks.

[7]  C.-C. Jay Kuo,et al.  Graph representation learning: a survey , 2019, APSIPA Transactions on Signal and Information Processing.

[8]  Junzhou Huang,et al.  DropEdge: Towards Deep Graph Convolutional Networks on Node Classification , 2019, ICLR.

[9]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jie Tang,et al.  Representation Learning for Attributed Multiplex Heterogeneous Network , 2019, KDD.

[11]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[12]  Liwei Qiu,et al.  Scalable Multiplex Network Embedding , 2018, IJCAI.

[13]  Yamir Moreno,et al.  Multiplex Networks: Basic Formalism and Structural Properties , 2018 .

[14]  Jiawei Han,et al.  mvn2vec: Preservation and Collaboration in Multi-View Network Embedding , 2018, ArXiv.

[15]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[16]  Jiawei Han,et al.  An Attention-based Collaboration Framework for Multi-View Network Representation Learning , 2017, CIKM.

[17]  Weiyi Liu,et al.  Principled Multilayer Network Embedding , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[18]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[19]  Prateek Mittal,et al.  Graph Data Anonymization, De-Anonymization Attacks, and De-Anonymizability Quantification: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[20]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[21]  Matteo Magnani,et al.  Multilayer Social Networks , 2016 .

[22]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[23]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[24]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[25]  Vito Latora,et al.  Structural reducibility of multilayer networks , 2014, Nature Communications.

[26]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[27]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[28]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[29]  Vito Latora,et al.  Structural measures for multiplex networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  A. Arenas,et al.  Mathematical Formulation of Multilayer Networks , 2013, 1307.4977.

[31]  R. Comunian,et al.  Social Network Analysis , 2011, Sports Analytics.

[32]  Kurt Mehlhorn,et al.  Weisfeiler-Lehman Graph Kernels , 2011, J. Mach. Learn. Res..

[33]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[34]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[35]  Andrzej Rucinski,et al.  Random Graphs , 2018, Foundations of Data Science.

[36]  Mike Tyers,et al.  BioGRID: a general repository for interaction datasets , 2005, Nucleic Acids Res..

[37]  Johan Bollen,et al.  Co-authorship networks in the digital library research community , 2005, Inf. Process. Manag..

[38]  N. Gulbahce,et al.  Network medicine: a network-based approach to human disease , 2010, Nature Reviews Genetics.