Layer Information Similarity Concerned Network Embedding

Great achievements have been made in network embedding based on single-layer networks. However, there are a variety of scenarios and systems that can be presented as multiplex networks, which can reveal more interesting patterns hidden in the data compared to single-layer networks. In the field of network embedding, in order to project the multiplex network into the latent space, it is necessary to consider richer structural information among network layers. However, current methods for multiplex network embedding mostly focus on the similarity of nodes in each layer of the network, while ignoring the similarity between different layers. In this paper, for multiplex network embedding, we propose a Layer Information Similarity Concerned Network Embedding (LISCNE) model considering the similarities between layers. Firstly, we introduce the common vector for each node shared by all layers and layer vectors for each layer where common vectors obtain the overall structure of the multiplex network and layer vectors learn semantics for each layer. We get the node embeddings in each layer by concatenating the common vectors and layer vectors with the consideration that the node embedding is related not only to the surrounding neighbors but also to the overall semantics. Furthermore, we define an index to formalize the similarity between different layers and the cross-network association. Constrained by layer similarity, the layer vectors with greater similarity are closer to each other and the aligned node embedding in these layers is also closer. To evaluate our proposed model, we conduct node classification and link prediction tasks to verify the effectiveness of our model, and the results show that LISCNE can achieve better or comparable performance compared to existing baseline methods.

[1]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[2]  Kevin Chen-Chuan Chang,et al.  A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[3]  Arunkumar Bagavathi,et al.  Multi-Net: A Scalable Multiplex Network Embedding Framework , 2018, COMPLEX NETWORKS.

[4]  Mahdi Jalili,et al.  Link Prediction in Multiplex Networks based on Interlayer Similarity , 2019, Physica A: Statistical Mechanics and its Applications.

[5]  Lin Li,et al.  Trio-based collaborative multi-view graph clustering with multiple constraints , 2021, Inf. Process. Manag..

[6]  C. Winick.  The Diffusion of an Innovation Among Physicians , 2016 .

[7]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[8]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[9]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[10]  J. Coleman,et al.  The Diffusion of an Innovation Among Physicians , 1957 .

[11]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[12]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[13]  Weiyi Liu,et al.  Principled Multilayer Network Embedding , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[14]  Maoguo Gong,et al.  Heuristic 3D Interactive Walks for Multilayer Network Embedding , 2020, IEEE Transactions on Knowledge and Data Engineering.

[15]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[16]  Liwei Qiu,et al.  Scalable Multiplex Network Embedding , 2018, IJCAI.

[17]  Philip S. Yu,et al.  Multi-view Clustering with Graph Embedding for Connectome Analysis , 2017, CIKM.

[18]  Philip S. Yu,et al.  A Survey of Community Detection Approaches: From Statistical Modeling to Deep Learning , 2021, IEEE Transactions on Knowledge and Data Engineering.

[19]  Mounir Ghogho,et al.  GraphCL: Contrastive Self-Supervised Learning of Graph Representations , 2020, ArXiv.

[20]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[21]  Jingping Bi,et al.  Cross-Network Embedding for Multi-Network Alignment , 2019, WWW.

[22]  Vasant Honavar,et al.  MEGAN: A Generative Adversarial Network for Multi-View Network Embedding , 2019, IJCAI.

[23]  Jiawei Han,et al.  Deep multiplex graph infomax: Attentive multiplex network embedding using global information , 2020, Knowl. Based Syst..

[24]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[25]  Vasant Honavar,et al.  Multi-view Network Embedding via Graph Factorization Clustering and Co-regularized Multi-view Agreement , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[26]  Jie Tang,et al.  Representation Learning for Attributed Multiplex Heterogeneous Network , 2019, KDD.

[27]  Charu C. Aggarwal,et al.  Multi-dimensional Graph Convolutional Networks , 2018, SDM.

[28]  Qiang Liu,et al.  Deep Graph Contrastive Representation Learning , 2020, ArXiv.

[29]  Xiao Liu,et al.  Co-Regularized Deep Multi-Network Embedding , 2018, WWW.

[30]  Tony Jebara,et al.  Structure preserving embedding , 2009, ICML '09.

[31]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[32]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[33]  Hamid R. Rabiee,et al.  MGCN: Semi-supervised Classification in Multi-layer Graphs with Graph Convolutional Networks , 2018, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[34]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[35]  Vito Latora,et al.  Structural reducibility of multilayer networks , 2015, Nature Communications.

[36]  Longin Jan Latecki,et al.  Rank-based self-training for graph convolutional networks , 2021, Inf. Process. Manag..

[37]  Koushik Mallick,et al.  Topo2Vec: A Novel Node Embedding Generation Based on Network Topology for Link Prediction , 2019, IEEE Transactions on Computational Social Systems.

[38]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[39]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[40]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[41]  Mike Tyers,et al.  BioGRID: a general repository for interaction datasets , 2005, Nucleic Acids Res..

[42]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[43]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[44]  Xiao Wang,et al.  One2Multi Graph Autoencoder for Multi-view Graph Clustering , 2020, WWW.

[45]  Jure Leskovec,et al.  Predicting multicellular function through multi-layer tissue networks , 2017, Bioinform..

[46]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[47]  Jiawei Han,et al.  An Attention-based Collaboration Framework for Multi-View Network Representation Learning , 2017, CIKM.

[48]  Huan Liu,et al.  Multi-Layered Network Embedding , 2018, SDM.

[49]  Hanghang Tong,et al.  MrMine: Multi-resolution Multi-network Embedding , 2019, CIKM.

[50]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.