Principled Multilayer Network Embedding

Multilayer network analysis has become a vital tool for understanding different relationships and their interactions in a complex system, where each layer in a multilayer network depicts the topological structure of a group of nodes corresponding to a particular relationship. The interactions among different layers imply how the interplay of different relations on the topology of each layer. For a single-layer network, network embedding methods have been proposed to project the nodes in a network into a continuous vector space with a relatively small number of dimensions, where the space embeds the social representations among nodes. These algorithms have been proved to have a better performance on a variety of regular graph analysis tasks, such as link prediction, or multi-label classification. In this paper, by extending a standard graph mining into multilayer network, we have proposed three methods ("network aggregation," "results aggregation" and "layer co-analysis") to project a multilayer network into a continuous vector space. On one hand, without leveraging interactions among layers, "network aggregation" and "results aggregation" apply the standard network embedding method on the merged graph or each layer to find a vector space for multilayer network. On the other hand, in order to consider the influence of interactions among layers, "layer co-analysis" expands any single-layer network embedding method to a multilayer network. By introducing the link transition probability based on information distance, this method not only uses the first and second order random walk to traverse on a layer, but also has the ability to traverse between layers by leveraging interactions. From the evaluation, we have proved that comparing with regular link prediction methods, "layer co-analysis" achieved the best performance on most of the datasets, while "network aggregation" and "results aggregation" also have better performance than regular link prediction methods.

[1]  Mohammad Al Hasan,et al.  Name disambiguation from link data in a collaboration graph , 2014, ASONAM.

[2]  Francesco Calabrese,et al.  ABACUS: frequent pAttern mining-BAsed Community discovery in mUltidimensional networkS , 2013, Data Mining and Knowledge Discovery.

[3]  Linyuan Lü,et al.  Predicting missing links via local information , 2009, 0901.0553.

[4]  Geoffrey Zweig,et al.  Linguistic Regularities in Continuous Space Word Representations , 2013, NAACL.

[5]  Lior Rokach,et al.  Predicting Student Exam's Scores by Analyzing Social Network Data , 2012, AMT.

[6]  Mohammad Al Hasan,et al.  Name Disambiguation in Anonymized Graphs using Network Embedding , 2017, CIKM.

[7]  Jure Leskovec,et al.  Higher-order organization of complex networks , 2016, Science.

[8]  Thomas W. Valente,et al.  The stability of centrality measures when networks are sampled , 2003, Soc. Networks.

[9]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[10]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[11]  Alexandre Arenas,et al.  Identifying modular flows on multilayer networks reveals highly overlapping organization in social systems , 2014, ArXiv.

[12]  Shlomo Havlin,et al.  Conditions for viral influence spreading through multiplex correlated social networks , 2014, 1404.3114.

[13]  Henrik Jeldtoft Jensen,et al.  Comparison of Communities Detection Algorithms for Multiplex , 2014, ArXiv.

[14]  Dane Taylor,et al.  Clustering Network Layers with the Strata Multilayer Stochastic Block Model , 2015, IEEE Transactions on Network Science and Engineering.

[15]  Paola Batistoni,et al.  International Conference , 2001 .

[16]  Katarzyna Musial,et al.  A degree centrality in multi-layered social network , 2011, 2011 International Conference on Computational Aspects of Social Networks (CASoN).

[17]  Marián Boguñá,et al.  Navigability of Complex Networks , 2007, ArXiv.

[18]  Mohammad Al Hasan,et al.  Trust from the past: Bayesian Personalized Ranking based Link Prediction in Knowledge Graphs , 2016, ArXiv.

[19]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  A. Arenas,et al.  Mathematical Formulation of Multilayer Networks , 2013, 1307.4977.

[21]  Katarzyna Musial,et al.  A Method for Group Extraction in Complex Social Networks , 2010, WSKS.

[22]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[23]  Katarzyna Musial,et al.  Analysis of Neighbourhoods in Multi-layered Dynamic Social Networks , 2012, Int. J. Comput. Intell. Syst..

[24]  Daryl R. DeFord,et al.  Spectral Clustering Methods for Multiplex Networks , 2017, Physica A: Statistical Mechanics and its Applications.

[25]  Alfred O. Hero,et al.  Multilayer spectral graph clustering via convex layer aggregation , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[26]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[27]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[28]  Cristopher Moore,et al.  Community detection, link prediction, and layer interdependence in multilayer networks , 2017, Physical review. E.

[29]  Mohammad Al Hasan,et al.  Name disambiguation from link data in a collaboration graph using temporal and topological features , 2014, Social Network Analysis and Mining.

[30]  Christos Faloutsos,et al.  Fast, Warped Graph Embedding: Unifying Framework and One-Click Algorithm , 2017, ArXiv.

[31]  Vito Latora,et al.  Structural reducibility of multilayer networks , 2015, Nature Communications.

[32]  Jae-Gil Lee,et al.  Community Detection in Multi-Layer Graphs: A Survey , 2015, SGMD.

[33]  Tao Zhou,et al.  Maximal planar networks with large clustering coefficient and power-law degree distribution. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Alfred O. Hero,et al.  Multilayer Spectral Graph Clustering via Convex Layer Aggregation: Theory and Algorithms , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[35]  Michael T. Heaney,et al.  Multiplex networks and interest group influence reputation: An exponential random graph model , 2014, Soc. Networks.

[36]  Katarzyna Musial,et al.  Individual Neighbourhood Exploration in Complex Multi-layered Social Network , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[37]  Mason A. Porter,et al.  A local perspective on community structure in multilayer networks , 2015, Network Science.

[38]  Murat Dundar,et al.  Simplicity of Kmeans Versus Deepness of Deep Learning: A Case of Unsupervised Feature Learning with Limited Data , 2015, ICMLA 2015.