Multi-Layered Network Embedding

Network embedding has gained more attentions in recent years. It has been shown that the learned lowdimensional node vector representations could advance a myriad of graph mining tasks such as node classification, community detection, and link prediction. A vast majority of the existing efforts are overwhelmingly devoted to single-layered networks or homogeneous networks with a single type of nodes and node interactions. However, in many real-world applications, a variety of networks could be abstracted and presented in a multilayered fashion. Typical multi-layered networks include critical infrastructure systems, collaboration platforms, social recommender systems, to name a few. Despite the widespread use of multi-layered networks, it remains a daunting task to learn vector representations of different types of nodes due to the bewildering combination of both within-layer connections and cross-layer network dependencies. In this paper, we study a novel problem of multi-layered network embedding. In particular, we propose a principled framework MANE to model both within-layer connections and cross-layer network dependencies simultaneously in a unified optimization framework for embedding representation learning. Experiments on real-world multi-layered networks corroborate the effectiveness of the proposed framework.

[1]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[2]  S. Havlin,et al.  Interdependent networks: reducing the coupling strength leads to a change from a first to second order percolation transition. , 2010, Physical review letters.

[3]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[4]  Sangkeun Lee,et al.  HotSpots: Failure Cascades on Heterogeneous Critical Infrastructure Networks , 2017, CIKM.

[5]  Philip S. Yu,et al.  Embedding of Embedding (EOE): Joint Embedding for Coupled Heterogeneous Networks , 2017, WSDM.

[6]  Feng Xu,et al.  Dual-Regularized One-Class Collaborative Filtering , 2014, CIKM.

[7]  Jingrui He,et al.  MUVIR: Multi-View Rare Category Detection , 2015, IJCAI.

[8]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[9]  Harry Eugene Stanley,et al.  Cascade of failures in coupled network systems with multiple support-dependent relations , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Huan Liu,et al.  Attributed Network Embedding for Learning in a Dynamic Environment , 2017, CIKM.

[11]  Kewei Cheng,et al.  Streaming Link Prediction on Dynamic Attributed Networks , 2018, WSDM.

[12]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[13]  James P. Peerenboom,et al.  Identifying, understanding, and analyzing critical infrastructure interdependencies , 2001 .

[14]  Jure Leskovec,et al.  Community Detection in Networks with Node Attributes , 2013, 2013 IEEE 13th International Conference on Data Mining.

[15]  Jingrui He,et al.  Towards Optimal Connectivity on Multi-Layered Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[16]  Hady Wirawan Lauw,et al.  Probabilistic Latent Document Network Embedding , 2014, 2014 IEEE International Conference on Data Mining.

[17]  Huan Liu,et al.  Toward Personalized Relational Learning , 2017, SDM.

[18]  Vito Latora,et al.  Structural measures for multiplex networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[20]  Chengqi Zhang,et al.  Tri-Party Deep Network Representation , 2016, IJCAI.

[21]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[22]  Philip S. Yu,et al.  Co-clustering by block value decomposition , 2005, KDD '05.

[23]  Graham Cormode,et al.  Node Classification in Social Networks , 2011, Social Network Data Analytics.

[24]  Yizhou Sun,et al.  Task-Guided and Path-Augmented Heterogeneous Network Embedding for Author Identification , 2016, WSDM.

[25]  Huan Liu,et al.  Toward online node classification on streaming networks , 2017, Data Mining and Knowledge Discovery.

[26]  Xiao Huang,et al.  Accelerated Attributed Network Embedding , 2017, SDM.

[27]  Lenwood S. Heath,et al.  Multimodal Networks: Structure and Operations , 2009, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[28]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[29]  Philip S. Yu,et al.  BL-MNE: Emerging Heterogeneous Social Network Embedding Through Broad Learning with Aligned Autoencoder , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[30]  Jingrui He,et al.  On the Connectivity of Multi-layered Networks: Models, Measures and Optimal Control , 2015, 2015 IEEE International Conference on Data Mining.

[31]  H. Stanley,et al.  Networks formed from interdependent networks , 2011, Nature Physics.

[32]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[33]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[34]  Hanghang Tong,et al.  Flexible and Robust Multi-Network Clustering , 2015, KDD.

[35]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[36]  Lei Xie,et al.  FASCINATE: Fast Cross-Layer Dependency Inference on Multi-layered Networks , 2016, KDD.

[37]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[38]  Harry Eugene Stanley,et al.  Catastrophic cascade of failures in interdependent networks , 2009, Nature.

[39]  Jérôme Idier,et al.  Algorithms for Nonnegative Matrix Factorization with the β-Divergence , 2010, Neural Computation.

[40]  Anna Monreale,et al.  Foundations of Multidimensional Network Analysis , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[41]  Hanghang Tong,et al.  Inside the atoms: ranking on a network of networks , 2014, KDD.

[42]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[43]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[44]  Qiaozhu Mei,et al.  PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks , 2015, KDD.

[45]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[46]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[47]  Jure Leskovec,et al.  Supervised random walks: predicting and recommending links in social networks , 2010, WSDM '11.

[48]  Jingrui He,et al.  A Randomized Approach for Crowdsourcing in the Presence of Multiple Views , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[49]  Charu C. Aggarwal,et al.  Heterogeneous Network Embedding via Deep Architectures , 2015, KDD.