Hyperbolic Multiplex Network Embedding with Maps of Random Walk

Recent research on network embedding in hyperbolic space have proven successful in several applications. However, nodes in real world networks tend to interact through several distinct channels. Simple aggregation or ignorance of this multiplexity will lead to misleading results. On the other hand, there exists redundant information between different interaction patterns between nodes. Recent research reveals the analogy between the community structure and the hyperbolic coordinate. To learn each node's effective embedding representation while reducing the redundancy of multiplex network, we then propose a unified framework combing multiplex network hyperbolic embedding and multiplex community detection. The intuitive rationale is that high order node embedding approach is expected to alleviate the observed network's sparse and noisy structure which will benefit the community detection task. On the contrary, the improved community structure will also guide the node embedding task. To incorporate the common features between channels while preserving unique features, a random walk approach which traversing in latent multiplex hyperbolic space is proposed to detect the community across channels and bridge the connection between node embedding and community detection. The proposed framework is evaluated on several network tasks using different real world dataset. The results demonstrates that our framework is effective and efficiency compared with state-of-the-art approaches.

[1]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Marián Boguñá,et al.  Popularity versus similarity in growing networks , 2011, Nature.

[3]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[4]  Andrew B. Nobel,et al.  Community Extraction in Multilayer Networks with Heterogeneous Community Structure , 2016, J. Mach. Learn. Res..

[5]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[6]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[7]  Dane Taylor,et al.  Enhanced detectability of community structure in multilayer networks through layer aggregation , 2015, Physical review letters.

[8]  Dane Taylor,et al.  Clustering Network Layers with the Strata Multilayer Stochastic Block Model , 2015, IEEE Transactions on Network Science and Engineering.

[9]  Amin Vahdat,et al.  Hyperbolic Geometry of Complex Networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Lubos Buzna,et al.  Geometric correlations mitigate the extreme vulnerability of multiplex networks against targeted attacks , 2017, Physical review letters.

[11]  Jiawei Han,et al.  mvn2vec: Preservation and Collaboration in Multi-View Network Embedding , 2018, ArXiv.

[12]  Philip S. Yu,et al.  Modularity in complex multilayer networks with multiple aspects: a static perspective , 2016, Applied Informatics.

[13]  Timothy Hospedales,et al.  Multi-relational Poincar\'e Graph Embeddings , 2019 .

[14]  Marián Boguñá,et al.  Self-similarity of complex networks and hidden metric spaces , 2007, Physical review letters.

[15]  Jian Pei,et al.  Arbitrary-Order Proximity Preserved Network Embedding , 2018, KDD.

[16]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[17]  Peter J. Bickel,et al.  Pseudo-likelihood methods for community detection in large sparse networks , 2012, 1207.2340.

[18]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[19]  Giovanni Montana,et al.  Community detection in multiplex networks using Locally Adaptive Random walks , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[20]  Miguel A. Andrade-Navarro,et al.  Efficient embedding of complex networks to hyperbolic space via their Laplacian , 2016, Scientific Reports.

[21]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[22]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[23]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[24]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[25]  Jiawei Han,et al.  An Attention-based Collaboration Framework for Multi-View Network Representation Learning , 2017, CIKM.

[26]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[27]  Weiyi Liu,et al.  Principled Multilayer Network Embedding , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[28]  M. Serrano,et al.  Hidden geometric correlations in real multiplex networks , 2016, Nature Physics.

[29]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[30]  Tobias Friedrich,et al.  Efficient Embedding of Scale-Free Graphs in the Hyperbolic Plane , 2018, IEEE/ACM Transactions on Networking.

[31]  Vito Latora,et al.  Structural reducibility of multilayer networks , 2015, Nature Communications.

[32]  Jie Tang,et al.  Representation Learning for Attributed Multiplex Heterogeneous Network , 2019, KDD.

[33]  Dmitri V. Krioukov,et al.  Network Mapping by Replaying Hyperbolic Growth , 2012, IEEE/ACM Transactions on Networking.

[34]  Douwe Kiela,et al.  Poincaré Embeddings for Learning Hierarchical Representations , 2017, NIPS.

[35]  Liwei Qiu,et al.  Scalable Multiplex Network Embedding , 2018, IJCAI.

[36]  Filippo Radicchi,et al.  Characterizing the Analogy Between Hyperbolic Embedding and Community Structure of Complex Networks. , 2018, Physical review letters.

[37]  Manlio De Domenico,et al.  Spectral entropies as information-theoretic tools for complex network comparison , 2016, 1609.01214.

[38]  Shou-De Lin,et al.  PRUNE: Preserving Proximity and Global Ranking for Network Embedding , 2017, NIPS.

[39]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[40]  Qingguang Li,et al.  Hyperbolic mapping of complex networks based on community information , 2016 .

[41]  Kevin Chen-Chuan Chang,et al.  Learning Community Embedding with Community Detection and Node Embedding on Graphs , 2017, CIKM.

[42]  Yang Yang,et al.  Representation Learning for Scale-free Networks , 2017, AAAI.

[43]  Dmitri V. Krioukov,et al.  Network Geometry Inference using Common Neighbors , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Maosong Sun,et al.  A Unified Framework for Community Detection and Network Representation Learning , 2016, IEEE Transactions on Knowledge and Data Engineering.

[45]  Tsuyoshi Murata,et al.  MELL: Effective Embedding Method for Multiplex Networks , 2018, WWW.

[46]  Edoardo M. Airoldi,et al.  Consistent estimation of dynamic and multi-layer block models , 2014, ICML.