Improved Deep Embeddings for Inferencing with Multi-Layered Graphs

Inferencing with graph data necessitates the mapping of its nodes into a vector space, where the relationships are preserved. However, with multi-layered graphs, where multiple types of relationships exist for the same set of nodes, it is crucial to exploit the information shared between layers, in addition to the distinct aspects of each layer. In this paper, we propose a novel approach that first obtains node embeddings in all layers jointly via DeepWalk on a supra graph, which allows interactions between layers, and then fine-tunes the embeddings to encourage cohesive structure in the latent space. With empirical studies in node classification, link prediction and multi-layered community detection, we show that the proposed approach outperforms existing single-and multi-layered graph embedding algorithms on several benchmarks. In addition to effectively scaling to a large number of layers (tested up to 37), our approach consistently produces highly modular community structure, even when compared to methods that directly optimize for the modularity function.

[1]  Liwei Qiu,et al.  Scalable Multiplex Network Embedding , 2018, IJCAI.

[2]  Weiyi Liu,et al.  Principled Multilayer Network Embedding , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[3]  P. D. Laat.  The collegial phenomenon. The social mechanisms of cooperation among peers in a corporate law partnership , 2003 .

[4]  Michael Breakspear,et al.  Graph analysis of the human connectome: Promise, progress, and pitfalls , 2013, NeuroImage.

[5]  M. Elter,et al.  The prediction of breast cancer biopsy outcomes using two CAD approaches that both emphasize an intelligible decision process. , 2007, Medical physics.

[6]  Alfred O. Hero,et al.  Multilayer Spectral Graph Clustering via Convex Layer Aggregation: Theory and Algorithms , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[7]  J. C. Schlimmer,et al.  Concept acquisition through representational adjustment , 1987 .

[8]  D. Chklovskii,et al.  Wiring optimization can relate neuronal structure and function. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[10]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Karthikeyan Natesan Ramamurthy,et al.  Robust Local Scaling Using Conditional Quantiles of Graph Similarities , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[13]  E. Lazega.  Introduction : Collegial Phenomenon : The Social Mechanisms of Cooperation Among Peers in a Corporate Law Partnership , 2001 .

[14]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[15]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[16]  Jieping Ye,et al.  Discriminative K-means for Clustering , 2007, NIPS.

[17]  Huan Liu,et al.  Multi-Layered Network Embedding , 2018, SDM.

[18]  Massimiliano Zanin,et al.  Emergence of network features from multiplexity , 2012, Scientific Reports.

[19]  Prakash Ishwar,et al.  Node Embedding via Word Embedding for Network Community Discovery , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[20]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[21]  A. Arenas,et al.  Community detection in complex networks using extremal optimization. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Boleslaw K. Szymanski,et al.  Community Detection via Maximization of Modularity and Its Variants , 2014, IEEE Transactions on Computational Social Systems.

[23]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[24]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[25]  Pradeep Ravikumar,et al.  Collaborative Filtering with Graph Information: Consistency and Scalable Methods , 2015, NIPS.

[26]  Xiaochun Cao,et al.  Modularity Based Community Detection with Deep Learning , 2016, IJCAI.

[27]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.