Semi-Supervised Deep Learning for Multiplex Networks

Multiplex networks are complex graph structures in which a set of entities are connected to each other via multiple types of relations, each relation representing a distinct layer. Such graphs are used to investigate many complex biological, social, and technological systems. In this work, we present a novel semi-supervised approach for structure-aware representation learning on multiplex networks. Our approach relies on maximizing the mutual information between local node-wise patch representations and label correlated structure-aware global graph representations to model the nodes and cluster structures jointly. Specifically, it leverages a novel cluster-aware, node-contextualized global graph summary generation strategy for effective joint-modeling of node and cluster representations across the layers of a multiplex network. Empirically, we demonstrate that the proposed architecture outperforms state-of-the-art methods in a range of tasks: classification, clustering, visualization, and similarity search on seven real-world multiplex networks for various experiment settings.

[1]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[2]  Partha Pratim Talukdar,et al.  ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations , 2020, AAAI.

[3]  Aaron C. Courville,et al.  MINE: Mutual Information Neural Estimation , 2018, ArXiv.

[4]  Balaraman Ravindran,et al.  A Unified Non-Negative Matrix Factorization Framework for Semi Supervised Learning on Graphs , 2020, SDM.

[5]  Weiyi Liu,et al.  Principled Multilayer Network Embedding , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[6]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[7]  Shanshan Li,et al.  Deep Collective Classification in Heterogeneous Information Networks , 2018, WWW.

[8]  R. Guimerà,et al.  Functional cartography of complex metabolic networks , 2005, Nature.

[9]  Jian Tang,et al.  InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization , 2019, ICLR.

[10]  Xiao Liu,et al.  Co-Regularized Deep Multi-Network Embedding , 2018, WWW.

[11]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[12]  Srinivasan Parthasarathy,et al.  MILE: A Multi-Level Framework for Scalable Graph Embedding , 2018, ICWSM.

[13]  William L. Hamilton Graph Representation Learning , 2020, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[14]  Hamid R. Rabiee,et al.  MGCN: Semi-supervised Classification in Multi-layer Graphs with Graph Convolutional Networks , 2018, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[15]  A. Tordai,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017 .

[16]  Donghyun Kim,et al.  Unsupervised Attributed Multiplex Network Embedding , 2020, AAAI.

[17]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[19]  Liefeng Bo,et al.  HDGI: An Unsupervised Graph Neural Network for Representation Learning in Heterogeneous Graph , 2019 .

[20]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[21]  Jure Leskovec,et al.  Modeling polypharmacy side effects with graph convolutional networks , 2018, bioRxiv.

[22]  Svetha Venkatesh,et al.  Column Networks for Collective Classification , 2016, AAAI.

[23]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[24]  Enhong Chen,et al.  Learning Deep Representations for Graph Clustering , 2014, AAAI.

[25]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[26]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[27]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[28]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Huan Liu,et al.  Multi-Layered Network Embedding , 2018, SDM.

[30]  Tsuyoshi Murata,et al.  MELL: Effective Embedding Method for Multiplex Networks , 2018, WWW.

[31]  Suhang Wang,et al.  Deep Multi-Graph Clustering via Attentive Cross-Graph Association , 2020, WSDM.

[32]  Liang Zhang,et al.  Structure-Feature based Graph Self-adaptive Pooling , 2020, WWW.

[33]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[34]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[35]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[36]  Liwei Qiu,et al.  Scalable Multiplex Network Embedding , 2018, IJCAI.

[37]  Philip S. Yu,et al.  Meta path-based collective classification in heterogeneous information networks , 2012, CIKM.