Exploiting Node Content for Multiview Graph Convolutional Network and Adversarial Regularization

Network representation learning (NRL) is crucial in the area of graph learning. Recently, graph autoencoders and its variants have gained much attention and popularity among various types of node embedding approaches. Most existing graph autoencoder-based methods aim to minimize the reconstruction errors of the input network while not explicitly considering the semantic relatedness between nodes. In this paper, we propose a novel network embedding method which models the consistency across different views of networks. More specifically, we create a second view from the input network which captures the relation between nodes based on node content and enforce the latent representations from the two views to be consistent by incorporating a multiview adversarial regularization module. The experimental studies on benchmark datasets prove the effectiveness of this method, and demonstrate that our method compares favorably with the state-of-the-art algorithms on challenging tasks such as link prediction and node clustering. We also evaluate our method on a real-world application, i.e., 30-day unplanned ICU readmission prediction, and achieve promising results compared with several baseline methods.

[1]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[2]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[3]  David M. Blei,et al.  Relational Topic Models for Document Networks , 2009, AISTATS.

[4]  Huan Liu,et al.  Leveraging social media networks for classification , 2011, Data Mining and Knowledge Discovery.

[5]  Lei Du,et al.  Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition , 2014, AAAI.

[6]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[7]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[8]  Navdeep Jaitly,et al.  Adversarial Autoencoders , 2015, ArXiv.

[9]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[10]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[11]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[12]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[13]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[14]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[15]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[16]  David Sontag,et al.  Learning Low-Dimensional Representations of Medical Concepts , 2016, CRI.

[17]  Douwe Kiela,et al.  Poincaré Embeddings for Learning Hierarchical Representations , 2017, NIPS.

[18]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[19]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[20]  Jure Leskovec,et al.  Representation Learning on Graphs: Methods and Applications , 2017, IEEE Data Eng. Bull..

[21]  Heng Huang,et al.  Deep Attributed Network Embedding , 2018, IJCAI.

[22]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[23]  Dan Wang,et al.  Adversarial Network Embedding , 2017, AAAI.

[24]  Lina Yao,et al.  Adversarially Regularized Graph Autoencoder , 2018, IJCAI.

[25]  Berthold Reinwald,et al.  Learning Electronic Health Records through Hyperbolic Embedding of Medical Ontologies , 2019, BCB.

[26]  Hyung Jin Chang,et al.  Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[27]  Aram Galstyan,et al.  Multitask learning and benchmarking with clinical time series data , 2017, Scientific Data.

[28]  R. Campbell,et al.  Analysis and prediction of unplanned intensive care unit readmission using recurrent neural networks with long short-term memory , 2018, bioRxiv.

[29]  James T. Kwok,et al.  Effective Decoding in Graph Auto-Encoder using Triadic Closure , 2019, AAAI.

[30]  Yao Zhao,et al.  Distribution-Induced Bidirectional Generative Adversarial Network for Graph Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).