dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learning

Abstract Learning graph representations is a fundamental task aimed at capturing various properties of graphs in vector space. The most recent methods learn such representations for static networks. However, real-world networks evolve over time and have varying dynamics. Capturing such evolution is key to predicting the properties of unseen networks. To understand how the network dynamics affect the prediction performance, we propose an embedding approach which learns the structure of evolution in dynamic graphs and can predict unseen links with higher precision. Our model, dyngraph2vec , learns the temporal transitions in the network using a deep architecture composed of dense and recurrent layers. We motivate the need for capturing dynamics for the prediction on a toy data set created using stochastic block models. We then demonstrate the efficacy of dyngraph2vec over existing state-of-the-art methods on two real-world data sets. We observe that learning dynamics can improve the quality of embedding and yield better performance in link prediction.

[1]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[2]  Yuchung J. Wang,et al.  Stochastic Blockmodels for Directed Graphs , 1987 .

[3]  Alexander J. Smola,et al.  Distributed large-scale natural graph factorization , 2013, WWW.

[4]  Anton J. Enright,et al.  Network visualization and analysis of gene expression data using BioLayout Express3D , 2009, Nature Protocols.

[5]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[6]  Jon M. Kleinberg,et al.  Overview of the 2003 KDD Cup , 2003, SKDD.

[7]  Kewei Cheng,et al.  Streaming Link Prediction on Dynamic Attributed Networks , 2018, WSDM.

[8]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[9]  Palash Goyal,et al.  Embedding Networks with Edge Attributes , 2018, HT.

[10]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Palash Goyal,et al.  Recommending Teammates with Deep Neural Networks , 2018, HT.

[13]  Nitish Talasu,et al.  A link prediction based approach for recommendation systems , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[14]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[15]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[16]  Yu Wang,et al.  Graph regularized nonnegative matrix factorization for temporal link prediction in dynamic networks , 2018 .

[17]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[18]  Yueting Zhuang,et al.  Dynamic Network Embedding by Modeling Triadic Closure Process , 2018, AAAI.

[19]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[20]  Christos Faloutsos,et al.  Graphs over time: densification laws, shrinking diameters and possible explanations , 2005, KDD '05.

[21]  Yan Liu,et al.  DynGEM: Deep Embedding Method for Dynamic Graphs , 2018, ArXiv.

[22]  Linton C. Freeman,et al.  Visualizing Social Networks , 2000, J. Soc. Struct..

[23]  Jian Pei,et al.  TIMERS: Error-Bounded SVD Restart on Dynamic Networks , 2017, AAAI.

[24]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[25]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[26]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[27]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[28]  Mohammad Al Hasan,et al.  DyLink2Vec: Effective Feature Representation for Link Prediction in Dynamic Networks , 2018, ArXiv.

[29]  M. Brand,et al.  Fast low-rank modifications of the thin singular value decomposition , 2006 .

[30]  Tamara G. Kolda,et al.  Temporal Link Prediction Using Matrix and Tensor Factorizations , 2010, TKDD.

[31]  Reinhard Schneider,et al.  A survey of visualization tools for biological network analysis , 2008, BioData Mining.

[32]  Purnamrita Sarkar,et al.  Nonparametric Link Prediction in Dynamic Networks , 2012, ICML.

[33]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[34]  Kristian Kersting,et al.  Learning Continuous-Time Bayesian Networks in Relational Domains: A Non-Parametric Approach , 2016, AAAI.

[35]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[36]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.