Link prediction in dynamic networks using time-aware network embedding and time series forecasting

As most real-world networks evolve over time, link prediction over such dynamic networks has become a challenging issue. Recent researches focus towards network embedding to improve the performance of link prediction task. Most of the network embedding methods are only applicable to static networks and therefore cannot capture the temporal variations of dynamic networks. In this work, we propose a time-aware network embedding method which generates node embeddings by capturing the temporal dynamics of evolving networks. Unlike existing works which use deep architectures, we design an evolving skip-gram architecture to create dynamic node embeddings. We use the node embedding similarities between consecutive snapshots to construct a univariate time series of node similarities. Further, we use times series forecasting using auto regressive integrated moving average (ARIMA) model to predict the future links. We conduct experiments using dynamic network snapshot datasets from various domains and demonstrate the advantages of our system compared to other state-of-the-art methods. We show that, combining network embedding with time series forecasting methods can be an efficient solution to improve the quality of link prediction in dynamic networks.

[1]  David Liben-Nowell,et al.  The link-prediction problem for social networks , 2007 .

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  Zehra Cataltepe,et al.  Link prediction using time series of neighborhood-based node similarity scores , 2015, Data Mining and Knowledge Discovery.

[4]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[5]  Jon M. Kleinberg,et al.  Overview of the 2003 KDD Cup , 2003, SKDD.

[6]  Oscar Castillo,et al.  A New Approach for Time Series Prediction Using Ensembles of IT2FNN Models with Optimization of Fuzzy Integrators , 2018, International Journal of Fuzzy Systems.

[7]  Kevin Chen-Chuan Chang,et al.  A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[8]  Fernando Berzal Galiano,et al.  A Survey of Link Prediction in Complex Networks , 2016, ACM Comput. Surv..

[9]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[10]  Shang-Hua Teng,et al.  Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems , 2003, STOC '04.

[11]  Yoshua Bengio,et al.  Hierarchical Probabilistic Neural Network Language Model , 2005, AISTATS.

[12]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[13]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[14]  Matthieu Latapy,et al.  Computing Communities in Large Networks Using Random Walks , 2004, J. Graph Algorithms Appl..

[15]  Chengqi Zhang,et al.  Tri-Party Deep Network Representation , 2016, IJCAI.

[16]  Philip S. Yu,et al.  Deep Dynamic Network Embedding for Link Prediction , 2018, IEEE Access.

[17]  Omer Levy,et al.  word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method , 2014, ArXiv.

[18]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[19]  Christophe Diot,et al.  Impact of Human Mobility on Opportunistic Forwarding Algorithms , 2007, IEEE Transactions on Mobile Computing.

[20]  Farshad Safaei,et al.  A novel multilayer model for missing link prediction and future link forecasting in dynamic complex networks , 2018 .

[21]  Sule Gündüz Ögüdücü,et al.  Temporal Link Prediction Using Time Series of Quasi-Local Node Similarity Measures , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[22]  Zhen Liu,et al.  Link prediction in complex networks: A local naïve Bayes model , 2011, ArXiv.

[23]  Richard James,et al.  Temporal dynamics and network analysis , 2012 .

[24]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[25]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[26]  Oscar Castillo,et al.  A New Approach to Multiple Time Series Prediction Using MIMO Fuzzy Aggregation Models with Modular Neural Networks , 2019, Int. J. Fuzzy Syst..

[27]  Aram Galstyan,et al.  Scalable Link Prediction in Dynamic Networks via Non-Negative Matrix Factorization , 2014, ArXiv.

[28]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[29]  Przemyslaw Kazienko,et al.  Matching Organizational Structure and Social Network Extracted from Email Communication , 2011, BIS.

[30]  Wenbo Zhao,et al.  PageRank and Random Walks on Graphs , 2010 .

[31]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[32]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[33]  Daniel R. Figueiredo,et al.  struc2vec: Learning Node Representations from Structural Identity , 2017, KDD.

[34]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[35]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[36]  Alper Ozcan,et al.  Supervised temporal link prediction using time series of similarity measures , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[37]  Oscar Castillo,et al.  ClusFuDE: Forecasting low dimensional numerical data using an improved method based on automatic clustering, fuzzy relationships and differential evolution , 2018, Eng. Appl. Artif. Intell..

[38]  Bin Li,et al.  DeepEye: Link prediction in dynamic networks based on non-negative matrix factorization , 2018, Big Data Min. Anal..

[39]  Yiming Yang,et al.  The Enron Corpus: A New Dataset for Email Classi(cid:12)cation Research , 2004 .

[40]  Xiaoke Ma,et al.  Nonnegative matrix factorization algorithms for link prediction in temporal networks using graph communicability , 2017, Pattern Recognit..

[41]  J. Kurths,et al.  Complex network approaches to nonlinear time series analysis , 2019, Physics Reports.

[42]  Mohammad Al Hasan,et al.  A Survey of Link Prediction in Social Networks , 2011, Social Network Data Analytics.

[43]  Yueting Zhuang,et al.  Dynamic Network Embedding by Modeling Triadic Closure Process , 2018, AAAI.

[44]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[45]  Wanjiun Liao,et al.  Tracking Network Evolution and Their Applications in Structural Network Analysis , 2019, IEEE Transactions on Network Science and Engineering.

[46]  Charu C. Aggarwal,et al.  Heterogeneous Network Embedding via Deep Architectures , 2015, KDD.

[47]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[48]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[49]  Hang-Hyun Jo,et al.  Bursty Time Series Analysis for Temporal Networks , 2019, Computational Social Sciences.

[50]  Roger M. Needham The changing environment for security protocols , 1997 .

[51]  Wang-Chien Lee,et al.  HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning , 2017, CIKM.