Restricted Boltzmann Machine-Based Approaches for Link Prediction in Dynamic Networks

Link prediction in dynamic networks aims to predict edges according to historical linkage status. It is inherently difficult because of the linear/non-linear transformation of underlying structures. The problem of efficiently performing dynamic link inference is extremely challenging due to the scale of networks and different evolving patterns. Most previous approaches for link prediction are based on members’ similarity and supervised learning methods. However, research work on investigating hidden patterns of dynamic social networks is rarely conducted. In this paper, we propose a novel framework that incorporates a deep learning method, i.e., temporal restricted Boltzmann machine, and a machine learning approach, i.e., gradient boosting decision tree. The proposed model is capable of modeling each link’s evolving patterns. We also propose a novel transformation for input matrix, which significantly reduces the computational complexity and makes our algorithm scalable to large networks. Extensive experiments demonstrate that the proposed method outperforms the existing state-of-the-art algorithms on real-world dynamic networks.

[1]  M. Newman Clustering and preferential attachment in growing networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  B. Schölkopf,et al.  Modeling Human Motion Using Binary Latent Variables , 2007 .

[3]  Matthew Rowe,et al.  Who Will Follow Whom? Exploiting Semantics for Link Prediction in Attention-Information Networks , 2012, SEMWEB.

[4]  Christopher M. Danforth,et al.  An evolutionary algorithm approach to link prediction in dynamic social networks , 2013, J. Comput. Sci..

[5]  David Liben-Nowell,et al.  The link-prediction problem for social networks , 2007 .

[6]  Hui Li,et al.  A Deep Learning Approach to Link Prediction in Dynamic Networks , 2014, SDM.

[7]  Paul Tseng,et al.  A coordinate gradient descent method for nonsmooth separable minimization , 2008, Math. Program..

[8]  Wei Tang,et al.  Supervised Link Prediction Using Multiple Sources , 2010, 2010 IEEE International Conference on Data Mining.

[9]  Feng Liu,et al.  Deep Learning Approaches for Link Prediction in Social Network Services , 2013, ICONIP.

[10]  M. Newman,et al.  Vertex similarity in networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  M. Ng,et al.  A Coordinate Gradient Descent Method for Nonsmooth , 2009 .

[12]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[13]  Roger Guimerà,et al.  Missing and spurious interactions and the reconstruction of complex networks , 2009, Proceedings of the National Academy of Sciences.

[14]  Brian D. Davison,et al.  Structural link analysis and prediction in microblogs , 2011, CIKM '11.

[15]  Jing Wang,et al.  Enhancing Link Prediction Using Gradient Boosting Features , 2016, ICIC.

[16]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[17]  Przemyslaw Kazienko,et al.  Matching Organizational Structure and Social Network Extracted from Email Communication , 2011, BIS.

[18]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[19]  Linyuan Lü,et al.  Predicting missing links via local information , 2009, 0901.0553.

[20]  Leo Katz,et al.  A new status index derived from sociometric analysis , 1953 .

[21]  Christos Faloutsos,et al.  Graph evolution: Densification and shrinking diameters , 2006, TKDD.

[22]  Christophe Diot,et al.  Impact of Human Mobility on Opportunistic Forwarding Algorithms , 2007, IEEE Transactions on Mobile Computing.

[23]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.

[24]  Charu C. Aggarwal,et al.  When will it happen?: relationship prediction in heterogeneous information networks , 2012, WSDM '12.

[25]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[26]  Peng Wang,et al.  Link prediction in social networks: the state-of-the-art , 2014, Science China Information Sciences.

[27]  Ling Chen,et al.  An efficient algorithm for link prediction in temporal uncertain social networks , 2016, Inf. Sci..

[28]  Srinivasan Parthasarathy,et al.  Local Probabilistic Models for Link Prediction , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[29]  Yiming Yang,et al.  The Enron Corpus: A New Dataset for Email Classi(cid:12)cation Research , 2004 .

[30]  Lada A. Adamic,et al.  Friends and neighbors on the Web , 2003, Soc. Networks.

[31]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.