Link Prediction for Partially Observed Networks

ABSTRACT Link prediction is one of the fundamental problems in network analysis. In many applications, notably in genetics, a partially observed network may not contain any negative examples, that is, edges known for certain to be absent, which creates a difficulty for existing supervised learning approaches. We develop a new method that treats the observed network as a sample of the true network with different sampling rates for positive (true edges) and negative (absent edges) examples. We obtain a relative ranking of potential links by their probabilities, using information on network topology as well as node covariates if available. The method relies on the intuitive assumption that if two pairs of nodes are similar, the probabilities of these pairs forming an edge are also similar. Empirically, the method performs well under many settings, including when the observed network is sparse. We apply the method to a protein–protein interaction network and a school friendship network.

[1]  Carey E. Priebe,et al.  Statistical Inference on Errorfully Observed Graphs , 2012, 1211.3601.

[2]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[3]  Linyuan Lu,et al.  Link Prediction in Complex Networks: A Survey , 2010, ArXiv.

[4]  Lada A. Adamic,et al.  Friends and neighbors on the Web , 2003, Soc. Networks.

[5]  J. Warga.  Minimizing Certain Convex Functions , 1963 .

[6]  Peter D. Hoff,et al.  Modeling homophily and stochastic equivalence in symmetric relational data , 2007, NIPS.

[7]  Jon Kleinberg,et al.  The link prediction problem for social networks , 2003, CIKM '03.

[8]  Charles Elkan,et al.  Link Prediction via Matrix Factorization , 2011, ECML/PKDD.

[9]  P. Tseng,et al.  On the convergence of the coordinate descent method for convex differentiable minimization , 1992 .

[10]  Nitesh V. Chawla,et al.  Predicting Links in Multi-relational and Heterogeneous Networks , 2012, 2012 IEEE 12th International Conference on Data Mining.

[11]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[12]  Lise Getoor,et al.  Link mining: a survey , 2005, SKDD.

[13]  Eric D. Kolaczyk,et al.  On the Propagation of Low-Rate Measurement Error to Subgraph Counts in Large, Sparse Networks , 2014 .

[14]  Prakash Balachandran,et al.  Inference of Network Summary Statistics Through Network Denoising , 2013, 1310.0423.

[15]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[16]  Stephen J. Wright,et al.  Quadratic programming , 2015 .

[17]  D. Hunter,et al.  Goodness of Fit of Social Network Models , 2008 .

[18]  Wei Chu,et al.  Stochastic Relational Models for Discriminative Link Prediction , 2006, NIPS.

[19]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[20]  William Stafford Noble,et al.  Choosing negative examples for the prediction of protein-protein interactions , 2006, BMC Bioinformatics.

[21]  Hisashi Kashima,et al.  Fast and Scalable Algorithms for Semi-supervised Link Prediction on Static and Dynamic Graphs , 2010, ECML/PKDD.

[22]  B. Snel,et al.  Comparative assessment of large-scale data sets of protein–protein interactions , 2002, Nature.

[23]  Jean-Philippe Vert,et al.  Supervised reconstruction of biological networks with local models , 2007, ISMB/ECCB.

[24]  Thomas L. Griffiths,et al.  Nonparametric Latent Feature Models for Link Prediction , 2009, NIPS.

[25]  David R. Hunter,et al.  Goodness of Fit of Social Network Models 1 , 2005 .

[26]  M. Newman,et al.  Vertex similarity in networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Mohammad Al Hasan,et al.  A Survey of Link Prediction in Social Networks , 2011, Social Network Data Analytics.

[28]  Yoshihiro Yamanishi,et al.  propagation: A fast semisupervised learning algorithm for link prediction , 2009 .

[29]  William Stafford Noble,et al.  Kernel methods for predicting protein-protein interactions , 2005, ISMB.

[30]  Mohammad Al Hasan,et al.  Link prediction using supervised learning , 2006 .

[31]  Clifford Hildreth,et al.  A quadratic programming procedure , 1957 .

[32]  Leo Katz,et al.  A new status index derived from sociometric analysis , 1953 .

[33]  Peter D. Hoff,et al.  Multiplicative latent factor models for description and prediction of social networks , 2009, Comput. Math. Organ. Theory.