Computationally efficient inference for latent position network models

Latent position models are widely used for the analysis of networks in a variety of research fields. In fact, these models possess a number of desirable theoretical properties, and are particularly easy to interpret. However, statistical methodologies to fit these models generally incur a computational cost which grows with the square of the number of nodes in the graph. This makes the analysis of large social networks impractical. In this paper, we propose a new method characterised by a linear computational complexity, which can be used to fit latent position models on networks of several tens of thousands nodes. Our approach relies on an approximation of the likelihood function, where the amount of noise introduced by the approximation can be arbitrarily reduced at the expense of computational efficiency. We establish several theoretical results that show how the likelihood error propagates to the invariant distribution of the Markov chain Monte Carlo sampler. In particular, we demonstrate that one can achieve a substantial reduction in computing time and still obtain a good estimate of the latent structure. Finally, we propose applications of our method to simulated networks and to a large coauthorships network, highlighting the usefulness of our approach.

[1]  Jonathan C. Mattingly,et al.  Error bounds for Approximations of Markov chains , 2017 .

[2]  Adrian E. Raftery,et al.  Representing degree distributions, clustering, and homophily in social networks with latent cluster random effects models , 2009, Soc. Networks.

[3]  Thomas Brendan Murphy,et al.  Variational Bayesian inference for the Latent Position Cluster Model , 2009, NIPS 2009.

[4]  Nial Friel,et al.  Bayesian model selection for the latent position cluster model for social networks , 2013, Network Science.

[5]  J. Rosenthal,et al.  Error Bounds for Approximations of Geometrically Ergodic Markov Chains , 2017 .

[6]  Adrian E Raftery,et al.  Interlocking directorates in Irish companies using a latent space model for bipartite networks , 2016, Proceedings of the National Academy of Sciences.

[7]  E. N. Gilbert,et al.  Random Plane Networks , 1961 .

[8]  Peter D. Hoff,et al.  Fast Inference for the Latent Space Network Model Using a Case-Control Approximate Likelihood , 2012, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[9]  Yuguo Chen,et al.  Analysis of the formation of the structure of social networks by using latent space models for ranked dynamic networks , 2015, 2005.08269.

[10]  Adrian E. Raftery,et al.  Properties of latent variable network models , 2015, Network Science.

[11]  A. Moore,et al.  Dynamic social network analysis using latent space models , 2005, SKDD.

[12]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[13]  Daniele Durante,et al.  Rejoinder: Nonparametric Bayes Modeling of Populations of Networks , 2017 .

[14]  Yuguo Chen,et al.  Latent Space Models for Dynamic Networks , 2015, 2005.08808.

[15]  Susan M. Shortreed,et al.  Positional Estimation Within a Latent Space Model for Networks , 2006 .

[16]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[17]  Pierre Alquier,et al.  Noisy Monte Carlo: convergence of Markov chains with approximate transition kernels , 2014, Statistics and Computing.

[18]  Pierre Alquier,et al.  Informed sub-sampling MCMC: approximate Bayesian inference for large datasets , 2017, Stat. Comput..

[19]  D. Rudolf,et al.  Perturbation theory for Markov chains via Wasserstein distance , 2015, Bernoulli.

[20]  Thomas Brendan Murphy,et al.  A Latent Space Model for Rank Data , 2006, SNA@ICML.

[21]  J. Rosenthal,et al.  General state space Markov chains and MCMC algorithms , 2004, math/0404033.

[22]  Matthew Roughan,et al.  Fast Generation of Spatially Embedded Random Networks , 2015, IEEE Transactions on Network Science and Engineering.

[23]  Christos Faloutsos,et al.  Graph evolution: Densification and shrinking diameters , 2006, TKDD.

[24]  Yuguo Chen,et al.  Latent space models for dynamic networks with weighted edges , 2020, Soc. Networks.

[25]  A. Raftery,et al.  Model‐based clustering for social networks , 2007 .

[26]  Adrian E Raftery,et al.  Comment: Extending the Latent Position Model for Networks , 2017, Journal of the American Statistical Association.

[27]  Yuchung J. Wang,et al.  Stochastic Blockmodels for Directed Graphs , 1987 .

[28]  Tyler H McCormick,et al.  LATENT SPACE MODELS FOR MULTIVIEW NETWORK DATA. , 2017, The annals of applied statistics.

[29]  J. Rosenthal,et al.  Two convergence properties of hybrid samplers , 1998 .

[30]  T. B. Murphy,et al.  Joint Modelling of Multiple Network Views , 2013, 1301.3759.

[31]  Daniele Durante,et al.  Locally Adaptive Dynamic Networks , 2015, 1505.05668.

[32]  Thomas Brendan Murphy,et al.  Review of statistical network analysis: models, algorithms, and software , 2012, Stat. Anal. Data Min..

[33]  Catherine Matias,et al.  MODELING HETEROGENEITY IN RANDOM GRAPHS THROUGH LATENT SPACE MODELS: A SELECTIVE REVIEW , 2014 .

[34]  A. Y. Mitrophanov,et al.  Sensitivity and convergence of uniformly ergodic Markov chains , 2005 .