A review of dynamic network models with latent variables.

We present a selective review of statistical modeling of dynamic networks. We focus on models with latent variables, specifically, the latent space models and the latent class models (or stochastic blockmodels), which investigate both the observed features and the unobserved structure of networks. We begin with an overview of the static models, and then we introduce the dynamic extensions. For each dynamic model, we also discuss its applications that have been studied in the literature, with the data source listed in Appendix. Based on the review, we summarize a list of open problems and challenges in dynamic network modeling with latent variables.

[1]  Jiashun Jin,et al.  Coauthorship and Citation Networks for Statisticians , 2014, ArXiv.

[2]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[3]  Randolph M. Siverson,et al.  Disputes, Democracies, and Dependencies: A Reexamination of the Kantian Peace , 2007 .

[4]  Pavel N Krivitsky,et al.  A separable model for dynamic networks , 2010, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[5]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[6]  Michael D. Ward,et al.  Persistent Patterns of International Commerce , 2007 .

[7]  Zhuang Ma,et al.  Exploration of Large Networks via Fast and Universal Latent Space Model Fitting , 2017, ArXiv.

[8]  Peter D. Hoff,et al.  Separable covariance arrays via the Tucker product, with applications to multivariate relational data , 2010, 1008.2169.

[9]  Eric P. Xing,et al.  Discrete Temporal Models of Social Networks , 2006, SNA@ICML.

[10]  Tai Qin,et al.  Regularized Spectral Clustering under the Degree-Corrected Stochastic Blockmodel , 2013, NIPS.

[11]  Michael D. Ward,et al.  Gravity's Rainbow: A dynamic latent space model for the world trade network , 2013, Network Science.

[12]  Yun Chi,et al.  Evolutionary spectral clustering by incorporating temporal smoothness , 2007, KDD '07.

[13]  Yihong Gong,et al.  Detecting communities and their evolutions in dynamic social networks—a Bayesian approach , 2011, Machine Learning.

[14]  A. Moore,et al.  Dynamic social network analysis using latent space models , 2005, SKDD.

[15]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[16]  Daniele Durante,et al.  Bayesian dynamic financial networks with time-varying predictors , 2014, 1403.2272.

[17]  Peter D. Hoff,et al.  Modeling homophily and stochastic equivalence in symmetric relational data , 2007, NIPS.

[18]  Le Song,et al.  Evolving Cluster Mixed-Membership Blockmodel for Time-Evolving Networks , 2011, AISTATS.

[19]  David Banks,et al.  Models for networks: a cross‐disciplinary science , 2012 .

[20]  B. Lyon,et al.  Across-year social stability shapes network structure in wintering migrant sparrows. , 2014, Ecology letters.

[21]  Pavel N. Krivitsky,et al.  Latent Position and Cluster Models for Statistical Networks , 2015 .

[22]  Edoardo M. Airoldi,et al.  A Survey of Statistical Network Models , 2009, Found. Trends Mach. Learn..

[23]  Peter D. Hoff,et al.  MULTILINEAR TENSOR REGRESSION FOR LONGITUDINAL RELATIONAL DATA. , 2014, The annals of applied statistics.

[24]  Nial Friel,et al.  Computationally efficient inference for latent position network models , 2018, 1804.02274.

[25]  Adrian E Raftery,et al.  Interlocking directorates in Irish companies using a latent space model for bipartite networks , 2016, Proceedings of the National Academy of Sciences.

[26]  Michael D. Ward,et al.  A new approach to analyzing coevolving longitudinal networks in international relations , 2016 .

[27]  Tom A. B. Snijders,et al.  Introduction to stochastic actor-based models for network dynamics , 2010, Soc. Networks.

[28]  Ilya R. Fischhoff,et al.  Similar but Different: Dynamic Social Network Analysis Highlights Fundamental Differences between the Fission-Fusion Societies of Two Equid Species, the Onager and Grevy’s Zebra , 2015, PloS one.

[29]  David M. Blei,et al.  Relational Topic Models for Document Networks , 2009, AISTATS.

[30]  Roman Vershynin,et al.  Community detection in sparse networks via Grothendieck’s inequality , 2014, Probability Theory and Related Fields.

[31]  Peter D. Hoff,et al.  Hierarchical multilinear models for multiway data , 2010, Comput. Stat. Data Anal..

[32]  B. S. Baker,et al.  Gene Expression During the Life Cycle of Drosophila melanogaster , 2002, Science.

[33]  Peter J. Bickel,et al.  Pseudo-likelihood methods for community detection in large sparse networks , 2012, 1207.2340.

[34]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .

[35]  Brian W. Junker,et al.  Hierarchical Network Models for Education Research , 2013 .

[36]  Lingzhou Xue,et al.  Model-Based Clustering of Time-Evolving Networks through Temporal Exponential-Family Random Graph Models , 2017, J. Multivar. Anal..

[37]  Purnamrita Sarkar,et al.  Estimating Mixed Memberships With Sharp Eigenvector Deviations , 2017, Journal of the American Statistical Association.

[38]  Ji Zhu,et al.  Consistency of community detection in networks under degree-corrected stochastic block models , 2011, 1110.3854.

[39]  Marianna Pensky,et al.  Spectral clustering in the dynamic stochastic block model , 2017, Electronic Journal of Statistics.

[40]  A. Raftery,et al.  Model‐based clustering for social networks , 2007 .

[41]  Padhraic Smyth,et al.  Continuous-Time Regression Models for Longitudinal Networks , 2011, NIPS.

[42]  Yun Chi,et al.  Facetnet: a framework for analyzing communities and their evolutions in dynamic networks , 2008, WWW.

[43]  J. Tinbergen Shaping the World Economy: Suggestions for an International Economic Policy , 1964 .

[44]  Elizaveta Levina,et al.  On semidefinite relaxations for the block model , 2014, ArXiv.

[45]  David Lazer,et al.  Inferring friendship network structure by using mobile phone data , 2009, Proceedings of the National Academy of Sciences.

[46]  Derek Owens-Oas,et al.  Modeling Community Structure and Topics in Dynamic Text Networks , 2016, Journal of Classification.

[47]  L. Freeman Finding Social Groups: A Meta-Analysis of the Southern Women Data , 2003 .

[48]  Padhraic Smyth,et al.  Dynamic Egocentric Models for Citation Networks , 2011, ICML.

[49]  Adrian E. Raftery,et al.  Representing degree distributions, clustering, and homophily in social networks with latent cluster random effects models , 2009, Soc. Networks.

[50]  Jiashun Jin,et al.  Estimating network memberships by simplex vertex hunting , 2017 .

[51]  Alfred O. Hero,et al.  Dynamic Stochastic Blockmodels for Time-Evolving Social Networks , 2014, IEEE Journal of Selected Topics in Signal Processing.

[52]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Yuguo Chen,et al.  Latent space models for dynamic networks with weighted edges , 2020, Soc. Networks.

[54]  Peter D. Hoff,et al.  Fast Inference for the Latent Space Network Model Using a Case-Control Approximate Likelihood , 2012, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[55]  Adrian E. Raftery,et al.  Properties of latent variable network models , 2015, Network Science.

[56]  Vincent Miele,et al.  Statistical clustering of temporal networks through a dynamic stochastic block model , 2015, 1506.07464.

[57]  Yuguo Chen,et al.  Latent Space Models for Dynamic Networks , 2015, 2005.08808.

[58]  Mark E. J. Newman,et al.  Structure and Dynamics of Networks , 2009 .

[59]  M. Acevedo,et al.  Social network models predict movement and connectivity in ecological landscapes , 2011, Proceedings of the National Academy of Sciences.

[60]  Bin Yu,et al.  Spectral clustering and the high-dimensional stochastic blockmodel , 2010, 1007.1684.

[61]  K. Stovel,et al.  Network Analysis and Political Science , 2011 .

[62]  Pavel N Krivitsky,et al.  Fitting Position Latent Cluster Models for Social Networks with latentnet. , 2008, Journal of statistical software.

[63]  Patrick J. Wolfe,et al.  Point process modelling for directed interaction networks , 2010, ArXiv.

[64]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[65]  Zhuang Ma,et al.  Exploration of Large Networks with Covariates via Fast and Universal Latent Space Model Fitting , 2017 .

[66]  Peter D. Hoff,et al.  Bilinear Mixed-Effects Models for Dyadic Data , 2005 .

[67]  D. Dunson,et al.  Nonparametric Bayes dynamic modelling of relational data , 2013, 1311.4669.

[68]  Daniele Durante,et al.  Bayesian Logistic Gaussian Process Models for Dynamic Networks , 2014, AISTATS.

[69]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[70]  E. Xing,et al.  A state-space mixed membership blockmodel for dynamic network tomography , 2008, 0901.0135.

[71]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockmodels for Graphs with Latent Block Structure , 1997 .

[72]  Peter D. Hoff,et al.  Multiplicative latent factor models for description and prediction of social networks , 2009, Comput. Math. Organ. Theory.

[73]  Peter D. Hoff,et al.  Likelihoods for fixed rank nomination networks , 2012, Network Science.

[74]  Srinivasan Parthasarathy,et al.  An event-based framework for characterizing the evolutionary behavior of interaction graphs , 2007, KDD '07.

[75]  Catherine Matias,et al.  MODELING HETEROGENEITY IN RANDOM GRAPHS THROUGH LATENT SPACE MODELS: A SELECTIVE REVIEW , 2014 .

[76]  Stanley Wasserman,et al.  Statistical Models for Social Networks , 2000 .

[77]  M. Newman Coauthorship networks and patterns of scientific collaboration , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[78]  Peter D. Hoff,et al.  Modeling Dependencies in International Relations Networks , 2004, Political Analysis.

[79]  Peter D. Hoff,et al.  Dyadic data analysis with amen , 2015, 1506.08237.

[80]  T. Snijders Stochastic actor-oriented models for network change , 1996 .

[81]  Michael D. Ward,et al.  Inferential Approaches for Network Analysis: AMEN for Latent Factor Models , 2016, Political Analysis.

[82]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[83]  Purnamrita Sarkar,et al.  A Latent Space Approach to Dynamic Embedding of Co-occurrence Data , 2007, AISTATS.

[84]  Bruce A. Desmarais,et al.  Statistical Inference in Political Networks Research , 2017, ArXiv.

[85]  A. Raftery,et al.  Model-based Gaussian and non-Gaussian clustering , 1993 .