Concentration and consistency results for canonical and curved exponential-family models of random graphs

Statistical inference for exponential-family models of random graphs with dependent edges is challenging. We stress the importance of additional structure and show that additional structure facilitates statistical inference. A simple example of a random graph with additional structure is a random graph with neighborhoods and local dependence within neighborhoods. We develop the first concentration and consistency results for maximum likelihood and $M$-estimators of a wide range of canonical and curved exponential-family models of random graphs with local dependence. All results are non-asymptotic and applicable to random graphs with finite populations of nodes, although asymptotic consistency results can be obtained as well. In addition, we show that additional structure can facilitate subgraph-to-graph estimation, and present concentration results for subgraph-to-graph estimators. As an application, we consider popular curved exponential-family models of random graphs, with local dependence induced by transitivity and parameter vectors whose dimensions depend on the number of nodes.

[1]  P. Diaconis,et al.  Estimating and understanding exponential random graph models , 2011, 1102.2650.

[2]  David R. Hunter,et al.  Curved exponential family models for social networks , 2007, Soc. Networks.

[3]  P. Pattison,et al.  New Specifications for Exponential Random Graph Models , 2006 .

[4]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.

[5]  Sumit Mukherjee,et al.  Consistent estimation in the two star Exponential Random Graph Model , 2013, 1310.4526.

[6]  Michael Schweinberger,et al.  hergm: Hierarchical Exponential-Family Random Graph Models , 2018 .

[7]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: I. An introduction to Markov graphs andp , 1996 .

[8]  Sourav Chatterjee,et al.  Estimation in spin glasses: A first step , 2006 .

[9]  Chenlei Leng,et al.  Asymptotics in directed exponential random graph models with an increasing bi-degree sequence , 2014, 1408.1156.

[10]  Van H. Vu,et al.  Divide and conquer martingales and the number of triangles in a random graph , 2004, Random Struct. Algorithms.

[11]  Martina Morris,et al.  Multilevel network data facilitate statistical inference for curved ERGMs with geometrically weighted terms , 2019, Soc. Networks.

[12]  Allan Sly,et al.  Random graphs with a given degree sequence , 2010, 1005.1136.

[13]  S. Mukherjee,et al.  Inference in Ising Models , 2015, 1507.07055.

[14]  Pavel N Krivitsky,et al.  Computational Statistical Methods for Social Network Models , 2012, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[15]  Stephen E. Fienberg,et al.  Statistical Inference in a Directed Network Model With Covariates , 2016, Journal of the American Statistical Association.

[16]  Mark S Handcock,et al.  MODELING SOCIAL NETWORKS FROM SAMPLED DATA. , 2010, The annals of applied statistics.

[17]  Pradeep Ravikumar,et al.  Graphical models via univariate exponential family distributions , 2013, J. Mach. Learn. Res..

[18]  W. Dempsey,et al.  A framework for statistical network modeling , 2015, 1509.08185.

[19]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[20]  Stephen E. Fienberg,et al.  Maximum Likelihood Estimation in Network Models , 2011, ArXiv.

[21]  Paola Zappa,et al.  The Analysis of Multilevel Networks in Organizations , 2015 .

[22]  Jennifer Neville,et al.  Relational Learning with One Network: An Asymptotic Analysis , 2011, AISTATS.

[23]  J. F. C. Kingman,et al.  Information and Exponential Families in Statistical Theory , 1980 .

[24]  R. Kass,et al.  Geometrical Foundations of Asymptotic Inference , 1997 .

[25]  Svante Janson,et al.  The infamous upper tail , 2002, Random Struct. Algorithms.

[26]  O. Barndorff-Nielsen.  Information and Exponential Families in Statistical Theory , 1980 .

[27]  A. Rinaldo,et al.  CONSISTENCY UNDER SAMPLING OF EXPONENTIAL RANDOM GRAPH MODELS. , 2011, Annals of statistics.

[28]  J. Jonasson.  The random triangle model , 1999, Journal of Applied Probability.

[29]  Peng Wang,et al.  Exponential random graph models for multilevel networks , 2013, Soc. Networks.

[30]  P. Holland,et al.  Local Structure in Social Networks , 1976 .

[31]  Julien Brailly,et al.  Exponential Random Graph Models for Social Networks , 2014 .

[32]  Emmanuel Lazega,et al.  Multilevel Network Analysis for the Social Sciences; Theory, Methods and Applications , 2016 .

[33]  Pavel N Krivitsky,et al.  On the Question of Effective Sample Size in Network Modeling: An Asymptotic Inquiry. , 2011, Statistical science : a review journal of the Institute of Mathematical Statistics.

[34]  Guy Bresler,et al.  Mixing Time of Exponential Random Graphs , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[35]  A. Rinaldo,et al.  On the geometry of discrete exponential families with application to exponential random graph models , 2008, 0901.0026.

[36]  Christoph Stadtfeld,et al.  Multilevel social spaces: The network dynamics of organizational fields , 2017, Network Science.

[37]  A. Rinaldo,et al.  Random networks, graphical models and exchangeability , 2017, 1701.08420.

[38]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[39]  D. Hunter,et al.  Goodness of Fit of Social Network Models , 2008 .

[40]  Laura M. Koehly,et al.  Multilevel models for social networks: Hierarchical Bayesian approaches to exponential random graph modeling , 2016, Soc. Networks.

[41]  Zack W. Almquist,et al.  A Flexible Parameterization for Baseline Mean Degree in Multiple-Network ERGMs , 2015, The Journal of mathematical sociology.

[42]  Martina Morris,et al.  Adjusting for Network Size and Composition Effects in Exponential-Family Random Graph Models. , 2010, Statistical methodology.

[43]  M. Schweinberger.  Instability, Sensitivity, and Degeneracy of Discrete Exponential Families , 2011, Journal of the American Statistical Association.

[44]  Van H. Vu,et al.  Concentration of non‐Lipschitz functions and applications , 2002, Random Struct. Algorithms.

[45]  D. Hunter,et al.  Inference in Curved Exponential Family Models for Networks , 2006 .

[46]  Jenine K. Harris.  An Introduction to Exponential Random Graph Modeling , 2013 .

[47]  B. Efron.  THE GEOMETRY OF EXPONENTIAL FAMILIES , 1978 .

[48]  B. Efron.  Defining the Curvature of a Statistical Problem (with Applications to Second Order Efficiency) , 1975 .

[49]  K. Ramanan,et al.  Concentration Inequalities for Dependent Random Variables via the Martingale Method , 2006, math/0609835.

[50]  S. Chatterjee.  Concentration Inequalities With Exchangeable Pairs , 2005 .

[51]  L. Brown.  Fundamentals of statistical exponential families: with applications in statistical decision theory , 1986 .

[52]  Ove Frank,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[53]  Charles J. Geyer,et al.  Likelihood inference in exponential families and directions of recession , 2009, 0901.0455.

[54]  Garry Robins,et al.  Introduction to multilevel social networks , 2016, Soc. Networks.

[55]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .

[56]  Paul-Marie Samson,et al.  Concentration of measure inequalities for Markov chains and $\Phi$-mixing processes , 2000 .

[57]  D. Rubin.  INFERENCE AND MISSING DATA , 1975 .

[58]  Tom A. B. Snijders,et al.  Exponential Random Graph Models for Social Networks , 2013 .

[59]  Mark S Handcock,et al.  Local dependence in random graph models: characterization, properties and statistical inference , 2015, Journal of the American Statistical Association.

[60]  Agata Fronczak,et al.  Exponential random graph models , 2012, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..