Consistent estimation of dynamic and multi-layer block models

Significant progress has been made recently on theoretical analysis of estimators for the stochastic block model (SBM). In this paper, we consider the multi-graph SBM, which serves as a foundation for many application settings including dynamic and multi-layer networks. We explore the asymptotic properties of two estimators for the multi-graph SBM, namely spectral clustering and the maximum-likelihood estimate (MLE), as the number of layers of the multi-graph increases. We derive sufficient conditions for consistency of both estimators and propose a variational approximation to the MLE that is computationally feasible for large networks. We verify the sufficient conditions via simulation and demonstrate that they are practical. In addition, we apply the model to two real data sets: a dynamic social network and a multi-layer social network with several types of relations.

[1]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[2]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[3]  M. M. Meyer,et al.  Statistical Analysis of Multiple Sociometric Relations. , 1985 .

[4]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  A. Moore,et al.  Dynamic social network analysis using latent space models , 2005, SKDD.

[6]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[7]  Purnamrita Sarkar,et al.  A Latent Space Approach to Dynamic Embedding of Co-occurrence Data , 2007, AISTATS.

[8]  Franck Picard,et al.  A mixture model for random graphs , 2008, Stat. Comput..

[9]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[10]  Edoardo M. Airoldi,et al.  A Survey of Statistical Network Models , 2009, Found. Trends Mach. Learn..

[11]  P. Bickel,et al.  A nonparametric view of network models and Newman–Girvan and other modularities , 2009, Proceedings of the National Academy of Sciences.

[12]  Amr Ahmed,et al.  Recovering time-varying networks of dependencies in social and biological studies , 2009, Proceedings of the National Academy of Sciences.

[13]  Michael Szell,et al.  Multirelational organization of large-scale social networks in an online world , 2010, Proceedings of the National Academy of Sciences.

[14]  E. Xing,et al.  Discrete Temporal Models of Social Networks , 2006, SNA@ICML.

[15]  R. Oliveira.  Concentration of the adjacency matrix and of the Laplacian in random graphs with independent edges , 2009, 0911.0600.

[16]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[17]  Naonori Ueda,et al.  Dynamic Infinite Relational Model for Time-varying Relational Data Analysis , 2010, NIPS.

[18]  Yihong Gong,et al.  Detecting communities and their evolutions in dynamic social networks—a Bayesian approach , 2011, Machine Learning.

[19]  Edward R. Scheinerman,et al.  Modeling graphs using dot product representations , 2010, Comput. Stat..

[20]  Le Song,et al.  Evolving Cluster Mixed-Membership Blockmodel for Time-Evolving Networks , 2011, AISTATS.

[21]  Matteo Magnani,et al.  The ML-Model for Multi-layer Social Networks , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[22]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Bin Yu,et al.  Spectral clustering and the high-dimensional stochastic blockmodel , 2010, 1007.1684.

[24]  James R. Foulds,et al.  A Dynamic Relational Infinite Feature Model for Longitudinal Social Networks , 2011, AISTATS.

[25]  Alain Celisse,et al.  Consistency of maximum-likelihood and variational estimators in the Stochastic Block Model , 2011, 1105.3288.

[26]  Carey E. Priebe,et al.  A Consistent Adjacency Spectral Embedding for Stochastic Blockmodel Graphs , 2011, 1108.2228.

[27]  Cristopher Moore,et al.  Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Ali Yener Mutlu,et al.  Dynamic network summarization using convex optimization , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[29]  Alfred O. Hero,et al.  Adaptive evolutionary clustering , 2011, Data Mining and Knowledge Discovery.

[30]  Xiangyu Chang,et al.  Asymptotic Normality of Maximum Likelihood and its Variational Approximation for Stochastic Blockmodels , 2012, ArXiv.

[31]  Jiashun Jin,et al.  Fast network community detection by SCORE , 2012, ArXiv.

[32]  Ji Zhu,et al.  Consistency of community detection in networks under degree-corrected stochastic block models , 2011, 1110.3854.

[33]  Edoardo M. Airoldi,et al.  Stochastic blockmodels with growing number of classes , 2010, Biometrika.

[34]  Zoubin Ghahramani,et al.  Dynamic Probabilistic Models for Latent Feature Propagation in Social Networks , 2013, ICML.

[35]  Edoardo M. Airoldi,et al.  Stochastic blockmodel approximation of a graphon: Theory and consistent estimation , 2013, NIPS.

[36]  Jure Leskovec,et al.  Nonparametric Multi-group Membership Model for Dynamic Networks , 2013, NIPS.

[37]  P. Wolfe,et al.  Nonparametric graphon estimation , 2013, 1309.5936.

[38]  Peter J. Bickel,et al.  Pseudo-likelihood methods for community detection in large sparse networks , 2012, 1207.2340.

[39]  Alfred O. Hero,et al.  Multi-Layer Graph Analysis for Dynamic Social Networks , 2013, IEEE Journal of Selected Topics in Signal Processing.

[40]  Alfred O. Hero,et al.  Dynamic Stochastic Blockmodels for Time-Evolving Social Networks , 2014, IEEE Journal of Selected Topics in Signal Processing.

[41]  Daniele Durante,et al.  Bayesian Logistic Gaussian Process Models for Dynamic Networks , 2014, AISTATS.

[42]  Edoardo M. Airoldi,et al.  Nonparametric estimation and testing of exchangeable graph models , 2014, AISTATS.

[43]  Daniele Durante,et al.  Nonparametric Bayes Modeling of Populations of Networks , 2014, 1406.7851.

[44]  Jiashun Jin,et al.  FAST COMMUNITY DETECTION BY SCORE , 2012, 1211.5803.

[45]  Kevin S. Xu.  Stochastic Block Transition Models for Dynamic Networks , 2014, AISTATS.

[46]  A. Rinaldo,et al.  Consistency of spectral clustering in stochastic block models , 2013, 1312.2050.

[47]  Harrison H. Zhou,et al.  Rate-optimal graphon estimation , 2014, 1410.5837.

[48]  Tyler H McCormick,et al.  LATENT SPACE MODELS FOR MULTIVIEW NETWORK DATA. , 2017, The annals of applied statistics.