Change Point Estimation in a Dynamic Stochastic Block Model

We consider the problem of estimating the location of a single change point in a dynamic stochastic block model. We propose two methods of estimating the change point, together with the model parameters. The first employs a least squares criterion function and takes into consideration the full structure of the stochastic block model and is evaluated at each point in time. Hence, as an intermediate step, it requires estimating the community structure based on a clustering algorithm at every time point. The second method comprises of the following two steps: in the first one, a least squares function is used and evaluated at each time point, but ignores the community structures and just considers a random graph generating mechanism exhibiting a change point. Once the change point is identified, in the second step, all network data before and after it are used together with a clustering algorithm to obtain the corresponding community structures and subsequently estimate the generating stochastic block model parameters. A comparison between these two methods is illustrated. Further, for both methods under their respective identifiability and certain additional regularity conditions, we establish rates of convergence and derive the asymptotic distributions of the change point estimators. The results are illustrated on synthetic data.

[1]  Bin Yu,et al.  Spectral clustering and the high-dimensional stochastic blockmodel , 2010, 1007.1684.

[2]  Chao Gao,et al.  Achieving Optimal Misclassification Proportion in Stochastic Block Models , 2015, J. Mach. Learn. Res..

[3]  G. Michailidis,et al.  Common change point estimation in panel data from the least squares and maximum likelihood viewpoints , 2017, 1708.05836.

[4]  Yihong Gong,et al.  Detecting communities and their evolutions in dynamic social networks—a Bayesian approach , 2011, Machine Learning.

[5]  Harry Crane,et al.  Probabilistic Foundations of Statistical Network Analysis , 2018 .

[6]  Jiashun Jin,et al.  FAST COMMUNITY DETECTION BY SCORE , 2012, 1211.5803.

[7]  Duncan J. Watts,et al.  The Structure and Dynamics of Networks: (Princeton Studies in Complexity) , 2006 .

[8]  I E Auger,et al.  Algorithms for the optimal identification of segment neighborhoods. , 1989, Bulletin of mathematical biology.

[9]  M. Kosorok Introduction to Empirical Processes and Semiparametric Inference , 2008 .

[10]  Anderson Y. Zhang,et al.  Minimax Rates of Community Detection in Stochastic Block Models , 2015, ArXiv.

[11]  Leto Peel,et al.  Detecting Change Points in the Large-Scale Structure of Evolving Networks , 2014, AAAI.

[12]  Bin Yu,et al.  Impact of regularization on spectral clustering , 2013, 2014 Information Theory and Applications Workshop (ITA).

[13]  Ji Zhu,et al.  Consistency of community detection in networks under degree-corrected stochastic block models , 2011, 1110.3854.

[14]  Marianna Pensky,et al.  Spectral clustering in the dynamic stochastic block model , 2017, Electronic Journal of Statistics.

[15]  Daniele Durante,et al.  Locally Adaptive Dynamic Networks , 2015, 1505.05668.

[16]  Patrick J. Wolfe,et al.  Co-clustering separately exchangeable network data , 2012, ArXiv.

[17]  Alessandro Casini,et al.  Structural Breaks in Time Series , 2018, Oxford Research Encyclopedia of Economics and Finance.

[18]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[19]  A. Tsybakov,et al.  Oracle inequalities for network models and sparse graphon estimation , 2015, 1507.04118.

[20]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[21]  Peter J. Mucha,et al.  Portrait of Political Party Polarization1 , 2013, Network Science.

[22]  George Michailidis,et al.  Core community structure recovery and phase transition detection in temporally evolving networks , 2018, Scientific Reports.

[23]  Can M. Le,et al.  Concentration and regularization of random graphs , 2015, Random Struct. Algorithms.

[24]  Le Song,et al.  Estimating time-varying networks , 2008, ISMB 2008.

[25]  B. Brodsky,et al.  Nonparametric Methods in Change Point Problems , 1993 .

[26]  Harrison H. Zhou,et al.  Rate-optimal graphon estimation , 2014, 1410.5837.

[27]  Srinivasan Parthasarathy,et al.  Hierarchical Change Point Detection on Dynamic Networks , 2017, WebSci.

[28]  L. Horváth,et al.  Limit Theorems in Change-Point Analysis , 1997 .

[29]  Edoardo M. Airoldi,et al.  Consistent estimation of dynamic and multi-layer block models , 2014, ICML.

[30]  Amit Kumar,et al.  A simple linear time (1 + /spl epsiv/)-approximation algorithm for k-means clustering in any dimensions , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[31]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data with R , 2020, Use R!.

[32]  A. Rinaldo,et al.  Optimal change point detection and localization in sparse dynamic networks , 2018, The Annals of Statistics.

[33]  Daniele Durante,et al.  Nonparametric Bayes Modeling of Populations of Networks , 2014, 1406.7851.

[34]  Marianna Pensky,et al.  Dynamic network models and graphon estimation , 2016, The Annals of Statistics.

[35]  E. Xing,et al.  A state-space mixed membership blockmodel for dynamic network tomography , 2008, 0901.0135.

[36]  Vincent Miele,et al.  Statistical clustering of temporal networks through a dynamic stochastic block model , 2015, 1506.07464.

[37]  A. Rinaldo,et al.  Consistency of spectral clustering in stochastic block models , 2013, 1312.2050.

[38]  P. Bickel,et al.  Role of normalization in spectral clustering for stochastic blockmodels , 2013, 1310.1495.

[39]  R. Oliveira Concentration of the adjacency matrix and of the Laplacian in random graphs with independent edges , 2009, 0911.0600.

[40]  Michael D. Ward,et al.  Relax, Tensors Are Here: Dependencies in International Processes , 2015, ArXiv.

[41]  Pierre Hansen,et al.  NP-hardness of Euclidean sum-of-squares clustering , 2008, Machine Learning.

[42]  Kevin S. Xu Stochastic Block Transition Models for Dynamic Networks , 2014, AISTATS.

[43]  E. Levina,et al.  Estimating network edge probabilities by neighborhood smoothing , 2015, 1509.08588.