Monitoring dynamic networks: A simulation‐based strategy for comparing monitoring methods and a comparative study

Recently there has been a lot of interest in monitoring and identifying changes in dynamic networks, which has led to the development of a variety of monitoring methods. Unfortunately, these methods have not been systematically compared; moreover, new methods are often designed for a specialized use case. In light of this, we propose the use of simulation to compare the performance of network monitoring methods over a variety of dynamic network changes. Using our family of simulated dynamic networks, we compare the performance of several state-of-the-art social network monitoring methods in the literature. We compare their performance over a variety of types of change; we consider both increases in communication levels, node propensity change as well as changes in community structure. We show that there does not exist one method that is uniformly superior to the others; the best method depends on the context and the type of change one wishes to detect. As such, we conclude that a variety of methods is needed for network monitoring and that it is important to understand in which scenarios a given method is appropriate.

[1]  A. Moore,et al.  Dynamic social network analysis using latent space models , 2005, SKDD.

[2]  George C. Runger,et al.  Monitoring Temporal Homogeneity in Attributed Network Streams , 2016 .

[3]  Edoardo M. Airoldi,et al.  A Survey of Statistical Network Models , 2009, Found. Trends Mach. Learn..

[4]  Alexander G. Tartakovsky,et al.  Statistical methods for network surveillance , 2018 .

[5]  Edoardo M. Airoldi,et al.  Consistent estimation of dynamic and multi-layer block models , 2014, ICML.

[6]  T. Snijders.  Models for longitudinal network datain , 2005 .

[7]  Rassoul Noorossana,et al.  Performance evaluation of EWMA and CUSUM control charts to detect anomalies in social networks using average and standard deviation of degree measures , 2018, Qual. Reliab. Eng. Int..

[8]  Gen Li,et al.  Varying-coefficient models for dynamic networks , 2017, Comput. Stat. Data Anal..

[9]  William H. Woodall,et al.  Performance evaluation of social network anomaly detection using a moving window–based scan method , 2018, Qual. Reliab. Eng. Int..

[10]  William H. Woodall,et al.  Modeling and detecting change in temporal networks via the degree corrected stochastic block model , 2019, Qual. Reliab. Eng. Int..

[11]  Mason A. Porter,et al.  Communities in Networks , 2009, ArXiv.

[12]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[13]  Srinivasan Parthasarathy,et al.  Fast Change Point Detection on Dynamic Social Networks , 2017, IJCAI.

[14]  Kathleen M. Carley,et al.  Social Network Change Detection , 2008 .

[15]  William H. Woodall,et al.  An overview and perspective on social network monitoring , 2016, ArXiv.

[16]  Murat Kulahci,et al.  Quality Quandaries: The Effect of Autocorrelation on Statistical Process Control Procedures , 2005 .

[17]  M Frisén,et al.  Evaluations of methods for statistical surveillance. , 1992, Statistics in medicine.

[18]  Kwok-Leung Tsui,et al.  Detecting node propensity changes in the dynamic degree corrected stochastic block model , 2018, Soc. Networks.

[19]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[20]  B. Bollobás.  The evolution of random graphs , 1984 .

[21]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: I. An introduction to Markov graphs andp , 1996 .

[22]  Leto Peel,et al.  Detecting Change Points in the Large-Scale Structure of Evolving Networks , 2014, AAAI.

[23]  Daniel B. Horn,et al.  Change Detection in Social Networks , 2008 .

[24]  Xiuzhen Zhang,et al.  Anomaly detection in online social networks , 2014, Soc. Networks.

[25]  Kathleen M. Carley,et al.  Detecting Change in Longitudinal Social Networks , 2011, J. Soc. Struct..

[26]  William H. Woodall,et al.  Modeling and Detecting Change in Temporal Networks via a Dynamic Degree Corrected Stochastic Block Model , 2016 .

[27]  A. Shiryaev.  On Optimum Methods in Quickest Detection Problems , 1963 .

[28]  Simon De Ridder,et al.  Detection and localization of change points in temporal networks with the aid of stochastic block models , 2016, ArXiv.

[29]  David J. Marchette,et al.  Scan Statistics on Enron Graphs , 2005, Comput. Math. Organ. Theory.

[30]  William H. Woodall,et al.  The value of summary statistics for anomaly detection in temporally evolving networks: A performance evaluation study , 2019, Applied Stochastic Models in Business and Industry.

[31]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[32]  E. Xing,et al.  Discrete Temporal Models of Social Networks , 2006, SNA@ICML.

[33]  Tai Qin,et al.  Regularized Spectral Clustering under the Degree-Corrected Stochastic Blockmodel , 2013, NIPS.

[34]  Jessen T. Havill,et al.  Networks , 1995, Discovering Computer Science.

[35]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: II. Multivariate relations. , 1999, The British journal of mathematical and statistical psychology.

[36]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  S. Wasserman.  Analyzing Social Networks as Stochastic Processes , 1980 .

[38]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[39]  Kathleen M. Carley,et al.  Detecting Change in Human Social Behavior Simulation , 2008 .

[40]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[41]  Stefan H. Steiner,et al.  Hurdle Blockmodels for Sparse Network Modeling , 2021, The American Statistician.

[42]  Samuel Leinhardt,et al.  A dynamic model for social networks , 1977 .