Critical analysis of (Quasi-)Surprise for community detection in complex networks

Module or community structures widely exist in complex networks, and optimizing statistical measures is one of the most popular approaches for revealing and identifying such structures in real-world applications. In this paper, we focus on critical behaviors of (Quasi-)Surprise, a type of statistical measure of interest for community structure, accompanied by a series of comparisons with other measures. Specially, the effect of various network parameters on the measures is thoroughly investigated. The critical number of dense subgraphs in partition transition is derived, and a kind of phase diagrams is provided to display and compare the phase transitions of the measures. The effect of “potential well” for (Quasi-)Surprise is revealed, which may be difficult to get across by general greedy (agglomerative or divisive) algorithms. Finally, an extension of Quasi-Surprise is introduced for the study of multi-scale structures. Experimental results are of help for understanding the critical behaviors of (Quasi-)Surprise, and may provide useful insight for the design of effective tools for community detection.

[1]  Corrado Priami,et al.  Snazer: the simulations and networks analyzer , 2010, BMC Systems Biology.

[2]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[3]  Michele Leone,et al.  (Un)detectable cluster structure in sparse networks. , 2007, Physical review letters.

[4]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Xiaochun Cao,et al.  Active link selection for efficient semi-supervised community detection , 2015, Scientific Reports.

[6]  Liang Tang,et al.  Enhancing community detection by using local structural information , 2016, ArXiv.

[7]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[8]  Ying Ju,et al.  Complex Network Clustering by a Multi-objective Evolutionary Algorithm Based on Decomposition and Membrane Structure , 2016, Scientific Reports.

[9]  Santo Fortunato,et al.  Finding Statistically Significant Communities in Networks , 2010, PloS one.

[10]  Tao Hu,et al.  Local modularity for community detection in complex networks , 2016 .

[11]  Yan Zhang,et al.  Multi-resolution community detection based on generalized self-loop rescaling strategy , 2014, Physica A: Statistical Mechanics and its Applications.

[12]  P. Ronhovde,et al.  Local resolution-limit-free Potts model for community detection. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Chris H. Q. Ding,et al.  Determining modular organization of protein interaction networks by maximizing modularity density , 2010, BMC Systems Biology.

[14]  Benjamin H. Good,et al.  Performance of modularity maximization in practical contexts. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Angelo Bifone,et al.  Modular structure of brain functional networks: breaking the resolution limit by Surprise , 2016, Scientific Reports.

[17]  Jian Yu,et al.  An efficient community detection algorithm using greedy surprise maximization , 2014 .

[18]  Stefan Bornholdt,et al.  Detecting fuzzy community structures in complex networks with a Potts model. , 2004, Physical review letters.

[19]  Jianrui Chen,et al.  A dynamic evolutionary clustering perspective: Community detection in signed networks by reconstructing neighbor sets , 2016 .

[20]  Xiang-Sun Zhang,et al.  Potts model based on a Markov process computation solves the community structure problem effectively , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[22]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[23]  Raj Rao Nadakuditi,et al.  Graph spectra and the detectability of community structure in networks , 2012, Physical review letters.

[24]  Xingpeng Jiang,et al.  Discovering communities in complex networks by edge label propagation , 2016, Scientific Reports.

[25]  Elbert E. N. Macau,et al.  Dynamical detection of network communities , 2016, Scientific Reports.

[26]  Zhao Yang,et al.  A Comparative Analysis of Community Detection Algorithms on Artificial Networks , 2016, Scientific Reports.

[27]  Jean-Charles Delvenne,et al.  Stability of graph communities across time scales , 2008, Proceedings of the National Academy of Sciences.

[28]  Steve Gregory,et al.  Finding overlapping communities in networks by label propagation , 2009, ArXiv.

[29]  Guanrong Chen,et al.  Identifying structures of continuously-varying weighted networks , 2016, Scientific Reports.

[30]  Alexander Struck,et al.  Identification of overlapping communities and their hierarchy by locally calculating community-changing resolution levels , 2010, ArXiv.

[31]  Shu Yan,et al.  Global and local targeted immunization in networks with community structure , 2015 .

[32]  Weixiong Zhang,et al.  Identification of leader and self-organizing communities in complex networks , 2017, Scientific Reports.

[33]  Xiang-Sun Zhang,et al.  Modularity optimization in community detection of complex networks , 2009 .

[34]  Chaoyang Zhang,et al.  A novel gene network inference algorithm using predictive minimum description length approach , 2010, BMC Systems Biology.

[35]  Xue-Qi Cheng,et al.  Uncovering the community structure associated with the diffusion dynamics on networks , 2009, 0911.2308.

[36]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Mingwei Leng,et al.  A divisive spectral method for network community detection , 2015, ArXiv.

[38]  J. Reichardt,et al.  Statistical mechanics of community detection. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Carlo Ratti,et al.  A General Optimization Technique for High Quality Community Detection in Complex Networks , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Xingyi Zhang,et al.  Overlapping Community Detection based on Network Decomposition , 2016, Scientific Reports.

[41]  Kuru Ratnavelu,et al.  A semi-synchronous label propagation algorithm with constraints for community detection in complex networks , 2017, Scientific Reports.

[42]  Sidney Redner,et al.  Community structure of the physical review citation network , 2009, J. Informetrics.

[43]  Xingyi Zhang,et al.  A seed-expanding method based on random walks for community detection in networks with ambiguous community structures , 2017, Scientific Reports.

[44]  C. Nardini,et al.  Correlation enhanced modularity-based belief propagation method for community detection in networks , 2016 .

[45]  Johan van Leeuwaarden,et al.  Epidemic spreading on complex networks with community structures , 2016, Scientific Reports.

[46]  Vincent A. Traag,et al.  Detecting communities using asymptotical Surprise , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Ignacio Marín,et al.  Surprise maximization reveals the community structure of complex networks , 2013, Scientific Reports.

[48]  Alessandro Flammini,et al.  Optimal network clustering for information diffusion , 2014, Physical review letters.

[49]  Alex Arenas,et al.  Analysis of the structure of complex networks at different resolution levels , 2007, physics/0703218.

[50]  Hui-Jia Li,et al.  Social significance of community structure: Statistical view , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Krista Rizman Zalik,et al.  Maximal Neighbor Similarity Reveals Real Communities in Networks , 2015, Scientific Reports.

[52]  Weidi Dai,et al.  A multi-similarity spectral clustering method for community detection in dynamic networks , 2016, Scientific Reports.

[53]  Matthieu Latapy,et al.  Computing Communities in Large Networks Using Random Walks , 2004, J. Graph Algorithms Appl..

[54]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[55]  Jian Yu,et al.  Node Attribute-enhanced Community Detection in Complex Networks , 2017, Scientific Reports.

[56]  Aihua Li,et al.  Fast and Accurate Mining the Community Structure: Integrating Center Locating and Membership Optimization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[57]  Wei Li,et al.  Multi-resolution community detection in massive networks , 2016, Scientific Reports.

[58]  Vincent A. Traag,et al.  Significant Scales in Community Structure , 2013, Scientific Reports.

[59]  Alex Arenas,et al.  Synchronization reveals topological scales in complex networks. , 2006, Physical review letters.

[60]  Jie Zhang,et al.  Finding Communities by Their Centers , 2016, Scientific Reports.