Phase transition of Surprise optimization in community detection

Abstract Community detection is one of important issues in the research of complex networks. In literatures, many methods have been proposed to detect community structures in the networks, while they also have the scope of application themselves. In this paper, we investigate an important measure for community detection, Surprise (Aldecoa and Marin, Sci. Rep. 3 (2013) 1060), by focusing on the critical points in the merging and splitting of communities. We firstly analyze the critical behavior of Surprise and give the phase diagrams in community-partition transition. The results show that the critical number of communities for Surprise has a super-exponential increase with the increase of the link-density difference, while it is close to that of Modularity for small difference between inter- and intra-community link densities. By directly optimizing Surprise, we experimentally test the results on various networks, following a series of comparisons with other classical methods, and further find that the heterogeneity of networks could quicken the splitting of communities. On the whole, the results show that Surprise tends to split communities due to various reasons such as the heterogeneity in link density, degree and community size, and it thus exhibits higher resolution than other methods, e.g., Modularity, in community detection. Finally, we provide several approaches for enhancing Surprise.

[1]  Kevin E. Bassler,et al.  Improved community structure detection using a modified fine-tuning strategy , 2009, ArXiv.

[2]  Mingwei Leng,et al.  A divisive spectral method for network community detection , 2015, ArXiv.

[3]  J. Reichardt,et al.  Statistical mechanics of community detection. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[5]  Michalis Vazirgiannis,et al.  Clustering and Community Detection in Directed Networks: A Survey , 2013, ArXiv.

[6]  Sune Lehmann,et al.  Link communities reveal multiscale complexity in networks , 2009, Nature.

[7]  Chris H. Q. Ding,et al.  Determining modular organization of protein interaction networks by maximizing modularity density , 2010, BMC Systems Biology.

[8]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[9]  Licheng Jiao,et al.  Density shrinking algorithm for community detection with path based similarity , 2015 .

[10]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[11]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[12]  Hongtao Lu,et al.  Enhanced modularity-based community detection by random walk network preprocessing. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Zhuo-Ming Ren,et al.  Effects of multiple spreaders in community networks , 2014 .

[14]  A. Arenas,et al.  Community detection in complex networks using extremal optimization. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Angelo Bifone,et al.  Modular structure of brain functional networks: breaking the resolution limit by Surprise , 2016, Scientific Reports.

[16]  Jian Yu,et al.  An efficient community detection algorithm using greedy surprise maximization , 2014 .

[17]  Jianrui Chen,et al.  A dynamic evolutionary clustering perspective: Community detection in signed networks by reconstructing neighbor sets , 2016 .

[18]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[19]  Hui-Jia Li,et al.  A novel dynamics combination model reveals the hidden information of community structure , 2015 .

[20]  Hao Wang,et al.  Measuring robustness of community structure in complex networks , 2014, ArXiv.

[21]  Pablo M. Gleiser,et al.  Community Structure in Jazz , 2003, Adv. Complex Syst..

[22]  Yan Zhang,et al.  Multi-resolution community detection based on generalized self-loop rescaling strategy , 2014, Physica A: Statistical Mechanics and its Applications.

[23]  P. Ronhovde,et al.  Local resolution-limit-free Potts model for community detection. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Santo Fortunato,et al.  Community detection in networks: A user guide , 2016, ArXiv.

[25]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Yan Zhang,et al.  Analysis and perturbation of degree correlation in complex networks , 2015, ArXiv.

[27]  C. Nardini,et al.  Correlation enhanced modularity-based belief propagation method for community detection in networks , 2016 .

[28]  Tao Hu,et al.  Local modularity for community detection in complex networks , 2016 .

[29]  Duanbing Chen,et al.  Efficient stepwise detection of communities in temporal networks , 2017 .

[30]  Athina P. Petropulu,et al.  Detecting community structure using label propagation with consensus weight in complex network , 2014 .

[31]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Dongxiao He,et al.  A model framework for the enhancement of community detection in complex networks , 2016 .

[33]  Jie Cao,et al.  Weighted modularity optimization for crisp and fuzzy community detection in large-scale networks , 2016 .

[34]  Alex Arenas,et al.  Analysis of the structure of complex networks at different resolution levels , 2007, physics/0703218.

[35]  Hui-Jia Li,et al.  Social significance of community structure: Statistical view , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[37]  Raj Rao Nadakuditi,et al.  Graph spectra and the detectability of community structure in networks , 2012, Physical review letters.

[38]  Vincent A. Traag,et al.  Detecting communities using asymptotical Surprise , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Jinghua Xiao,et al.  Improving the recommender algorithms with the detected communities in bipartite networks , 2017 .

[40]  Xingyuan Wang,et al.  Community detection using local neighborhood in complex networks , 2015 .

[41]  Peng Gang Sun,et al.  Complete graph model for community detection , 2017 .

[42]  K. Deng,et al.  Linear analysis of degree correlations in complex networks , 2016 .

[43]  Cristopher Moore,et al.  Phase transition in the detection of modules in sparse networks , 2011, Physical review letters.

[44]  Pengfei Jiao,et al.  Identification of multi-attribute functional urban areas under a perspective of community detection: A case study , 2016 .

[45]  Jinlong Ma,et al.  Traffic dynamics on two-layer complex networks with limited delivering capacity , 2016 .

[46]  Xiang-Sun Zhang,et al.  Modularity optimization in community detection of complex networks , 2009 .

[47]  Santo Fortunato,et al.  Finding Statistically Significant Communities in Networks , 2010, PloS one.

[48]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Yong Wang,et al.  Overlapping Community Detection in Complex Networks using Symmetric Binary Matrix Factorization , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  Charo I. Del Genio,et al.  Finding network communities using modularity density , 2016, ArXiv.

[51]  Chaoyang Zhang,et al.  A novel gene network inference algorithm using predictive minimum description length approach , 2010, BMC Systems Biology.

[52]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[53]  Yu Xin,et al.  The adaptive dynamic community detection algorithm based on the non-homogeneous random walking , 2016 .

[54]  Ronghua Shang,et al.  A multiobjective evolutionary algorithm to find community structures based on affinity propagation , 2016 .

[55]  Ke Hu,et al.  Analysis of community-detection methods based on Potts spin model in complex networks , 2015 .

[56]  Li Zhang,et al.  Community detection in signed networks based on discrete-time model , 2017 .

[57]  Tao You,et al.  Community Detection in Complex Networks Using Density-based Clustering Algorithm , 2015, ArXiv.

[58]  Ignacio Marín,et al.  Surprise maximization reveals the community structure of complex networks , 2013, Scientific Reports.

[59]  Shuai Zhang,et al.  Improved efficient routing strategy on two-layer complex networks , 2016 .

[60]  Ying Fan,et al.  Cascading failures in complex networks with community structure , 2014 .

[61]  Liang Tang,et al.  Enhancing community detection by using local structural information , 2016, ArXiv.