USI-AUC: An evaluation criterion of community detection based on a novel link-prediction method

Modularity Evaluation (ME) is usually used in community detection for evaluating the disjoint and overlapping communities. In this paper, two obvious defects of ME are revealed and proved, including the non-decreasing contribution of isolated nodes to modularity and lacking of appropriate measures on overlapping community. We also propose a new evaluation criterion, the USI-AUC, which is the Area Under the Curve (AUC), originated from link-prediction of Uniform-Structure-Information (USI) model. We test the new criterion on various datasets, and find that such criterion can avoid the issues exposed in ME.

[1]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[2]  M. Barber.  Modularity and community detection in bipartite networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Mark E. J. Newman,et al.  Community detection in networks: Modularity optimization and maximum likelihood are equivalent , 2016, ArXiv.

[4]  Donald E. Knuth,et al.  The Stanford GraphBase - a platform for combinatorial computing , 1993 .

[5]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Réka Albert,et al.  Near linear time algorithm to detect community structures in large-scale networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Spyros Kotoulas,et al.  Efficient Skew Handling for Outer Joins in a Cloud Computing Environment , 2018, IEEE Transactions on Cloud Computing.

[8]  J. Reichardt,et al.  Statistical mechanics of community detection. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[11]  Vincenza Carchiolo,et al.  Extending modularity definition for directed graphs with overlapping communities , 2008 .

[12]  Jean-Loup Guillaume,et al.  Fast unfolding of community hierarchies in large networks , 2008, ArXiv.

[13]  Jianbin Huang,et al.  Towards Online Multiresolution Community Detection in Large-Scale Networks , 2011, PloS one.

[14]  Huawei Shen,et al.  Quantifying and identifying the overlapping community structure in networks , 2009, 0905.2666.

[15]  Alex Arenas,et al.  Analysis of the structure of complex networks at different resolution levels , 2007, physics/0703218.

[16]  Konstantin Avrachenkov,et al.  Cooperative Game Theory Approaches for Network Partitioning , 2017, COCOON.

[17]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[18]  L. Collins,et al.  Omega: A General Formulation of the Rand Index of Cluster Recovery Suitable for Non-disjoint Solutions. , 1988, Multivariate behavioral research.

[19]  V. Carchiolo,et al.  Extending the definition of modularity to directed graphs with overlapping communities , 2008, 0801.1647.

[20]  John E. Hopcroft,et al.  Using community information to improve the precision of link prediction methods , 2012, WWW.

[21]  Alneu de Andrade Lopes,et al.  A naïve Bayes model based on overlapping groups for link prediction in online social networks , 2015, SAC.

[22]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[23]  P. Ronhovde,et al.  Local resolution-limit-free Potts model for community detection. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[25]  Leon Danon,et al.  The effect of size heterogeneity on community identification in complex networks , 2006, physics/0601144.

[26]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[27]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[29]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[30]  P. Hespanha,et al.  An Efficient MATLAB Algorithm for Graph Partitioning , 2006 .

[31]  Johan A. K. Suykens,et al.  Kernel spectral clustering for community detection in complex networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[32]  Zhong Liu,et al.  Hierarchical Clustering Based on Hyper-edge Similarity for Community Detection , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[33]  Boleslaw K. Szymanski,et al.  Overlapping community detection in networks: The state-of-the-art and comparative study , 2011, CSUR.

[34]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data , 2009 .

[35]  C. Winick.  The Diffusion of an Innovation Among Physicians , 2016 .

[36]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[37]  Chris Hankin,et al.  Multi-scale Community Detection using Stability as Optimisation Criterion in a Greedy Algorithm , 2011, KDIR.

[38]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[39]  Steve Gregory,et al.  Finding overlapping communities in networks by label propagation , 2009, ArXiv.

[40]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[41]  Mao-Bin Hu,et al.  Detect overlapping and hierarchical community structure in networks , 2008, ArXiv.

[42]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[43]  Sanghamitra Bandyopadhyay,et al.  FOCS: Fast Overlapped Community Search , 2015, IEEE Transactions on Knowledge and Data Engineering.

[44]  T. Murata,et al.  Advanced modularity-specialized label propagation algorithm for detecting communities in networks , 2009, 0910.1154.

[45]  Clara Pizzuti,et al.  GA-Net: A Genetic Algorithm for Community Detection in Social Networks , 2008, PPSN.

[46]  Alneu de Andrade Lopes,et al.  Exploiting behaviors of communities of twitter users for link prediction , 2013, Social Network Analysis and Mining.

[47]  Spyros Kotoulas,et al.  Robust and Skew-resistant Parallel Joins in Shared-Nothing Systems , 2014, CIKM.

[48]  T. Nepusz,et al.  Fuzzy communities and the concept of bridgeness in complex networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Steve Gregory,et al.  Fuzzy overlapping communities in networks , 2010, ArXiv.

[50]  Mohamed A. Ismail,et al.  Enhanced community detection in social networks using active spectral clustering , 2016, SAC.

[51]  M. Newman.  Community detection in networks: Modularity optimization and maximum likelihood are equivalent , 2016, Physical review. E.

[52]  A. Arenas,et al.  Community detection in complex networks using extremal optimization. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Sune Lehmann,et al.  Link communities reveal multiscale complexity in networks , 2009, Nature.

[54]  J. Coleman,et al.  The Diffusion of an Innovation Among Physicians , 1957 .