Revealing dynamic communities in networks using genetic algorithm with merge and split operators

Abstract Community structures are pervasive in real-world networks, portraying the strong local clustering of nodes. Unveiling the community structure of a network is deemed to be a crucial step towards understanding its dynamics. Actually, most real-world networks are dynamic, and their community structures are evolving over time accordingly. How to reveal these dynamic communities has recently become a pressing issue. This paper presents an evolutionary method termed MSGA for accurately identifying dynamic communities in networks. First, we propose temporal asymptotic surprise (TAS), an effective measure to evaluate the quality of a partition on the snapshot of the dynamic network. Then we develop ad-hoc merge and split operators to perform an information-directed large-scale search at a low cost. Finally, large-scale search, coupled with classic genetic operators, are used to reveal a better solution for each snapshot of the network. MSGA does not require specifying the proposed number of communities. It can break the resolution limit and satisfies temporal smoothness constraints. Experimental results show that MSGA outperforms other state-of-the-art approaches on both synthetic networks and real-world networks.

[1]  Andrea Lancichinetti,et al.  Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Jean Véronis,et al.  HyperLex: lexical cartography for information retrieval , 2004, Comput. Speech Lang..

[3]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[4]  Maoguo Gong,et al.  Community Detection in Dynamic Social Networks Based on Multiobjective Immune Algorithm , 2012, Journal of Computer Science and Technology.

[5]  Lin Gao,et al.  Dynamic community detection based on network structural perturbation and topological similarity , 2017 .

[6]  A. Arenas,et al.  Community detection in complex networks using extremal optimization. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Dong Yang,et al.  Henneberg Growth of Social Networks: Modeling the Facebook , 2020, IEEE Transactions on Network Science and Engineering.

[8]  Benjamin H. Good,et al.  Performance of modularity maximization in practical contexts. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Francesco Folino,et al.  An Evolutionary Multiobjective Approach for Community Discovery in Dynamic Networks , 2014, IEEE Transactions on Knowledge and Data Engineering.

[10]  Dragomir R. Radev,et al.  LexRank: Graph-based Lexical Centrality as Salience in Text Summarization , 2004, J. Artif. Intell. Res..

[11]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[12]  Luonan Chen,et al.  Quantitative function for community detection. , 2008 .

[13]  Jingpu Zhang,et al.  Prediction of lncRNA-protein interactions using HeteSim scores based on heterogeneous networks , 2017, Scientific Reports.

[14]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[15]  Vincent A. Traag,et al.  Detecting communities using asymptotical Surprise , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  R. Guimerà,et al.  Functional cartography of complex metabolic networks , 2005, Nature.

[17]  Clara Pizzuti,et al.  GA-Net: A Genetic Algorithm for Community Detection in Social Networks , 2008, PPSN.

[18]  Santosh S. Vempala,et al.  On clusterings: Good, bad and spectral , 2004, JACM.

[19]  Alfred O. Hero,et al.  Dynamic Stochastic Blockmodels for Time-Evolving Social Networks , 2014, IEEE Journal of Selected Topics in Signal Processing.

[20]  Yun Chi,et al.  Analyzing communities and their evolutions in dynamic social networks , 2009, TKDD.

[21]  Giulio Rossetti,et al.  Community Discovery in Dynamic Networks , 2017, ACM Comput. Surv..

[22]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[23]  P. Ronhovde,et al.  Local resolution-limit-free Potts model for community detection. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  M. Hastings.  Community detection as an inference problem. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Jian-Guo Liu,et al.  Community detection via measuring the strength between nodes for dynamic networks , 2018, Physica A: Statistical Mechanics and its Applications.

[26]  Réka Albert,et al.  Near linear time algorithm to detect community structures in large-scale networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Jingpu Zhang,et al.  KATZLGO: Large-Scale Prediction of LncRNA Functions by Using the KATZ Measure Based on Multiple Networks , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[28]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Ignacio Marín,et al.  Surprise maximization reveals the community structure of complex networks , 2013, Scientific Reports.

[30]  Jitendra Malik,et al.  Normalized Cut and Image Segmentation , 1997 .

[31]  Peng Xiang,et al.  Automatic network clustering via density-constrained optimization with grouping operator , 2016, Appl. Soft Comput..

[32]  Bin Li,et al.  Multiobjective biogeography based optimization algorithm with decomposition for community detection in dynamic networks , 2015 .

[33]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[34]  Jihong Guan,et al.  Finding overlapping communities in networks using evolutionary method , 2013, ArXiv.

[35]  Mark E. J. Newman,et al.  Spectral methods for network community detection and graph partitioning , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Kevin D. Dorfman.  Erratum: DNA electrophoresis in microfluidic post arrays under moderate electric fields [Phys. Rev. E 73, 061922 (2006)] , 2008 .

[37]  Yongsheng Ding,et al.  Low-Rank Kernel Matrix Factorization for Large-Scale Evolutionary Clustering , 2012, IEEE Transactions on Knowledge and Data Engineering.

[38]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Ignacio Marín,et al.  Deciphering Network Community Structure by Surprise , 2011, PloS one.

[40]  Weidi Dai,et al.  A multi-similarity spectral clustering method for community detection in dynamic networks , 2016, Scientific Reports.

[41]  Jiawei Han,et al.  A Particle-and-Density Based Evolutionary Clustering Method for Dynamic Networks , 2009, Proc. VLDB Endow..

[42]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[43]  Shihua Zhang,et al.  Uncovering fuzzy community structure in complex networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Yun Chi,et al.  On evolutionary spectral clustering , 2009, TKDD.

[45]  Deepayan Chakrabarti,et al.  Evolutionary clustering , 2006, KDD '06.

[46]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[47]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[48]  Angelo Bifone,et al.  Modular structure of brain functional networks: breaking the resolution limit by Surprise , 2016, Scientific Reports.

[49]  Jian Yu,et al.  An efficient community detection algorithm using greedy surprise maximization , 2014 .

[50]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Martin Rosvall,et al.  An information-theoretic framework for resolving community structure in complex networks , 2007, Proceedings of the National Academy of Sciences.

[52]  Kathryn Roeder,et al.  Global spectral clustering in dynamic networks , 2018, Proceedings of the National Academy of Sciences.

[53]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[54]  Bara'a Ali Attea,et al.  A new multi-objective evolutionary framework for community mining in dynamic social networks , 2016, Swarm Evol. Comput..

[55]  Chonghui Guo,et al.  Evolutionary community structure discovery in dynamic weighted networks , 2014 .

[56]  Di Dong,et al.  Evolutionary Nonnegative Matrix Factorization Algorithms for Community Detection in Dynamic Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[57]  Enrique Herrera-Viedma,et al.  An incremental method to detect communities in dynamic evolving social networks , 2019, Knowl. Based Syst..

[58]  E A Leicht,et al.  Mixture models and exploratory analysis in networks , 2006, Proceedings of the National Academy of Sciences.

[59]  Shuigeng Zhou,et al.  Evolutionary method for finding communities in bipartite networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  Zechao Li,et al.  Tracking the evolution of overlapping communities in dynamic social networks , 2018, Knowl. Based Syst..

[61]  Edith Cohen,et al.  Search and replication in unstructured peer-to-peer networks , 2002 .

[62]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.