A community detection algorithm using network topologies and rule-based hierarchical arc-merging strategies

The authors use four criteria to examine a novel community detection algorithm: (a) effectiveness in terms of producing high values of normalized mutual information (NMI) and modularity, using well-known social networks for testing; (b) examination, meaning the ability to examine mitigating resolution limit problems using NMI values and synthetic networks; (c) correctness, meaning the ability to identify useful community structure results in terms of NMI values and Lancichinetti-Fortunato-Radicchi (LFR) benchmark networks; and (d) scalability, or the ability to produce comparable modularity values with fast execution times when working with large-scale real-world networks. In addition to describing a simple hierarchical arc-merging (HAM) algorithm that uses network topology information, we introduce rule-based arc-merging strategies for identifying community structures. Five well-studied social network datasets and eight sets of LFR benchmark networks were employed to validate the correctness of a ground-truth community, eight large-scale real-world complex networks were used to measure its efficiency, and two synthetic networks were used to determine its susceptibility to two resolution limit problems. Our experimental results indicate that the proposed HAM algorithm exhibited satisfactory performance efficiency, and that HAM-identified and ground-truth communities were comparable in terms of social and LFR benchmark networks, while mitigating resolution limit problems.

[1]  Alex Arenas,et al.  Analysis of the structure of complex networks at different resolution levels , 2007, physics/0703218.

[2]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Clara Pizzuti,et al.  A Multi-objective Genetic Algorithm for Community Detection in Networks , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[4]  Chang Honghao,et al.  Community detection using Ant Colony Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[5]  Yangyang Li,et al.  Large-scale community detection based on node membership grade and sub-communities integration , 2015, Physica A: Statistical Mechanics and its Applications.

[6]  M. Barber,et al.  Detecting network communities by propagating labels under constraints. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[8]  Hongtao Lu,et al.  Enhanced modularity-based community detection by random walk network preprocessing. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  S. Havlin,et al.  Self-similarity of complex networks , 2005, Nature.

[10]  ZhaoHan,et al.  Identifying influential nodes in complex networks with community structure , 2013 .

[11]  Jianhua Li,et al.  Locating Structural Centers: A Density-Based Clustering Method for Community Detection , 2017, PloS one.

[12]  Zuren Feng,et al.  Community detection using Ant Colony Optimization , 2013, IEEE Congress on Evolutionary Computation.

[13]  Réka Albert,et al.  Near linear time algorithm to detect community structures in large-scale networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Santo Fortunato,et al.  Limits of modularity maximization in community detection , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Konstantin Avrachenkov,et al.  Cooperative Game Theory Approaches for Network Partitioning , 2017, COCOON.

[16]  Ronghua Shang,et al.  A multiobjective evolutionary algorithm to find community structures based on affinity propagation , 2016 .

[17]  Yu Xue,et al.  A community integration strategy based on an improved modularity density increment for large-scale networks , 2017 .

[18]  Xiuzhen Zhang,et al.  Ant colony clustering with fitness perception and pheromone diffusion for community detection in complex networks , 2013 .

[19]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[20]  Qingfu Zhang,et al.  Community detection in networks by using multiobjective evolutionary algorithm with decomposition , 2012 .

[21]  R. Guimerà,et al.  Functional cartography of complex metabolic networks , 2005, Nature.

[22]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[23]  R. Carter 11 – IT and society , 1991 .

[24]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[25]  Matteo Pellegrini,et al.  Detecting Communities Based on Network Topology , 2014, Scientific Reports.

[26]  Tomoyuki Hiroyasu,et al.  Multiobjective clustering with automatic k-determination for large-scale data , 2007, GECCO '07.

[27]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Maoguo Gong,et al.  Complex Network Clustering by Multiobjective Discrete Particle Swarm Optimization Based on Decomposition , 2014, IEEE Transactions on Evolutionary Computation.

[29]  Martin Rosvall,et al.  An information-theoretic framework for resolving community structure in complex networks , 2007, Proceedings of the National Academy of Sciences.

[30]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[31]  Jiawei Han,et al.  Density-based shrinkage for revealing hierarchical and overlapping community structure in networks , 2011 .

[32]  Lin Gao,et al.  Detecting Overlapping Protein Complexes by Rough-Fuzzy Clustering in Protein-Protein Interaction Networks , 2014, PloS one.

[33]  O. Bagasra,et al.  Proceedings of the National Academy of Sciences , 1914, Science.

[34]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[35]  Xiangdong Liu,et al.  Web community detection model using particle swarm optimization , 2008, IEEE Congress on Evolutionary Computation.

[36]  Lada A. Adamic,et al.  The political blogosphere and the 2004 U.S. election: divided they blog , 2005, LinkKDD '05.

[37]  P. Ronhovde,et al.  Multiresolution community detection for megascale networks by information-based replica correlations. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Javier M Buldú,et al.  Community structures and role detection in music networks. , 2008, Chaos.

[39]  Yan Zhang,et al.  Multi-resolution community detection based on generalized self-loop rescaling strategy , 2014, Physica A: Statistical Mechanics and its Applications.

[40]  Lin Yanping,et al.  Web community detection model using particle swarm optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[41]  T. Murata,et al.  Advanced modularity-specialized label propagation algorithm for detecting communities in networks , 2009, 0910.1154.

[42]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[44]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[45]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[46]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[47]  M. Newman,et al.  Finding community structure in very large networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  Chung-Yuan Huang,et al.  Using a two-phase evolutionary framework to select multiple network spreaders based on community structure , 2016 .

[49]  Haluk Bingol,et al.  Community Detection in Complex Networks Using Genetic Algorithms , 2006, 0711.0491.

[50]  M. Newman Communities, modules and large-scale structure in networks , 2011, Nature Physics.

[51]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[52]  Sune Lehmann,et al.  Link communities reveal multiscale complexity in networks , 2009, Nature.

[53]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[54]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[55]  Qinbao Song,et al.  CenLP: A centrality-based label propagation algorithm for community detection in networks , 2015 .

[56]  Jian Yu,et al.  An efficient community detection algorithm using greedy surprise maximization , 2014 .

[57]  Keith C. C. Chan,et al.  Evolutionary community detection in social networks , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[58]  Clara Pizzuti,et al.  A Multiobjective Genetic Algorithm to Find Communities in Complex Networks , 2012, IEEE Transactions on Evolutionary Computation.

[59]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  Maoguo Gong,et al.  Memetic algorithm for community detection in networks. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[61]  Ronghua Shang,et al.  Circularly Searching Core Nodes Based Label Propagation Algorithm for Community Detection , 2016, Int. J. Pattern Recognit. Artif. Intell..

[62]  Han Zhao,et al.  Identifying influential nodes in complex networks with community structure , 2013, Knowl. Based Syst..

[63]  M. Newman,et al.  Vertex similarity in networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[64]  Andrea Lancichinetti,et al.  Community detection algorithms: a comparative analysis: invited presentation, extended abstract , 2009, VALUETOOLS.

[65]  Shihua Zhang,et al.  Identification of overlapping community structure in complex networks using fuzzy c-means clustering , 2007 .

[66]  Jari Saramäki,et al.  Emergence of communities in weighted networks. , 2007, Physical review letters.

[67]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[68]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[69]  Ronghua Shang,et al.  Community detection based on modularity and an improved genetic algorithm , 2013 .

[70]  Hernán A. Makse,et al.  A review of fractality and self-similarity in complex networks , 2007 .

[71]  Clara Pizzuti,et al.  GA-Net: A Genetic Algorithm for Community Detection in Social Networks , 2008, PPSN.

[72]  Chung-Yuan Huang,et al.  Using global diversity and local topology features to identify influential network spreaders , 2015 .

[73]  J. Reichardt,et al.  Statistical mechanics of community detection. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[74]  Licheng Jiao,et al.  Density shrinking algorithm for community detection with path based similarity , 2015 .