Multi-objective evolutionary clustering for large-scale dynamic community detection

Abstract The research of dynamic community detection is becoming increasingly popular since it can disclose how the community structures change over time in dynamic networks. Evolutionary clustering is often utilized for the goal and has achieved some success, which, however, still has some major drawbacks: (1) The absence of error correction may lead to the result-drifting problem and the error accumulation problem; (2) The NP-hardness of modularity based community detection makes it low efficiency to get an exact solution. In this paper, an efficient and effective multi-objective method, namely DYN-MODPSO, is proposed, and where the traditional evolutionary clustering framework and the particle swarm algorithm are modified and enhanced, respectively. The main contributions include that: (1) A novel strategy, namely the recent future reference, is devised for the initial clustering result correction to make the dynamic community detection more effective; (2) The traditional particle swarm algorithm is improved and integrated with the evolutionary clustering framework by profitably exploiting the proposed strategy; (3) The de-redundant random walk based population initialization is proposed to diversify the individuals in a quality-guaranteed way. Furthermore, the multi-individual crossover operator and the improved interference operator are carefully designed to keep the solution from local optimization. Extensive experiments conducted on the real and the synthetic dynamic networks manifest that the proposed DYN-MODPSO outperforms the competitors in terms of both effectiveness and efficiency.

[1]  Jing Liu,et al.  An improved multi-objective evolutionary algorithm for simultaneously detecting separated and overlapping communities , 2015, Natural Computing.

[2]  Maoguo Gong,et al.  Complex Network Clustering by Multiobjective Discrete Particle Swarm Optimization Based on Decomposition , 2014, IEEE Transactions on Evolutionary Computation.

[3]  A. Moore,et al.  Dynamic social network analysis using latent space models , 2005, SKDD.

[4]  Consolación Gil,et al.  Adaptive community detection in complex networks using genetic algorithms , 2017, Neurocomputing.

[5]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[6]  João Gama,et al.  Dynamic community detection in evolving networks using locality modularity optimization , 2016, Social Network Analysis and Mining.

[7]  Francesco Folino,et al.  An Evolutionary Multiobjective Approach for Community Discovery in Dynamic Networks , 2014, IEEE Transactions on Knowledge and Data Engineering.

[8]  Borut Zalik,et al.  Memetic algorithm using node entropy and partition entropy for community detection in networks , 2018, Inf. Sci..

[9]  Babak Amiri,et al.  A hybrid artificial immune network for detecting communities in complex networks , 2014, Computing.

[10]  Deepayan Chakrabarti,et al.  Evolutionary clustering , 2006, KDD '06.

[11]  Di Dong,et al.  Evolutionary Nonnegative Matrix Factorization Algorithms for Community Detection in Dynamic Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[12]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[13]  Jiawei Han,et al.  A Particle-and-Density Based Evolutionary Clustering Method for Dynamic Networks , 2009, Proc. VLDB Endow..

[14]  Chunguang Zhou,et al.  Community Mining in Complex Networks---Clustering Combination Based Genetic Algorithm: Community Mining in Complex Networks---Clustering Combination Based Genetic Algorithm , 2010 .

[15]  Mikko Kolehmainen,et al.  Why don’t you use Evolutionary Algorithms in Big Data? , 2017 .

[16]  Ali Hamzeh,et al.  Incremental community miner for dynamic networks , 2018, Applied Intelligence.

[17]  Clara Pizzuti,et al.  Evolutionary Computation for Community Detection in Networks: A Review , 2018, IEEE Transactions on Evolutionary Computation.

[18]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Charu C. Aggarwal,et al.  Evolutionary Network Analysis , 2014, ACM Comput. Surv..

[20]  Bin Wu,et al.  Dynamic Community Detection Algorithm Based on Incremental Identification , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[21]  Mikkel T. Jensen,et al.  Reducing the run-time complexity of multiobjective EAs: The NSGA-II and other algorithms , 2003, IEEE Trans. Evol. Comput..