CoVeC: Coarse-grained vertex clustering for efficient community detection in sparse complex networks

Abstract This paper tackles the problem of community detection in large-scale graphs. In the literature devoted to this topic, an iterative algorithm, called Louvain Method (LM), stands out as an effective and fast solution for this problem. However, the first iterations of the LM are the most costly. To overcome this issue, this paper introduces CoVeC, a Coarse-grained Vertex Clustering for efficient community detection in sparse complex networks. CoVeC pre-processes the original graph in order to forward a graph of reduced size to the LM. The subsequent group formation, including the maximization of group quality, as per the modularity metric, is left to the LM. We evaluate our proposal using real-world and synthetic networks, presenting distinct sizes and sparsity levels. Overall, our experimental results show that CoVeC can be a way faster option than the first iterations of the LM, yet similarly effective. In fact, for sparser graphs, the combo CoVeC+LM outperforms the standalone LM and its variations, attaining a mean processing time reduction of 47% and a mean modularity reduction of only 0.4%.

[1]  David Fuhry,et al.  Community Discovery: Simple and Scalable Approaches , 2015 .

[2]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[3]  Daniel Gómez,et al.  A New Community Detection Algorithm Based on Fuzzy Measures , 2019, Intelligent and Fuzzy Techniques in Big Data Analytics and Decision Making.

[4]  Christos Faloutsos,et al.  Sampling from large graphs , 2006, KDD '06.

[5]  Sanjukta Bhowmick,et al.  A Template for Parallelizing the Louvain Method for Modularity Maximization , 2013 .

[6]  Jure Leskovec,et al.  Empirical comparison of algorithms for network community detection , 2010, WWW '10.

[7]  Niloy Ganguly,et al.  Metrics for Community Analysis , 2016, ACM Comput. Surv..

[8]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[9]  Paulo A. A. Esquef,et al.  Método Rápido de Agrupamento de Vértices para Detecção de Comunidades em Redes Complexas de Larga-escala , 2018, Anais do Workshop em Desempenho de Sistemas Computacionais e de Comunicação (WPerformance).

[10]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[11]  Mary Inaba,et al.  A Simple Acceleration Method for the Louvain Algorithm , 2016 .

[12]  Hadi Tabatabaee Malazi,et al.  Adaptive parallel Louvain community detection on a multicore platform , 2017, Microprocess. Microsystems.

[13]  Laxmi Chaudhary,et al.  Community Detection Using an Enhanced Louvain Method in Complex Networks , 2018, ICDCIT.

[14]  Jérôme Kunegis,et al.  KONECT: the Koblenz network collection , 2013, WWW.

[15]  Jure Leskovec,et al.  Community Detection in Networks with Node Attributes , 2013, 2013 IEEE 13th International Conference on Data Mining.

[16]  Oscar Castillo,et al.  An Extension of the Fuzzy Possibilistic Clustering Algorithm Using Type-2 Fuzzy Logic Techniques , 2017, Adv. Fuzzy Syst..

[17]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[18]  Hosung Park,et al.  What is Twitter, a social network or a news media? , 2010, WWW '10.

[19]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Ignacio Marín,et al.  Deciphering Network Community Structure by Surprise , 2011, PloS one.

[21]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[22]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  J. A. Bondy,et al.  Graph Theory with Applications , 1978 .

[24]  Albert-Lszl Barabsi,et al.  Network Science , 2016, Encyclopedia of Big Data.

[25]  Steve Harenberg,et al.  Community detection in large‐scale networks: a survey and empirical evaluation , 2014 .

[26]  Andrea Lancichinetti,et al.  Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Vincent A. Traag,et al.  Faster unfolding of communities: speeding up the Louvain algorithm , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Hao Lu,et al.  Distributed Louvain Algorithm for Graph Community Detection , 2018, 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[29]  Yunpeng Zhao,et al.  A survey on theoretical advances of community detection in networks , 2017, ArXiv.

[30]  Santo Fortunato,et al.  Community detection in networks: Structural communities versus ground truth , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Srinivasan Parthasarathy,et al.  Local graph sparsification for scalable clustering , 2011, SIGMOD '11.

[32]  Ignacio Marín,et al.  Surprise maximization reveals the community structure of complex networks , 2013, Scientific Reports.