Overlapping communities detection based on spectral analysis of line graphs

Abstract Community in networks are often overlapping where one vertex belongs to several clusters. Meanwhile, many networks show hierarchical structure such that community is recursively grouped into hierarchical organization. In order to obtain overlapping communities from a global hierarchy of vertices, a new algorithm (named SAoLG) is proposed to build the hierarchical organization along with detecting the overlap of community structure. SAoLG applies the spectral analysis into line graphs to unify the overlap and hierarchical structure of the communities. In order to avoid the limitation of absolute distance such as Euclidean distance, SAoLG employs Angular distance to compute the similarity between vertices. Furthermore, we make a micro-improvement partition density to evaluate the quality of community structure and use it to obtain the more reasonable and sensible community numbers. The proposed SAoLG algorithm achieves a balance between overlap and hierarchy by applying spectral analysis to edge community detection. The experimental results on one standard network and six real-world networks show that the SAoLG algorithm achieves higher modularity and reasonable community number values than those generated by Ahn’s algorithm, the classical CPM and GN ones.

[1]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Andrea Lancichinetti,et al.  Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[4]  Yong Wang,et al.  Overlapping Community Detection in Complex Networks using Symmetric Binary Matrix Factorization , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[6]  Mark Newman,et al.  Detecting community structure in networks , 2004 .

[7]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[8]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[9]  Li Zhang,et al.  Learning similarity with cosine similarity ensemble , 2015, Inf. Sci..

[10]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[11]  Maoguo Gong,et al.  Overlapping community detection via network dynamics. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  R. Lambiotte,et al.  Line graphs, link partitions, and overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Yonggang Lu,et al.  A novel travel-time based similarity measure for hierarchical clustering , 2016, Neurocomputing.

[14]  Shengrui Wang,et al.  A direct approach to graph clustering , 2004, Neural Networks and Computational Intelligence.

[15]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Mohsen Afsharchi,et al.  Community detection in social networks using hybrid merging of sub-communities , 2014, J. Netw. Comput. Appl..

[17]  Chris Phillips,et al.  Parallel numerical algorithms , 1992, Prentice Hall International Series in Computer Science.

[18]  Dong Liu,et al.  Semi-supervised community detection based on discrete potential theory , 2014 .

[19]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[20]  Ian Davidson,et al.  A flexible ILP formulation for hierarchical clustering , 2017, Artif. Intell..

[21]  Mao-Bin Hu,et al.  Detect overlapping and hierarchical community structure in networks , 2008, ArXiv.

[22]  Sune Lehmann,et al.  Link communities reveal multiscale complexity in networks , 2009, Nature.

[23]  Konstantin Avrachenkov,et al.  Cooperative Game Theory Approaches for Network Partitioning , 2017, COCOON.

[24]  Brian W. Kernighan,et al.  An efficient heuristic procedure for partitioning graphs , 1970, Bell Syst. Tech. J..

[25]  David Lusseau,et al.  The emergent properties of a dolphin social network , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[26]  Martin Rosvall,et al.  An information-theoretic framework for resolving community structure in complex networks , 2007, Proceedings of the National Academy of Sciences.

[27]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[28]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[29]  Fergal Reid,et al.  Partitioning Breaks Communities , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[30]  M. A. Muñoz,et al.  Journal of Statistical Mechanics: An IOP and SISSA journal Theory and Experiment Detecting network communities: a new systematic and efficient algorithm , 2004 .

[31]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Pablo M. Gleiser,et al.  Community Structure in Jazz , 2003, Adv. Complex Syst..

[34]  Yang Jiao,et al.  Clustering dynamics of complex discrete-time networks and its application in community detection. , 2014, Chaos.