Community Detection in Complex Networks via Clique Conductance

Network science plays a central role in understanding and modeling complex systems in many areas including physics, sociology, biology, computer science, economics, politics, and neuroscience. One of the most important features of networks is community structure, i.e., clustering of nodes that are locally densely interconnected. Communities reveal the hierarchical organization of nodes, and detecting communities is of great importance in the study of complex systems. Most existing community-detection methods consider low-order connection patterns at the level of individual links. But high-order connection patterns, at the level of small subnetworks, are generally not considered. In this paper, we develop a novel community-detection method based on cliques, i.e., local complete subnetworks. The proposed method overcomes the deficiencies of previous similar community-detection methods by considering the mathematical properties of cliques. We apply the proposed method to computer-generated graphs and real-world network datasets. When applied to networks with known community structure, the proposed method detects the structure with high fidelity and sensitivity. When applied to networks with no a priori information regarding community structure, the proposed method yields insightful results revealing the organization of these complex networks. We also show that the proposed method is guaranteed to detect near-optimal clusters in the bipartition case.

[1]  C. Bron,et al.  Algorithm 457: finding all cliques of an undirected graph , 1973 .

[2]  Andrew B. Kahng,et al.  New spectral methods for ratio cut partitioning and clustering , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[3]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[4]  C. Lee Giles,et al.  Self-Organization and Identification of Web Communities , 2002, Computer.

[5]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  P. Händel,et al.  The β-model — Maximum Likelihood, Cramér-Rao Bounds, and Hypothesis Testing , 2017 .

[7]  Lav R. Varshney,et al.  Structural Properties of the Caenorhabditis elegans Neuronal Network , 2009, PLoS Comput. Biol..

[8]  M. Newman The physics of networks , 2008 .

[9]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[10]  Luca Trevisan,et al.  Multi-way spectral partitioning and higher-order cheeger inequalities , 2011, STOC '12.

[11]  J. V. Rauff,et al.  Introduction to Mathematical Sociology , 2012 .

[12]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[13]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[14]  Jure Leskovec,et al.  Higher-order organization of complex networks , 2016, Science.

[15]  J. Moon,et al.  On cliques in graphs , 1965 .

[16]  S. Brenner,et al.  The structure of the nervous system of the nematode Caenorhabditis elegans. , 1986, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  L. Mirny,et al.  Protein complexes and functional modules in molecular networks , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Konstantin Avrachenkov,et al.  Cooperative Game Theory Approaches for Network Partitioning , 2017, COCOON.

[19]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[20]  A. Hoffman,et al.  Lower bounds for the partitioning of graphs , 1973 .

[21]  Alexander Rives,et al.  Modular organization of cellular networks , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Mark S. Granovetter The Strength of Weak Ties , 1973, American Journal of Sociology.

[23]  Ann E Sizemore,et al.  Closures and Cavities in the Human Connectome , 2016 .

[24]  Guido Caldarelli,et al.  Scale-Free Networks , 2007 .

[25]  S. Strogatz Exploring complex networks , 2001, Nature.

[26]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[27]  Mason A. Porter,et al.  Communities in Networks , 2009, ArXiv.

[28]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[29]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[30]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  R. Ho Algebraic Topology , 2022 .

[32]  Richard M. Leahy,et al.  An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Dorothea Wagner,et al.  Between Min Cut and Graph Bisection , 1993, MFCS.

[34]  M. Newman,et al.  Finding community structure in very large networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  T. Vicsek,et al.  Clique percolation in random networks. , 2005, Physical review letters.

[36]  D. Chklovskii,et al.  Wiring optimization can relate neuronal structure and function. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[37]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.

[38]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[39]  Phani Chavali,et al.  Distributed Power System State Estimation Using Factor Graphs , 2015, IEEE Transactions on Signal Processing.

[40]  Balachander Krishnamurthy,et al.  On network-aware clustering of Web clients , 2000, SIGCOMM.

[41]  Benjamin H. Good,et al.  Performance of modularity maximization in practical contexts. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  YuanBo,et al.  Detecting functional modules in the yeast protein--protein interaction network , 2006 .

[43]  J. Cheeger A lower bound for the smallest eigenvalue of the Laplacian , 1969 .

[44]  Ina Koch,et al.  Enumerating all connected maximal common subgraphs in two graphs , 2001, Theor. Comput. Sci..

[45]  Gongguo Tang,et al.  A game-theoretic approach for optimal time-of-use electricity pricing , 2013, IEEE Transactions on Power Systems.

[46]  Masaru Kitsuregawa,et al.  A Graph Based Approach to Extract a Neighborhood Customer Community for Collaborative Filtering , 2002, DNIS.

[47]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[48]  C. Jacobi,et al.  C. G. J. Jacobi's Gesammelte Werke: Über ein leichtes Verfahren, die in der Theorie der Sacularstorungen vorkommenden Gleichungen numerisch aufzulosen , 1846 .

[49]  Zoran Levnajic,et al.  Revealing the Hidden Language of Complex Networks , 2014, Scientific Reports.

[50]  HERBERT A. SIMON,et al.  The Architecture of Complexity , 1991 .

[51]  Jingchun Chen,et al.  Detecting functional modules in the yeast protein-protein interaction network , 2006, Bioinform..

[52]  Gongguo Tang,et al.  Optimal time-of-use electricity pricing using game theory , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[53]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[54]  S. Redner How popular is your paper? An empirical study of the citation distribution , 1998, cond-mat/9804163.

[55]  J. Coleman Introduction to Mathematical Sociology , 1965 .

[56]  Ronald S. Burt,et al.  Positions in Networks , 1976 .

[57]  Akira Tanaka,et al.  The worst-case time complexity for generating all maximal cliques and computational experiments , 2006, Theor. Comput. Sci..

[58]  Isaac Skog,et al.  The $\beta$-Model—Maximum Likelihood, Cramér–Rao Bounds, and Hypothesis Testing , 2017, IEEE Transactions on Signal Processing.

[59]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[61]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[62]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[63]  D. R. White,et al.  Structural cohesion and embeddedness: A hierarchical concept of social groups , 2003 .

[64]  Mechthild Stoer,et al.  A simple min-cut algorithm , 1997, JACM.

[65]  R. Carter 11 – IT and society , 1991 .

[66]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[67]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[68]  M. Fiedler A property of eigenvectors of nonnegative symmetric matrices and its application to graph theory , 1975 .

[69]  Daniel J. Brass,et al.  Network Analysis in the Social Sciences , 2009, Science.

[70]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[71]  F. Chung Four Cheeger-type Inequalities for Graph Partitioning Algorithms ∗ , 2009 .

[72]  Frédéric Cazals,et al.  A note on the problem of reporting maximal cliques , 2008, Theor. Comput. Sci..

[73]  Marco Pellegrini,et al.  Extraction and classification of dense communities in the web , 2007, WWW '07.