Modeling and Detecting Community Hierarchies

Community detection has in recent years emerged as an invaluable tool for describing and quantifying interactions in networks. In this paper we propose a theoretical model that explicitly formalizes both the tight connections within each community and the hierarchical nature of the communities. We further present an efficient algorithm that provably detects all the communities in our model. Experiments demonstrate that our definition successfully models real world communities, and our algorithm compares favorably with existing approaches.

[1]  Mark Braverman,et al.  Finding Endogenously Formed Communities , 2012, SODA.

[2]  John E. Hopcroft,et al.  Detecting the Structure of Social Networks Using (α, β)-Communities , 2011, WAW.

[3]  Yizhou Sun,et al.  SHRINK: a structural clustering algorithm for detecting hierarchical communities in networks , 2010, CIKM.

[4]  Robert E. Tarjan,et al.  Finding Strongly Knit Clusters in Social Networks , 2008, Internet Math..

[5]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.

[6]  Dayou Liu,et al.  Hierarchical community detection with applications to real-world network analysis , 2013, Data Knowl. Eng..

[7]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[8]  Shang-Hua Teng,et al.  Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems , 2003, STOC '04.

[9]  Kevin Leyton-Brown,et al.  Proceedings of the 13th ACM Conference on Electronic Commerce, EC 2012, Valencia, Spain, June 4-8, 2012 , 2012, EC.

[10]  M. Cosentino Lagomarsino,et al.  Hierarchy and feedback in the evolution of the Escherichia coli transcription network , 2007, Proceedings of the National Academy of Sciences.

[11]  Xiaokang Yang,et al.  A Hierarchical Diffusion Algorithm for Community Detection in Social Networks , 2010, 2010 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[12]  Mark Newman,et al.  Detecting community structure in networks , 2004 .

[13]  O. de Weck,et al.  Overview of metrics and their correlation patterns for multiple-metric topology analysis on heterogeneous graph ensembles. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Robert E. Tarjan,et al.  Clustering Social Networks , 2007, WAW.

[15]  J. Brown Behavioral Ecology and Sociobiology , 2019, Encyclopedia of Animal Behavior.

[16]  László Babai,et al.  Proceedings of the thirty-sixth annual ACM symposium on Theory of computing , 2004, STOC 2004.

[17]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[18]  Giri Narasimhan,et al.  Geometric spanner networks , 2007 .

[19]  Pablo M. Gleiser,et al.  Community Structure in Jazz , 2003, Adv. Complex Syst..

[20]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[21]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[22]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Jure Leskovec,et al.  Empirical comparison of algorithms for network community detection , 2010, WWW '10.

[24]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[25]  M. Newman,et al.  Finding community structure in very large networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Le Song,et al.  A Multiscale Community Blockmodel for Network Exploration , 2011, AISTATS.

[27]  S. D. Chatterji Proceedings of the International Congress of Mathematicians , 1995 .

[28]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[29]  T. Snijders,et al.  10. Settings in Social Networks: A Measurement Model , 2003 .

[30]  Claudio Castellano,et al.  Defining and identifying communities in networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[32]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[33]  Jure Leskovec,et al.  Learning to Discover Social Circles in Ego Networks , 2012, NIPS.

[34]  Maria-Florina Balcan,et al.  Robust hierarchical clustering , 2013, J. Mach. Learn. Res..

[35]  Donald E. Knuth,et al.  The Stanford GraphBase - a platform for combinatorial computing , 1993 .

[36]  Andrea Lancichinetti,et al.  Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Sanjeev Arora,et al.  Finding overlapping communities in social networks: toward a rigorous approach , 2011, EC '12.

[38]  Jure Leskovec,et al.  Latent Multi-group Membership Graph Model , 2012, ICML.