Understanding complex networks with community-nding algorithms

In a complex network, edges between nodes are often distributed non-uniformly, leading to the formation of hierarchical community structures. However, finding community structure in dense networks has proven to be a difficult task. We study current community-finding algorithms on a small but dense social network from the California Institute of Technology, formed on www.thefacebook.com. Using knowledge of the school’s undergraduate Housing system, we assess the capabilities of modularity-maximizing algorithms, which we find to work decently, and singlelinkage clustering, which we find to work poorly. We also propose a new agglomerative algorithm for constructing overlapping communities using local shells, and implement methods for visualizing overlap between communities.

[1]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[3]  M. Newman,et al.  Finding community structure in very large networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[5]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[6]  Mason A. Porter,et al.  A network analysis of committees in the United States House of Representatives , 2005, ArXiv.

[7]  Erik M Bollt,et al.  Local method for detecting communities. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Alex Arenas,et al.  Community structure identification , 2005 .

[9]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[10]  S. Strogatz Exploring complex networks , 2001, Nature.

[11]  Mark Newman,et al.  Detecting community structure in networks , 2004 .

[12]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .

[13]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[14]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[15]  R. Guimerà,et al.  Functional cartography of complex metabolic networks , 2005, Nature.

[16]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.