A New Method for Extracting the Hierarchical Organization of Networks

Extracting the hierarchical organization of networks is currently a pressing task for understanding complex networked systems. The hierarchy of a network is essentially defined by the heterogeneity of link densities of communities at different scales. Here, we define a top-level partition (TLP) as a bipartition of the network (or a sub-network) such that no top-level community (TLC) runs across the two parts. It has been found that a TLP generally has a higher modularity than a non-top-level (TLP) partition when their TLCs have similar sizes and when the link densities of neighboring levels are well separated from each other. A spectral TLP procedure is proposed here to search for TLPs of a network (or sub-network). To extract the hierarchical organization of large complex networks, an algorithm called TLPA has been developed based on the TLP. Experiments have shown that the method developed in this research extract hierarchy accurately from network data.

[1]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[2]  D. Watts.  The “New” Science of Networks , 2004 .

[3]  Alex Arenas,et al.  Analysis of the structure of complex networks at different resolution levels , 2007, physics/0703218.

[4]  Petter Holme,et al.  Subnetwork hierarchies of biochemical pathways , 2002, Bioinform..

[5]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Roger Guimerà,et al.  Extracting the hierarchical organization of complex systems , 2007, Proceedings of the National Academy of Sciences.

[7]  M. A. Muñoz,et al.  Journal of Statistical Mechanics: An IOP and SISSA journal Theory and Experiment Detecting network communities: a new systematic and efficient algorithm , 2004 .

[8]  C. Lee Giles,et al.  Self-Organization and Identification of Web Communities , 2002, Computer.

[9]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[11]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[12]  A. Arenas,et al.  Community detection in complex networks using extremal optimization. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[14]  J. Reichardt,et al.  Partitioning and modularity of graphs with arbitrary degree distribution. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  R. Guimerà,et al.  Functional cartography of complex metabolic networks , 2005, Nature.

[17]  Hongtao Lu,et al.  Enhanced modularity-based community detection by random walk network preprocessing. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Benjamin H. Good,et al.  Performance of modularity maximization in practical contexts. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[21]  Brian Everitt,et al.  Cluster analysis , 1974 .

[22]  Konstantin Avrachenkov,et al.  Cooperative Game Theory Approaches for Network Partitioning , 2017, COCOON.

[23]  Peter Mariolis.  INTERLOCKING DIRECTORATES AND CONTROL OF CORPORATIONS: THE THEORY OF BANK CONTROL , 2016 .

[24]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[25]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[26]  A Díaz-Guilera,et al.  Self-similar community structure in a network of human interactions. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[28]  Alex Arenas,et al.  Synchronization reveals topological scales in complex networks. , 2006, Physical review letters.

[29]  Sergey N. Dorogovtsev,et al.  Evolution of Networks: From Biological Nets to the Internet and WWW (Physics) , 2003 .

[30]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Ulrik Brandes,et al.  On Modularity Clustering , 2008, IEEE Transactions on Knowledge and Data Engineering.

[32]  Clara Pizzuti,et al.  GA-Net: A Genetic Algorithm for Community Detection in Social Networks , 2008, PPSN.

[33]  Claudio Castellano,et al.  Defining and identifying communities in networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[34]  R. May,et al.  Networks of sexual contacts: implications for the pattern of spread of HIV , 1989, AIDS.

[35]  M. Newman,et al.  Finding community structure in very large networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[37]  Shuigeng Zhou,et al.  Evolutionary method for finding communities in bipartite networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Sergei Maslov,et al.  Hierarchy measures in complex networks. , 2003, Physical review letters.

[39]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Haijun Zhou.  Network landscape from a Brownian particle's perspective. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Victoria A. Higman,et al.  Uncovering network systems within protein structures. , 2003, Journal of molecular biology.

[42]  K. Kaski,et al.  Limited resolution in complex network community detection with Potts model approach , 2006 .

[43]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[44]  R. Guimerà,et al.  Modularity from fluctuations in random graphs and complex networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[46]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[47]  Sergei Maslov,et al.  Modularity and extreme edges of the internet. , 2003, Physical review letters.

[48]  Wen-Xu Wang,et al.  Collective synchronization induced by epidemic dynamics on complex networks with communities. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.