Using arborescences to estimate hierarchicalness in directed complex networks

Complex networks are a useful tool for the understanding of complex systems. One of the emerging properties of such systems is their tendency to form hierarchies: networks can be organized in levels, with nodes in each level exerting control on the ones beneath them. In this paper, we focus on the problem of estimating how hierarchical a directed network is. We propose a structural argument: a network has a strong top-down organization if we need to delete only few edges to reduce it to a perfect hierarchy—an arborescence. In an arborescence, all edges point away from the root and there are no horizontal connections, both characteristics we desire in our idealization of what a perfect hierarchy requires. We test our arborescence score in synthetic and real-world directed networks against the current state of the art in hierarchy detection: agony, flow hierarchy and global reaching centrality. These tests highlight that our arborescence score is intuitive and we can visualize it; it is able to better distinguish between networks with and without a hierarchical structure; it agrees the most with the literature about the hierarchy of well-studied complex systems; and it is not just a score, but it provides an overall scheme of the underlying hierarchy of any directed complex network.

[1]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[2]  Eljas Soisalon-Soininen,et al.  On Finding the Strongly Connected Components in a Directed Graph , 1994, Inf. Process. Lett..

[3]  Sune Lehmann,et al.  Link communities reveal multiscale complexity in networks , 2009, Nature.

[4]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[5]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[6]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[7]  Alex Bavelas,et al.  Communication Patterns in Task‐Oriented Groups , 1950 .

[8]  Srinivasan Parthasarathy,et al.  Breaking Cycles In Noisy Hierarchies , 2017, WebSci.

[9]  Deborah L. McGuinness,et al.  Proceedings of the 2017 ACM on Web Science Conference , 2017, WebSci.

[10]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.

[11]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[12]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[13]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[14]  Enys Mones,et al.  Hierarchy Measure for Complex Networks , 2012, PloS one.

[15]  Xuelong Li,et al.  A survey of graph edit distance , 2010, Pattern Analysis and Applications.

[16]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[17]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  L. Freeman,et al.  Analyzing the Structure of the Centrality-Productivity Literature Created Between 1948 and 1979 , 1990 .

[19]  Nikolaj Tatti,et al.  Hierarchies in Directed Networks , 2015, 2015 IEEE International Conference on Data Mining.

[20]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[21]  Liviu Iftode,et al.  Finding hierarchy in directed online social networks , 2011, WWW.

[22]  S. Coulomb,et al.  Gene essentiality and the topology of protein interaction networks , 2005, Proceedings of the Royal Society B: Biological Sciences.

[23]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[24]  Ruth Nussinov,et al.  Structure and dynamics of molecular networks: A novel paradigm of drug discovery. A comprehensive review , 2012, Pharmacology & therapeutics.

[25]  M. Gerstein,et al.  Genomic analysis of the hierarchical structure of regulatory networks , 2006, Proceedings of the National Academy of Sciences.

[26]  Gary Gordon,et al.  A greedoid polynomial which distinguishes rooted arborescences , 1989 .

[27]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[28]  Beom Jun Kim,et al.  Growing scale-free networks with tunable clustering. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Béla Bollobás,et al.  Directed scale-free graphs , 2003, SODA '03.

[30]  Michele Coscia,et al.  Network Backboning with Noisy Data , 2017, 2017 IEEE 33rd International Conference on Data Engineering (ICDE).

[31]  A Vázquez,et al.  The topological relationship between the large-scale attributes and local interaction patterns of complex networks , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[32]  M. A. Muñoz,et al.  Griffiths phases and the stretching of criticality in brain networks , 2013, Nature Communications.

[33]  B. Bollobás The evolution of random graphs , 1984 .

[34]  Albert-László Barabási,et al.  Effect of correlations on network controllability , 2012, Scientific Reports.

[35]  Jeffrey Xu Yu,et al.  Exploring Hierarchies in Online Social Networks , 2015, IEEE Transactions on Knowledge and Data Engineering.

[36]  Christopher L. Magee,et al.  ESD Working Paper Series ESD-WP-2010-01 , 2010 .

[37]  Dino Pedreschi,et al.  The retail market as a complex system , 2014, EPJ Data Science.

[38]  Wouter de Nooy,et al.  A literary playground: Literary criticism and balance theory , 1999 .

[39]  Marcus Kaiser,et al.  Nonoptimal Component Placement, but Short Processing Paths, due to Long-Distance Projections in Neural Systems , 2006, PLoS Comput. Biol..

[40]  Daniel B. Larremore,et al.  Systematic inequality and hierarchy in faculty hiring networks , 2015, Science Advances.

[41]  Jon M. Kleinberg,et al.  The Web as a Graph: Measurements, Models, and Methods , 1999, COCOON.

[42]  Dino Pedreschi,et al.  Uncovering Hierarchical and Overlapping Communities with a Local-First Approach , 2014, TKDD.

[43]  Michele Coscia,et al.  Evidence That Calls-Based and Mobility Networks Are Isomorphic , 2015, PloS one.

[44]  C. Winick The Diffusion of an Innovation Among Physicians , 2016 .

[45]  Carlos Melián,et al.  FOOD WEB COHESION , 2004 .