Finding the right scale of a network: Efficient identification of causal emergence through spectral clustering

All networks can be analyzed at multiple scales. A higher scale of a network is made up of macro-nodes: subgraphs that have been grouped into individual nodes. Recasting a network at higher scales can have useful effects, such as decreasing the uncertainty in the movement of random walkers across the network while also decreasing the size of the network. However, the task of finding such a macroscale representation is computationally difficult, as the set of all possible scales of a network grows exponentially with the number of nodes. Here we compare various methods for finding the most informative scale of a network, discovering that an approach based on spectral analysis outperforms greedy and gradient descent-based methods. We then use this procedure to show how several structural properties of preferential attachment networks vary across scales. We describe how meso- and macroscale representations of networks can have significant benefits over their underlying microscale, which include properties such as increase in determinism, a decrease in degeneracy, a lower entropy rate of random walkers on the network, an increase in global network efficiency, and higher values for a variety of centrality measures than the microscale.

[1]  Britta Ruhnau,et al.  Eigenvector-centrality - a node-centrality? , 2000, Soc. Networks.

[2]  Ernesto Estrada,et al.  Communicability in complex networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[4]  Erik Hoel,et al.  Uncertainty and causal emergence in complex networks , 2019, ArXiv.

[5]  Tim Appenzeller,et al.  Beyond Reductionism , 1999, Science.

[6]  Erik P. Hoel,et al.  Quantifying causal emergence shows that macro can beat micro , 2013, Proceedings of the National Academy of Sciences.

[7]  Jure Leskovec,et al.  Empirical comparison of algorithms for network community detection , 2010, WWW '10.

[8]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[9]  Erik P. Hoel When the Map Is Better Than the Territory , 2016, Entropy.

[10]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[11]  R. Yuste From the neuron doctrine to neural networks , 2015, Nature Reviews Neuroscience.

[12]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[13]  F. Chung,et al.  Spectra of random graphs with given expected degrees , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[14]  M. Fiedler Laplacian of graphs and algebraic connectivity , 1989 .

[15]  Nitesh V. Chawla,et al.  Representing higher-order dependencies in networks , 2015, Science Advances.

[16]  D. Spielman,et al.  Spectral partitioning works: planar graphs and finite element meshes , 1996, Proceedings of 37th Conference on Foundations of Computer Science.

[17]  Albert-László Barabási,et al.  Scale-Free Networks: A Decade and Beyond , 2009, Science.

[18]  Gary L. Miller,et al.  On the performance of spectral graph partitioning methods , 1995, SODA '95.

[19]  D. Buxhoeveden,et al.  The minicolumn hypothesis in neuroscience. , 2002, Brain : a journal of neurology.

[20]  Essam El Seidy,et al.  Spectra of Some Simple Graphs , 2015 .

[21]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[22]  Erik P. Hoel,et al.  Can the macro beat the micro? Integrated information across spatiotemporal scales. , 2016, Neuroscience of consciousness.

[23]  Y. Nesterov A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2) , 1983 .

[24]  G. Strang Introduction to Linear Algebra , 1993 .

[25]  Dan Chen,et al.  Complex network comparison based on communicability sequence entropy. , 2018, Physical review. E.