Algorithmic complexity of multiplex networks

Multilayer networks preserve full information about the different interactions among the constituents of a complex system, and have recently proven quite useful in modelling transportation networks, social circles, and the human brain. A fundamental and still open problem is to assess if and when the multilayer representation of a system provides a qualitatively better model than the classical single-layer aggregated network. Here we tackle this problem from an algorithmic information theory perspective. We propose an intuitive way to encode a multilayer network into a bit string, and we define the complexity of a multilayer network as the ratio of the Kolmogorov complexity of the bit strings associated to the multilayer and to the corresponding aggregated graph. We find that there exists a maximum amount of additional information that a multilayer model can encode with respect to the equivalent single-layer graph. We show how our complexity measure can be used to obtain low-dimensional representations of multidimensional systems, to cluster multilayer networks into a small set of meaningful super-families, and to detect tipping points in the evolution of different time-varying multilayer graphs. Interestingly, the low-dimensional multiplex networks obtained with the proposed method also retain most of the dynamical properties of the original systems, as demonstrated for instance by the preservation of the epidemic threshold in the multiplex SIS model. These results suggest that information-theoretic approaches can be effectively employed for a more systematic analysis of static and time-varying multidimensional complex systems.

[1]  Jean-Paul Delahaye,et al.  Numerical evaluation of algorithmic complexity for short strings: A glance into the innermost structure of randomness , 2011, Appl. Math. Comput..

[2]  Ginestra Bianconi,et al.  Mesoscopic Structures Reveal the Network Between the Layers of Multiplex Datasets , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Giulio Cimini,et al.  The statistical physics of real-world networks , 2018, Nature Reviews Physics.

[4]  Tiago P. Peixoto Reconstructing networks with unknown and heterogeneous errors , 2018, Physical Review X.

[5]  Piet Van Mieghem,et al.  Epidemic processes in complex networks , 2014, ArXiv.

[6]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[7]  Alexandre Arenas,et al.  Identifying modular flows on multilayer networks reveals highly overlapping organization in social systems , 2014, ArXiv.

[8]  G. Bianconi The entropy of randomized network ensembles , 2007, 0708.0153.

[9]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[10]  Maxi San Miguel,et al.  Irreducibility of multilayer network dynamics: the case of the voter model , 2015, ArXiv.

[11]  A. Mowshowitz,et al.  Entropy and the complexity of graphs. I. An index of the relative complexity of a graph. , 1968, The Bulletin of mathematical biophysics.

[12]  Vito Latora,et al.  Collective Phenomena Emerging from the Interactions between Dynamical Processes in Multiplex Networks. , 2014, Physical review letters.

[13]  A. Arenas,et al.  Mathematical Formulation of Multilayer Networks , 2013, 1307.4977.

[14]  A. Shiryayev On Tables of Random Numbers , 1993 .

[15]  Harry Eugene Stanley,et al.  Catastrophic cascade of failures in interdependent networks , 2009, Nature.

[16]  Conrado J. Pérez Vicente,et al.  Diffusion dynamics on multiplex networks , 2012, Physical review letters.

[17]  Ernesto Estrada,et al.  Walk entropies in graphs , 2013, 1303.6203.

[18]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[19]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[20]  Alex Arenas,et al.  Mapping Multiplex Hubs in Human Functional Brain Networks , 2016, Frontiers in Neuroscience.

[21]  Deokjae Lee,et al.  Recent Advances of Percolation Theory in Complex Networks , 2018, Journal of the Korean Physical Society.

[22]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[23]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[24]  Dane Taylor,et al.  Clustering Network Layers with the Strata Multilayer Stochastic Block Model , 2015, IEEE Transactions on Network Science and Engineering.

[25]  Ginestra Bianconi,et al.  Entropy measures for networks: toward an information theory of complex topologies. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Matthias Dehmer,et al.  Entropy and the Complexity of Graphs Revisited , 2012, Entropy.

[27]  Abbe Mowshowitz,et al.  Entropy and the complexity of graphs , 1967 .

[28]  Hector Zenil,et al.  A Review of Graph and Network Complexity from an Algorithmic Information Perspective , 2018, Entropy.

[29]  N EKouvaris,et al.  Opinion competition dynamics on multiplex networks , 2017 .

[30]  G. Bianconi Entropy of network ensembles. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Przemyslaw Kazienko,et al.  On Measuring the Complexity of Networks: Kolmogorov Complexity versus Entropy , 2017, Complex..

[32]  Tiago P. Peixoto Model selection and hypothesis testing for large-scale network models with overlapping groups , 2014, ArXiv.

[33]  Nicola Amoroso,et al.  Multiplex Networks for Early Diagnosis of Alzheimer's Disease , 2018, Front. Aging Neurosci..

[34]  Yamir Moreno,et al.  Dynamics of interacting diseases , 2014, 1402.4523.

[35]  Vito Latora,et al.  The multiplex dependency structure of financial markets , 2016, Complex..

[36]  A. Arenas,et al.  Abrupt transition in the structural formation of interconnected networks , 2013, Nature Physics.

[37]  R. Lambiotte,et al.  From networks to optimal higher-order models of complex systems , 2019, Nature Physics.

[38]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[39]  Matthias Dehmer,et al.  A history of graph entropy measures , 2011, Inf. Sci..

[40]  Roger Guimerà,et al.  Accurate and scalable social recommendation using mixed-membership stochastic block models , 2016, Proceedings of the National Academy of Sciences.

[41]  Vito Latora,et al.  Measuring and modelling correlations in multiplex networks , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Mason A. Porter,et al.  Layer Communities in Multiplex Networks , 2017, Journal of Statistical Physics.

[43]  Vito Latora,et al.  Multilayer motif analysis of brain networks. , 2016, Chaos.

[44]  Vito Latora,et al.  Structural measures for multiplex networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  V. Latora,et al.  Complex Networks: Principles, Methods and Applications , 2017 .

[46]  Barbora Micenková,et al.  Combinatorial Analysis of Multiple Networks , 2013, ArXiv.

[47]  Yamir Moreno,et al.  Contact-based Social Contagion in Multiplex Networks , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[49]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[50]  Vito Latora,et al.  The new challenges of multiplex networks: Measures and models , 2016, The European Physical Journal Special Topics.

[51]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[52]  Simone Severini,et al.  Quantifying Complexity in Networks: The von Neumann Entropy , 2009, Int. J. Agent Technol. Syst..

[53]  Hector Zenil,et al.  Correlation of automorphism group size and topological properties with program−size complexity evaluations of graphs and complex networks , 2013, 1306.0322.

[54]  Mason A. Porter,et al.  Lost in transportation: Information measures and cognitive limits in multilayer navigation , 2016, Science Advances.

[55]  Vito Latora,et al.  Efficient exploration of multiplex networks , 2015, 1505.01378.

[56]  Yamir Moreno,et al.  Effects of Network Structure, Competition and Memory Time on Social Spreading Phenomena , 2015, Physical Review. X.

[57]  Giuseppe Nicosia,et al.  Pareto Optimality in Multilayer Network Growth. , 2018, Physical review letters.

[58]  Vito Latora,et al.  Interplay between consensus and coherence in a model of interacting opinions , 2015, ArXiv.

[59]  Cristopher Moore,et al.  Community detection, link prediction, and layer interdependence in multilayer networks , 2017, Physical review. E.

[60]  Roger Guimerà,et al.  Multilayer stochastic block models reveal the multilayer structure of complex networks , 2014, ArXiv.

[61]  Massimiliano Zanin,et al.  Emergence of network features from multiplexity , 2012, Scientific Reports.

[62]  Vito Latora,et al.  Structural reducibility of multilayer networks , 2015, Nature Communications.

[63]  Alex Arenas,et al.  Spreading Processes in Multiplex Metapopulations Containing Different Mobility Networks , 2018, Physical Review. X.

[64]  Gregory J. Chaitin,et al.  On the Simplicity and Speed of Programs for Computing Infinite Sets of Natural Numbers , 1969, J. ACM.

[65]  John von Neumann,et al.  Mathematical Foundations of Quantum Mechanics: New Edition , 2018 .

[66]  Matthias Dehmer,et al.  Information processing in complex networks: Graph entropy and information functionals , 2008, Appl. Math. Comput..

[67]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[68]  M. Newman,et al.  Statistical mechanics of networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  Sergio Gómez,et al.  On the dynamical interplay between awareness and epidemic spreading in multiplex networks , 2013, Physical review letters.

[70]  Mason A. Porter,et al.  Author Correction: The physics of spreading processes in multilayer networks , 2016, 1604.02021.

[71]  V. Latora,et al.  Layered social influence promotes multiculturality in the Axelrod model , 2016, Scientific Reports.

[72]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[73]  Lucas Lacasa,et al.  Multiplex Decomposition of Non-Markovian Dynamics and the Hidden Layer Reconstruction Problem , 2017, Physical Review X.