Algorithmic Information Distortions in Node-Aligned and Node-Unaligned Multidimensional Networks

In this article, we investigate limitations of importing methods based on algorithmic information theory from monoplex networks into multidimensional networks (such as multilayer networks) that have a large number of extra dimensions (i.e., aspects). In the worst-case scenario, it has been previously shown that node-aligned multidimensional networks with non-uniform multidimensional spaces can display exponentially larger algorithmic information (or lossless compressibility) distortions with respect to their isomorphic monoplex networks, so that these distortions grow at least linearly with the number of extra dimensions. In the present article, we demonstrate that node-unaligned multidimensional networks, either with uniform or non-uniform multidimensional spaces, can also display exponentially larger algorithmic information distortions with respect to their isomorphic monoplex networks. However, unlike the node-aligned non-uniform case studied in previous work, these distortions in the node-unaligned case grow at least exponentially with the number of extra dimensions. On the other hand, for node-aligned multidimensional networks with uniform multidimensional spaces, we demonstrate that any distortion can only grow up to a logarithmic order of the number of extra dimensions. Thus, these results establish that isomorphisms between finite multidimensional networks and finite monoplex networks do not preserve algorithmic information in general and highlight that the algorithmic information of the multidimensional space itself needs to be taken into account in multidimensional network complexity analysis.

[1]  Hector Zenil,et al.  The Thermodynamics of Network Coding, and an Algorithmic Refinement of the Principle of Maximum Entropy † , 2018, Entropy.

[2]  Hector Zenil,et al.  Minimal Algorithmic Information Loss Methods for Dimension Reduction, Feature Selection and Network Sparsification. , 2018, 1802.05843.

[3]  Ifail,et al.  An example , 2020, A Psychoanalytical-Historical Perspective on Capitalism and Politics.

[4]  Hector Zenil,et al.  Low Algorithmic Complexity Entropy-deceiving Graphs , 2016, Physical review. E.

[5]  Hector Zenil,et al.  Causal deconvolution by algorithmic generative models , 2019, Nature Machine Intelligence.

[6]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[7]  Eric Fleury,et al.  MultiAspect Graphs: Algebraic representation and algorithms , 2015, Algorithms.

[8]  Santiago Figueira,et al.  An example of a computable absolutely normal number , 2002, Theor. Comput. Sci..

[9]  Harry Buhrman,et al.  Kolmogorov Random Graphs and the Incompressibility Method , 1999, SIAM J. Comput..

[10]  Giulio Rossetti,et al.  Community Discovery in Dynamic Networks , 2017, ACM Comput. Surv..

[11]  Hector Zenil,et al.  Quantifying loss of information in network-based dimensionality reduction techniques , 2015, J. Complex Networks.

[12]  A. Santoro,et al.  Algorithmic complexity of multiplex networks , 2019, Physical Review X.

[13]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[14]  Matthias Dehmer,et al.  Entropy and the Complexity of Graphs Revisited , 2012, Entropy.

[15]  Hector Zenil,et al.  A Review of Graph and Network Complexity from an Algorithmic Information Perspective , 2018, Entropy.

[16]  Eric Fleury,et al.  On MultiAspect graphs , 2014, Theor. Comput. Sci..

[17]  Paul M. B. Vitányi,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1993, Graduate Texts in Computer Science.

[18]  Przemyslaw Kazienko,et al.  On Measuring the Complexity of Networks: Kolmogorov Complexity versus Entropy , 2017, Complex..

[19]  Hector Zenil,et al.  Correlation of automorphism group size and topological properties with program−size complexity evaluations of graphs and complex networks , 2013, 1306.0322.

[20]  Cristian Claude,et al.  Information and Randomness: An Algorithmic Perspective , 1994 .

[21]  Artur Ziviani,et al.  A Multilayer and Time-Varying Structural Analysis of the Brazilian Air Transportation Network , 2017, LADaS@VLDB.

[22]  Hector Zenil,et al.  Algorithmic information and incompressibility of families of multidimensional networks. , 2018 .

[23]  Anna Monreale,et al.  Foundations of Multidimensional Network Analysis , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[24]  Marcus Hutter,et al.  Algorithmic Information Theory , 1977, IBM J. Res. Dev..

[25]  Jari Saramäki,et al.  Path lengths, correlations, and centrality in temporal networks , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[27]  Artur Ziviani,et al.  Avoiding Spurious Paths in Centralities Based on Shortest Paths in High Order Networks , 2018, 2018 Eighth Latin-American Symposium on Dependable Computing (LADC).

[28]  Robin Wilson,et al.  Modern Graph Theory , 2013 .

[29]  Othon Michail,et al.  An Introduction to Temporal Graphs: An Algorithmic Perspective* , 2015, Internet Math..

[30]  Alex Borges Vieira,et al.  Time Centrality in Dynamic Complex Networks , 2015, Adv. Complex Syst..

[31]  A. Alarcón,et al.  FUNDAMENTALS , 2000, Springer Monographs in Mathematics.

[32]  Hector Zenil,et al.  On incompressible high order networks , 2018, ArXiv.

[33]  Cristian S. Calude Borel Normality and Algorithmic Randomness , 1993, Developments in Language Theory.

[34]  Cristian S. Calude Information and Randomness: An Algorithmic Perspective , 1994 .

[35]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[36]  Bakhadyr Khoussainov,et al.  A quest for algorithmically random infinite structures , 2014, CSL-LICS.

[37]  A. Arenas,et al.  Mathematical Formulation of Multilayer Networks , 2013, 1307.4977.

[38]  Denis R. Hirschfeldt,et al.  Algorithmic randomness and complexity. Theory and Applications of Computability , 2012 .