An Algorithmic Information Calculus for Causal Discovery and Reprogramming Systems

Summary We introduce and develop a method that demonstrates that the algorithmic information content of a system can be used as a steering handle in the dynamical phase space, thus affording an avenue for controlling and reprogramming systems. The method consists of applying a series of controlled interventions to a networked system while estimating how the algorithmic information content is affected. We demonstrate the method by reconstructing the phase space and their generative rules of some discrete dynamical systems (cellular automata) serving as controlled case studies. Next, the model-based interventional or causal calculus is evaluated and validated using (1) a huge large set of small graphs, (2) a number of larger networks with different topologies, and finally (3) biological networks derived from a widely studied and validated genetic network (E. coli) as well as on a significant number of differentiating (Th17) and differentiated human cells from a curated biological network data.

[1]  A. Barabasi,et al.  Drug—target network , 2007, Nature Biotechnology.

[2]  Jean-Philippe Noël,et al.  Nonlinear system identification in structural dynamics: 10 more years of progress , 2017 .

[3]  A. Barabasi,et al.  Network medicine : a network-based approach to human disease , 2010 .

[4]  Brendan D. McKay,et al.  Practical graph isomorphism, II , 2013, J. Symb. Comput..

[5]  Harry Buhrman,et al.  Kolmogorov Random Graphs and the Incompressibility Method , 1999, SIAM J. Comput..

[6]  Aurélien Naldi,et al.  Diversity and Plasticity of Th Cell Types Predicted from Regulatory Network Modelling , 2010, PLoS Comput. Biol..

[7]  Hector Zenil,et al.  Cross-boundary Behavioural Reprogrammability Reveals Evidence of Pervasive Universality , 2015, Int. J. Unconv. Comput..

[8]  Per Martin-Löf,et al.  The Definition of Random Sequences , 1966, Inf. Control..

[9]  Jesper Tegnér,et al.  Consistent Feature Selection for Pattern Recognition in Polynomial Time , 2007, J. Mach. Learn. Res..

[10]  Riitta Lahesmaa,et al.  Identification of early gene expression changes during human Th17 cell differentiation. , 2012, Blood.

[11]  Hector Zenil,et al.  HiDi: an efficient reverse engineering schema for large‐scale dynamic regulatory network reconstruction using adaptive differentiation , 2017, Bioinform..

[12]  Hector Zenil,et al.  Causal deconvolution by algorithmic generative models , 2019, Nature Machine Intelligence.

[13]  Marcus Hutter,et al.  Algorithmic Information Theory , 1977, IBM J. Res. Dev..

[14]  Hector Zenil,et al.  Methods of information theory and algorithmic complexity for network biology. , 2014, Seminars in cell & developmental biology.

[15]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[16]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[17]  Rodney G. Downey,et al.  Algorithmic Randomness and Complexity , 2010, Theory and Applications of Computability.

[18]  A. Regev,et al.  Dynamic regulatory network controlling Th17 cell differentiation , 2013, Nature.

[19]  M. Aldana.  Boolean dynamics of networks with scale-free topology , 2003 .

[20]  Jean-Paul Delahaye,et al.  Calculating Kolmogorov Complexity from the Output Frequency Distributions of Small Turing Machines , 2012, PloS one.

[21]  Cristian S. Calude,et al.  Most Programs Stop Quickly or Never Halt , 2006, Adv. Appl. Math..

[22]  John J. Tyson,et al.  A Mathematical Model for the Reciprocal Differentiation of T Helper 17 Cells and Induced Regulatory T Cells , 2011, PLoS Comput. Biol..

[23]  Hector Zenil,et al.  A perspective on bridging scales and design of models using low-dimensional manifolds and data-driven model inference , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[24]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[25]  Claus-Peter Schnorr,et al.  Zufälligkeit und Wahrscheinlichkeit - Eine algorithmische Begründung der Wahrscheinlichkeitstheorie , 1971, Lecture Notes in Mathematics.

[26]  Hector Zenil,et al.  A Decomposition Method for Global Evaluation of Shannon Entropy and Local Estimations of Algorithmic Complexity , 2016, Entropy.

[27]  W. Paul,et al.  Differentiation of effector CD4 T cell populations (*). , 2010, Annual review of immunology.

[28]  Luis Filipe Coelho Antunes,et al.  Depth as Randomness Deficiency , 2008, Theory of Computing Systems.

[29]  S. Kauffman.  Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[30]  T. Rado.  On non-computable functions , 1962 .

[31]  Hector Zenil,et al.  A Review of Graph and Network Complexity from an Algorithmic Information Perspective , 2018, Entropy.

[32]  Gilles Clermont,et al.  Computational disease modeling – fact or fiction? , 2009, BMC Systems Biology.

[33]  Andrew Wuensche,et al.  Basins of attraction in network dynamics: A conceptual framework for biomolecular networks , 2003 .

[34]  Diogo M. Camacho,et al.  Wisdom of crowds for robust gene network inference , 2012, Nature Methods.

[35]  Hector Zenil,et al.  Low Algorithmic Complexity Entropy-deceiving Graphs , 2016, Physical review. E.

[36]  Albert-László Barabási,et al.  Control Principles of Complex Networks , 2015, ArXiv.

[37]  Albert-László Barabási,et al.  Controllability of complex networks , 2011, Nature.

[38]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[39]  Samantha A. Morris,et al.  Dissecting Engineered Cell Types and Enhancing Cell Fate Conversion via CellNet , 2014, Cell.

[40]  Lars Kaderali,et al.  Dynamic probabilistic threshold networks to infer signaling pathways from time-course perturbation data , 2014, BMC Bioinformatics.

[41]  Jean-Paul Delahaye,et al.  Numerical evaluation of algorithmic complexity for short strings: A glance into the innermost structure of randomness , 2011, Appl. Math. Comput..

[42]  Giulio Cimini,et al.  The statistical physics of real-world networks , 2018, Nature Reviews Physics.

[43]  M. Cascante,et al.  Network modules uncover mechanisms of skeletal muscle dysfunction in COPD patients , 2018, Journal of Translational Medicine.

[44]  A. Nies.  Computability and randomness , 2009 .