Balance between Noise and Information Flow Maximizes Set Complexity of Network Dynamics

Boolean networks have been used as a discrete model for several biological systems, including metabolic and genetic regulatory networks. Due to their simplicity they offer a firm foundation for generic studies of physical systems. In this work we show, using a measure of context-dependent information, set complexity, that prior to reaching an attractor, random Boolean networks pass through a transient state characterized by high complexity. We justify this finding with a use of another measure of complexity, namely, the statistical complexity. We show that the networks can be tuned to the regime of maximal complexity by adding a suitable amount of noise to the deterministic Boolean dynamics. In fact, we show that for networks with Poisson degree distributions, all networks ranging from subcritical to slightly supercritical can be tuned with noise to reach maximal set complexity in their dynamics. For networks with a fixed number of inputs this is true for near-to-critical networks. This increase in complexity is obtained at the expense of disruption in information flow. For a large ensemble of networks showing maximal complexity, there exists a balance between noise and contracting dynamics in the state space. In networks that are close to critical the intrinsic noise required for the tuning is smaller and thus also has the smallest effect in terms of the information processing in the system. Our results suggest that the maximization of complexity near to the state transition might be a more general phenomenon in physical systems, and that noise present in a system may in fact be useful in retaining the system in a state with high information content.

[1]  Cosma Rohilla Shalizi Optimal Nonlinear Prediction of Random Fields on Networks , 2003, DMCS.

[2]  Ricardo López-Ruiz,et al.  A Statistical Measure of Complexity , 1995, ArXiv.

[3]  H. Othmer,et al.  The topology of the regulatory interactions predicts the expression pattern of the segment polarity genes in Drosophila melanogaster. , 2003, Journal of theoretical biology.

[4]  David J. Galas,et al.  Complexity of networks II: The set complexity of edge-colored graphs , 2012, Complex..

[5]  Stefan Bornholdt,et al.  Less Is More in Modeling Large Genetic Networks , 2005, Science.

[6]  M. Gerstein,et al.  Genomic analysis of regulatory network dynamics reveals large topological changes , 2004, Nature.

[7]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[8]  Carlos Gershenson,et al.  Updating Schemes in Random Boolean Networks: Do They Really Matter? , 2004, ArXiv.

[9]  Ian H. Witten,et al.  Data Compression Using Adaptive Coding and Partial String Matching , 1984, IEEE Trans. Commun..

[10]  Matti Nykter,et al.  Information Diversity in Structure and Dynamics of Simulated Neuronal Networks , 2011, Front. Comput. Neurosci..

[11]  P. Grassberger Toward a quantitative theory of self-generated complexity , 1986 .

[12]  S. Kauffman,et al.  On the dynamics of random Boolean networks subject to noise: attractors, ergodic sets and cell types. , 2010, Journal of theoretical biology.

[13]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[14]  Christof Teuscher,et al.  Critical Values in Asynchronous Random Boolean Networks , 2003, ECAL.

[15]  L. Kadanoff,et al.  Boolean Dynamics with Random Couplings , 2002, nlin/0204062.

[16]  Young,et al.  Inferring statistical complexity. , 1989, Physical review letters.

[17]  L. Hood,et al.  Gene expression dynamics in the macrophage exhibit criticality , 2008, Proceedings of the National Academy of Sciences.

[18]  B. Derrida,et al.  Evolution of overlaps between configurations in random Boolean networks , 1986 .

[19]  Khalid Sayood,et al.  A new sequence distance measure for phylogenetic tree construction , 2003, Bioinform..

[20]  Rolf Landauer,et al.  A simple measure of complexity , 1988, Nature.

[21]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[22]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[23]  Olli Yli-Harja,et al.  Of the complexity of Boolean network state trajectories , 2011 .

[24]  Jason Lloyd-Price,et al.  Mutual information in random Boolean models of regulatory networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER IN EVOLUTION: SELF-ORGANIZATION AND SELECTION , 1992 .

[26]  Giulia Galbiati M. J. Fischer: On the Complexity of 2-Output Boolean Networks , 1981, Theor. Comput. Sci..

[27]  Barbara Drossel,et al.  Noise in random Boolean networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  S. Kauffman,et al.  Measures for information propagation in Boolean networks , 2007 .

[29]  Phil Husbands,et al.  Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems , 2004 .

[30]  B. Derrida,et al.  Phase Transitions in Two-Dimensional Kauffman Cellular Automata , 1986 .

[31]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[32]  Ilya Shmulevich,et al.  Critical networks exhibit maximal information diversity in structure-dynamics relationships. , 2008, Physical review letters.

[33]  Mikhail Prokopenko,et al.  Information Dynamics in Small-World Boolean Networks , 2011, Artificial Life.

[34]  Noga Alon,et al.  The monotone circuit complexity of boolean functions , 1987, Comb..

[35]  Robert Haslinger,et al.  Quantifying self-organization with optimal predictors. , 2004, Physical review letters.

[36]  Xinwei Gong,et al.  Quantifying the complexity of random Boolean networks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Ilya Shmulevich,et al.  Eukaryotic cells are dynamically ordered or critical but not chaotic. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Stefan Bornholdt,et al.  Stable and unstable attractors in Boolean networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  I. Shmulevich,et al.  Basin entropy in Boolean network ensembles. , 2007, Physical review letters.

[40]  Bin Ma,et al.  The similarity metric , 2001, IEEE Transactions on Information Theory.

[41]  S. Strogatz Exploring complex networks , 2001, Nature.

[42]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[43]  Jordi Bascompte,et al.  The architecture of mutualistic networks minimizes competition and increases biodiversity , 2009, Nature.

[44]  S. Kauffman Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[45]  David J. Galas,et al.  Complexity of networks I: The set-complexity of binary graphs , 2011, Complex..

[46]  Nathan D. Price,et al.  Biological Information as Set-Based Complexity , 2010, IEEE Transactions on Information Theory.