Scale free topology as an effective feedback system

Biological networks are often heterogeneous in their connectivity pattern, with degree distributions featuring a heavy tail of highly connected hubs. The implications of this heterogeneity on dynamical properties are a topic of much interest. Here we show that interpreting topology as a feedback circuit can provide novel insights on dynamics. Based on the observation that in finite networks a small number of hubs have a disproportionate effect on the entire system, we construct an approximation by lumping these nodes into a single effective hub, which acts as a feedback loop with the rest of the nodes. We use this approximation to study dynamics of networks with scale-free degree distributions, focusing on their probability of convergence to fixed points. We find that the approximation preserves convergence statistics over a wide range of settings. Our mapping provides a parametrization of scale free topology which is predictive at the ensemble level and also retains properties of individual realizations. Specifically, outgoing hubs have an organizing role that can drive the network to convergence, in analogy to suppression of chaos by an external drive. In contrast, incoming hubs have no such property, resulting in a marked difference between the behavior of networks with outgoing vs. incoming scale free degree distribution. Combining feedback analysis with mean field theory predicts a transition between convergent and divergent dynamics which is corroborated by numerical simulations. Furthermore, they highlight the effect of a handful of outlying hubs, rather than of the connectivity distribution law as a whole, on network dynamics.

[1]  Sergey N. Dorogovtsev,et al.  Critical phenomena in complex networks , 2007, ArXiv.

[2]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[3]  Baruch Barzel,et al.  Dynamic patterns of information flow in complex networks , 2017, Nature Communications.

[4]  G. Buzsáki,et al.  The log-dynamic brain: how skewed distributions affect network operations , 2014, Nature Reviews Neuroscience.

[5]  M. Aldana.  Boolean dynamics of networks with scale-free topology , 2003 .

[6]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[7]  L. Kadanoff,et al.  Boolean Dynamics with Random Couplings , 2002, nlin/0204062.

[8]  Farzad Farkhooi,et al.  Complete Mean-Field Theory for Dynamics of Binary Recurrent Networks. , 2017, Physical review letters.

[9]  Peter E. Latham,et al.  Randomly Connected Networks Have Short Temporal Memory , 2013, Neural Computation.

[10]  Claudius Gros,et al.  Random Boolean Networks , 2013 .

[11]  G. Wainrib,et al.  Topological and dynamical complexity of random neural networks. , 2012, Physical review letters.

[12]  P. Desrosiers,et al.  Spectral Dimension Reduction of Complex Dynamical Networks , 2018, Physical Review X.

[13]  Dianne P. O'Leary,et al.  Why Do Hubs in the Yeast Protein Interaction Network Tend To Be Essential: Reexamining the Connection between the Network Topology and Essentiality , 2008, PLoS Comput. Biol..

[14]  Naama Brenner,et al.  Synaptic Size Dynamics as an Effectively Stochastic Process , 2014, PLoS Comput. Biol..

[15]  Tomoki Fukai,et al.  Computational Implications of Lognormally Distributed Synaptic Weights , 2014, Proceedings of the IEEE.

[16]  Guido Caldarelli,et al.  Scale-Free Networks , 2007 .

[17]  S. Strogatz.  Exploring complex networks , 2001, Nature.

[18]  A. Barabasi,et al.  Universal resilience patterns in complex networks , 2016, Nature.

[19]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[20]  Albert-László Barabási,et al.  Universality in network dynamics , 2013, Nature Physics.

[21]  Atsushi Mochizuki,et al.  Expected Number of Fixed Points in Boolean Networks with Arbitrary Topology. , 2017, Physical review letters.

[22]  L. Abbott,et al.  Stimulus-dependent suppression of chaos in recurrent neural networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Jean-Pierre Eckmann,et al.  Leader neurons in population bursts of 2D living neural networks , 2008 .

[24]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[25]  I. Rebay,et al.  Master regulators in development: Views from the Drosophila retinal determination and mammalian pluripotency gene networks. , 2017, Developmental biology.

[26]  Gipsi Lima-Mendez,et al.  The powerful law of the power law and other myths in network biology. , 2009, Molecular bioSystems.

[27]  R. Castelo,et al.  The propagation of perturbations in rewired bacterial gene networks , 2015, Nature Communications.

[28]  T. Yomo,et al.  Global coordination in adaptation to gene rewiring , 2015, Nucleic acids research.

[29]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[30]  J. Nadal,et al.  What can we learn from synaptic weight distributions? , 2007, Trends in Neurosciences.

[31]  Chung-Yen Lin,et al.  Hubba: hub objects analyzer—a framework of interactome hubs identification for network biology , 2008, Nucleic Acids Res..

[32]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[33]  U. Alon.  Network motifs: theory and experimental approaches , 2007, Nature Reviews Genetics.

[34]  Naama Brenner,et al.  Exploratory adaptation in large random networks , 2016, Nature Communications.

[35]  Gabriel S. Eichler,et al.  Cell fates as high-dimensional attractor states of a complex gene regulatory network. , 2005, Physical review letters.

[36]  H Sompolinsky,et al.  Dynamics of random neural networks with bistable units. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Nikolaos Berntenis,et al.  Detection of attractors of large Boolean networks via exhaustive enumeration of appropriate subspaces of the state space , 2013, BMC Bioinformatics.

[38]  Claudio Castellano,et al.  Relating topological determinants of complex networks to their spectral properties: structural and dynamical effects , 2017, 1703.10438.

[39]  Merav Stern,et al.  Transition to chaos in random networks with cell-type-specific connectivity. , 2014, Physical review letters.

[40]  Piet Van Mieghem,et al.  Epidemic processes in complex networks , 2014, ArXiv.

[41]  J. Hopfield,et al.  From molecular to modular cell biology , 1999, Nature.

[42]  Raissa M. D'Souza,et al.  Complex networks: Structure comes to random graphs , 2009 .

[43]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[44]  Alexander Rivkind,et al.  Local Dynamics in Trained Recurrent Neural Networks. , 2015, Physical review letters.

[45]  P. Bourgine,et al.  Topological and causal structure of the yeast transcriptional regulatory network , 2002, Nature Genetics.

[46]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Danny Eytan,et al.  Dynamics and Effective Topology Underlying Synchronization in Networks of Cortical Neurons , 2006, The Journal of Neuroscience.