Sensitive Dependence of Optimal Network Dynamics on Network Structure

The relation between network structure and dynamics is determinant for the behavior of complex systems in numerous domains. An important long-standing problem concerns the properties of the networks that optimize the dynamics with respect to a given performance measure. Here we show that such optimization can lead to sensitive dependence of the dynamics on the structure of the network. Specifically, using diffusively coupled systems as examples, we demonstrate that the stability of a dynamical state can exhibit sensitivity to unweighted structural perturbations (i.e., link removals and node additions) for undirected optimal networks and to weighted perturbations (i.e., small changes in link weights) for directed optimal networks. As mechanisms underlying this sensitivity, we identify discontinuous transitions occurring in the complement of undirected optimal networks and the prevalence of eigenvector degeneracy in directed optimal networks. These findings establish a unified characterization of networks optimized for dynamical stability, which we illustrate using Turing instability in activator-inhibitor systems, synchronization in power-grid networks, network diffusion, and several other network processes. Our results suggest that the network structure of a complex system operating near an optimum can potentially be fine-tuned for a significantly enhanced stability compared to what one might expect from simple extrapolation. On the other hand, they also suggest constraints on how close to the optimum the system can be in practice. Finally, the results have potential implications for biophysical networks, which have evolved under the competing pressures of optimizing fitness while remaining robust against perturbations.

[1]  Marc Timme,et al.  Self-organized adaptation of a simple neural circuit enables complex robot behaviour , 2010, ArXiv.

[2]  J. Spencer,et al.  Explosive Percolation in Random Networks , 2009, Science.

[3]  Martin Vingron,et al.  Design and statistical properties of robust functional networks: a model study of biological signal transduction. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  J M Carlson,et al.  Highly optimized tolerance: a mechanism for power laws in designed systems. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[5]  A. Mikhailov,et al.  Entrainment of randomly coupled oscillator networks by a pacemaker. , 2004, Physical review letters.

[6]  B. Webb,et al.  Isospectral graph transformations, spectral equivalence, and global stability of dynamical networks , 2010, 1010.3272.

[7]  D. Stroud,et al.  Synchronization in disordered Josephson junction arrays: small-world connections and the Kuramoto model. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Benjamin A Carreras,et al.  Complex systems analysis of series of blackouts: cascading failure, critical points, and self-organization. , 2007, Chaos.

[9]  Oliver Riordan,et al.  Explosive Percolation Is Continuous , 2011, Science.

[10]  Vito Latora,et al.  Remote synchronization reveals network symmetries and functional modules. , 2012, Physical review letters.

[11]  S. Strogatz,et al.  Comparing the locking threshold for rings and chains of oscillators. , 2016, Physical review. E.

[12]  Theodore Kolokolnikov,et al.  Maximizing algebraic connectivity for certain families of graphs , 2014, ArXiv.

[13]  Michael P H Stumpf,et al.  Topological sensitivity analysis for systems biology , 2014, Proceedings of the National Academy of Sciences.

[14]  Joseph D. Hart,et al.  Adding connections can hinder network synchronization of time-delayed oscillators. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  John L Hudson,et al.  Emerging Coherence in a Population of Chemical Oscillators , 2002, Science.

[16]  Damián H Zanette,et al.  Contact switching as a control strategy for epidemic outbreaks. , 2008, Journal of theoretical biology.

[17]  Florian Dörfler,et al.  Synchronization and transient stability in power networks and non-uniform Kuramoto oscillators , 2009, Proceedings of the 2010 American Control Conference.

[18]  S. Strogatz,et al.  The size of the sync basin. , 2006, Chaos.

[19]  Marko Wagner,et al.  A Combinatorial Approach To Matrix Theory And Its Applications , 2016 .

[20]  Guanrong Chen,et al.  Discrete H∞ Optimization , 1997 .

[21]  Hiroaki Kitano,et al.  Biological robustness , 2008, Nature Reviews Genetics.

[22]  Edward T. Bullmore,et al.  Efficiency and Cost of Economical Brain Functional Networks , 2007, PLoS Comput. Biol..

[23]  Adilson E Motter,et al.  Heterogeneity in oscillator networks: are smaller worlds easier to synchronize? , 2003, Physical review letters.

[24]  L. Trefethen,et al.  Spectra and pseudospectra : the behavior of nonnormal matrices and operators , 2005 .

[25]  Lazaros K. Gallos,et al.  Explosive percolation in the human protein homology network , 2009, 0911.4082.

[26]  Monika Sharma,et al.  Chemical oscillations , 2006 .

[27]  E. Ott,et al.  The effect of network topology on the stability of discrete state models of genetic control , 2009, Proceedings of the National Academy of Sciences.

[28]  Randy A. Freeman,et al.  Multi-Agent Coordination by Decentralized Estimation and Control , 2008, IEEE Transactions on Automatic Control.

[29]  Jie Sun,et al.  Approximating spectral impact of structural perturbations in large networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  M. A. Muñoz,et al.  Entangled networks, synchronization, and optimal network topology. , 2005, Physical review letters.

[31]  Erik M. Bollt,et al.  Master stability functions for coupled nearly identical dynamical systems , 2008, 0811.0649.

[32]  Ido Kanter,et al.  Controlling synchronization in large laser networks. , 2012, Physical review letters.

[33]  H. Mori,et al.  Construction of Escherichia coli K-12 in-frame, single-gene knockout mutants: the Keio collection , 2006, Molecular systems biology.

[34]  P. Strevens Iii , 1985 .

[35]  Seth A. Myers,et al.  Spontaneous synchrony in power-grid networks , 2013, Nature Physics.

[36]  Edward Ott,et al.  Emergence of coherence in complex networks of heterogeneous dynamical systems. , 2006, Physical review letters.

[37]  Mw Hirsch,et al.  Chaos In Dynamical Systems , 2016 .

[38]  T. Carroll,et al.  Master Stability Functions for Synchronized Coupled Systems , 1998 .

[39]  Ha Hong,et al.  Performance-optimized hierarchical models predict neural responses in higher visual cortex , 2014, Proceedings of the National Academy of Sciences.

[40]  Sean N. Brennan,et al.  Observability and Controllability of Nonlinear Networks: The Role of Symmetry , 2013, Physical review. X.

[41]  U. Dieckmann,et al.  Self-extinction through optimizing selection , 2013, Journal of theoretical biology.

[42]  Johnson,et al.  Three coupled oscillators as a universal probe of synchronization stability in coupled oscillator arrays , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[43]  Qiu Xinyun,et al.  The optimal synchronizability of a class network , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[44]  Francesco Sorrentino,et al.  Cluster synchronization and isolated desynchronization in complex networks with symmetries , 2013, Nature Communications.

[45]  Noga Alon,et al.  Eigenvalues and expanders , 1986, Comb..

[46]  Christoph Maas,et al.  Transportation in graphs and the admittance spectrum , 1987, Discret. Appl. Math..

[47]  A. Hagberg,et al.  Rewiring networks for synchronization. , 2008, Chaos.

[48]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[49]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[50]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[51]  O. Sporns,et al.  Motifs in Brain Networks , 2004, PLoS biology.

[52]  Adilson E Motter,et al.  Network synchronization landscape reveals compensatory structures, quantization, and the positive effect of negative interactions , 2009, Proceedings of the National Academy of Sciences.

[53]  Conrado J. Pérez Vicente,et al.  Diffusion dynamics on multiplex networks , 2012, Physical review letters.

[54]  E. Ott Chaos in Dynamical Systems: Contents , 2002 .

[55]  Kenneth Showalter,et al.  Insights into collective cell behaviour from populations of coupled chemical oscillators. , 2015, Physical chemistry chemical physics : PCCP.

[56]  Raissa M. D'Souza,et al.  Anomalous critical and supercritical phenomena in explosive percolation , 2015, Nature Physics.

[57]  Mansour Eslami,et al.  Theory of sensitivity in dynamic systems , 1994 .

[58]  Wei Chen,et al.  Microtransition cascades to percolation. , 2014, Physical review letters.

[59]  Chao Liu,et al.  Network synchronizability analysis: the theory of subgraphs and complementary graphs , 2007, ArXiv.

[60]  I. Epstein,et al.  Response of complex networks to stimuli. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[61]  S. Strogatz Exploring complex networks , 2001, Nature.

[62]  Martin Hasler,et al.  Generalized connection graph method for synchronization in asymmetrical networks , 2006 .

[63]  G. Buzsáki,et al.  Interneuron Diversity series: Circuit complexity and axon wiring economy of cortical interneurons , 2004, Trends in Neurosciences.

[64]  Thilo Gross,et al.  Epidemic dynamics on an adaptive network. , 2005, Physical review letters.

[65]  J. S. Andrade,et al.  Optimal synchronizability of bearings. , 2013, Physical review letters.

[66]  C. Hutchison,et al.  Essential genes of a minimal bacterium. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Rubén J. Sánchez-García,et al.  Spectral characteristics of network redundancy. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[68]  Zoltán Toroczkai,et al.  Structural bottlenecks for communication in networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  Alexander S. Mikhailov,et al.  Turing patterns in network-organized activator–inhibitor systems , 2008, 0807.1230.

[70]  Alessandro Vespignani,et al.  Reaction–diffusion processes and metapopulation models in heterogeneous networks , 2007, cond-mat/0703129.

[71]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[72]  F. Garofalo,et al.  Controllability of complex networks via pinning. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[73]  W. R. Cluett,et al.  Characterizing metabolic pathway diversification in the context of perturbation size. , 2015, Metabolic engineering.

[74]  Xiaodong Huang,et al.  Structure and control of self-sustained target waves in excitable small-world networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[75]  Andrei Z. Broder,et al.  On the second eigenvalue of random regular graphs , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[76]  Takamitsu Watanabe,et al.  Enhancing the spectral gap of networks by node removal. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[77]  Markus Brede Optimal synchronization in space. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[78]  Tao Zhou,et al.  Optimal synchronizability of networks , 2007 .

[79]  Liang Huang,et al.  Topological control of synchronous patterns in systems of networked chaotic oscillators , 2013 .

[80]  G. Filatrella,et al.  Analysis of a power grid using a Kuramoto-like model , 2007, 0705.1305.

[81]  Dane Taylor,et al.  Optimal synchronization of complex networks. , 2014, Physical review letters.

[82]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[83]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[84]  M. Murty Ramanujan Graphs , 1965 .

[85]  Adilson E. Motter,et al.  Maximum performance at minimum cost in network synchronization , 2006, cond-mat/0609622.

[86]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[87]  S N Dorogovtsev,et al.  Explosive percolation transition is actually continuous. , 2010, Physical review letters.

[88]  J. Stelling,et al.  Robustness of Cellular Functions , 2004, Cell.

[89]  Hiroshi Kori,et al.  Strong effects of network architecture in the entrainment of coupled oscillator systems. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[90]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[91]  Jürgen Kurths,et al.  Cluster explosive synchronization in complex networks. , 2013, Physical review letters.

[92]  Dane Taylor,et al.  Causal Network Inference by Optimal Causation Entropy , 2014, SIAM J. Appl. Dyn. Syst..

[93]  A. Motter,et al.  Synchronization is optimal in nondiagonalizable networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[94]  Edward Ott,et al.  Spatial patterns of desynchronization bursts in networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[95]  Stephen Eubank,et al.  Network Reliability: The effect of local network structure on diffusive processes , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[96]  Mark Newman,et al.  Dynamical systems on networks , 2018, Oxford Scholarship Online.

[97]  Adilson E Motter,et al.  Robustness of optimal synchronization in real networks. , 2011, Physical review letters.