Development of structural correlations and synchronization from adaptive rewiring in networks of Kuramoto oscillators

Synchronization of non-identical oscillators coupled through complex networks is an important example of collective behavior, and it is interesting to ask how the structural organization of network interactions influences this process. Several studies have explored and uncovered optimal topologies for synchronization by making purposeful alterations to a network. On the other hand, the connectivity patterns of many natural systems are often not static, but are rather modulated over time according to their dynamics. However, this co-evolution and the extent to which the dynamics of the individual units can shape the organization of the network itself are less well understood. Here, we study initially randomly connected but locally adaptive networks of Kuramoto oscillators. In particular, the system employs a co-evolutionary rewiring strategy that depends only on the instantaneous, pairwise phase differences of neighboring oscillators, and that conserves the total number of edges, allowing the effects of local reorganization to be isolated. We find that a simple rule—which preserves connections between more out-of-phase oscillators while rewiring connections between more in-phase oscillators—can cause initially disordered networks to organize into more structured topologies that support enhanced synchronization dynamics. We examine how this process unfolds over time, finding a dependence on the intrinsic frequencies of the oscillators, the global coupling, and the network density, in terms of how the adaptive mechanism reorganizes the network and influences the dynamics. Importantly, for large enough coupling and after sufficient adaptation, the resulting networks exhibit interesting characteristics, including degree–frequency and frequency–neighbor frequency correlations. These properties have previously been associated with optimal synchronization or explosive transitions in which the networks were constructed using global information. On the contrary, by considering a time-dependent interplay between structure and dynamics, this work offers a mechanism through which emergent phenomena and organization can arise in complex systems utilizing local rules.

[1]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[2]  Markus Brede Enhancing Synchronization in Systems of Non-identical Kuramoto Oscillators , 2009, Complex.

[3]  Yoshiki Kuramoto,et al.  In International Symposium on Mathematical Problems in Theoretical Physics , 1975 .

[4]  A. Winfree The geometry of biological time , 1991 .

[5]  Jin Fan,et al.  Enhancement of Synchronizability of the Kuramoto Model with Assortative Degree-Frequency Mixing , 2009, Complex.

[6]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[7]  Danielle S. Bassett,et al.  Collective Decision Dynamics in the Presence of External Drivers , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  S. Bornholdt,et al.  Topological evolution of dynamical networks: global criticality from local dynamics. , 2000, Physical review letters.

[9]  Florian Dörfler,et al.  Synchronization and transient stability in power networks and non-uniform Kuramoto oscillators , 2009, Proceedings of the 2010 American Control Conference.

[10]  S. Solla,et al.  Self-sustained activity in a small-world network of excitable neurons. , 2003, Physical review letters.

[11]  Piet Van Mieghem,et al.  Epidemic processes in complex networks , 2014, ArXiv.

[12]  G. Ermentrout,et al.  Gamma rhythms and beta rhythms have different synchronization properties. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Vito Latora,et al.  Emergence of structural patterns out of synchronization in networks with competitive interactions , 2011, Scientific reports.

[14]  Pablo M. Gleiser,et al.  Synchronization and structure in an adaptive oscillator network , 2006 .

[15]  C. J. Stam,et al.  Functional connectivity patterns of human magnetoencephalographic recordings: a ‘small-world’ network? , 2004, Neuroscience Letters.

[16]  Lubos Buzna,et al.  Synchronization in symmetric bipolar population networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Trilochan Bagarti,et al.  Synchronization in an evolving network , 2015 .

[18]  Chun Wong,et al.  Modeling complex systems with adaptive networks , 2013, Comput. Math. Appl..

[19]  Yamir Moreno,et al.  Synchronization of Kuramoto oscillators in scale-free networks , 2004 .

[20]  David Terman,et al.  Mathematical foundations of neuroscience , 2010 .

[21]  Bethany Percha,et al.  Transition from local to global phase synchrony in small world neural network and its possible implications for epilepsy. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  S. Strogatz From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[23]  Franziska Abend,et al.  Sync The Emerging Science Of Spontaneous Order , 2016 .

[24]  Marc Timme,et al.  Self-organized synchronization in decentralized power grids. , 2012, Physical review letters.

[25]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Daichi Kimura,et al.  Coevolutionary networks with homophily and heterophily. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  A. Díaz-Guilera,et al.  Synchronization and modularity in complex networks , 2007 .

[28]  Zonghua Liu,et al.  Explosive synchronization in adaptive and multilayer networks. , 2014, Physical review letters.

[29]  Thomas K. D. M. Peron,et al.  The Kuramoto model in complex networks , 2015, 1511.07139.

[30]  A. Díaz-Guilera,et al.  Role of network topology in the synchronization of power systems , 2012, 1207.0406.

[31]  M. Brede Synchrony-optimized networks of non-identical Kuramoto oscillators , 2008, 0809.4531.

[32]  Pérez,et al.  Synchronization, diversity, and topology of networks of integrate and fire oscillators , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[33]  Seth A. Myers,et al.  Spontaneous synchrony in power-grid networks , 2013, Nature Physics.

[34]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[35]  Julia Kluge,et al.  Emergence Of Dynamical Order Synchronization Phenomena In Complex Systems , 2016 .

[36]  Andreas Daffertshofer,et al.  Generative Models of Cortical Oscillations: Neurobiological Implications of the Kuramoto Model , 2010, Front. Hum. Neurosci..

[37]  Changsong Zhou,et al.  Dynamical weights and enhanced synchronization in adaptive complex networks. , 2006, Physical review letters.

[38]  Toshio Aoyagi,et al.  Co-evolution of phases and connection strengths in a network of phase oscillators. , 2009, Physical review letters.

[39]  V. Booth,et al.  Interplay between excitability type and distributions of neuronal connectivity determines neuronal network synchronization. , 2016, Physical review. E.

[40]  E. Ott,et al.  Adaptive synchronization of dynamics on evolving complex networks. , 2008, Physical review letters.

[41]  J Gómez-Gardeñes,et al.  Emerging meso- and macroscales from synchronization of adaptive networks. , 2011, Physical review letters.

[42]  Alex Arenas,et al.  Synchronization reveals topological scales in complex networks. , 2006, Physical review letters.

[43]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[44]  Cees van Leeuwen,et al.  Robust emergence of small-world structure in networks of spiking neurons , 2007, Cognitive Neurodynamics.

[45]  Fernando Moya Orsatti,et al.  Optimized network structure for full-synchronization , 2009 .

[46]  Wu-Jie Yuan,et al.  Interplay between structure and dynamics in adaptive complex networks: emergence and amplification of modularity by adaptive dynamics. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  L F Lago-Fernández,et al.  Fast response and temporal coherent oscillations in small-world networks. , 1999, Physical review letters.

[48]  E. Bullmore,et al.  Adaptive reconfiguration of fractal small-world human brain functional networks , 2006, Proceedings of the National Academy of Sciences.

[49]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[50]  Todd K. Leen,et al.  Anti-Hebbian Spike-Timing-Dependent Plasticity and Adaptive Sensory Processing , 2010, Front. Comput. Neurosci..

[51]  Wenwu Yu,et al.  Better synchronizability in generalized adaptive networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  Guido Caldarelli,et al.  Concurrent enhancement of percolation and synchronization in adaptive networks , 2015, Scientific Reports.

[53]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[54]  Pulin Gong,et al.  Evolution to a small-world network with chaotic units , 2004 .

[55]  Per Sebastian Skardal,et al.  Hierarchical synchrony of phase oscillators in modular networks. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[57]  L Q English,et al.  Synchronization in phase-coupled Kuramoto oscillator networks with axonal delay and synaptic plasticity. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  D. Papo,et al.  Explosive transitions to synchronization in networks of phase oscillators , 2012, Scientific Reports.

[59]  G. Deco,et al.  Emerging concepts for the dynamical organization of resting-state activity in the brain , 2010, Nature Reviews Neuroscience.

[60]  F. C. Santos,et al.  Evolutionary games in self-organizing populations , 2008 .

[61]  Deok-Sun Lee Synchronization transition in scale-free networks: clusters of synchrony. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[62]  Entraining the topology and the dynamics of a network of phase oscillators. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[63]  R. Spigler,et al.  The Kuramoto model: A simple paradigm for synchronization phenomena , 2005 .

[64]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[65]  Mauricio Barahona,et al.  Synchronization in small-world systems. , 2002, Physical review letters.

[66]  Istvan Z Kiss,et al.  Epidemic spread in networks: Existing methods and current challenges. , 2014, Mathematical modelling of natural phenomena.

[67]  Alex Arenas,et al.  Paths to synchronization on complex networks. , 2006, Physical review letters.

[68]  Danielle S Bassett,et al.  Cognitive fitness of cost-efficient brain functional networks , 2009, Proceedings of the National Academy of Sciences.

[69]  Y. Moreno,et al.  Epidemic outbreaks in complex heterogeneous networks , 2001, cond-mat/0107267.

[70]  Olaf Sporns,et al.  Connectivity and complexity: the relationship between neuroanatomy and brain dynamics , 2000, Neural Networks.

[71]  Javier M. Buldú,et al.  Phase Locking Induces Scale-Free Topologies in Networks of Coupled Oscillators , 2008, PloS one.

[72]  T. Carroll,et al.  Master Stability Functions for Synchronized Coupled Systems , 1998 .

[73]  Olaf Sporns,et al.  Symbiotic relationship between brain structure and dynamics , 2009, BMC Neuroscience.

[74]  Thilo Gross,et al.  Epidemic dynamics on an adaptive network. , 2005, Physical review letters.

[75]  I Leyva,et al.  Explosive synchronization in weighted complex networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[76]  Georg A Gottwald,et al.  On the topology of synchrony optimized networks of a Kuramoto-model with non-identical oscillators. , 2011, Chaos.

[77]  Markus Brede,et al.  Locals vs. global synchronization in networks of non-identical Kuramoto oscillators , 2008 .

[78]  Alex Arenas,et al.  Synchronizability determined by coupling strengths and topology on complex networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[79]  Lev S Tsimring,et al.  Plasticity and learning in a network of coupled phase oscillators. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[80]  Beom Jun Kim,et al.  Synchronization on small-world networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[81]  Satu Elisa Schaeffer,et al.  Assortative and modular networks are shaped by adaptive synchronization processes. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[82]  Sergio Gómez,et al.  Explosive synchronization transitions in scale-free networks. , 2011, Physical review letters.

[83]  Peter Somogyi,et al.  Anti-Hebbian Long-Term Potentiation in the Hippocampal Feedback Inhibitory Circuit , 2007, Science.

[84]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[85]  M. Gerstein,et al.  Genomic analysis of regulatory network dynamics reveals large topological changes , 2004, Nature.

[86]  Jian-Fang Zhou,et al.  Spontaneous scale-free structure in adaptive networks with synchronously dynamical linking. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[87]  Toshio Aoyagi,et al.  Self-organized network of phase oscillators coupled by activity-dependent interactions. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[88]  S. Bornholdt,et al.  Self-organized critical neural networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[89]  A. Pikovsky,et al.  Synchronization: Theory and Application , 2003 .

[90]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[91]  Jianye Zhao,et al.  Adaptive coupling and enhanced synchronization in coupled phase oscillators. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[92]  Alessandro Vespignani,et al.  Dynamical Processes on Complex Networks , 2008 .

[93]  Guy Karlebach,et al.  Modelling and analysis of gene regulatory networks , 2008, Nature Reviews Molecular Cell Biology.

[94]  M. Newman,et al.  Nonequilibrium phase transition in the coevolution of networks and opinions. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[95]  Ying-Cheng Lai,et al.  Transition to global synchronization in clustered networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[96]  Celso Freitas,et al.  Synchronization versus neighborhood similarity in complex networks of nonidentical oscillators. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[97]  Ivan Tyukin,et al.  Spatially constrained adaptive rewiring in cortical networks creates spatially modular small world architectures , 2014, Cognitive Neurodynamics.

[98]  Thilo Gross,et al.  Adaptive coevolutionary networks: a review , 2007, Journal of The Royal Society Interface.

[99]  G. Gottwald Model reduction for networks of coupled oscillators. , 2015, Chaos.

[100]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[101]  O. Sporns,et al.  Key role of coupling, delay, and noise in resting brain fluctuations , 2009, Proceedings of the National Academy of Sciences.

[102]  A. Arenas,et al.  Erosion of synchronization in networks of coupled oscillators. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[103]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[104]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[105]  C. Stam,et al.  Nonlinear dynamical analysis of EEG and MEG: Review of an emerging field , 2005, Clinical Neurophysiology.

[106]  A. Arenas,et al.  Synchronization processes in complex networks , 2006, nlin/0610057.

[107]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[108]  Markus Brede,et al.  The synchronization transition in correlated oscillator populations , 2008, 0810.1121.

[109]  Chris Arney Sync: The Emerging Science of Spontaneous Order , 2007 .

[110]  Alessandro Vespignani Modelling dynamical processes in complex socio-technical systems , 2011, Nature Physics.

[111]  E Oh,et al.  Modular synchronization in complex networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[112]  R. S. Pinto,et al.  Optimal synchronization of Kuramoto oscillators: A dimensional reduction approach. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[113]  Marc Timme,et al.  Breaking synchrony by heterogeneity in complex networks. , 2003, Physical review letters.

[114]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[115]  M. Elowitz,et al.  A synthetic oscillatory network of transcriptional regulators , 2000, Nature.

[116]  L. Glass Synchronization and rhythmic processes in physiology , 2001, Nature.

[117]  Dane Taylor,et al.  Optimal synchronization of complex networks. , 2014, Physical review letters.

[118]  Brian Litt,et al.  Dynamic Network Drivers of Seizure Generation, Propagation and Termination in Human Neocortical Epilepsy , 2014, PLoS Comput. Biol..

[119]  Jianye Zhao,et al.  The adaptive coupling scheme and the heterogeneity in intrinsic frequency and degree distributions of the complex networks , 2014 .