Propagation delays determine neuronal activity and synaptic connectivity patterns emerging in plastic neuronal networks.

In plastic neuronal networks, the synaptic strengths are adapted to the neuronal activity. Specifically, spike-timing-dependent plasticity (STDP) is a fundamental mechanism that modifies the synaptic strengths based on the relative timing of pre- and postsynaptic spikes, taking into account the spikes' temporal order. In many studies, propagation delays were neglected to avoid additional dynamic complexity or computational costs. So far, networks equipped with a classic STDP rule typically rule out bidirectional couplings (i.e., either loops or uncoupled states) and are, hence, not able to reproduce fundamental experimental findings. In this review paper, we consider additional features, e.g., extensions of the classic STDP rule or additional aspects like noise, in order to overcome the contradictions between theory and experiment. In addition, we review in detail recent studies showing that a classic STDP rule combined with realistic propagation patterns is able to capture relevant experimental findings. In two coupled oscillatory neurons with propagation delays, bidirectional synapses can be preserved and potentiated. This result also holds for large networks of type-II phase oscillators. In addition, not only the mean of the initial distribution of synaptic weights, but also its standard deviation crucially determines the emergent structural connectivity, i.e., the mean final synaptic weight, the number of two-neuron loops, and the symmetry of the final connectivity pattern. The latter is affected by the firing rates, where more symmetric synaptic configurations emerge at higher firing rates. Finally, we discuss these findings in the context of the computational neuroscience-based development of desynchronizing brain stimulation techniques.

[1]  S. A. Campbell,et al.  Stability and Synchronization of a Ring of Identical Cells with Delayed Coupling , 2004 .

[2]  Peter A. Tass,et al.  Dendritic and Axonal Propagation Delays Determine Emergent Structures of Neuronal Networks with Plastic Synapses , 2017, Scientific Reports.

[3]  Alireza Valizadeh,et al.  Synchronization of oscillators through time-shifted common inputs. , 2016, Physical review. E.

[4]  H. Kwan,et al.  Single unit analysis of the human ventral thalamic nuclear group. Tremor-related activity in functionally identified cells. , 1994, Brain : a journal of neurology.

[5]  Bard Ermentrout,et al.  Type I Membranes, Phase Resetting Curves, and Synchrony , 1996, Neural Computation.

[6]  Peter A. Tass,et al.  A model of desynchronizing deep brain stimulation with a demand-controlled coordinated reset of neural subpopulations , 2003, Biological Cybernetics.

[7]  Toshio Aoyagi,et al.  Co-evolution of phases and connection strengths in a network of phase oscillators. , 2009, Physical review letters.

[8]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.

[9]  Y. Kawaguchi,et al.  Recurrent Connection Patterns of Corticostriatal Pyramidal Cells in Frontal Cortex , 2006, The Journal of Neuroscience.

[10]  Thomas Nowotny,et al.  Enhancement of Synchronization in a Hybrid Neural Circuit by Spike-Timing Dependent Plasticity , 2003, The Journal of Neuroscience.

[11]  J. Danckaert,et al.  Synchronization properties of network motifs: influence of coupling delay and symmetry. , 2008, Chaos.

[12]  P. Tass Phase Resetting in Medicine and Biology , 1999 .

[13]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[14]  Günther Palm,et al.  Does Spike-Timing-Dependent Synaptic Plasticity Couple or Decouple Neurons Firing in Synchrony? , 2012, Front. Comput. Neurosci..

[15]  Jan Karbowski,et al.  Synchrony arising from a balanced synaptic plasticity in a network of heterogeneous neural oscillators. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[17]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[18]  Claudio R Mirasso,et al.  Anticipated and zero-lag synchronization in motifs of delay-coupled systems. , 2017, Chaos.

[19]  Wulfram Gerstner,et al.  Frontiers in Synaptic Neuroscience Synaptic Neuroscience , 2022 .

[20]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[21]  Eugene M. Izhikevich,et al.  Weakly pulse-coupled oscillators, FM interactions, synchronization, and oscillatory associative memory , 1999, IEEE Trans. Neural Networks.

[22]  Peter A. Tass,et al.  Self-organized noise resistance of oscillatory neural networks with spike timing-dependent plasticity , 2013, Scientific Reports.

[23]  C. Koch,et al.  Effect of geometrical irregularities on propagation delay in axonal trees. , 1991, Biophysical journal.

[24]  E. Izhikevich Phase models with explicit time delays , 1998 .

[25]  Andreas Knoblauch,et al.  Synaptic plasticity, conduction delays, and inter-areal phase relations of spike activity in a model of reciprocally connected areas , 2003, Neurocomputing.

[26]  Wulfram Gerstner,et al.  Intrinsic Stabilization of Output Rates by Spike-Based Hebbian Learning , 2001, Neural Computation.

[27]  D. Debanne,et al.  Release-Dependent Variations in Synaptic Latency: A Putative Code for Short- and Long-Term Synaptic Dynamics , 2007, Neuron.

[28]  Mingzhou Ding,et al.  Will a large complex system with time delays be stable? , 2004, Physical review letters.

[29]  Christof Koch,et al.  The role of single neurons in information processing , 2000, Nature Neuroscience.

[30]  H. Swadlow,et al.  Corticogeniculate neurons, corticotectal neurons, and suspected interneurons in visual cortex of awake rabbits: receptive-field properties, axonal properties, and effects of EEG arousal. , 1987, Journal of neurophysiology.

[31]  E. Schöll,et al.  Synchronization of networks of oscillators with distributed delay coupling. , 2014, Chaos.

[32]  Markus Diesmann,et al.  Spike-Timing-Dependent Plasticity in Balanced Random Networks , 2007, Neural Computation.

[33]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[34]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[35]  Andreas Knoblauch,et al.  Spike-timing-dependent synaptic plasticity can form "zero lag links" for cortical oscillations , 2004, Neurocomputing.

[36]  Ernst,et al.  Synchronization induced by temporal delays in pulse-coupled oscillators. , 1995, Physical review letters.

[37]  H. Bergman,et al.  Pathological synchronization in Parkinson's disease: networks, models and treatments , 2007, Trends in Neurosciences.

[38]  David W. Nauen,et al.  Coactivation and timing-dependent integration of synaptic potentiation and depression , 2005, Nature Neuroscience.

[39]  Christian Hauptmann,et al.  Coordinated reset neuromodulation for Parkinson's disease: Proof-of-concept study , 2014, Movement disorders : official journal of the Movement Disorder Society.

[40]  Baktash Babadi,et al.  Pairwise Analysis Can Account for Network Structures Arising from Spike-Timing Dependent Plasticity , 2013, PLoS Comput. Biol..

[41]  Peter A. Tass,et al.  Delay-Induced Multistability and Loop Formation in Neuronal Networks with Spike-Timing-Dependent Plasticity , 2018, Scientific Reports.

[42]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[44]  H. Markram,et al.  Physiology and anatomy of synaptic connections between thick tufted pyramidal neurones in the developing rat neocortex. , 1997, The Journal of physiology.

[45]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[46]  Jeffrey L. Elman,et al.  Distributed Representations, Simple Recurrent Networks, and Grammatical Structure , 1991, Mach. Learn..

[47]  Evgueniy V. Lubenov,et al.  Decoupling through Synchrony in Neuronal Circuits with Propagation Delays , 2008, Neuron.

[48]  Daniel D. Lee,et al.  Equilibrium properties of temporally asymmetric Hebbian plasticity. , 2000, Physical review letters.

[49]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[50]  Jürgen Kurths,et al.  The impact of propagation and processing delays on amplitude and oscillation deaths in the presence of symmetry-breaking coupling. , 2017, Chaos.

[51]  Matthew D. Johnson,et al.  Coordinated Reset Deep Brain Stimulation of Subthalamic Nucleus Produces Long-Lasting, Dose-Dependent Motor Improvements in the 1-Methyl-4-phenyl-1,2,3,6-tetrahydropyridine Non-Human Primate Model of Parkinsonism , 2016, Brain Stimulation.

[52]  Guillermo A. Cecchi,et al.  A Theory of Loop Formation and Elimination by Spike Timing-Dependent Plasticity , 2009, Front. Neural Circuits.

[53]  Peter A Tass,et al.  Delay- and coupling-induced firing patterns in oscillatory neural loops. , 2011, Physical review letters.

[54]  Matthieu Gilson,et al.  Delay Selection by Spike-Timing-Dependent Plasticity in Recurrent Networks of Spiking Neurons Receiving Oscillatory Inputs , 2013, PLoS Comput. Biol..

[55]  Alireza Valizadeh,et al.  Zero-Lag Synchronization Despite Inhomogeneities in a Relay System , 2014, PloS one.

[56]  Peter A. Tass,et al.  Impact of acoustic coordinated reset neuromodulation on effective connectivity in a neural network of phantom sound , 2013, NeuroImage.

[57]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[58]  Thomas Erneux,et al.  Introduction to Focus Issue: Time-delay dynamics. , 2017, Chaos.

[59]  Rishidev Chaudhuri,et al.  Computational principles of memory , 2016, Nature Neuroscience.

[60]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[61]  Peter A. Tass,et al.  Desynchronizing electrical and sensory coordinated reset neuromodulation , 2012, Front. Hum. Neurosci..

[62]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[63]  S. Bungay,et al.  Equivariant Hopf bifurcation in a ring of identical cells with delayed coupling , 2005 .

[64]  Christian Hauptmann,et al.  Counteracting tinnitus by acoustic coordinated reset neuromodulation. , 2012, Restorative neurology and neuroscience.

[65]  Caroline A. Lea-Carnall,et al.  Evidence for frequency-dependent cortical plasticity in the human brain , 2017, Proceedings of the National Academy of Sciences.

[66]  Katsunori Kitano,et al.  Interplay between a phase response curve and spike-timing-dependent plasticity leading to wireless clustering. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[67]  Z. Duan,et al.  Synchronization transitions on scale-free neuronal networks due to finite information transmission delays. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[68]  Peter Ford Dominey,et al.  Recurrent temporal networks and language acquisition—from corticostriatal neurophysiology to reservoir computing , 2013, Front. Psychol..

[69]  C. Canavier,et al.  Phase-Resetting Curves Determine Synchronization, Phase Locking, and Clustering in Networks of Neural Oscillators , 2009, The Journal of Neuroscience.

[70]  Sue Ann Campbell,et al.  Stability, Bifurcation, and Multistability in a System of Two Coupled Neurons with Multiple Time Delays , 2000, SIAM J. Appl. Math..

[71]  Caitlin R. S. Williams,et al.  Synchronization states and multistability in a ring of periodic oscillators: experimentally variable coupling delays. , 2013, Chaos.

[72]  G Cheron,et al.  Central somatosensory conduction in man: neural generators and interpeak latencies of the far-field components recorded from neck and right or left scalp and earlobes. , 1980, Electroencephalography and clinical neurophysiology.

[73]  Peter A. Tass,et al.  Long-term anti-kindling effects of desynchronizing brain stimulation: a theoretical study , 2005, Biological Cybernetics.

[74]  P. Tass,et al.  Reversing pathologically increased EEG power by acoustic coordinated reset neuromodulation , 2013, Human brain mapping.

[75]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[76]  Leonardo L. Gollo,et al.  Stimulus-dependent synchronization in delayed-coupled neuronal networks , 2016, Scientific Reports.

[77]  H. Bergman,et al.  Neurons in the globus pallidus do not show correlated activity in the normal monkey, but phase-locked oscillations appear in the MPTP model of parkinsonism. , 1995, Journal of neurophysiology.

[78]  Nebojša Vasović,et al.  Type I vs. type II excitable systems with delayed coupling , 2005 .

[79]  P. Tass,et al.  Cumulative and after-effects of short and weak coordinated reset stimulation: a modeling study , 2009, Journal of neural engineering.

[80]  Andreas Schierwagen,et al.  Dendritic morphology and signal delay in superior colliculus neurons , 2001, Neurocomputing.

[81]  Zhongkui Sun,et al.  Delay-induced stochastic bifurcations in a bistable system under white noise. , 2015, Chaos.

[82]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[83]  Christian Hauptmann,et al.  Multistability in the Kuramoto model with synaptic plasticity. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[84]  I Segev,et al.  Signal delay and input synchronization in passive dendritic structures. , 1993, Journal of neurophysiology.

[85]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[86]  Peter A. Tass,et al.  Coordinated reset vibrotactile stimulation shows prolonged improvement in Parkinson's disease , 2017, Movement disorders : official journal of the Movement Disorder Society.

[87]  Yuliya N. Kyrychko,et al.  Dynamics of Neural Systems with Discrete and Distributed Time Delays , 2015, SIAM J. Appl. Dyn. Syst..

[88]  Sen,et al.  Experimental evidence of time-delay-induced death in coupled limit-cycle oscillators , 1998, Physical review letters.

[89]  Peter A Tass,et al.  Vibrotactile Coordinated Reset Stimulation for the Treatment of Neurological Diseases: Concepts and Device Specifications , 2017, Cureus.

[90]  R Huerta,et al.  Robustness and enhancement of neural synchronization by activity-dependent coupling. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[91]  Christian Hauptmann,et al.  Coordinated reset has sustained aftereffects in Parkinsonian monkeys , 2012, Annals of neurology.

[92]  Jan Sieber,et al.  Local bifurcations in differential equations with state-dependent delay. , 2017, Chaos.

[93]  Hongyong Zhao,et al.  Global asymptotic stability of Hopfield neural network involving distributed delays , 2004, Neural Networks.

[94]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[95]  Leonhard Lücken,et al.  Noise-enhanced coupling between two oscillators with long-term plasticity. , 2015, Physical review. E.

[96]  G. Buzsáki,et al.  Gamma Oscillation by Synaptic Inhibition in a Hippocampal Interneuronal Network Model , 1996, The Journal of Neuroscience.

[97]  Naoki Masuda,et al.  Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity , 2007, Journal of Computational Neuroscience.

[98]  Yongli Song,et al.  Stability switches, oscillatory multistability, and spatio-temporal patterns of nonlinear oscillations in recurrently delay coupled neural networks , 2009, Biological Cybernetics.

[99]  Steven H. Strogatz,et al.  Nonlinear dynamics: Death by delay , 1998, Nature.