Self-organized Criticality via Retro-Synaptic Signals

The brain is a complex system par excellence. In the last decade the observation of neuronal avalanches in neocortical circuits suggested the presence of self-organised criticality in brain networks. The occurrence of this type of dynamics implies several benefits to neural computation. However, the mechanisms that give rise to critical behaviour in these systems, and how they interact with other neuronal processes such as synaptic plasticity are not fully understood. In this paper, we present a long-term plasticity rule based on retro-synaptic signals that allows the system to reach a critical state in which clusters of activity are distributed as a power-law, among other observables. Our synaptic plasticity rule coexists with other synaptic mechanisms such as spike-timing-dependent plasticity, which implies that the resulting synaptic modulation captures not only the temporal correlations between spiking times of pre- and post-synaptic units, which has been suggested as requirement for learning and memory in neural systems, but also drives the system to a state of optimal neural information processing.

[1]  Henrik Jeldtoft Jensen,et al.  Self-Organized Criticality , 1998 .

[2]  Woodrow L. Shew,et al.  Predicting criticality and dynamic range in complex networks: effects of topology. , 2010, Physical review letters.

[3]  D. Turcotte,et al.  Self-organized criticality , 1999 .

[4]  The success of complex networks at criticality , 2015, 1507.07884.

[5]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[6]  Seunghwan Kim,et al.  Self-organized criticality and scale-free properties in emergent functional neural networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[8]  Woodrow L. Shew,et al.  Voltage Imaging of Waking Mouse Cortex Reveals Emergence of Critical Neuronal Dynamics , 2014, The Journal of Neuroscience.

[9]  L. de Arcangelis,et al.  Self-organized criticality model for brain plasticity. , 2006, Physical review letters.

[10]  M. A. Muñoz,et al.  Self-organization without conservation: true or just apparent scale-invariance? , 2009, 0905.1799.

[11]  D. Purves.  Body and Brain: A Trophic Theory of Neural Connections , 1988 .

[12]  J. Michael Herrmann,et al.  Small-world structure induced by spike-timing-dependent plasticity in networks with critical dynamics , 2015, 1507.07879.

[13]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[14]  S. Bornholdt,et al.  Self-organized critical neural networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Leo P. Kadanoff,et al.  Theories of Matter: Infinities and Renormalization , 2010, 1002.2985.

[16]  John M. Beggs,et al.  Being Critical of Criticality in the Brain , 2012, Front. Physio..

[17]  Andreas Klaus,et al.  Statistical Analyses Support Power Law Distributions Found in Neuronal Avalanches , 2011, PloS one.

[18]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[19]  Vivien Chevaleyre,et al.  Endocannabinoid-mediated synaptic plasticity in the CNS. , 2006, Annual review of neuroscience.

[20]  D. Sornette.  Critical Phenomena in Natural Sciences: Chaos, Fractals, Selforganization and Disorder: Concepts and Tools , 2000 .

[21]  Giacomo Indiveri,et al.  Spatio-temporal Spike Pattern Classification in Neuromorphic Systems , 2013, Living Machines.

[22]  D. Plenz,et al.  Spontaneous cortical activity in awake monkeys composed of neuronal avalanches , 2009, Proceedings of the National Academy of Sciences.

[23]  D. Ginty,et al.  Functions and mechanisms of retrograde neurotrophin signalling , 2005, Nature Reviews Neuroscience.

[24]  Woodrow L. Shew,et al.  Adaptation to sensory input tunes visual cortex to criticality , 2015, Nature Physics.

[25]  M. Magnasco,et al.  Self-tuned critical anti-Hebbian networks. , 2009, Physical review letters.

[26]  D. Long.  Networks of the Brain , 2011 .

[27]  Megan R. Carey,et al.  Activity-Dependent Regulation of Synapses by Retrograde Messengers , 2009, Neuron.

[28]  Kenneth D. Harris,et al.  The Neural Marketplace: I. General Formalism and Linear Theory , 2014, bioRxiv.

[29]  Ioana Sporea,et al.  Supervised Learning in Multilayer Spiking Neural Networks , 2012, Neural Computation.

[30]  P. Scheiffele,et al.  Transcriptional control of synaptic differentiation by retrograde signals , 2004, Current Opinion in Neurobiology.

[31]  Didier Sornette,et al.  Stock market crashes are outliers , 1998 .

[32]  Hans J. Herrmann,et al.  Activity-Dependent Neuronal Model on Complex Networks , 2012, Front. Physio..

[33]  K. Harris.  Stability of the fittest: organizing learning through retroaxonal signals , 2008, Trends in Neurosciences.

[34]  S. Bornholdt,et al.  Topological evolution of dynamical networks: global criticality from local dynamics. , 2000, Physical review letters.

[35]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[36]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[37]  V. Frette,et al.  Avalanche dynamics in a pile of rice , 1996, Nature.

[38]  Andreas Klaus,et al.  Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state , 2015, eLife.

[39]  K. Mellanby.  How Nature works , 1978, Nature.

[40]  Thilo Gross,et al.  Adaptive self-organization in a realistic neural network model. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[42]  Victor Hernandez-Urbina,et al.  Neuronal avalanches in complex networks , 2016 .

[43]  L. de Arcangelis,et al.  Learning as a phenomenon occurring in a critical state , 2010, Proceedings of the National Academy of Sciences.

[44]  J. Sethna,et al.  Crackling noise , 2001, Nature.

[45]  Michel Cabane,et al.  Aerosols in Titan's atmosphere : models, sampling techniques and chemical analysis , 1991 .

[46]  E. Klann,et al.  Sources and targets of reactive oxygen species in synaptic plasticity and memory. , 2006, Antioxidants & redox signaling.

[47]  P. Bak,et al.  A forest-fire model and some thoughts on turbulence , 1990 .

[48]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[49]  Tobi Delbruck,et al.  Real-time classification and sensor fusion with a spiking deep belief network , 2013, Front. Neurosci..

[50]  S. Bornholdt,et al.  Avalanches in Self-Organized Critical Neural Networks: A Minimal Model for the Neural SOC Universality Class , 2012, PloS one.

[51]  J. M. Herrmann,et al.  Finite-size effects of avalanche dynamics. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  John M. Beggs,et al.  Universal critical dynamics in high resolution neuronal avalanche data. , 2012, Physical review letters.

[53]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[54]  M. Dalva,et al.  Cell adhesion molecules: signalling functions at the synapse , 2007, Nature Reviews Neuroscience.

[55]  Beom Jun Kim,et al.  Growing scale-free networks with tunable clustering. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  Pablo Balenzuela,et al.  Criticality in Large-Scale Brain fMRI Dynamics Unveiled by a Novel Point Process Analysis , 2012, Front. Physio..

[57]  J. Sethna,et al.  Crackling noise : Complex systems , 2001 .

[58]  Carla Perrone-Capano,et al.  Activity-dependent neural network model on scale-free networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  B. Gutenberg,et al.  Magnitude and Energy of Earthquakes , 1936, Nature.

[60]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[61]  M. A. Muñoz,et al.  Self-organization without conservation: are neuronal avalanches generically critical? , 2010, 1001.3256.

[62]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.