Growing Critical: Self-Organized Criticality in a Developing Neural System.

Experiments in various neural systems found avalanches: bursts of activity with characteristics typical for critical dynamics. A possible explanation for their occurrence is an underlying network that self-organizes into a critical state. We propose a simple spiking model for developing neural networks, showing how these may "grow into" criticality. Avalanches generated by our model correspond to clusters of widely applied Hawkes processes. We analytically derive the cluster size and duration distributions and find that they agree with those of experimentally observed neuronal avalanches.

[1]  P Arhem,et al.  Single-channel currents trigger action potentials in small cultured hippocampal neurons. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[2]  A. Dassios,et al.  A dynamic contagion process , 2011, Advances in Applied Probability.

[3]  Thilo Gross,et al.  Adaptive self-organization in a realistic neural network model. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  S. B. Kater,et al.  Calcium regulation of the neuronal growth cone , 1988, Trends in Neurosciences.

[5]  Erik A. Lewis,et al.  Self-exciting point process models of civilian deaths in Iraq , 2011, Security Journal.

[6]  Charles J. Mode,et al.  A general age-dependent branching process. II , 1968 .

[7]  A. V. Ooyen,et al.  Activity-dependent outgrowth of neurons and overshoot phenomena in developing neural networks , 1994 .

[8]  K. Abbink,et al.  24 , 1871, You Can Cross the Massacre on Foot.

[9]  J. M. Herrmann,et al.  Phase transitions towards criticality in a neural system with adaptive interactions. , 2009, Physical review letters.

[10]  S. Bornholdt,et al.  Self-organized critical neural networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  A. V. Ooyen.  Using theoretical models to analyse neural development , 2011, Nature Reviews Neuroscience.

[12]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[13]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[14]  David Oakes,et al.  The Markovian self-exciting process , 1975, Journal of Applied Probability.

[15]  S. V. Aksenov,et al.  Implementation of the Combined--Nonlinear Condensation Transformation , 2002, math/0207086.

[16]  A. van Ooyen,et al.  Independently Outgrowing Neurons and Geometry-Based Synapse Formation Produce Networks with Realistic Synaptic Connectivity , 2014, PloS one.

[17]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[18]  P. Bak,et al.  Self-organized criticality. , 1988, Physical review. A, General physics.

[19]  W. Marsden.  I and J , 2012 .

[20]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[21]  P G Nelson,et al.  Effects of patterned electrical activity on neurite outgrowth from mouse sensory neurons , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  Ting Wang,et al.  Markov-modulated Hawkes process with stepwise decay , 2012 .

[23]  A. Levine,et al.  New estimates of the storage permanence and ocean co-benefits of enhanced rock weathering , 2023, PNAS nexus.

[24]  Jérémie Barral,et al.  Synaptic scaling rule preserves excitatory–inhibitory balance and salient neuronal network dynamics , 2016, Nature Neuroscience.

[25]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.

[26]  Peter J. Mohr,et al.  Application of the Combined Nonlinear-Condensation Transformation to Problems in Statistical Analysis and Theoretical Physics , 2003 .

[27]  Stanley,et al.  Self-organized branching processes: Mean-field theory for avalanches. , 1995, Physical review letters.

[28]  Johannes Zierenberg,et al.  Homeostatic plasticity and external input shape neural network dynamics , 2018, bioRxiv.

[29]  Seunghoon Lee,et al.  A transient network of intrinsically bursting starburst cells underlies the generation of retinal waves , 2006, Nature Neuroscience.

[30]  J. Michael Herrmann,et al.  Criticality of avalanche dynamics in adaptive recurrent networks , 2006, Neurocomputing.

[31]  M. A. Muñoz,et al.  Self-organization without conservation: are neuronal avalanches generically critical? , 2010, 1001.3256.

[32]  Florentin Wörgötter,et al.  Self-Organized Criticality in Developing Neuronal Networks , 2010, PLoS Comput. Biol..

[33]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[34]  G. Turrigiano.  Homeostatic synaptic plasticity: local and global mechanisms for stabilizing neuronal function. , 2012, Cold Spring Harbor perspectives in biology.

[35]  W. Singer,et al.  Neuronal avalanches in spontaneous activity in vivo. , 2010, Journal of neurophysiology.

[36]  Lingjiong Zhu,et al.  Limit theorems for Markovian Hawkes processes with a large initial intensity , 2015, Stochastic Processes and their Applications.

[37]  M. A. Muñoz,et al.  Simple unified view of branching process statistics: Random walks in balanced logarithmic potentials. , 2016, Physical review. E.

[38]  A. Hawkes.  Spectra of some self-exciting and mutually exciting point processes , 1971 .

[39]  F. Huizen,et al.  Tetrodotoxin enhances initial neurite outgrowth from fetal rat cerebral cortex cells in vitro , 1987, Brain Research.

[40]  B. M. Fulk.  MATH , 1992 .

[41]  L. Abbott,et al.  A simple growth model constructs critical avalanche networks. , 2007, Progress in brain research.

[42]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[43]  Woodrow L. Shew,et al.  The Functional Benefits of Criticality in the Cortex , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[44]  R. Kanzaki,et al.  Development of neural population activity toward self-organized criticality , 2017, Neuroscience.

[45]  M. A. Muñoz,et al.  Self-organization without conservation: true or just apparent scale-invariance? , 2009, 0905.1799.

[46]  J. Tanner,et al.  A derivation of the Borel distribution , 1961 .

[47]  S. B. Kater,et al.  Suppression of neurite elongation and growth cone motility by electrical activity. , 1986, Science.

[48]  D. Owen.  Handbook of Mathematical Functions with Formulas , 1965 .

[49]  V. Torre,et al.  On the Dynamics of the Spontaneous Activity in Neuronal Networks , 2007, PloS one.

[50]  Matthias H Hennig,et al.  Early-Stage Waves in the Retinal Network Emerge Close to a Critical State Transition between Local and Global Functional Connectivity , 2009, The Journal of Neuroscience.

[51]  J. M. Herrmann,et al.  Finite-size effects of avalanche dynamics. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[53]  Matthieu Gilson,et al.  Spike-timing-dependent plasticity for neurons with recurrent connections , 2007, Biological Cybernetics.

[54]  D. Sornette.  Sweeping of an instability : an alternative to self-organized criticality to get powerlaws without parameter tuning , 1994 .

[55]  D. Marković,et al.  Power laws and Self-Organized Criticality in Theory and Nature , 2013, 1310.5527.

[56]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[57]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[58]  Ericka Stricklin-Parker,et al.  Ann , 2005 .

[59]  Henrik Jeldtoft Jensen,et al.  Self-Organized Criticality , 1998 .

[60]  Tang,et al.  Self-Organized Criticality: An Explanation of 1/f Noise , 2011 .

[61]  Marla B. Feller,et al.  Cellular Mechanisms Underlying Spatiotemporal Features of Cholinergic Retinal Waves , 2012, The Journal of Neuroscience.

[62]  Jochen Triesch,et al.  Spike avalanches in vivo suggest a driven, slightly subcritical brain state , 2014, Front. Syst. Neurosci..

[63]  A. Hawkes,et al.  A cluster process representation of a self-exciting process , 1974, Journal of Applied Probability.

[64]  D. Plenz,et al.  Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3 , 2008, Proceedings of the National Academy of Sciences.

[65]  S. Bornholdt,et al.  Topological evolution of dynamical networks: global criticality from local dynamics. , 2000, Physical review letters.

[66]  Arvind Kumar,et al.  The High-Conductance State of Cortical Networks , 2008, Neural Computation.

[67]  Kay Giesecke,et al.  Affine Point Processes and Portfolio Credit Risk , 2010, SIAM J. Financial Math..

[68]  Jochen Triesch,et al.  Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network , 2017, PloS one.

[69]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[70]  Viola Priesemann,et al.  Subsampling effects in neuronal avalanche distributions recorded in vivo , 2009, BMC Neuroscience.

[71]  S. Kater,et al.  Regulation of growth cone behavior by calcium , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  V. Priesemann,et al.  Subsampling scaling , 2017, Nature Communications.

[73]  D. Drew.  Mark , 2005, Neonatal Network.

[74]  Thilo Gross,et al.  Analytical investigation of self-organized criticality in neural networks , 2012, Journal of The Royal Society Interface.

[75]  E. Bacry,et al.  Hawkes Processes in Finance , 2015, 1502.04592.

[76]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .