Analytical investigation of self-organized criticality in neural networks

Dynamical criticality has been shown to enhance information processing in dynamical systems, and there is evidence for self-organized criticality in neural networks. A plausible mechanism for such self-organization is activity-dependent synaptic plasticity. Here, we model neurons as discrete-state nodes on an adaptive network following stochastic dynamics. At a threshold connectivity, this system undergoes a dynamical phase transition at which persistent activity sets in. In a low-dimensional representation of the macroscopic dynamics, this corresponds to a transcritical bifurcation. We show analytically that adding activity-dependent rewiring rules, inspired by homeostatic plasticity, leads to the emergence of an attractive steady state at criticality and present numerical evidence for the system's evolution to such a state.

[1]  F. Jülicher,et al.  Auditory sensitivity provided by self-tuned critical oscillations of hair cells. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[2]  K. Christensen,et al.  Evolution of Random Networks , 1998 .

[3]  F. C. Santos,et al.  Evolutionary games in self-organizing populations , 2008 .

[4]  Thilo Gross,et al.  Adaptive self-organization in a realistic neural network model. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  D. Plenz,et al.  The organizing principles of neuronal avalanches: cell assemblies in the cortex? , 2007, Trends in Neurosciences.

[6]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[7]  John M Beggs,et al.  The criticality hypothesis: how local cortical networks might optimize information processing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[8]  J. M. Herrmann,et al.  Phase transitions towards criticality in a neural system with adaptive interactions. , 2009, Physical review letters.

[9]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[10]  Alessandro Vespignani,et al.  How self-organized criticality works: A unified mean-field picture , 1997, cond-mat/9709192.

[11]  Thilo Gross,et al.  Adaptive coevolutionary networks: a review , 2007, Journal of The Royal Society Interface.

[12]  C. Meisel,et al.  Self-organized criticality in adaptive neural networks , 2009 .

[13]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[14]  Thilo Gross,et al.  Epidemic dynamics on an adaptive network. , 2005, Physical review letters.

[15]  Avi Ma'ayan,et al.  Microdynamics and criticality of adaptive regulatory networks. , 2009, Physical review letters.

[16]  Gerd Zschaler,et al.  Early fragmentation in the adaptive voter model on directed networks. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  D. F. Hays,et al.  Table of Integrals, Series, and Products , 1966 .

[18]  J. A. Kuznecov.  Elements of applied bifurcation theory , 1998 .

[19]  S. Bornholdt,et al.  Self-organized critical neural networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Chris T Bauch,et al.  The spread of infectious diseases in spatially structured populations: an invasory pair approximation. , 2005, Mathematical biosciences.

[21]  M. Newman,et al.  Random graphs with arbitrary degree distributions and their applications. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[23]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[24]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[25]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[26]  L. Chua.  Memristor-The missing circuit element , 1971 .

[27]  M. A. Muñoz,et al.  Paths to self-organized criticality , 1999, cond-mat/9910454.

[28]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[29]  M. A. Muñoz,et al.  Self-organization without conservation: true or just apparent scale-invariance? , 2009, 0905.1799.

[30]  Thomas F. Fairgrieve,et al.  AUTO 2000 : CONTINUATION AND BIFURCATION SOFTWARE FOR ORDINARY DIFFERENTIAL EQUATIONS (with HomCont) , 1997 .

[31]  O C Martin,et al.  Adaptive networks of trading agents. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  E. Novikov,et al.  Scale-similar activity in the brain , 1997 .

[33]  S. Bornholdt,et al.  Evolutionary games and the emergence of complex networks , 2002, cond-mat/0211666.

[34]  Edward T. Bullmore,et al.  Broadband Criticality of Human Brain Network Synchronization , 2009, PLoS Comput. Biol..

[35]  Niraj S. Desai,et al.  Plasticity in the intrinsic excitability of cortical pyramidal neurons , 1999, Nature Neuroscience.

[36]  P. Kaye.  Infectious diseases of humans: Dynamics and control , 1993 .

[37]  Thilo Gross,et al.  Adaptive Networks: Theory, Models and Applications , 2009 .

[38]  W. Freeman,et al.  Spatial spectral analysis of human electrocorticograms including the alpha and gamma bands , 2000, Journal of Neuroscience Methods.

[39]  S. Bornholdt,et al.  Topological evolution of dynamical networks: global criticality from local dynamics. , 2000, Physical review letters.

[40]  Judit K. Makara,et al.  Compartmentalized dendritic plasticity and input feature storage in neurons , 2008, Nature.

[41]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[42]  Edward T. Bullmore,et al.  Failure of Adaptive Self-Organized Criticality during Epileptic Seizure Attacks , 2011, PLoS Comput. Biol..

[43]  M. A. Muñoz,et al.  Self-organization without conservation: are neuronal avalanches generically critical? , 2010, 1001.3256.

[44]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.