25 years of criticality in neuroscience — established results, open controversies, novel concepts

Twenty-five years ago, Dunkelmann and Radons (1994) showed that neural networks can self-organize to a critical state. In models, the critical state offers a number of computational advantages. Thus this hypothesis, and in particular the experimental work by Beggs and Plenz (2003), has triggered an avalanche of research, with thousands of studies referring to it. Nonetheless, experimental results are still contradictory. How is it possible, that a hypothesis has attracted active research for decades, but nonetheless remains controversial? We discuss the experimental and conceptual controversy, and then present a parsimonious solution that (i) unifies the contradictory experimental results, (ii) avoids disadvantages of a critical state, and (iii) enables rapid, adaptive tuning of network properties to task requirements.

[1]  田中 琢真 Recurrent infomax generates cell assemblies, neuronal avalanches, and simple cell-like selectivity , 2009 .

[2]  Roberto Serra,et al.  Dynamical Criticality: Overview and Open Questions , 2015, Journal of Systems Science and Complexity.

[3]  James G. King,et al.  Reconstruction and Simulation of Neocortical Microcircuitry , 2015, Cell.

[4]  Gustavo Deco,et al.  Spontaneous cortical activity is transiently poised close to criticality , 2017, PLoS Comput. Biol..

[5]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[6]  Michael Breakspear,et al.  Cortical burst dynamics predict clinical outcome early in extremely preterm infants. , 2015, Brain : a journal of neurology.

[7]  Johannes Zierenberg,et al.  Operating in a Reverberating Regime Enables Rapid Tuning of Network States to Task Requirements , 2018, Front. Syst. Neurosci..

[8]  Michael J. Berry,et al.  The simplest maximum entropy model for collective behavior in a neural network , 2012, 1207.6319.

[9]  Henrik Jeldtoft Jensen,et al.  Self-Organized Criticality: Emergent Complex Behavior in Physical and Biological Systems , 1998 .

[10]  Oren Shriki,et al.  Near-Critical Dynamics in Stimulus-Evoked Activity of the Human Brain and Its Relation to Spontaneous Resting-State Activity , 2015, The Journal of Neuroscience.

[11]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[12]  J Wilting,et al.  Between Perfectly Critical and Fully Irregular: A Reverberating Model Captures and Predicts Cortical Spike Propagation , 2018, Cerebral cortex.

[13]  Amiram Grinvald,et al.  Critical dynamics, anesthesia and information integration: Lessons from multi-scale criticality analysis of voltage imaging data , 2018, NeuroImage.

[14]  C. Bédard,et al.  Does the 1/f frequency scaling of brain signals reflect self-organized critical states? , 2006, Physical review letters.

[15]  V. Priesemann,et al.  Subsampling scaling , 2017, Nature Communications.

[16]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[17]  K. Linkenkaer-Hansen,et al.  Neuronal long-range temporal correlations and avalanche dynamics are correlated with behavioral scaling laws , 2013, Proceedings of the National Academy of Sciences.

[18]  G. Sumbre,et al.  Whole-Brain Neuronal Activity Displays Crackling Noise Dynamics , 2018, Neuron.

[19]  Zach D. Haga,et al.  Avalanche Analysis from Multielectrode Ensemble Recordings in Cat, Monkey, and Human Cerebral Cortex during Wakefulness and Sleep , 2012, Front. Physio..

[20]  J. Touboul,et al.  Can Power-Law Scaling and Neuronal Avalanches Arise from Stochastic Dynamics? , 2009, PloS one.

[21]  D. Heeger,et al.  Slow Cortical Dynamics and the Accumulation of Information over Long Timescales , 2012, Neuron.

[22]  Joseph Lee,et al.  Relationship of critical dynamics, functional connectivity, and states of consciousness in large-scale human brain networks , 2019, NeuroImage.

[23]  M. Nicolelis,et al.  Spike Avalanches Exhibit Universal Dynamics across the Sleep-Wake Cycle , 2010, PloS one.

[24]  Andreas Klaus,et al.  The Interplay between Long- and Short-Range Temporal Correlations Shapes Cortex Dynamics across Vigilance States , 2017, The Journal of Neuroscience.

[25]  Minoru Asada,et al.  Information processing in echo state networks at the edge of chaos , 2011, Theory in Biosciences.

[26]  M Girardi-Schappo,et al.  Critical avalanches and subsampling in map-based neural networks coupled with noisy synapses. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[28]  Jochen Triesch,et al.  Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network , 2017, PloS one.

[29]  Matthias Bethge,et al.  Signatures of criticality arise from random subsampling in simple population models , 2016, PLoS Comput. Biol..

[30]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[31]  W. Singer,et al.  Neuronal avalanches in spontaneous activity in vivo. , 2010, Journal of neurophysiology.

[32]  Johannes Zierenberg,et al.  Homeostatic plasticity and external input shape neural network dynamics , 2018, bioRxiv.

[33]  Shan Yu,et al.  Maintained avalanche dynamics during task-induced changes of neuronal activity in nonhuman primates , 2017, eLife.

[34]  John M. Beggs,et al.  Universal critical dynamics in high resolution neuronal avalanche data. , 2012, Physical review letters.

[35]  Florentin Wörgötter,et al.  Self-Organized Criticality in Developing Neuronal Networks , 2010, PLoS Comput. Biol..

[36]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[37]  Fred Wolf,et al.  Flexible information routing by transient synchrony , 2017, Nature Neuroscience.

[38]  M. Copelli,et al.  Undersampled Critical Branching Processes on Small-World and Random Networks Fail to Reproduce the Statistics of Spike Avalanches , 2014, PloS one.

[39]  Woodrow L. Shew,et al.  The Functional Benefits of Criticality in the Cortex , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[40]  Nergis Tomen,et al.  Marginally subcritical dynamics explain enhanced stimulus discriminability under attention , 2014, Front. Syst. Neurosci..

[41]  Nicolas Brunel,et al.  Dynamics of networks of randomly connected excitatory and inhibitory spiking neurons , 2000, Journal of Physiology-Paris.

[42]  L. L. Bologna,et al.  Self-organization and neuronal avalanches in networks of dissociated cortical neurons , 2008, Neuroscience.

[43]  Matthew J. Brookes,et al.  Resting state MEG oscillations show long-range temporal correlations of phase synchrony that break down during finger movement , 2015, Front. Physiol..

[44]  Woodrow L. Shew,et al.  Cascades and Cognitive State: Focused Attention Incurs Subcritical Dynamics , 2015, The Journal of Neuroscience.

[45]  W. Bialek,et al.  Are Biological Systems Poised at Criticality? , 2010, 1012.2242.

[46]  Tang,et al.  Self-Organized Criticality: An Explanation of 1/f Noise , 2011 .

[47]  Woodrow L. Shew,et al.  Adaptation towards scale-free dynamics improves cortical stimulus discrimination at the cost of reduced detection , 2017, PLoS Comput. Biol..

[48]  Jens Wilting,et al.  Inferring collective dynamical states from widely unobserved systems , 2016, Nature Communications.

[49]  Woodrow L. Shew,et al.  Voltage Imaging of Waking Mouse Cortex Reveals Emergence of Critical Neuronal Dynamics , 2014, The Journal of Neuroscience.

[50]  Oren Shriki,et al.  Optimal Information Representation and Criticality in an Adaptive Sensory Recurrent Neuronal Network , 2016, PLoS Comput. Biol..

[51]  G. Pruessner Self-Organised Criticality: Theory, Models and Characterisation , 2012 .

[52]  Jochen Triesch,et al.  Spike avalanches in vivo suggest a driven, slightly subcritical brain state , 2014, Front. Syst. Neurosci..

[53]  Richard Coppola,et al.  Neuronal avalanches in the resting MEG of the human brain , 2012 .

[54]  Viola Priesemann,et al.  Neuronal Avalanches Differ from Wakefulness to Deep Sleep – Evidence from Intracranial Depth Recordings in Humans , 2013, PLoS Comput. Biol..

[55]  M. A. Muñoz,et al.  Landau–Ginzburg theory of cortex dynamics: Scale-free avalanches emerge at the edge of synchronization , 2018, Proceedings of the National Academy of Sciences.

[56]  V. Torre,et al.  On the Dynamics of the Spontaneous Activity in Neuronal Networks , 2007, PloS one.

[57]  Leonardo L. Gollo Coexistence of critical sensitivity and subcritical specificity can yield optimal population coding , 2017, Journal of The Royal Society Interface.

[58]  Robert Leech,et al.  The characteristic patterns of neuronal avalanches in mice under anesthesia and at rest: An investigation using constrained artificial neural networks , 2018, PloS one.

[59]  Heiko Hoffmann,et al.  Optimization by Self-Organized Criticality , 2018, Scientific Reports.

[60]  Steven Laureys,et al.  Large-scale signatures of unconsciousness are consistent with a departure from critical dynamics , 2015, Journal of The Royal Society Interface.

[61]  Kenneth D Harris,et al.  Challenges and opportunities for large-scale electrophysiology with Neuropixels probes , 2018, Current Opinion in Neurobiology.

[62]  M. A. Muñoz Colloquium: Criticality and dynamical scaling in living systems , 2017, Reviews of Modern Physics.

[63]  C. Honey,et al.  Processing Timescales as an Organizing Principle for Primate Cortex , 2015, Neuron.

[64]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[65]  Pablo Balenzuela,et al.  Criticality in Large-Scale Brain fMRI Dynamics Unveiled by a Novel Point Process Analysis , 2012, Front. Physio..

[66]  E. N. Miranda,et al.  Self-organized criticality with disorder and frustration , 1991 .

[67]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[68]  Viola Priesemann,et al.  Can a time varying external drive give rise to apparent criticality in neural systems? , 2018, PLoS Comput. Biol..

[69]  J. M. Herrmann,et al.  Phase transitions towards criticality in a neural system with adaptive interactions. , 2009, Physical review letters.

[70]  T. E. Harris,et al.  The Theory of Branching Processes. , 1963 .

[71]  David J. Sharp,et al.  Cortical Entropy, Mutual Information and Scale-Free Dynamics in Waking Mice , 2016, Cerebral cortex.

[72]  Moritz Helias,et al.  Distributions of covariances as a window into the operational regime of neuronal networks , 2016 .

[73]  M. A. Muñoz,et al.  Neutral Theory and Scale-Free Neural Dynamics , 2017, 1703.05079.

[74]  José Carlos Príncipe,et al.  Special issue on echo state networks and liquid state machines , 2007, Neural Networks.

[75]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[76]  John M Beggs,et al.  The criticality hypothesis: how local cortical networks might optimize information processing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[77]  K. Linkenkaer-Hansen,et al.  Long-Range Temporal Correlations and Scaling Behavior in Human Brain Oscillations , 2001, The Journal of Neuroscience.

[78]  Andreas Klaus,et al.  Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state , 2015, eLife.

[79]  D. Plenz,et al.  Spontaneous cortical activity in awake monkeys composed of neuronal avalanches , 2009, Proceedings of the National Academy of Sciences.

[80]  Kimberlyn A Bailey,et al.  Decline of long-range temporal correlations in the human brain during sustained wakefulness , 2017, Scientific Reports.

[81]  Woodrow L. Shew,et al.  State-dependent intrinsic predictability of cortical network dynamics , 2015, PLoS Comput. Biol..

[82]  Gašper Tkačik,et al.  Maximum entropy models as a tool for building precise neural controls , 2017, Current Opinion in Neurobiology.

[83]  Michael J. Berry,et al.  Thermodynamics and signatures of criticality in a network of neurons , 2015, Proceedings of the National Academy of Sciences.

[84]  John M. Beggs,et al.  Quasicritical brain dynamics on a nonequilibrium Widom line. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[85]  Viola Priesemann,et al.  Subsampling effects in neuronal avalanche distributions recorded in vivo , 2009, BMC Neuroscience.

[86]  K. Linkenkaer-Hansen,et al.  Critical-State Dynamics of Avalanches and Oscillations Jointly Emerge from Balanced Excitation/Inhibition in Neuronal Networks , 2012, The Journal of Neuroscience.

[87]  Gasper Tkacik,et al.  Probabilistic models for neural populations that naturally capture global coupling and criticality , 2017, PLoS Comput. Biol..

[88]  Nicholas A. Steinmetz,et al.  High-dimensional geometry of population responses in visual cortex , 2018, Nature.

[89]  S. Carpenter,et al.  Anticipating Critical Transitions , 2012, Science.

[90]  Raoul-Martin Memmesheimer,et al.  Growing Critical: Self-Organized Criticality in a Developing Neural System. , 2018, Physical review letters.

[91]  L Berthouze,et al.  Power-law distribution of phase-locking intervals does not imply critical interaction. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[92]  Peter E. Latham,et al.  Computing and Stability in Cortical Networks , 2004, Neural Computation.

[93]  T. Bossomaier,et al.  Information flow in a kinetic Ising model peaks in the disordered phase. , 2013, Physical review letters.