The Functional Benefits of Criticality in the Cortex

Rapidly growing empirical evidence supports the hypothesis that the cortex operates near criticality. Although the confirmation of this hypothesis would mark a significant advance in fundamental understanding of cortical physiology, a natural question arises: What functional benefits are endowed to cortical circuits that operate at criticality? In this review, we first describe an introductory-level thought experiment to provide the reader with an intuitive understanding of criticality. Second, we discuss some practical approaches for investigating criticality. Finally, we review quantitative evidence that three functional properties of the cortex are optimized at criticality: 1) dynamic range, 2) information transmission, and 3) information capacity. We focus on recently reported experimental evidence and briefly discuss the theory and history of these ideas.

[1]  Original Papers by the late John Hopkinson, DSc, FRS Vol i, Technical Papers , 1904, Nature.

[2]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[3]  B. Cragg,et al.  The organisation of neurones: a co-operative analogy. , 1954, Electroencephalography and clinical neurophysiology.

[4]  B. Cragg,et al.  Memory: the analogy with ferromagnetic hysteresis. , 1955, Brain : a journal of neurology.

[5]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[6]  Stephen Wolfram,et al.  Universality and complexity in cellular automata , 1983 .

[7]  K. E. Kürten Critical phenomena in model neural networks , 1988 .

[8]  Young,et al.  Inferring statistical complexity. , 1989, Physical review letters.

[9]  Bernardo A. Huberman,et al.  The performance of cooperative processes , 1990 .

[10]  Stuart A. Kauffman,et al.  Requirements for evolvability in complex systems: orderly dynamics and frozen components , 1990 .

[11]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[12]  James P. Crutchfield,et al.  Computation at the Onset of Chaos , 1991 .

[13]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[14]  Wentian Li,et al.  Transition phenomena in cellular automata rule space , 1991 .

[15]  A. Fisher,et al.  The Theory of critical phenomena , 1992 .

[16]  Robert W. Kentridge Dissipative Structures and Self-Organizing Criticality in Neural Networks with Spatially Localized Connectivity , 1993 .

[17]  Marius Usher,et al.  Network Amplification of Local Fluctuations Causes High Spike Rate Variability, Fractal Firing Patterns and Oscillatory Local Field Potentials , 1994, Neural Computation.

[18]  E. Marder,et al.  Activity-dependent changes in the intrinsic properties of cultured neurons. , 1994, Science.

[19]  Andreas V. M. Herz,et al.  Earthquake cycles and neural reverberations , 1995 .

[20]  Dan-Mei Chen,et al.  Self-organized criticality in a cellular automaton model of pulse-coupled integrate-and-fire neurons , 1995 .

[21]  J. Hopfield,et al.  Earthquake cycles and neural reverberations: Collective oscillations in systems with pulse-coupled threshold elements. , 1995, Physical review letters.

[22]  Stassinopoulos,et al.  Democratic reinforcement: A principle for brain function. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[24]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[25]  Dirk V. Arnold,et al.  Information-theoretic Analysis of Phase Transitions , 1996, Complex Syst..

[26]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[27]  Daniel Lehmann,et al.  Regulated Criticality in the Brain? , 1998, Adv. Complex Syst..

[28]  A Vespignani,et al.  Avalanche and spreading exponents in systems with absorbing states. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[29]  P. Bak,et al.  Learning from mistakes , 1997, Neuroscience.

[30]  E Greenfield,et al.  Mutual information in a dilute, asymmetric neural network model. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Oren Shriki,et al.  Dynamic and Computational Models of Recurrent Networks in the Brain , 2003 .

[32]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[33]  M. Merzenich,et al.  Model of autism: increased ratio of excitation/inhibition in key neural systems , 2003, Genes, brain, and behavior.

[34]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[35]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[36]  D A Steyn-Ross,et al.  Cortical entropy changes with general anaesthesia: theory and experiment. , 2004, Physiological measurement.

[37]  John R. Huguenard,et al.  Long-lasting self-inhibition of neocortical interneurons mediated by endocannabinoids , 2004, Nature.

[38]  John M. Beggs,et al.  Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004, The Journal of Neuroscience.

[39]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[40]  G. Williams,et al.  Under the curve: Critical issues for elucidating D1 receptor function in working memory , 2006, Neuroscience.

[41]  M. Calcagnotto,et al.  Cortical Inhibition Modified by Embryonic Neural Precursors Grafted into the Postnatal Brain , 2006, The Journal of Neuroscience.

[42]  Haye Hinrichsen,et al.  Non-Equilibrium Phase Transitions , 2010 .

[43]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[44]  D. Plenz,et al.  Inverted-U Profile of Dopamine–NMDA-Mediated Spontaneous Avalanche Recurrence in Superficial Layers of Rat Prefrontal Cortex , 2006, The Journal of Neuroscience.

[45]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[46]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[47]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[48]  D. McCormick,et al.  Enhancement of visual responsiveness by spontaneous local network activity in vivo. , 2007, Journal of neurophysiology.

[49]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[50]  Henry Markram,et al.  The Intense World Syndrome – an Alternative Hypothesis for Autism , 2007, Front. Neurosci..

[51]  John M Beggs,et al.  The criticality hypothesis: how local cortical networks might optimize information processing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[52]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[53]  S. Kauffman,et al.  Measures for information propagation in Boolean networks , 2007 .

[54]  Gina G. Turrigiano,et al.  Multiple Modes of Network Homeostasis in Visual Cortical Layer 2/3 , 2008, The Journal of Neuroscience.

[55]  D. Plenz,et al.  Homeostasis of neuronal avalanches during postnatal cortex development in vitro , 2008, Journal of Neuroscience Methods.

[56]  K. Linkenkaer-Hansen,et al.  Avalanche dynamics of human brain oscillations: Relation to critical branching processes and temporal correlations , 2008, Human brain mapping.

[57]  L. L. Bologna,et al.  Self-organization and neuronal avalanches in networks of dissociated cortical neurons , 2008, Neuroscience.

[58]  M. Zhuo,et al.  Synaptic Imbalance, Stereotypies, and Impaired Social Interactions in Mice with Altered Neuroligin 2 Expression , 2008, The Journal of Neuroscience.

[59]  Matthew K Belmonte,et al.  Brain hyper-reactivity to auditory novel targets in children with high-functioning autism. , 2008, Brain : a journal of neurology.

[60]  G. Baranek,et al.  Perceptual metrics of individuals with autism provide evidence for disinhibition , 2008, Autism research : official journal of the International Society for Autism Research.

[61]  G. Tononi,et al.  Consciousness and Anesthesia , 2008, Science.

[62]  P. Thuras,et al.  Expression of GABAB Receptors Is Altered in Brains of Subjects with Autism , 2009, The Cerebellum.

[63]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[64]  D. Plenz,et al.  Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3 , 2008, Proceedings of the National Academy of Sciences.

[65]  H. Adesnik,et al.  Input normalization by global feedforward inhibition expands cortical dynamic range , 2009, Nature Neuroscience.

[66]  Wei Chen,et al.  A few strong connections: optimizing information retention in neuronal avalanches , 2010, BMC Neuroscience.

[67]  Y. Frégnac,et al.  Involvement of nicotinic and muscarinic receptors in the endogenous cholinergic modulation of the balance between excitation and inhibition in the young rat visual cortex. , 2009, Cerebral cortex.

[68]  Takeshi Kaneko,et al.  Recurrent Infomax Generates Cell Assemblies, Neuronal Avalanches, and Simple Cell-Like Selectivity , 2009, Neural Computation.

[69]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[70]  Amiram Grinvald,et al.  Arousal increases the representational capacity of cortical tissue , 2009, Journal of Computational Neuroscience.

[71]  Thilo Gross,et al.  Adaptive self-organization in a realistic neural network model. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[72]  S. Spence,et al.  The Role of Epilepsy and Epileptiform EEGs in Autism Spectrum Disorders , 2009, Pediatric Research.

[73]  D. Plenz,et al.  Spontaneous cortical activity in awake monkeys composed of neuronal avalanches , 2009, Proceedings of the National Academy of Sciences.

[74]  T. Südhof,et al.  Common circuit defect of excitatory-inhibitory balance in mouse models of autism , 2009, Journal of Neurodevelopmental Disorders.

[75]  J. Cowan,et al.  Statistical mechanics of the neocortex. , 2009, Progress in biophysics and molecular biology.

[76]  Edward T. Bullmore,et al.  Broadband Criticality of Human Brain Network Synchronization , 2009, PLoS Comput. Biol..

[77]  G. Blatt,et al.  Decreased GABAA receptors and benzodiazepine binding sites in the anterior cingulate cortex in autism , 2009, Autism research : official journal of the International Society for Autism Research.

[78]  D. Chialvo,et al.  Ising-like dynamics in large-scale functional brain networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[79]  Stefan Mihalas,et al.  Self-organized criticality occurs in non-conservative neuronal networks during Up states , 2010, Nature physics.

[80]  Rhonda Dzakpasu,et al.  Observed network dynamics from altering the balance between excitatory and inhibitory neurons in cultured networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[81]  P. Fossier,et al.  Serotoninergic fine-tuning of the excitation-inhibition balance in rat visual cortical networks. , 2010, Cerebral cortex.

[82]  Florentin Wörgötter,et al.  Self-Organized Criticality in Developing Neuronal Networks , 2010, PLoS Comput. Biol..

[83]  Marcus Kaiser,et al.  Optimal Hierarchical Modular Topologies for Producing Limited Sustained Activation of Neural Networks , 2009, Front. Neuroinform..

[84]  M. Nicolelis,et al.  Spike Avalanches Exhibit Universal Dynamics across the Sleep-Wake Cycle , 2010, PloS one.

[85]  Marcus Kaiser,et al.  Hierarchy and Dynamics of Neural Networks , 2010, Front. Neuroinform..

[86]  Christopher T. Kello,et al.  Scaling laws in cognitive sciences , 2010, Trends in Cognitive Sciences.

[87]  Jill L Silverman,et al.  Repetitive Self-Grooming Behavior in the BTBR Mouse Model of Autism is Blocked by the mGluR5 Antagonist MPEP , 2010, Neuropsychopharmacology.

[88]  M. A. Sutton,et al.  Distinct FGFs promote differentiation of excitatory and inhibitory synapses , 2010, Nature.

[89]  W. Singer,et al.  Neuronal avalanches in spontaneous activity in vivo. , 2010, Journal of neurophysiology.

[90]  G. Blatt,et al.  Decreased GABAB receptors in the cingulate cortex and fusiform gyrus in Autism , 2010, Journal of neurochemistry.

[91]  Rodney C. Samaco,et al.  GABAergic dysfunction mediates autism-like stereotypies and Rett syndrome phenotypes , 2010, Nature.

[92]  Thomas Nowotny,et al.  Multiscale model of an inhibitory network shows optimal properties near bifurcation. , 2011, Physical review letters.

[93]  Lief E. Fenno,et al.  Neocortical excitation/inhibition balance in information processing and social dysfunction , 2011, Nature.

[94]  Woodrow L. Shew,et al.  Predicting criticality and dynamic range in complex networks: effects of topology. , 2010, Physical review letters.

[95]  Olaf Sporns,et al.  Neurobiologically Realistic Determinants of Self-Organized Criticality in Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[96]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[97]  E. Ott,et al.  Effects of network topology, transmission delays, and refractoriness on the response of coupled excitable systems to a stochastic stimulus. , 2011, Chaos.

[98]  Zhi Zhang,et al.  Developmental maturation of excitation and inhibition balance in principal neurons across four layers of somatosensory cortex , 2011, Neuroscience.

[99]  Changsong Zhou,et al.  Hierarchical modular structure enhances the robustness of self-organized criticality in neural networks , 2012 .

[100]  Woodrow L. Shew,et al.  Maximal Variability of Phase Synchrony in Cortical Networks with Neuronal Avalanches , 2012, The Journal of Neuroscience.

[101]  Sharon C. Lyter,et al.  Diagnostic and Statistical Manual of Mental Disorders: Making it Work for Social Work , 2012 .