The Emergence of Integrated Information, Complexity, and ‘Consciousness’ at Criticality

Using the critical Ising model of the brain, integrated information as a measure of consciousness is measured in toy models of generic neural networks. Monte Carlo simulations are run on 159 random weighted networks analogous to small 5-node neural network motifs. The integrated information generated by this sample of small Ising models is measured across the model parameter space. It is observed that integrated information, as a type of order parameter not unlike a concept like magnetism, undergoes a phase transition at the critical point in the model. This critical point is demarcated by the peaks of the generalized susceptibility of integrated information, a point where the ‘consciousness’ of the system is maximally susceptible to perturbations and on the boundary between an ordered and disordered form. This study adds further evidence to support that the emergence of consciousness coincides with the more universal patterns of self-organized criticality, evolution, the emergence of complexity, and the integration of complex systems. Author summary Understanding consciousness through a scientific and mathematical language is slowly coming into reach and so testing and grounding these emerging ideas onto empirical observations and known systems is a first step to properly framing this ancient problem. This paper in particular explores the Integrated Information Theory of Consciousness framed within the physics of the Ising model to understand how and when consciousness, or integrated information, can arise in simple dynamical systems. The emergence of consciousness is treated like the emergence of other classical macroscopic observables in physics such as magnetism and understood as a dynamical phase of matter. Our findings show that the sensitivity of consciousness in a complex system is maximized when the system is undergoing a phase transition, also known as a critical point. This result, combined with a body of evidence highlighting the privelaged state of critical systems suggests that, like many other complex phenomenon, consciousness may simply follow from/emerge out of the tendency of a system to self-organize to criticality.

[1]  Christof Koch,et al.  The Minimal Complexity of Adapting Agents Increases with Fitness , 2012, ALIFE.

[2]  M. A. Muñoz,et al.  Insect Swarms Go Critical , 2014 .

[3]  B. E. Juel,et al.  Evaluating Approximations and Heuristic Measures of Integrated Information , 2019, Entropy.

[4]  Miguel Aguilera,et al.  Scaling Behaviour and Critical Phase Transitions in Integrated Information Theory , 2019, Entropy.

[5]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[6]  Ginestra Bianconi,et al.  The role of dimensionality in neuronal network dynamics , 2016, Scientific Reports.

[7]  Gustavo Deco,et al.  Connectome-harmonic decomposition of human brain activity reveals dynamical repertoire re-organization under LSD , 2017, bioRxiv.

[8]  D. Stauffer.  Monte Carlo simulations in statistical physics , 1988 .

[9]  R. Mantegna,et al.  Scaling behaviour in the dynamics of an economic index , 1995, Nature.

[10]  Dante R Chialvo,et al.  Brain organization into resting state networks emerges at criticality on a model of the human connectome. , 2012, Physical review letters.

[11]  A. Cavagna,et al.  Finite-size scaling as a way to probe near-criticality in natural swarms. , 2014, Physical review letters.

[12]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[13]  Thilo Gross,et al.  Self-organized criticality as a fundamental property of neural systems , 2014, Front. Syst. Neurosci..

[14]  Nicholas Bennett,et al.  Criticality Maximizes Complexity in Neural Tissue , 2016, Front. Physiol..

[15]  M. A. Muñoz,et al.  Griffiths phases and the stretching of criticality in brain networks , 2013, Nature Communications.

[16]  Larissa Albantakis,et al.  PyPhi: A toolbox for integrated information theory , 2017, PLoS Comput. Biol..

[17]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[18]  D. Chialvo,et al.  Ising-like dynamics in large-scale functional brain networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  R. Spigler,et al.  The Kuramoto model: A simple paradigm for synchronization phenomena , 2005 .

[20]  D. Chialvo.  Emergent complex neural dynamics , 2010, 1010.2530.

[21]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[22]  Eric Smith,et al.  The Origin and Nature of Life on Earth: The Emergence of the Fourth Geosphere , 2016 .

[23]  Peter M. A. Sloot,et al.  Information geometric analysis of phase transitions in complex patterns: the case of the Gray-Scott reaction-diffusion model , 2015, ArXiv.

[24]  Nima Dehghani,et al.  Ensemble inhibition and excitation in the human cortex: An Ising-model analysis with uncertainties. , 2018, Physical review. E.

[25]  W. Bialek,et al.  Are Biological Systems Poised at Criticality? , 2010, 1012.2242.

[26]  Jorge Hidalgo,et al.  Information-based fitness and the emergence of criticality in living systems , 2013, Proceedings of the National Academy of Sciences.

[27]  S. Kauffman,et al.  Critical Dynamics in Genetic Regulatory Networks: Examples from Four Kingdoms , 2008, PloS one.

[28]  Jochen Triesch,et al.  Spike avalanches in vivo suggest a driven, slightly subcritical brain state , 2014, Front. Syst. Neurosci..

[29]  K. Wilson.  The renormalization group: Critical phenomena and the Kondo problem , 1975 .

[30]  Andrea Soddu,et al.  Role of Dimensionality in Predicting the Spontaneous Behavior of the Brain using the Classical Ising Model and the Ising Model Implemented on the Structural Connectome , 2018 .

[31]  Woodrow L. Shew,et al.  The Functional Benefits of Criticality in the Cortex , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[32]  Dante R. Chialvo.  Critical brain networks , 2004 .

[33]  Huzihiro Araki,et al.  International Symposium on Mathematical Problems in Theoretical Physics , 1975 .

[34]  Anthony G. Hudetz,et al.  Criticality as a Determinant of Integrated Information Φ in Human Brain Networks , 2019, bioRxiv.

[35]  N. Goldenfeld,et al.  Life is Physics: Evolution as a Collective Phenomenon Far From Equilibrium , 2010, 1011.4125.

[36]  Hernán A Makse,et al.  Small-world to fractal transition in complex networks: a renormalization group approach. , 2009, Physical review letters.

[37]  James Odell,et al.  Between order and chaos , 2011, Nature Physics.

[38]  Gustavo Deco,et al.  How anatomy shapes dynamics: a semi-analytical study of the brain at rest by a simple spin model , 2012, Front. Comput. Neurosci..

[39]  D. Hansel,et al.  Phase Dynamics for Weakly Coupled Hodgkin-Huxley Neurons , 1993 .

[40]  Jorge Stolfi,et al.  Phase transitions and self-organized criticality in networks of stochastic spiking neurons , 2016, Scientific Reports.

[41]  Robert H. Swendsen,et al.  Monte Carlo Renormalization Group Calculations of Critical Behavior in the Simple Cubic Ising Model , 1984 .

[42]  Arend Hintze,et al.  Integrated Information Increases with Fitness in the Evolution of Animats , 2011, PLoS Comput. Biol..

[43]  P. Bak,et al.  Complexity, contingency, and criticality. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[44]  L. Onsager.  Crystal statistics. I. A two-dimensional model with an order-disorder transition , 1944 .

[45]  D. Chialvo,et al.  Self-similar correlation function in brain resting-state functional magnetic resonance imaging , 2010, Journal of The Royal Society Interface.

[46]  D. Turcotte,et al.  Self-organized criticality , 1999 .

[47]  P. Alstrøm,et al.  COMPLEXITY AND CRITICALITY , 2004 .

[48]  Max Tegmark,et al.  Improved Measures of Integrated Information , 2016, PLoS Comput. Biol..

[49]  Larissa Albantakis,et al.  From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0 , 2014, PLoS Comput. Biol..

[50]  G. Tononi,et al.  Consciousness and Complexity during Unresponsiveness Induced by Propofol, Xenon, and Ketamine , 2015, Current Biology.

[51]  Pablo Balenzuela,et al.  Criticality in Large-Scale Brain fMRI Dynamics Unveiled by a Novel Point Process Analysis , 2012, Front. Physio..

[52]  M. Marchesi,et al.  Scaling and criticality in a stochastic multi-agent model of a financial market , 1999, Nature.

[53]  R. Swendsen.  Monte Carlo Renormalization Group , 2011 .

[54]  H. Morowitz.  The Emergence of Everything: How the World Became Complex , 2002 .

[55]  Daniele Marinazzo,et al.  Information Transfer and Criticality in the Ising Model on the Human Connectome , 2014, PloS one.

[56]  J. Sethna,et al.  Crackling noise , 2001, Nature.

[57]  D. Cumin,et al.  Generalising the Kuramoto Model for the study of Neuronal Synchronisation in the Brain , 2007 .

[58]  M. Newman,et al.  Renormalization Group Analysis of the Small-World Network Model , 1999, cond-mat/9903357.

[59]  Arend Hintze,et al.  Evolution of Integrated Causal Structures in Animats Exposed to Environments of Increasing Complexity , 2014, PLoS Comput. Biol..

[60]  John M Beggs,et al.  The criticality hypothesis: how local cortical networks might optimize information processing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[61]  L. de Arcangelis,et al.  Learning as a phenomenon occurring in a critical state , 2010, Proceedings of the National Academy of Sciences.

[62]  Saurabh R. Gandhi.  Renormalization group on complex networks , 2014 .