Integrated Information and State Differentiation

Integrated information (Φ) is a measure of the cause-effect power of a physical system. This paper investigates the relationship between Φ as defined in Integrated Information Theory and state differentiation (D), the number of, and difference between potential system states. Here we provide theoretical justification of the relationship between Φ and D, then validate the results using a simulation study. First, we show that a physical system in a state with high Φ necessarily has many elements and specifies many causal relationships. Furthermore, if the average value of integrated information across all states is high, the system must also have high differentiation. Next, we explore the use of D as a proxy for Φ using artificial networks, evolved to have integrated structures. The results show a positive linear relationship between Φ and D for multiple network sizes and connectivity patterns. Finally we investigate the differentiation evoked by sensory inputs and show that, under certain conditions, it is possible to estimate integrated information without a direct perturbation of its internal elements. In concluding, we discuss the need for further validation on larger networks and explore the potential applications of this work to the empirical study of consciousness, especially concerning the practical estimation of Φ from neuroimaging data.

[1]  G. Edelman,et al.  Consciousness and Complexity , 1998 .

[2]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[3]  G. Tononi,et al.  A Theoretically Based Index of Consciousness Independent of Sensory Processing and Behavior , 2013, Science Translational Medicine.

[4]  G Tononi,et al.  Integrated information theory of consciousness: an updated account. , 2012, Archives italiennes de biologie.

[5]  Steven Laureys,et al.  Automated EEG entropy measurements in coma, vegetative state/unresponsive wakefulness syndrome and minimally conscious state. , 2011, Functional neurology.

[6]  Anil K. Seth,et al.  Practical Measures of Integrated Information for Time-Series Data , 2011, PLoS Comput. Biol..

[7]  Larissa Albantakis,et al.  From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0 , 2014, PLoS Comput. Biol..

[8]  G. Tononi,et al.  Consciousness and Complexity during Unresponsiveness Induced by Propofol, Xenon, and Ketamine , 2015, Current Biology.

[9]  Jared S. Moore.  Is This Phenomenology , 1942 .

[10]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[11]  Stanislas Dehaene,et al.  Toward a computational theory of conscious processing , 2014, Current Opinion in Neurobiology.

[12]  G. Tononi,et al.  Local Slow Waves in Superficial Layers of Primary Cortical Areas during REM Sleep , 2016, Current Biology.

[13]  Larissa Albantakis,et al.  The Intrinsic Cause-Effect Power of Discrete Dynamical Systems - From Elementary Cellular Automata to Adapting Animats , 2015, Entropy.

[14]  Cyriel M A Pennartz,et al.  Mouse V1 population correlates of visual detection rely on heterogeneity within neuronal response patterns , 2015, eLife.

[15]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[16]  Adam B. Barrett,et al.  An integration of integrated information theory with fundamental physics , 2014, Front. Psychol..

[17]  G Tononi,et al.  A complexity measure for selective matching of signals by the brain. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[18]  G. Tononi,et al.  Stimulus Set Meaningfulness and Neurophysiological Differentiation: A Functional Magnetic Resonance Imaging Study , 2014, bioRxiv.

[19]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[20]  Arend Hintze,et al.  Evolution of Integrated Causal Structures in Animats Exposed to Environments of Increasing Complexity , 2014, PLoS Comput. Biol..

[21]  Carlo Tomasi,et al.  The Earth Mover’s Distance , 2001 .

[22]  A. Seth.  Causal connectivity of evolved neural networks during behavior. , 2005, Network.

[23]  Fabio Sebastiano,et al.  Functional Isolation Within the Cerebral Cortex in the Vegetative State , 2011, Neurorehabilitation and neural repair.

[24]  Arend Hintze,et al.  Integrated Information Increases with Fitness in the Evolution of Animats , 2011, PLoS Comput. Biol..

[25]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[26]  Giulio Tononi,et al.  Integrated information theory , 2015, Scholarpedia.

[27]  C. Koch,et al.  Consciousness: here, there and everywhere? , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  M. Sigman,et al.  Signature of consciousness in the dynamics of resting-state brain activity , 2015, Proceedings of the National Academy of Sciences.

[29]  Xiping Liu,et al.  Dynamic Repertoire of Intrinsic Brain States Is Reduced in Propofol-Induced Unconsciousness , 2015, Brain Connect..

[30]  G Tononi,et al.  Cortical reactivity and effective connectivity during REM sleep in humans , 2010, Cognitive neuroscience.

[31]  G. Tononi,et al.  Breakdown of Cortical Effective Connectivity During Sleep , 2005, Science.

[32]  G. Tononi.  An information integration theory of consciousness , 2004, BMC Neuroscience.

[33]  Toru Yanagawa,et al.  Measuring Integrated Information from the Decoding Perspective , 2015, PLoS Comput. Biol..

[34]  Erik P. Hoel,et al.  Quantifying causal emergence shows that macro can beat micro , 2013, Proceedings of the National Academy of Sciences.