The inner screen model of consciousness: applying the free energy principle directly to the study of conscious experience

This paper presents a model of consciousness that follows directly from the free-energy principle (FEP). We first rehearse the classical and quantum formulations of the FEP. In particular, we consider the inner screen hypothesis that follows from the quantum information theoretic version of the FEP. We then review applications of the FEP to the known sparse (nested and hierarchical) neuro-anatomy of the brain. We focus on the holographic structure of the brain, and how this structure supports (overt and covert) action.

[1]  A. Safron Integrated world modeling theory expanded: Implications for the future of consciousness , 2022, Frontiers in Computational Neuroscience.

[2]  Won Gi Yeo The Hidden Spring, a Journey to the Source of Consciousness , 2022, Psychoanalysis.

[3]  C. Fields,et al.  The Physical Meaning of the Holographic Principle , 2022, Quanta.

[4]  Lancelot Da Costa,et al.  Path integrals, particular kinds, and strange things. , 2022, Physics of life reviews.

[5]  M. Ramstead,et al.  Mapping Husserlian phenomenology onto active inference , 2022, IWAI.

[6]  Dalton A R Sakthivadivel,et al.  On the Map-Territory Fallacy Fallacy , 2022, 2208.06924.

[7]  C. Buckley,et al.  Spin glass systems as collective active inference , 2022, IWAI.

[8]  A. Clark,et al.  Expecting some action: Predictive Processing and the construction of conscious experience , 2022, Review of Philosophy and Psychology.

[9]  C. Fields,et al.  Competency in Navigating Arbitrary Spaces as an Invariant for Analyzing Cognition in Diverse Embodiments , 2022, Entropy.

[10]  Lancelot Da Costa,et al.  On Bayesian mechanics: a physics of and by beliefs , 2022, Interface Focus.

[11]  Dalton A R Sakthivadivel,et al.  Towards a Geometry and Analysis for Bayesian Mechanics , 2022, 2204.11900.

[12]  Michael Levin,et al.  Neurons as hierarchies of quantum reference frames , 2022, Biosyst..

[13]  K. Friston,et al.  A free energy principle for generic quantum systems. , 2021, Progress in biophysics and molecular biology.

[14]  M. Solms Précis of The Hidden Spring: A Journey to the Source of Consciousness , 2021, Journal of Consciousness Studies.

[15]  A. Safron World Models and the Physical Substrates of Consciousness: Hidden Sources of the Stream of Experience? , 2021, Journal of Consciousness Studies.

[16]  Jakub Limanowski Precision control for a flexible body representation , 2021, Neuroscience & Biobehavioral Reviews.

[17]  Tim Verbelen,et al.  Generalized Simultaneous Localization and Mapping (G-SLAM) as unification framework for natural and artificial intelligences: towards reverse engineering the hippocampal/entorhinal system and principles of high-level cognition , 2021, Frontiers in Systems Neuroscience.

[18]  Kai Ueltzhöffer,et al.  Stochastic Chaos and Markov Blankets , 2021, Entropy.

[19]  C. Hesp,et al.  Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference , 2021, Neuroscience of consciousness.

[20]  K. Friston,et al.  What might interoceptive inference reveal about consciousness? , 2021, Review of Philosophy and Psychology.

[21]  J. Hohwy Conscious Self-Evidencing , 2021, Review of Philosophy and Psychology.

[22]  Grigorios A. Pavliotis,et al.  Bayesian mechanics for stationary processes , 2021, Proceedings of the Royal Society A.

[23]  Adam Safron,et al.  The Radically Embodied Conscious Cybernetic Bayesian Brain: From Free Energy to Free Will and Back Again , 2021, Entropy.

[24]  C. Fields,et al.  Minimal physicalism as a scale-free substrate for cognition and consciousness , 2021, Neuroscience of consciousness.

[25]  G. Jamieson An insula view of predictive processing in hypnotic responses. , 2021 .

[26]  Chris Fields,et al.  Information flow in context-dependent hierarchical Bayesian inference , 2020, J. Exp. Theor. Artif. Intell..

[27]  Karl J. Friston,et al.  Neural and phenotypic representation under the free-energy principle , 2020, Neuroscience & Biobehavioral Reviews.

[28]  Adeel Razi,et al.  Parcels and particles: Markov blankets in the brain , 2020, Network Neuroscience.

[29]  Karl J. Friston,et al.  Is the Free-Energy Principle a Formal Theory of Semantics? From Variational Density Dynamics to Neural and Phenotypic Representations , 2020, Entropy.

[30]  C. Fields,et al.  Holographic Screens Are Classical Information Channels , 2020, Quantum Reports.

[31]  Adam Safron,et al.  An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation , 2019, Frontiers in Artificial Intelligence.

[32]  Karl J. Friston,et al.  Markov blankets in the brain , 2020, Neuroscience & Biobehavioral Reviews.

[33]  Karl J. Friston,et al.  Prediction and memory: A predictive coding account , 2020, Progress in neurobiology.

[34]  Karl J. Friston,et al.  Modules or Mean-Fields? , 2020, Entropy.

[35]  Karl J. Friston,et al.  Sentience and the Origins of Consciousness: From Cartesian Duality to Markovian Monism , 2020, Entropy.

[36]  Bartosz Michał Radomski,et al.  New directions in predictive processing , 2020 .

[37]  J. Hohwy,et al.  The Intermediate Scope of Consciousness in the Predictive Mind , 2020, Erkenntnis.

[38]  Wanja Wiese,et al.  The science of consciousness does not need another theory, it needs a minimal unifying model , 2020, Neuroscience of consciousness.

[39]  Spencer Kellis,et al.  From thought to action: The brain–machine interface in posterior parietal cortex , 2019, Proceedings of the National Academy of Sciences.

[40]  Karl J. Friston,et al.  Variational ecology and the physics of sentient systems , 2019, Physics of life reviews.

[41]  Adeel Razi,et al.  On Markov blankets and hierarchical self-organisation , 2019, Journal of theoretical biology.

[42]  Karl J. Friston,et al.  Waves of prediction , 2019, PLoS biology.

[43]  Karl J. Friston,et al.  A tale of two densities: active inference is enactive inference , 2019, Adapt. Behav..

[44]  Karl J. Friston A free energy principle for a particular physics , 2019, 1906.10184.

[45]  Karl J. Friston,et al.  REBUS and the Anarchic Brain: Toward a Unified Model of the Brain Action of Psychedelics , 2019, Pharmacological Reviews.

[46]  Mark D. Sprevak Two Kinds of Information Processing in Cognition , 2019, Review of Philosophy and Psychology.

[47]  Subutai Ahmad,et al.  How Can We Be So Dense? The Benefits of Using Highly Sparse Representations , 2019, ArXiv.

[48]  Hernán A. Makse,et al.  How the Brain Transitions from Conscious to Subliminal Perception , 2019, Neuroscience.

[49]  Karl J. Friston,et al.  Multiscale integration: beyond internalism and externalism , 2019, Synthese.

[50]  Karl J. Friston,et al.  Perceptual awareness and active inference , 2019, Neuroscience of consciousness.

[51]  Karl J. Friston,et al.  Deep temporal models and active inference , 2017, Neuroscience & Biobehavioral Reviews.

[52]  J. Hohwy,et al.  Content and misrepresentation in hierarchical generative models , 2018, Synthese.

[53]  Karl J. Friston,et al.  ‘Seeing the Dark’: Grounding Phenomenal Transparency and Opacity in Precision Estimation for Active Inference , 2018, Front. Psychol..

[54]  Karl J. Friston,et al.  The graphical brain: Belief propagation and active inference , 2017, Network Neuroscience.

[55]  Henry Markram,et al.  Rich cell-type-specific network topology in neocortical microcircuitry , 2017, Nature Neuroscience.

[56]  M. Nour,et al.  Psychedelics and the science of self-experience. , 2017, The British journal of psychiatry : the journal of mental science.

[57]  Karl J. Friston,et al.  The role of interoceptive inference in theory of mind , 2017, Brain and Cognition.

[58]  Karl J. Friston,et al.  Answering Schrödinger's question: A free-energy formulation , 2017, Physics of life reviews.

[59]  J. Tani Exploring Robotic Minds: Actions, Symbols, and Consciousness as Self-Organizing Dynamic Phenomena , 2016 .

[60]  Karl J. Friston,et al.  Active interoceptive inference and the emotional brain , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[61]  M. Tsakiris,et al.  ‘Bodily precision’: a predictive coding account of individual differences in interoceptive accuracy , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[62]  Karl J. Friston,et al.  The Functional Anatomy of Time: What and When in the Brain , 2016, Trends in Cognitive Sciences.

[63]  J. Hohwy The self-evidencing brain , 2016 .

[64]  C. Koch,et al.  Integrated information theory: from consciousness to its physical substrate , 2016, Nature Reviews Neuroscience.

[65]  Yoshua Bengio,et al.  Towards a Biologically Plausible Backprop , 2016, ArXiv.

[66]  Cecilia Wong,et al.  The Conscious Mind , 2015, Leonardo.

[67]  Karl J. Friston,et al.  Cerebral hierarchies: predictive processing, precision and the pulvinar , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[68]  Giulio Tononi,et al.  Integrated information theory , 2015, Scholarpedia.

[69]  J. Hohwy The Predictive Mind , 2013 .

[70]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[71]  Karl J. Friston,et al.  Broadband Cortical Desynchronization Underlies the Human Psychedelic State , 2013, The Journal of Neuroscience.

[72]  Felix Blankenburg,et al.  Minimal self-models and the free energy principle , 2013, Front. Hum. Neurosci..

[73]  Karl J. Friston Life as we know it , 2013, Journal of The Royal Society Interface.

[74]  Andy Clark,et al.  The many faces of precision (Replies to commentaries on “Whatever next? Neural prediction, situated agents, and the future of cognitive science”) , 2013, Front. Psychol..

[75]  H. Bergson,et al.  Time and free will; an essay on the immediate data of consciousness , 2013 .

[76]  M. Solms The Conscious Id , 2013 .

[77]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[78]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[79]  Giovanni Pezzulo,et al.  An Active Inference view of cognitive control , 2012, Front. Psychology.

[80]  P. Dayan Twenty-Five Lessons from Computational Neuromodulation , 2012, Neuron.

[81]  Karl J. Friston,et al.  Waking and dreaming consciousness: Neurobiological and functional considerations , 2012, Progress in Neurobiology.

[82]  O. Sporns,et al.  High-cost, high-capacity backbone for global brain communication , 2012, Proceedings of the National Academy of Sciences.

[83]  Karl J. Friston,et al.  Perception and self-organized instability , 2012, Front. Comput. Neurosci..

[84]  O. Sporns,et al.  The economy of brain network organization , 2012, Nature Reviews Neuroscience.

[85]  J. Kaas,et al.  Cortical networks subserving upper limb movements in primates. , 2012, European journal of physical and rehabilitation medicine.

[86]  J. Hohwy Attention and Conscious Perception in the Hypothesis Testing Brain , 2012, Front. Psychology.

[87]  R. Schmidt,et al.  Cross-Frequency Phase–Phase Coupling between Theta and Gamma Oscillations in the Hippocampus , 2012, The Journal of Neuroscience.

[88]  J. Changeux,et al.  Experimental and Theoretical Approaches to Conscious Processing , 2011, Neuron.

[89]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[90]  M. Häusser,et al.  Dendritic Discrimination of Temporal Input Sequences in Cortical Neurons , 2010, Science.

[91]  Karl J. Friston,et al.  Is the free-energy principle neurocentric? , 2010, Nature Reviews Neuroscience.

[92]  Giacomo Rizzolatti,et al.  Premotor theory of attention , 2010, Scholarpedia.

[93]  J. Hobson,et al.  REM sleep and dreaming: towards a theory of protoconsciousness , 2009, Nature Reviews Neuroscience.

[94]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[95]  Karl J. Friston,et al.  Predictive coding explains binocular rivalry: An epistemological review , 2008, Cognition.

[96]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[97]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[98]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[99]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.

[100]  T. Metzinger Phenomenal transparency and cognitive self-reference , 2003 .

[101]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[102]  R. Bousso The Holographic principle , 2002, hep-th/0203101.

[103]  M. Usher A Statistical Referential Theory of Content: Using Information Theory to Account for Misrepresentation , 2001 .

[104]  L. Swanson Cerebral hemisphere regulation of motivated behavior 1 1 Published on the World Wide Web on 2 November 2000. , 2000, Brain Research.

[105]  M P Young,et al.  Hierarchical organization of macaque and cat cortical sensory systems explored with a novel network processor. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[106]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[107]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[108]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[109]  John Rowan,et al.  Consciousness and Experience , 1997 .

[110]  Rita Nolan A Theory of Content and Other Essays , 1992 .

[111]  R. Douglas,et al.  A functional microcircuit for cat visual cortex. , 1991, The Journal of physiology.

[112]  K. Pribram Brain and Perception: Holonomy and Structure in Figural Processing , 1991 .

[113]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[114]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[115]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[116]  Fred I. Dretske,et al.  Knowledge and the Flow of Information , 1985 .

[117]  J A Hobson,et al.  Neuronal excitability modulation over the sleep cycle: a structural and mathematical model. , 1975, Science.

[118]  W. Ashby,et al.  Every Good Regulator of a System Must Be a Model of That System , 1970 .

[119]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[120]  D. A. R. Sakthivadivel A CONSTRAINT GEOMETRY FOR INFERENCE AND INTEGRATION , 2022 .

[121]  A. Damasio The strange order of things : life, feeling, and the making of the cultures , 2018 .

[122]  Karl J. Friston,et al.  How and why consciousness arises: Some considerations from physics and physiology , 2018 .

[123]  Jakub Limanowski,et al.  Attending to the Body Action and Self-Experience in the Active Inference Framework , 2017 .

[124]  Karl J. Friston Embodied Inference : or “ I think therefore I am , if I am what I think ” , 2010 .

[125]  Olaf Sporns,et al.  The small world of the cerebral cortex , 2007, Neuroinformatics.

[126]  D. Rosenthal Consciousness and mind , 2005 .

[127]  B. Baars Global workspace theory of consciousness: toward a cognitive neuroscience of human experience. , 2005, Progress in brain research.

[128]  David Mumford,et al.  On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[129]  D. Papineau Theories of Consciousness , 2003 .

[130]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[131]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[132]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[133]  D. Pavón The Entropy of Hawking Radiation , 1987 .