Life and Understanding: The Origins of “Understanding” in Self-Organizing Nervous Systems

This article is motivated by a formulation of biotic self-organization in Friston (2013), where the emergence of “life” in coupled material entities (e.g., macromolecules) was predicated on bounded subsets that maintain a degree of statistical independence from the rest of the network. Boundary elements in such systems constitute a Markov blanket; separating the internal states of a system from its surrounding states. In this article, we ask whether Markov blankets operate in the nervous system and underlie the development of intelligence, enabling a progression from the ability to sense the environment to the ability to understand it. Markov blankets have been previously hypothesized to form in neuronal networks as a result of phase transitions that cause network subsets to fold into bounded assemblies, or packets (Yufik and Sheridan, 1997; Yufik, 1998a). The ensuing neuronal packets hypothesis builds on the notion of neuronal assemblies (Hebb, 1949, 1980), treating such assemblies as flexible but stable biophysical structures capable of withstanding entropic erosion. In other words, structures that maintain their integrity under changing conditions. In this treatment, neuronal packets give rise to perception of “objects”; i.e., quasi-stable (stimulus bound) feature groupings that are conserved over multiple presentations (e.g., the experience of perceiving “apple” can be interrupted and resumed many times). Monitoring the variations in such groups enables the apprehension of behavior; i.e., attributing to objects the ability to undergo changes without loss of self-identity. Ultimately, “understanding” involves self-directed composition and manipulation of the ensuing “mental models” that are constituted by neuronal packets, whose dynamics capture relationships among objects: that is, dependencies in the behavior of objects under varying conditions. For example, movement is known to involve rotation of population vectors in the motor cortex (Georgopoulos et al., 1988, 1993). The neuronal packet hypothesis associates “understanding” with the ability to detect and generate coordinated rotation of population vectors—in neuronal packets—in associative cortex and other regions in the brain. The ability to coordinate vector representations in this way is assumed to have developed in conjunction with the ability to postpone overt motor expression of implicit movement, thus creating a mechanism for prediction and behavioral optimization via mental modeling that is unique to higher species. This article advances the notion that Markov blankets—necessary for the emergence of life—have been subsequently exploited by evolution and thus ground the ways that living organisms adapt to their environment, culminating in their ability to understand it.

[1]  Mark T. Keane,et al.  Cognitive Psychology: A Student's Handbook , 1990 .

[2]  J. E. Mcguire,et al.  FORESIGHT AND UNDERSTANDING , 1962 .

[3]  H. Jeffreys Logical Foundations of Probability , 1952, Nature.

[4]  J. Piaget The Grasp of Consciousness: Action and Concept in the Young Child , 1976 .

[5]  Shy Shoham,et al.  Identification of network-level coding units for real-time representation of episodic experiences in the hippocampus , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[6]  E. Schrödinger,et al.  What is life? : the physical aspect of the living cell , 1946 .

[7]  Anthony Trewavas,et al.  Plant intelligence: Mindless mastery , 2002, Nature.

[8]  On Brain and Value: Utility, Preference, Play and Creativity , 2018 .

[9]  Masao Ito Movement and thought: identical control mechanisms by the cerebellum , 1993, Trends in Neurosciences.

[10]  S. Lehar The World in Your Head : A Gestalt View of the Mechanism of Conscious Experience , 2003 .

[11]  R. Penrose,et al.  The Large, the Small and the Human Mind by Roger Penrose. Cambridge University Press, 1997, xviii + 185 pp. £14.95 , 1998, Philosophy.

[12]  Giovanna Citti,et al.  The constitution of visual perceptual units in the functional architecture of V1 , 2014, Journal of Computational Neuroscience.

[13]  Benjamin Libet,et al.  The Volitional Brain: Towards a Neuroscience of Free Will , 1999 .

[14]  George M. Whitesides,et al.  Surface tension-powered self-assembly of microstructures - the state-of-the-art , 2003 .

[15]  J. Kelso,et al.  Cortical coordination dynamics and cognition , 2001, Trends in Cognitive Sciences.

[16]  S. Sloman Causal Models: How People Think about the World and Its Alternatives , 2005 .

[17]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[18]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[19]  D. Dieks,et al.  Reduction and Understanding , 1998 .

[20]  A. Harken,et al.  Order out of chaos. , 2017, The Journal of thoracic and cardiovascular surgery.

[21]  Terrence J. Sejnowski,et al.  Prospective Optimization , 2014, Proceedings of the IEEE.

[22]  Paul Smolensky,et al.  Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1990, Artif. Intell..

[23]  M. S. Salman Topical Review : The Cerebellum: It's About Time! But Timing Is Not Everything-New Insights Into the Role of the Cerebellum in Timing Motor and Cognitive Tasks , 2002, Journal of child neurology.

[24]  INVESTIGATIONS , 1984, The Lancet.

[25]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[26]  Mats G. Nordahl,et al.  Evolving Recurrent Neural Networks , 1993 .

[27]  Harold Tarrant,et al.  Aristotle: the desire to understand , 1990 .

[28]  Per Bak,et al.  How Nature Works , 1996 .

[29]  L. Brakel A Universe of Consciousness: How Matter Becomes Imagination , 2001 .

[30]  W. Köhler Gestalt psychology , 1967 .

[31]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[32]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[33]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[34]  M. Bunge Causality and modern science , 1979 .

[35]  S. Yantis Multielement visual tracking: Attention and perceptual organization , 1992, Cognitive Psychology.

[36]  R. Sternberg,et al.  The Psychology of Intelligence , 2002 .

[37]  PROBABILISTIC RESOURCE ALLOCATION SYSTEM WITH SELF-ADAPTIVE CAPABILITY , 2022 .

[38]  D. Bertsekas,et al.  A Vector Space Approach to Models and Optimization , 1983 .

[39]  J. Fritz,et al.  Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex , 2003, Nature Neuroscience.

[40]  C. Doran,et al.  Geometric Algebra for Physicists , 2003 .

[41]  R. M. Gaze Dynamic patterns , 1975, Nature.

[42]  H. Haken,et al.  Synergetics , 1988, IEEE Circuits and Devices Magazine.

[43]  V. Isaeva Self-organization in biological systems , 2012, Biology Bulletin.

[44]  Gregory Chaitin,et al.  The limits of reason. , 2006, Scientific American.

[45]  Christopher R. Hitchcock,et al.  Probabilistic Measures of Causal Strength , 2011 .

[46]  Claude E. Shannon,et al.  Mathematical Theory of the Differential Analyzer , 1941 .

[47]  Edward Mackinnon Aspects of Scientific Explanation: and Other Essays in the Philosophy of Science , 1967 .

[48]  S. Lehar Gestalt isomorphism and the primacy of subjective conscious experience: A Gestalt Bubble model , 2003, Behavioral and Brain Sciences.

[49]  L. Loeb Autobiographical Notes , 2015, Perspectives in biology and medicine.

[50]  Y. M. Yufik How the mind works: an exercise in pragmatism , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[51]  Jeremy L. England,et al.  Statistical physics of self-replication. , 2012, The Journal of chemical physics.

[52]  C. Daly,et al.  Physical Properties , 2021, Cotton and Flax Fibre-Reinforced Geopolymer Composites.

[53]  Hugh Lehman,et al.  On Understanding Mathematics. , 1977 .

[54]  René Thom,et al.  Structural stability and morphogenesis - an outline of a general theory of models , 1977, Advanced book classics.

[55]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[56]  Michael Barr,et al.  The Emperor's New Mind , 1989 .

[57]  B. MacLennan Mixing Memory and Desire: Want and Will in Neural Modeling , 1998 .

[58]  L. Keita Scientific Explanation and the Causal Structure of the World , 1990 .

[59]  F. Varela,et al.  Radical embodiment: neural dynamics and consciousness , 2001, Trends in Cognitive Sciences.

[60]  W. Köhler The Mentality of Apes. , 2018, Nature.

[61]  Robert Rosen,et al.  Structural stability and morphogenesis , 1977 .

[62]  David Maccallum,et al.  Quantum Mechanics: Historical Contingency and the Copenhagen Hegemony , 1996 .

[63]  Wolf Singer,et al.  The Brain, a Complex Self-organizing System , 2009, European Review.

[64]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[65]  Bernhard Poerksen,et al.  The end of certainty , 1992 .

[66]  Sunil Thakur,et al.  The Nature of Physical Reality , 2015 .

[67]  C. J. Keyser Contributions to the Founding of the Theory of Transfinite Numbers , 1916 .

[68]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[69]  Jeremy D Schmahmann,et al.  The functional neuroanatomy of decision-making. , 2012, The Journal of neuropsychiatry and clinical neurosciences.

[70]  B. C. Lesieutre Self-organizing criticality , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[71]  S. David,et al.  Does attention play a role in dynamic receptive field adaptation to changing acoustic salience in A1? , 2007, Hearing Research.

[72]  Daniel Polani,et al.  On the Cross-Disciplinary Nature of Guided Self-Organisation , 2014 .

[73]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[74]  Hanna Damasio,et al.  Exploring the Concept of Homeostasis and Considering its Implications for Economics , 2015 .

[75]  M. Marder Plant intelligence and attention , 2013, Plant signaling & behavior.

[76]  W. Freeman,et al.  Reclaiming cognition : the primacy of action, intention and emotion , 1999 .

[77]  Adeel Razi,et al.  The Connected Brain: Causality, models, and intrinsic dynamics , 2016, IEEE Signal Processing Magazine.

[78]  K. Reinhold Theory of the Understanding , 2011 .

[79]  D. Hestenes,et al.  Clifford Algebra to Geometric Calculus: A Unified Language for Mathematics and Physics , 1984 .

[80]  Peter Mariën,et al.  Cerebellar neurocognition: Insights into the bottom of the brain , 2008, Clinical Neurology and Neurosurgery.

[81]  Béla Bollobás,et al.  Phase transitions in the neuropercolation model of neural populations with mixed local and non-local interactions , 2005, Biological Cybernetics.

[82]  N. Humphrey Seeing Red: A Study in Consciousness , 2006 .

[83]  D. Hebb Essay on mind , 1980 .

[84]  R. Sperry A modified concept of consciousness. , 1969, Psychological review.

[85]  Walter J. Freeman,et al.  Metastability, instability, and state transition in neocortex , 2005, Neural Networks.

[86]  Charles G. Gross,et al.  Aristotle on the Brain , 1995 .

[87]  Thomas B. Sheridan,et al.  Virtual networks: new framework for operator modeling and interface optimization in complex supervisory control systems , 1996 .

[88]  G. Hempel,et al.  Deductive-Nomological vs. Statistical Explanation , 1962 .

[89]  James H. Fetzer Statistical Explanation and Statistical Relevance , 1981 .

[90]  T. Butt A Psychology of Understanding , 2008 .

[91]  David M. Raup,et al.  How Nature Works: The Science of Self-Organized Criticality , 1997 .

[92]  Yan M. Yufik,et al.  Virtual Associative Networks: A Framework for Cognitive Modeling , 2018 .

[93]  Henrik Jeldtoft Jensen,et al.  Self-Organized Criticality , 1998 .

[94]  Terrence J. Sejnowski,et al.  The Wilson–Cowan model, 36 years later , 2009, Biological Cybernetics.

[95]  Beth Stevens,et al.  Do glia drive synaptic and cognitive impairment in disease? , 2015, Nature Neuroscience.

[96]  Lokendra Shastri,et al.  Biological Grounding of Recruitment Learning and Vicinal Algorithms in Long-Term Potentiation , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[97]  G. Edelman,et al.  Reentry: a key mechanism for integration of brain function , 2013, Front. Integr. Neurosci..

[98]  H. Haken,et al.  Intentionality in non-equilibrium systems? The functional aspects of self-organized pattern formation , 2007 .

[99]  A. White Essays on Actions and Events. , 1981 .

[100]  Geoffrey E. Hinton Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[101]  J. Kelso,et al.  Coordination Dynamics in Cognitive Neuroscience , 2016, Front. Neurosci..

[102]  Sylvia Weir,et al.  Action perception , 1974 .

[103]  Yan M. Yufik,et al.  Information Blending in Virtual Associative Networks: A New Paradigm for Sensor Integration , 1999, Int. J. Artif. Intell. Tools.

[104]  Joseph Y. Halpern,et al.  Graded Causation and Defaults , 2013, The British Journal for the Philosophy of Science.

[105]  Karl J. Friston Life as we know it , 2013, Journal of The Royal Society Interface.

[106]  Karolin Papst Foundations Of Understanding , 2016 .

[107]  J. Piaget Success and Understanding , 1978 .

[108]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[109]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[110]  Hava T. Siegelmann,et al.  Evolving recurrent neural networks are super-Turing , 2011, The 2011 International Joint Conference on Neural Networks.

[111]  William G. Faris Shadows of the Mind: A Search for the Missing Science of Consciousness , 1997 .

[112]  Paul J. Werbos Values, Goals and Utility in an Engineering-Based Theory of Mammalian Intelligence , 2018 .

[113]  Lena Jaeger The Mind Of Man Models Of Human Understanding , 2016 .

[114]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[115]  G. F. Tremblay,et al.  Bright Air, Brilliant Fire: On the Matter of the Mind, Gerald M. Edelman. 1992. Basic Books, New York, NY. 280 pages. ISBN: 0-465-05245-2. $25.00 , 1992 .

[116]  Yan M. Yufik,et al.  Understanding, consciousness and thermodynamics of cognition , 2013 .

[117]  Karl H. Pribram,et al.  Brain and values : is a biological science of values possible , 1998 .

[118]  Mandy Eberhart,et al.  The Scientific Image , 2016 .

[119]  Maxine Leeds Craig,et al.  How to Solve the Mind/Body Problem , 2013 .

[120]  Elizabeth Barber,et al.  Connectivity, Complexity, and Catastrophe in Large-Scale Systems , 1980 .

[121]  Karl J. Friston,et al.  Towards a Neuronal Gauge Theory , 2016, PLoS biology.

[122]  Kevin M. Brooks,et al.  Thoughts beyond words : When language overshadows insight , 1993 .

[123]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[124]  J. Piaget The construction of reality in the child , 1954 .

[125]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[126]  Hava T. Siegelmann,et al.  Neural networks and analog computation - beyond the Turing limit , 1999, Progress in theoretical computer science.

[127]  J. Linnett,et al.  Quantum mechanics , 1975, Nature.

[128]  R. Lipowsky Surface‐induced order and disorder: Critical phenomena at first‐order phase transitions (invited) , 1984 .

[129]  Joachim Weickert,et al.  Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods , 2005, International Journal of Computer Vision.

[130]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[131]  J. Tsien,et al.  Organizing principles of real-time memory encoding: neural clique assemblies and universal neural codes , 2006, Trends in Neurosciences.

[132]  Massimiliano Di Ventra,et al.  On the physical properties of memristive, memcapacitive and meminductive systems , 2013, Nanotechnology.

[133]  P. Glansdorff,et al.  Thermodynamic theory of structure, stability and fluctuations , 1971 .

[134]  Michael Brereton,et al.  Synergetics: An Introduction – Nonequilibrium Phase Transitions and Self–Organisation in Physics, Chemistry and Biology , 1978 .

[135]  H. Haken Synergetics: an Introduction, Nonequilibrium Phase Transitions and Self-organization in Physics, Chemistry, and Biology , 1977 .

[136]  Sergei Gepshtein,et al.  Sensory adaptation as optimal resource allocation , 2013, Proceedings of the National Academy of Sciences.

[137]  H. Haken,et al.  PHASE TRANSITIONS IN THE HUMAN BRAIN: SPATIAL MODE DYNAMICS , 1992 .

[138]  G. Edelman Neural Darwinism: Selection and reentrant signaling in higher brain function , 1993, Neuron.

[139]  Harold J. Morowitz,et al.  Foundations Of Bioenergetics , 1978 .

[140]  Robert Kozma,et al.  Adaptation of the generalized Carnot cycle to describe thermodynamics of cerebral cortex , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[141]  D. Hestenes,et al.  Clifford Algebra to Geometric Calculus , 1984 .

[142]  Joseph Zhuo Tsien,et al.  The memory code , 2007 .

[143]  A. Damasio,et al.  The nature of feelings: evolutionary and neurobiological origins , 2013, Nature Reviews Neuroscience.

[144]  Ilya Prigogine Mind and Matter: Beyond the Cartesian Dualism , 2018, Origins.

[145]  P. Johnson-Laird,et al.  The Nature and Limits of Human Understanding , 2003 .

[146]  Karl J. Friston,et al.  Information and Efficiency in the Nervous System—A Synthesis , 2013, PLoS Comput. Biol..

[147]  W. Meehan Review of How the mind uses the brain (to move the body and image the universe). , 2011 .

[148]  W. Salmon Four decades of scientific explanation , 1989 .

[149]  J. Piaget,et al.  The Development of Thought: Equilibration of Cognitive Structures , 1977 .

[150]  B. Bartel,et al.  Seeing Red , 2003, Science.

[151]  Karl J. Friston,et al.  Cognitive Dynamics: From Attractors to Active Inference , 2014, Proceedings of the IEEE.

[152]  Theron Alexander,et al.  Development in Infancy , 2017 .

[153]  Hava T. Siegelmann,et al.  Neural Networks and Analog Computation , 1999, Progress in Theoretical Computer Science.

[154]  H. Haken Advanced Synergetics: Instability Hierarchies of Self-Organizing Systems and Devices , 1983 .

[155]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[156]  W. Ashby,et al.  Every Good Regulator of a System Must Be a Model of That System , 1970 .

[157]  David Chart A Theory of Understanding: Philosophical and Psychological Perspectives , 2000 .

[158]  W. Glasser Control Theory: A New Explanation of How We Control Our Lives , 1985 .

[159]  J. Shah Properties of energy-minimizing segmentations , 1992 .

[160]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[161]  G. Wallis,et al.  Shape learning and discrimination in reef fish , 2009, Journal of Experimental Biology.

[162]  W. H. F. Barnes The Nature of Explanation , 1944, Nature.

[163]  Bruce E. Murdoch,et al.  The cerebellum and language: Historical perspective and review , 2010, Cortex.

[164]  Martin Golubitsky,et al.  What Geometric Visual Hallucinations Tell Us about the Visual Cortex , 2002, Neural Computation.

[165]  Kamran Baig An act of creation , 2003, BMJ : British Medical Journal.

[166]  J. Woodward,et al.  Scientific Explanation and the Causal Structure of the World , 1988 .

[167]  H. Morowitz Biophysics of Ecology. (Book Reviews: Energy Flow in Biology. Biological Organization as a Problem in Thermal Physics) , 1969 .

[168]  F. Keil,et al.  Explanation and understanding , 2015 .

[169]  Masao Ito Control of mental activities by internal models in the cerebellum , 2008, Nature Reviews Neuroscience.

[170]  C. Blakemore The Working Brain , 1972, Nature.

[171]  Dynamic Self-Organization in the Brain as Observed by Transient Cortical Coherence , 2018, Origins.

[172]  K. H. Stauder,et al.  Psychology of the Child , 1959 .

[173]  Mounya Elhilali,et al.  Monkey Frequency-Modulation Encoding in the Primary Auditory Cortex of the Awake Owl , 2001 .

[174]  Thomas B. Sheridan,et al.  Swiss army knife and Ockham's razor: modeling and facilitating operator's comprehension in complex dynamic tasks , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[175]  A. Fairhall,et al.  Sensory adaptation , 2007, Current Opinion in Neurobiology.

[176]  Thomas Bartelborth,et al.  Explanatory Unification , 2004, Synthese.

[177]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.