Neural Autopoiesis: Organizing Self-Boundaries by Stimulus Avoidance in Biological and Artificial Neural Networks

Living organisms must actively maintain themselves in order to continue existing. Autopoiesis is a key concept in the study of living organisms, where the boundaries of the organism are not static but dynamically regulated by the system itself. To study the autonomous regulation of a self-boundary, we focus on neural homeodynamic responses to environmental changes using both biological and artificial neural networks. Previous studies showed that embodied cultured neural networks and spiking neural networks with spike-timing dependent plasticity (STDP) learn an action as they avoid stimulation from outside. In this article, as a result of our experiments using embodied cultured neurons, we find that there is also a second property allowing the network to avoid stimulation: If the agent cannot learn an action to avoid the external stimuli, it tends to decrease the stimulus-evoked spikes, as if to ignore the uncontrollable input. We also show such a behavior is reproduced by spiking neural networks with asymmetric STDP. We consider that these properties are to be regarded as autonomous regulation of self and nonself for the network, in which a controllable neuron is regarded as self, and an uncontrollable neuron is regarded as nonself. Finally, we introduce neural autopoiesis by proposing the principle of stimulus avoidance.

[1]  Steve M. Potter,et al.  Real-time multi-channel stimulus artifact suppression by local curve fitting , 2002, Journal of Neuroscience Methods.

[2]  R. Kanzaki,et al.  Cortical Mapping of Mismatch Negativity with Deviance Detection Property in Rat , 2013, PloS one.

[3]  S. Nelson,et al.  Short-Term Depression at Thalamocortical Synapses Contributes to Rapid Adaptation of Cortical Sensory Responses In Vivo , 2002, Neuron.

[4]  Andreas Hierlemann,et al.  Switch-Matrix-Based High-Density Microelectrode Array in CMOS Technology , 2010, IEEE Journal of Solid-State Circuits.

[5]  Eisaku Maeda,et al.  Experimental analysis of neuronal dynamics in cultured cortical networks and transitions between different patterns of activity , 1997, Biological Cybernetics.

[6]  W. Ashby,et al.  Design for a brain; the origin of adaptive behavior , 2011 .

[7]  Danny Eytan,et al.  Dynamics and Effective Topology Underlying Synchronization in Networks of Cortical Neurons , 2006, The Journal of Neuroscience.

[8]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[9]  Hiroyuki Iizuka,et al.  Toward Spinozist Robotics: Exploring the Minimal Dynamics of Behavioral Preference , 2007, Adapt. Behav..

[10]  Shimon Marom,et al.  Development, learning and memory in large random networks of cortical neurons: lessons beyond anatomy , 2002, Quarterly Reviews of Biophysics.

[11]  H. Maturana,et al.  Autopoiesis and Cognition : The Realization of the Living (Boston Studies in the Philosophy of Scie , 1980 .

[12]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[13]  R. Kanzaki,et al.  Development of neural population activity toward self-organized criticality , 2017, Neuroscience.

[14]  G. Laurent,et al.  Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts , 2007, Nature.

[15]  Takashi Ikegami,et al.  From a homeostatic to a homeodynamic self , 2008, Biosyst..

[16]  Steve M. Potter,et al.  Spatio-temporal electrical stimuli shape behavior of an embodied cortical network in a goal-directed learning task , 2008, Journal of neural engineering.

[17]  Hiroyuki Iizuka,et al.  How (not) to model autonomous behaviour , 2008, Biosyst..

[18]  Steve M. Potter,et al.  A new approach to neural cell culture for long-term studies , 2001, Journal of Neuroscience Methods.

[19]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[20]  Carles Escera,et al.  Neurons along the auditory pathway exhibit a hierarchical organization of prediction error , 2017, Nature Communications.

[21]  Karl J. Friston,et al.  Active inference and agency: optimal control without cost functions , 2012, Biological Cybernetics.

[22]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[23]  Karl J. Friston,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[24]  W. Ashby,et al.  Design for a brain: The origin of adaptive behaviour (2nd ed. rev.). , 1960 .

[25]  Steve M. Potter,et al.  Plasticity of recurring spatiotemporal activity patterns in cortical networks , 2007, Physical biology.

[26]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[27]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[28]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[29]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[30]  Di Paolo,et al.  Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions , 2000 .

[31]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[32]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[33]  Susanne Schmid,et al.  Synaptic depression and short-term habituation are located in the sensory part of the mammalian startle pathway , 2006, BMC Neuroscience.

[34]  R. Kanzaki,et al.  State-Dependent Propagation of Neuronal Sub-Population in Spontaneous Synchronized Bursts , 2016, Front. Syst. Neurosci..

[35]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[36]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[37]  Y. Dan,et al.  Spike timing-dependent plasticity: from synapse to perception. , 2006, Physiological reviews.

[38]  R. Kanzaki,et al.  Amplitude and phase-locking adaptation of neural oscillation in the rat auditory cortex in response to tone sequence , 2014, Neuroscience Research.

[39]  G Shahaf,et al.  Learning in Networks of Cortical Neurons , 2001, The Journal of Neuroscience.

[40]  Jerne Nk Towards a network theory of the immune system. , 1974 .

[41]  Takashi Ikegami,et al.  Learning by stimulation avoidance: A principle to control spiking neural networks dynamics , 2016, PloS one.

[42]  G. Stanley,et al.  Rapid Sensory Adaptation Redux: A Circuit Perspective , 2016, Neuron.

[43]  Takeshi Mita,et al.  Emergence of Sense-Making Behavior by the Stimulus Avoidance Principle: Experiments on a Robot Behavior Controlled by Cultured Neuronal Cells , 2015, ECAL.

[44]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[45]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[46]  Jinde Cao,et al.  Introduction to Computational Neuroscience , 2016 .

[47]  I. Nelken,et al.  Processing of low-probability sounds by cortical neurons , 2003, Nature Neuroscience.

[48]  H. Maturana,et al.  Autopoiesis: the organization of living systems, its characterization and a model. , 1974, Currents in modern biology.

[49]  Takashi Ikegami,et al.  Learning by stimulation avoidance scales to large neural networks , 2017, ECAL.

[50]  U. Frey,et al.  Tracking axonal action potential propagation on a high-density microelectrode array across hundreds of sites , 2013, Nature Communications.

[51]  T.B. DeMarse,et al.  MeaBench: A toolset for multi-electrode data acquisition and on-line analysis , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[52]  Eric L. Schwartz,et al.  Computational Neuroscience , 1993, Neuromethods.

[53]  H. Maturana,et al.  Autopoiesis and Cognition , 1980 .

[54]  Hirokazu Takahashi,et al.  Locally embedded presages of global network bursts , 2017, Proceedings of the National Academy of Sciences.