Neural coordination can be enhanced by occasional interruption of normal firing patterns: A self-optimizing spiking neural network model

The state space of a conventional Hopfield network typically exhibits many different attractors of which only a small subset satisfies constraints between neurons in a globally optimal fashion. It has recently been demonstrated that combining Hebbian learning with occasional alterations of normal neural states avoids this problem by means of self-organized enlargement of the best basins of attraction. However, so far it is not clear to what extent this process of self-optimization is also operative in real brains. Here we demonstrate that it can be transferred to more biologically plausible neural networks by implementing a self-optimizing spiking neural network model. In addition, by using this spiking neural network to emulate a Hopfield network with Hebbian learning, we attempt to make a connection between rate-based and temporal coding based neural systems. Although further work is required to make this model more realistic, it already suggests that the efficacy of the self-optimizing process is independent from the simplifying assumptions of a conventional Hopfield network. We also discuss natural and cultural processes that could be responsible for occasional alteration of neural firing patterns in actual brains.

[1]  Tom Froese,et al.  Turing instabilities in biology, culture, and consciousness? On the enactive origins of symbolic material culture , 2013, Adapt. Behav..

[2]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[3]  V. Turner The Ritual Process: Structure and Anti-Structure , 1971 .

[4]  V. Turner,et al.  The Ritual Process. Structure and Anti-Structure , 1978 .

[5]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[6]  Vladimir Kryzhanovsky,et al.  Binary Optimization: On the Probability of a Local Minimum Detection in Random Search , 2006, ICAISC.

[7]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[8]  James David Lewis-Williams,et al.  Comment on: Froese et al.: ‘Turing instabilities in biology, culture, and consciousness’ , 2014, Adapt. Behav..

[9]  Wright Professor Stephen,et al.  Rites of Passage , 2010 .

[10]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[11]  Barb Shellian,et al.  High Hopes , 1998 .

[12]  E. Kandel,et al.  Is Heterosynaptic modulation essential for stabilizing hebbian plasiticity and memory , 2000, Nature Reviews Neuroscience.

[13]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[14]  Richard A. Watson,et al.  Optimization in "self-modeling" complex adaptive systems , 2011, Complex..

[15]  Peter J Hellyer,et al.  The entropic brain: a theory of conscious states informed by neuroimaging research with psychedelic drugs , 2014, Front. Hum. Neurosci..

[16]  Kazuyuki Aihara,et al.  A CMOS Spiking Neural Network Circuit with Symmetric/Asymmetric STDP Function , 2009, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[17]  Wolfgang Maass,et al.  Fast Sigmoidal Networks via Spiking Neurons , 1997, Neural Computation.

[18]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[19]  Karl J. Friston,et al.  Broadband Cortical Desynchronization Underlies the Human Psychedelic State , 2013, The Journal of Neuroscience.

[20]  Christof Koch,et al.  The role of single neurons in information processing , 2000, Nature Neuroscience.

[21]  Jason Noble,et al.  “If You Can't Be With the One You Love, Love the One You're With”: How Individual Habituation of Agent Interactions Improves Global Utility , 2011, Artificial Life.

[22]  Peter Tiño,et al.  Learning Beyond Finite Memory in Recurrent Networks of Spiking Neurons , 2005, Neural Computation.

[23]  Sue Wilson,et al.  Sleep in schizophrenia: time for closer attention. , 2012, The British journal of psychiatry : the journal of mental science.

[24]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Wolfgang Maass,et al.  Networks of spiking neurons can emulate arbitrary Hopfield nets in temporal coding , 1997 .

[26]  E. Kandel,et al.  A form of long-lasting, learning-related synaptic plasticity in the hippocampus induced by heterosynaptic low-frequency pairing. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[27]  A. V. Gennep The rites of passage , 1960 .

[28]  Richard A. Watson,et al.  Global Adaptation in Networks of Selfish Components: Emergent Associative Memory at the System Scale , 2011, Artificial Life.

[29]  Richard A. Watson,et al.  Transformations in the scale of behavior and the global optimization of constraints in adaptive networks , 2011, Adapt. Behav..

[30]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.