An Associative Memory of Hodgkin-Huxley Neuron Networks with Willshaw-Type Synaptic Couplings

An associative memory has been discussed of neural networks consisting of spiking N (=100) Hodgkin–Huxley (HH) neurons with time-delayed couplings, which memorize P patterns in their synaptic weights. In addition to excitatory synapses whose strengths are modified after the Willshaw-type learning rule with the 0/1 code for quiescent/active states, the network includes uniform inhibitory synapses which are introduced to reduce cross-talk noises. Our simulations of the HH neuron network for the noise-free state have shown to yield a fairly good performance with the storage capacity of α c = P max / N ∼0.4–2.4 for the low neuron activity of f ∼0.04–0.10. This storage capacity of our temporal-code network is comparable to that of the rate-code model with the Willshaw-type synapses. Our HH neuron network is realized not to be vulnerable to the distribution of time delays in couplings. The variability of interspace interval (ISI) of output spike trains in the process of retrieving stored patterns is also discussed.

[1]  O. Krisement.  Phase transition in a Willshaw net , 1992 .

[2]  Shun-ichi Amari,et al.  Characteristics of sparsely encoded associative memory , 1989, Neural Networks.

[3]  Masato Okada,et al.  Statistical Mechanics of an Oscillator Associative Memory with Scattered Natural Frequencies , 1999 .

[4]  K Aihara,et al.  Periodic and non-periodic responses of a periodically forced Hodgkin-Huxley oscillator. , 1984, Journal of theoretical biology.

[5]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[6]  C. Stevens,et al.  Input synchrony and the irregular firing of cortical neurons , 1998, Nature Neuroscience.

[7]  Masatoshi Shiino,et al.  ASSOCIATIVE MEMORY BASED ON SYNCHRONIZED FIRING OF SPIKING NEURONS WITH TIME-DELAYED INTERACTIONS , 1998 .

[8]  Charles J. Wilson.  Dendritic morphology, inward rectification, and the functional properties of neostriatal neurons , 1992 .

[9]  D. Perkel,et al.  Motor Pattern Production in Reciprocally Inhibitory Neurons Exhibiting Postinhibitory Rebound , 1974, Science.

[10]  M. Konishi.  The neural algorithm for sound localization in the owl. , 1990, Harvey lectures.

[11]  A. Herz,et al.  Content-addressable memory with spiking neurons , 1999 .

[12]  G. A. Kohring.  Performance enhancement of Willshaw type networks through the use of limit cycles , 1990 .

[13]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[14]  Wolfgang Maass,et al.  Networks of spiking neurons can emulate arbitrary Hopfield nets in temporal coding , 1997 .

[15]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[16]  Gutfreund,et al.  Processing of temporal sequences in neural networks. , 1988, Physical review letters.

[17]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[18]  Sompolinsky,et al.  Willshaw model: Associative memory with sparse coding and low firing rates. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[19]  H. Hasegawa,et al.  Responses of a Hodgkin-Huxley neuron to various types of spike-train inputs. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[21]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[22]  Joel L. Davis,et al.  Single neuron computation , 1992 .

[23]  J. Nadal,et al.  Associative memory: on the (puzzling) sparse coding limit , 1991 .

[24]  Jianfeng Feng,et al.  Spike output jitter, mean firing time and coefficient of variation , 1998 .

[25]  N. Brunel.  Storage capacity of neural networks: effect of the fluctuations of the number of active neurons per memory , 1994 .

[26]  Kanter,et al.  Temporal association in asymmetric neural networks. , 1986, Physical review letters.

[27]  William R. Softky,et al.  Simple codes versus efficient codes , 1995, Current Opinion in Neurobiology.

[28]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[29]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[30]  Boris S. Gutkin,et al.  Dynamics of Membrane Excitability Determine Interspike Interval Variability: A Link Between Spike Generation Mechanisms and Cortical Spike Train Statistics , 1998, Neural Computation.

[31]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[32]  J. Cao,et al.  Periodic oscillatory solution of bidirectional associative memory networks with delays. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[33]  N. Suga,et al.  Specificity of combination-sensitive neurons for processing of complex biosonar signals in auditory cortex of the mustached bat. , 1983, Journal of neurophysiology.

[34]  E. Gardner.  The space of interactions in neural network models , 1988 .

[35]  Jianfeng Feng,et al.  Variability of Firing of Hodgkin-Huxley and FitzHugh-Nagumo Neurons with Stochastic Synaptic Input , 1999 .

[36]  Marius Usher,et al.  Network Amplification of Local Fluctuations Causes High Spike Rate Variability, Fractal Firing Patterns and Oscillatory Local Field Potentials , 1994, Neural Computation.

[37]  J. Buhmann,et al.  Associative memory with high information content. , 1989, Physical review. A, General physics.

[38]  S. Miyazaki,et al.  Behavior of solutions of the Hodgkin-Huxley equations and its relation to properties of mechanoreceptors. , 1975, Biophysical journal.

[39]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[40]  C. Carr,et al.  A time-comparison circuit in the electric fish midbrain. I. Behavior and physiology , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  Toshio Aoyagi,et al.  OSCILLATOR NEURAL NETWORK RETRIEVING SPARSELY CODED PHASE PATTERNS , 1999 .

[42]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[43]  M Shiino,et al.  Associative memory storing an extensive number of patterns based on a network of oscillators with distributed natural frequencies in the presence of external white noise. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[44]  Edmund T. Rolls,et al.  Time for retrieval in recurrent associative memories , 1997 .

[45]  D. Amit,et al.  Optimised network for sparsely coded patterns , 1989 .

[46]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[47]  T Kanamaru,et al.  Associative memory retrieval induced by fluctuations in a pulsed neural network. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[48]  Christof Koch,et al.  Cortical Cells Should Fire Regularly, But Do Not , 1999, Neural Computation.

[49]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[50]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[51]  Wulfram Gerstner,et al.  Associative memory in a network of ‘spiking’ neurons , 1992 .

[52]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.