Autoassociative memory retrieval and spontaneous activity bumps in small-world networks of integrate-and-fire neurons

The metric structure of synaptic connections is obviously an important factor in shaping the properties of neural networks, in particular the capacity to retrieve memories, with which are endowed autoassociative nets operating via attractor dynamics. Qualitatively, some real networks in the brain could be characterized as 'small worlds', in the sense that the structure of their connections is intermediate between the extremes of an orderly geometric arrangement and of a geometry-independent random mesh. Small worlds can be defined more precisely in terms of their mean path length and clustering coefficient; but is such a precise description useful for a better understanding of how the type of connectivity affects memory retrieval? We have simulated an autoassociative memory network of integrate-and-fire units, positioned on a ring, with the network connectivity varied parametrically between ordered and random. We find that the network retrieves previously stored memory patterns when the connectivity is close to random, and displays the characteristic behavior of ordered nets (localized 'bumps' of activity) when the connectivity is close to ordered. Recent analytical work shows that these two behaviors can coexist in a network of simple threshold-linear units, leading to localized retrieval states. We find that they tend to be mutually exclusive behaviors, however, with our integrate-and-fire units. Moreover, the transition between the two occurs for values of the connectivity parameter which are not simply related to the notion of small worlds.

[1]  Matthieu De Beule,et al.  Small Worlds: The Dynamics of Networks between Order and Randomness , 1999 .

[2]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[3]  Alessandro Treves,et al.  An associative network with spatially organized connectivity , 2004 .

[4]  E Bienenstock,et al.  On the dimensionality of cortical graphs , 1996, Journal of Physiology-Paris.

[5]  Alessandro Treves,et al.  Localized activity profiles and storage capacity of rate-based autoassociative networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Nicolas Brunel,et al.  Dynamics of a recurrent network of spiking neurons before and following learning , 1997 .

[7]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[8]  Guillermo Abramson,et al.  Associative memory on a small-world neural network , 2003, nlin/0310033.

[9]  Alessandro Treves,et al.  Attractor neural networks storing multiple space representations: A model for hippocampal place fields , 1998, cond-mat/9807101.

[10]  A. Treves.  Mean-field analysis of neuronal spike dynamics , 1993 .

[11]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[12]  Ali A. Minai,et al.  Efficient associative memory using small-world architecture , 2001, Neurocomputing.

[13]  Béla Bollobás,et al.  Random Graphs , 1985 .

[14]  Alessandro Treves,et al.  Stable and Rapid Recurrent Processing in Realistic Autoassociative Memories , 1998, Neural Computation.

[15]  Michael Menzinger,et al.  Topology and computational performance of attractor neural networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Alessandro Treves,et al.  Computational Constraints that may have Favoured the Lamination of Sensory Cortex , 2003, Journal of Computational Neuroscience.

[17]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .

[18]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[19]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[20]  E. Gardner,et al.  An Exactly Solvable Asymmetric Neural Network Model , 1987 .