论文信息 - Associative storage and retrieval of highly correlated natural pattern sets in diluted Hopfield networks

Associative storage and retrieval of highly correlated natural pattern sets in diluted Hopfield networks

A model for the recognition of natural highly correlated video images is proposed. The problems of storing all patterns as individual attractors and of building classes are discussed. It is shown that a sparsely connected associative memory of the Hopfield type is able to fulfill both tasks. A design strategy for the construction of a suitable locally connected architecture is suggested, using a statistical analysis of an arbitrary given pattern set. The duality between learning and dilution is employed, and different learning respectively dilution schemes are discussed. The practical use and the efficiency of the model are shown in simulations of a large network (N=12288). A set of natural patterns with high interpattern correlations and a high site correlation within each pattern is used, in which the correlations are given and not constructed by special rules as for highly correlated random pattern sets.<<ETX>>

Klaus-Robert Müller | Herbert Janssen | Thomas Stiefvater

[1] Thomas B. Kepler,et al. Domains of attraction in neural networks , 1988 .

[2] E Gardner. Optimal basins of attraction in randomly sparse neural network models , 1989 .

[3] B. Forrest. Content-addressability and learning in neural networks , 1988 .

[4] A. Komoda,et al. Quenched versus annealed dilution in neural networks , 1990 .

[5] H. Horner. Neural networks with low levels of activity: Ising vs. McCulloch-Pitts neurons , 1989 .

[6] J. Buhmann,et al. Associative memory with high information content. , 1989, Physical review. A, General physics.

[7] Sompolinsky,et al. Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[8] D. Amit,et al. Statistical mechanics of neural networks near saturation , 1987 .

[9] E. Gardner. The space of interactions in neural network models , 1988 .

[10] Andrew Canning,et al. Partially connected models of neural networks , 1988 .

[11] Sompolinsky,et al. Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.