A hierarchical neural network model for associative memory

A hierarchical neural network model with feedback interconnections, which has the function of associative memory and the ability to recognize patterns, is proposed. The model consists of a hierarchical multi-layered network to which efferent connections are added, so as to make positive feedback loops in pairs with afferent connections. The cell-layer at the initial stage of the network is the input layer which receives the stimulus input and at the same time works as an output layer for associative recall. The deepest layer is the output layer for pattern-recognition. Pattern-recognition is performed hierarchically by integrating information by converging afferent paths in the network. For the purpose of associative recall, the integrated information is again distributed to lower-order cells by diverging efferent paths. These two operations progress simultaneously in the network. If a fragment of a training pattern is presented to the network which has completed its self-organization, the entire pattern will gradually be recalled in the initial layer. If a stimulus consisting of a number of training patterns superposed is presented, one pattern gradually becomes predominant in the recalled output after competition between the patterns, and the others disappear. At about the same time when the recalled pattern reaches a steady state in he initial layer, in the deepest layer of the network, a response is elicited from the cell corresponding to the category of the finally-recalled pattern. Once a steady state has been reached, the response of the network is automatically extinguished by inhibitory signals from a steadiness-detecting cell. If the same stimulus is still presented after inhibition, a response for another pattern, formerly suppressed, will now appear, because the cells of the network have adaptation characteristics which makes the same response unlikely to recur. Since inhibition occurs repeatedly, the superposed input patterns are recalled one by one in turn.

[1]  S. Kaplan.  The Physiology of Thought , 1950 .

[2]  N. Tsukahara.  The properties of the cerebello-pontine reverberating circuit. , 1972, Brain research.

[3]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[4]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[5]  J. Tigges,et al.  Reciprocal point‐to‐point connections between parastriate and striate cortex in the squirrel monkey (Saimiri) , 1973, The Journal of comparative neurology.

[6]  A. Kendon,et al.  Organization of behavior in face-to-face interaction , 1975 .

[7]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[9]  H. Akil,et al.  Behavioral neurochemistry: neuroregulators and behavioral states. , 1978, Science.

[10]  M. Wong-Riley.  Columnar cortico-cortical interconnections within the visual system of the squirrel and macaque monkeys , 1979, Brain Research.

[11]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[12]  Kunihiko Fukushima.  A hierarchical neural network model for associative memory , 1983 .

[13]  福島 邦彦,et al.  A Hierarchical Neural Network Model for Associative Memory , 1985 .

[14]  Kunihiko Fukushima,et al.  Cognitron: A self-organizing multilayered neural network , 1975, Biological Cybernetics.

[15]  H. Wigström,et al.  A model of a neural network with recurrent inhibition , 2004, Kybernetik.

[16]  Gerd Willwacher,et al.  Storage of a temporal pattern sequence in a network , 2004, Biological Cybernetics.

[17]  Kunihiko Fukushima,et al.  A model of associative memory in the brain , 1973, Kybernetik.

[18]  K. Fukushima,et al.  A self-organizing neural network with a function of associative memory: Feedback-type cognitron , 2004, Biological Cybernetics.

[19]  Jack W. Silverstein,et al.  Asymptotics applied to a neural network , 1976, Biological Cybernetics.

[20]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[21]  Philip R. Westlake,et al.  The possibilities of neural holographic processes within the brain , 1970, Kybernetik.