Coexistence of memory patterns and mixed states in a sparsely encoded associative memory model storing ultrametric patterns

Abstract.Analyzing the coexistence of memory patterns and mixed states gives important information for constructing a model for the face responsive neurons of the monkey inferior-temporal cortex. We analyzed whether the memory patterns coexist with mixed states when the sparse coding scheme is used for the associative memory model storing ultrametric patterns. For memory patterns and mixed states to coexist, there must be sufficient capacity for storing them and their threshold values must be the same. We determined that the storage capacities for all mixed states composed of correlated memory patterns diverge as 1/|flogf| (where f is the firing rate) even when the correlation of the memory patterns is infinitesimally small. We also determined that the memory patterns and the mixed states can become the equilibrium state of the model in the same threshold value. These results mean that they can coexist in this model. These findings should contribute to research on face responsive neurons in the monkey inferior-temporal cortex.

[1]  N Brunel,et al.  Correlations of cortical Hebbian reverberations: theory versus experiment , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Masato Okada,et al.  Mixed state on a sparsely encoded associative memory model , 1999, Biological Cybernetics.

[3]  Shun-ichi Amari,et al.  Characteristics of sparsely encoded associative memory , 1989, Neural Networks.

[4]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[5]  Barry J. Richmond,et al.  Information flow and temporal coding in primate pattern vision , 1995, Journal of Computational Neuroscience.

[6]  N Matsumoto.  Dynamics of the face-responsive neurons in the temporal cortex , 2000 .

[7]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[8]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[10]  Masato Okada,et al.  Notions of Associative Memory and Sparse Coding , 1996, Neural Networks.

[11]  Masato Okada,et al.  Mixed states on neural network with structural learning , 2004, Neural Networks.

[12]  José F. Fontanari,et al.  Generalization in a Hopfield network , 1990 .

[13]  Néstor Parga,et al.  A recurrent model of transformation invariance by association , 2000, Neural Networks.

[14]  Néstor Parga,et al.  Transform-Invariant Recognition by Association in a Recurrent Network , 1998, Neural Computation.

[15]  Yoshiyuki Kabashima,et al.  Bistability of mixed states in a neural network storing hierarchical patterns , 2000 .

[16]  J. Buhmann,et al.  Associative memory with high information content. , 1989, Physical review. A, General physics.

[17]  M. Shiino,et al.  Self-consistent signal-to-noise analysis and its application to analogue neural networks with asymmetric connections , 1992 .

[18]  D. Amit,et al.  Optimised network for sparsely coded patterns , 1989 .

[19]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[20]  Daniel J. Amit,et al.  Conversion of Temporal Correlations Between Stimuli to Spatial Correlations Between Attractors , 1999, Neural Computation.

[21]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.