An Iterative Incremental Learning Algorithm for Complex-Valued Hopfield Associative Memory

This paper discusses a complex-valued Hopfield associative memory with an iterative incremental learning algorithm. The mathematical proofs derive that the weight matrix is approximated as a weight matrix by the complex-valued pseudo inverse algorithm. Furthermore, the minimum number of iterations for the learning sequence is defined with maintaining the network stability. From the result of simulation experiment in terms of memory capacity and noise tolerance, the proposed model has the superior ability than the model with a complex-valued pseudo inverse learning algorithm.

[1]  Masaki Kobayashi,et al.  Complex-valued Multidirectional Associative Memory , 2005 .

[2]  Nobuyuki Matsui,et al.  An iterative learning scheme for multistate complex-valued and quaternionic Hopfield neural networks , 2009, 2009 International Joint Conference on Neural Networks.

[3]  Blatt,et al.  Neural networks: A local learning prescription for arbitrary correlated patterns. , 1991, Physical review letters.

[4]  Masafumi Hagiwara.  Multidirectional associative memory , 1990 .

[5]  W. Krauth,et al.  Learning algorithms with optimal stability in neural networks , 1987 .

[6]  Amos J. Storkey,et al.  The basins of attraction of a new Hopfield learning rule , 1999, Neural Networks.

[7]  Naresh K. Sinha,et al.  Regression and the Moore-Penrose pseudoinverse : Arthur Albert. 180 pages, diagrams, 6 × 9 in. New York, London, Academic Press, 1972. Price not available. , 1974 .

[8]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[9]  Bart Kosko.  Constructing an associative memory , 1987 .

[10]  Mounir Boukadoum,et al.  A bidirectional heteroassociative memory for binary and grey-level patterns , 2006, IEEE Transactions on Neural Networks.

[11]  D.-L. Lee,et al.  Improvements of Complex-Valued Hopfield Associative Memory by Using Generalized Projection Rules , 2006, IEEE Transactions on Neural Networks.

[12]  E. Gardner,et al.  Optimal basins of attraction in randomly sparse neural network models , 1989 .

[13]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[14]  Opper,et al.  Learning of correlated patterns in spin-glass networks by local learning rules. , 1987, Physical review letters.