Distance-Based Sparse Associative Memory Neural Network Algorithm for Pattern Recognition

A sparse two-Dimension distance weighted approach for improving the performance of exponential correlation associative memory (ECAM) and modified exponential correlation associative memory (MECAM) is presented in this paper. The approach is inspired by biological visual perception mechanism and extensively existing sparse small-world network phenomenon. By means of the approach, the two new associative memory neural networks, i.e., distance-based sparse ECAM (DBS-ECAM) and distance-based sparse MECAM (DBS-MECAM), are induced by introducing both the decaying two-Dimension distance factor and small-world architecture into ECAM and MECAM’s evolution rule for image processing application. Such a new configuration can reduce the connection complexity of conventional fully connected associative memories so that makes AM’ VLSI implementation easier. More importantly, the experiments performed on the binary visual images show DBS-ECAM and DBS-MECAM can learn and recognize patterns more effectively than ECAM and MECAM, respectively.

[1]  Joaquín J. Torres,et al.  Influence of topology on the performance of a neural network , 2004, Neurocomputing.

[2]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[3]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[4]  Chung-Ping Kwong,et al.  Recurrent correlation associative memories with multiple-value , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[5]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[6]  Demetri Psaltis,et al.  Nonlinear discriminant functions and associative memories , 1987 .

[7]  Carl G. Looney,et al.  Pattern recognition using neural networks , 1997 .

[8]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[9]  John S. Denker,et al.  Neural Networks for Computing , 1998 .

[10]  Tzi-Dar Chiueh,et al.  Exponential bidirectional associative memories , 1990 .

[11]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[12]  Seong-Gon Kong,et al.  Block-based neural networks , 2001, IEEE Trans. Neural Networks.

[13]  Ali A. Minai,et al.  Efficient associative memory using small-world architecture , 2001, Neurocomputing.

[14]  Santosh S. Venkatesh.  Robustness in neural computation: Random graphs and sparsity , 1992, IEEE Trans. Inf. Theory.

[15]  Wei Yan,et al.  Improved exponential bidirectional associative memory , 1997 .

[16]  Tzi-Dar Chiueh,et al.  Multivalued associative memories based on recurrent networks , 1993, IEEE Trans. Neural Networks.

[17]  Beom Jun Kim.  Performance of networks of artificial neurons: the role of clustering. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .

[19]  Heng-Ming Tai,et al.  High-order bidirectional associative memory , 1989 .

[20]  Michael Menzinger,et al.  Topology and computational performance of attractor neural networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Vijayan K. Asari,et al.  Learning using distance based training algorithm for pattern recognition, , 2004, Pattern Recognit. Lett..

[22]  M. R. Sayeh,et al.  Pattern Recognition Using A Neural Network , 1988, Other Conferences.

[23]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Dembo,et al.  General potential surfaces and neural networks. , 1988, Physical review. A, General physics.

[25]  Rodney M. Goodman,et al.  Recurrent correlation associative memories , 1991, IEEE Trans. Neural Networks.

[26]  Amir Dembo,et al.  High Density Associative Memories , 1987, NIPS.