FPGA IMPLEMENTATION OF VERY LARGE ASSOCIATIVE MEMORIES Application to Automatic Speech Recognition

Associative networks have a number of properties, including a rapid, compute efficient best-match and intrinsic fault tolerance, that make them ideal for many applications. However, large networks can be slow to emulate because of their storage and bandwidth requirements. In this chapter we present a simple but effective model of association and then discuss a performance analysis we have done in implementing this model on a single high-end PC workstation, a PC cluster, and FPGA hardware.

[1]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[2]  Shaojuan Zhu,et al.  Simulation of associative neural networks , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[3]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[4]  Anthony Skjellum,et al.  Using MPI - portable parallel programming with the message-parsing interface , 1994 .

[5]  G. Palm,et al.  On associative memory , 2004, Biological Cybernetics.

[6]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[7]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[8]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Stephen M. Omohundro,et al.  Bumptrees for Efficient Function, Constraint and Classification Learning , 1990, NIPS.

[10]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[11]  Kenneth E. Batcher.  The Multidimensional Access Memory in STARAN , 1977, IEEE Transactions on Computers.

[12]  Anders Lansner,et al.  A Higher order Bayesian Neural Network with Spiking Units , 1996, Int. J. Neural Syst..

[13]  David J. Willshaw,et al.  Improving recall from an associative memory , 1995, Biological Cybernetics.

[14]  James A. Anderson,et al.  An Introduction To Neural Networks , 1998 .

[15]  Valentino Braitenberg,et al.  Brain Size and Number of Neurons: An Exercise in Synthetic Neuroanatomy , 2004, Journal of Computational Neuroscience.

[16]  David Willshaw,et al.  Performance characteristics of the associative net , 1992 .

[17]  Thomas L. Sterling,et al.  A design study of alternative network topologies for the Beowulf parallel workstation , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.