Associative Memory Design Using Support Vector Machines

The relation existing between support vector machines (SVMs) and recurrent associative memories is investigated. The design of associative memories based on the generalized brain-state-in-a-box (GBSB) neural model is formulated as a set of independent classification tasks which can be efficiently solved by standard software packages for SVM learning. Some properties of the networks designed in this way are evidenced, like the fact that surprisingly they follow a generalized Hebb's law. The performance of the SVM approach is compared to existing methods with nonsymmetric connections, by some design examples

[1]  Derong Liu,et al.  A new synthesis approach for feedback neural networks based on the perceptron training algorithm , 1997, IEEE Trans. Neural Networks.

[2]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[3]  Stanislaw H. Zak,et al.  On neural networks that design neural associative memories , 1997, IEEE Trans. Neural Networks.

[4]  Stefen Hui,et al.  Dynamical analysis of the brain-state-in-a-box (BSB) neural models , 1992, IEEE Trans. Neural Networks.

[5]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[6]  R. Perfetti.  A neural network to design neural networks , 1991 .

[7]  A.N. Michel,et al.  Associative memories via artificial neural networks , 1990, IEEE Control Systems Magazine.

[8]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[9]  A. M. Youssef,et al.  Autoassociative neural memory capacity and dynamics , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[10]  Mohamad H. Hassoun,et al.  High Performance Recording Algorithm For Hopfield Model Associative Memories , 1989 .

[11]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[12]  Stefen Hui,et al.  Synthesis of Brain-State-in-a-Box (BSB) based associative memories , 1994, IEEE Trans. Neural Networks.

[13]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[14]  Renzo Perfetti,et al.  A synthesis procedure for brain-state-in-a-box neural networks , 1995, IEEE Trans. Neural Networks.

[15]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Gert Cauwenberghs,et al.  Kerneltron: support vector "machine" in silicon , 2003, IEEE Trans. Neural Networks.