On neural networks that design neural associative memories

The design problem of generalized brain-state-in-a-box (GBSB) type associative memories is formulated as a constrained optimization program, and "designer" neural networks for solving the program in real time are proposed. The stability of the designer networks is analyzed using Barbalat's lemma. The analyzed and synthesized neural associative memories do not require symmetric weight matrices. Two types of the GBSB-based associative memories are analyzed, one when the network trajectories are constrained to reside in the hypercube [-1, 1](n) and the other type when the network trajectories are confined to stay in the hypercube [0, 1](n). Numerical examples and simulations are presented to illustrate the results obtained.

[1]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[2]  J. Farrell,et al.  Qualitative analysis of neural networks , 1989 .

[3]  A. Pierro,et al.  A simultaneous projections method for linear inequalities , 1985 .

[4]  R. Golden.  Stability and optimization analyses of the generalized brain-state-in-a-box neural network model , 1993 .

[5]  Stefen Hui,et al.  On solving constrained optimization problems with neural networks: a penalty method approach , 1993, IEEE Trans. Neural Networks.

[6]  Michael Peter Kennedy,et al.  Unifying the Tank and Hopfield linear programming circuit and the canonical nonlinear programming circuit of Chua and Lin , 1987 .

[7]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[8]  Lawrence P. Huelsman,et al.  Operational Amplifiers; Design and Applications , 1971 .

[9]  Stefen Hui,et al.  Synthesis of Brain-State-in-a-Box (BSB) based associative memories , 1994, IEEE Trans. Neural Networks.

[10]  Stefen Hui,et al.  Learning and Forgetting in Generalized Brain-state-in-a-box (BSB) Neural Associative Memories , 1996, Neural Networks.

[11]  Tao Wang,et al.  Improving recall in associative memories by dynamic threshold , 1994, Neural Networks.

[12]  Y. Censor,et al.  New methods for linear inequalities , 1982 .

[13]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[14]  T. Kailath,et al.  Discrete Neural Computation: A Theoretical Foundation , 1995 .

[15]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[16]  Stefen Hui,et al.  Dynamical analysis of the brain-state-in-a-box (BSB) neural models , 1992, IEEE Trans. Neural Networks.

[17]  Leon O. Chua,et al.  Cellular neural networks: Theory and circuit design , 1992, Int. J. Circuit Theory Appl..

[18]  A.N. Michel,et al.  Associative memories via artificial neural networks , 1990, IEEE Control Systems Magazine.

[19]  M. Fiedler,et al.  On matrices with non-positive off-diagonal elements and positive principal minors , 1962 .

[20]  S. Hui.  Dynamics and stability of the Brain-State-in-a-Box (BSB) neural models. , 1993 .

[21]  R. Perfetti.  A neural network to design neural networks , 1991 .