A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application

The design, analysis, and application of a new recurrent neural network for quadratic programming, called simplified dual neural network, are discussed. The analysis mainly concentrates on the convergence property and the computational complexity of the neural network. The simplified dual neural network is shown to be globally convergent to the exact optimal solution. The complexity of the neural network architecture is reduced with the number of neurons equal to the number of inequality constraints. Its application to k-winners-take-all (KWTA) operation is discussed to demonstrate how to solve problems with this neural network

[1]  Kiichi Urahama,et al.  K-winners-take-all circuit with O(N) complexity , 1995, IEEE Trans. Neural Networks.

[2]  M. Blumer,et al.  Azaarenes in Recent Marine Sediments , 1977, Science.

[3]  Ian Parberry,et al.  Circuit complexity and neural networks , 1994 .

[4]  John Hertz.  Computing with attractors , 1998 .

[5]  R. Fantacci,et al.  A neural network for constrained optimization with application to CDMA communication systems , 2003, IEEE Trans. Circuits Syst. II Express Briefs.

[6]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[7]  Youshen Xia,et al.  A new neural network for solving linear and quadratic programming problems , 1996, IEEE Trans. Neural Networks.

[8]  Jun Wang,et al.  A one-layer recurrent neural network for support vector machine learning , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[10]  Changyin Sun,et al.  On exponential stability of delayed neural networks with a general class of activation functions , 2002 .

[11]  B. Sekerkiran,et al.  A CMOS K-winners-take-all circuit with O(n) complexity , 1999 .

[12]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[13]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[14]  Corneliu A. Marinov,et al.  Performance analysis for a K-winners-take-all analog neural network: basic theory , 2003, IEEE Trans. Neural Networks.

[15]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[16]  Wolfgang Maass,et al.  On the Computational Power of Winner-Take-All , 2000, Neural Computation.

[17]  William J. Wolfe,et al.  K-winner networks , 1991, IEEE Trans. Neural Networks.

[18]  Mingqi Deng,et al.  Winner-take-all networks , 1992 .

[19]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[20]  Shengwei Zhang,et al.  Lagrange programming neural networks , 1992 .

[21]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[22]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[23]  Wolfgang Maass,et al.  Neural Computation with Winner-Take-All as the Only Nonlinear Operation , 1999, NIPS.

[24]  Shubao Liu,et al.  Blind adaptive multiuser detection using a recurrent neural network , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[25]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[26]  Stephen J. Wright.  Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[27]  Corneliu A. Marinov,et al.  Another K-winners-take-all analog neural network , 2000, IEEE Trans. Neural Networks Learn. Syst..

[28]  Hava T. Siegelmann,et al.  Neural networks and analog computation - beyond the Turing limit , 1999, Progress in theoretical computer science.

[29]  Jun Wang,et al.  A dual neural network for kinematic control of redundant robot manipulators , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[31]  Bernard Fino,et al.  Multiuser detection: , 1999, Ann. des Télécommunications.

[32]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[33]  Jun Wang.  Analogue winner-take-all neural networks for determining maximum and minimum signals , 1994 .

[34]  Corneliu A. Marinov,et al.  Stable computational dynamics for a class of circuits with O(N) interconnections capable of KWTA and rank extractions , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[35]  Jayadeva,et al.  A neural network with O(N) neurons for ranking N numbers in O(1/N) time , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[36]  Yunong Zhang,et al.  A dual neural network for convex quadratic programming subject to linear equality and inequality constraints , 2002 .

[37]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .