A one-layer recurrent neural network for convex programming

This paper presents a one-layer recurrent neural network for solving convex programming problems subject to linear equality and nonnegativity constraints. The number of neurons in the neural network is equal to that of decision variables in the optimization problem. Compared with the existing neural networks for optimization, the proposed neural network has lower model complexity. Moreover, the proposed neural network is proved to be globally convergent to the optimal solution(s) under some mild conditions. Simulation results show the effectiveness and performance of the proposed neural network.

[1]  Hector A. Rosales-Macedo.  Nonlinear Programming: Theory and Algorithms (2nd Edition) , 1993 .

[2]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[3]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[4]  M. Forti,et al.  Generalized Lyapunov approach for convergence of neural networks with discontinuous or non-Lipschitz activations , 2006 .

[5]  Stephen J. Wright.  Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[6]  Tianping Chen,et al.  Dynamical Behaviors of Delayed Neural Network Systems with Discontinuous Activation Functions , 2006, Neural Computation.

[7]  Youshen Xia,et al.  A new neural network for solving linear and quadratic programming problems , 1996, IEEE Trans. Neural Networks.

[8]  Shiji Song,et al.  A Neural Network Model for Non-smooth Optimization over a Compact Convex Subset , 2006, ISNN.

[9]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[10]  Jun Wang,et al.  A general methodology for designing globally convergent optimization neural networks , 1998, IEEE Trans. Neural Networks.

[11]  Yunong Zhang,et al.  A dual neural network for convex quadratic programming subject to linear equality and inequality constraints , 2002 .

[12]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[13]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[14]  Jun Wang.  Analysis and design of a recurrent neural network for linear programming , 1993 .

[15]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[16]  Tianping Chen,et al.  Dynamical behaviors of Cohen-Grossberg neural networks with discontinuous activation functions , 2005, Neural Networks.

[17]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[18]  Jinde Cao,et al.  A high performance neural network for solving nonlinear programming problems with hybrid constraints , 2001 .

[19]  Jun Wang,et al.  A dual neural network for kinematic control of redundant robot manipulators , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Michael A. Shanblatt,et al.  Linear and quadratic programming neural network analysis , 1992, IEEE Trans. Neural Networks.

[21]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[22]  M. Forti,et al.  Global convergence of neural networks with discontinuous neuron activations , 2003 .

[23]  Jinde Cao,et al.  Solving Quadratic Programming Problems by Delayed Projection Neural Network , 2006, IEEE Transactions on Neural Networks.

[24]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[25]  Jun Wang,et al.  A recurrent neural network for nonlinear optimization with a continuously differentiable objective function and bound constraints , 2000, IEEE Trans. Neural Networks Learn. Syst..

[26]  J. Aubin,et al.  Differential inclusions set-valued maps and viability theory , 1984 .

[27]  Mauro Forti,et al.  Generalized neural network for nonsmooth nonlinear programming problems , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[28]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .