A high-performance feedback neural network for solving convex nonlinear programming problems

Based on a new idea of successive approximation, this paper proposes a high-performance feedback neural network model for solving convex nonlinear programming problems. Differing from existing neural network optimization models, no dual variables, penalty parameters, or Lagrange multipliers are involved in the proposed network. It has the least number of state variables and is very simple in structure. In particular, the proposed network has better asymptotic stability. For an arbitrarily given initial point, the trajectory of the network converges to an optimal solution of the convex nonlinear programming problem under no more than the standard assumptions. In addition, the network can also solve linear programming and convex quadratic programming problems, and the new idea of a feedback network may be used to solve other optimization problems. Feasibility and efficiency are also substantiated by simulation examples.

[1]  Tamas Henk,et al.  Neural circuits for solving nonlinear programming problems , 1997 .

[2]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[3]  Mitsuo Gen,et al.  A modified ANN for convex programming with linear constraints , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[4]  Jun Wang,et al.  A general methodology for designing globally convergent optimization neural networks , 1998, IEEE Trans. Neural Networks.

[5]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[6]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[7]  I. N. da Silva,et al.  Nonlinear optimization using a modified Hopfield model , 1998 .

[8]  Michael A. Shanblatt,et al.  Improved Neural Networks For Linear and Nonlinear Programming , 1991, Int. J. Neural Syst..

[9]  Kwong-Sak Leung,et al.  A new gradient-based neural network for solving linear and quadratic programming problems , 2001, IEEE Trans. Neural Networks.

[10]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[11]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[12]  Klaus Schittkowski,et al.  Test examples for nonlinear programming codes , 1980 .

[13]  Roger Knott,et al.  Modern Applied Mathematics: Optimization and Operations Research , 1983 .

[14]  Shengwei Zhang,et al.  Lagrange programming neural networks , 1992 .

[15]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.