A Generalized Global Convergence Theory of Projection-Type Neural Networks for Optimization

The projection-type neural networks $\tau \frac{dx}{dt}=-x+P_{\Omega }(x-\Lambda (t)\partial ^{0}E(x))$are generic and useful models for solving the constrained optimization problems min {E(x)|x∈Ω}. In the existing convergence/ stability analysis, the most are deduced based on the assumptions that E is uniformly or strictly convex and Ω is box-shaped. In this talk we present a generalized theory on convergence/stability of the networks. In the general setting that E is only convex and Ω is any closed bounded convex set, it is shown the global convergence/asymptotic stability of the networks in a specified sense. The presented theory sharpens and generalizes the existing results, and, consequently, underlies the applicability of the neural networks for a broader type of optimization problems.

[1]  Jun Wang,et al.  A general projection neural network for solving monotone variational inequalities and related optimization problems , 2004, IEEE Transactions on Neural Networks.

[2]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[3]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[4]  Tsuneo Yoshikawa,et al.  Foundations of Robotics: Analysis and Control , 1990 .

[5]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[6]  Cornelius T. Leondes,et al.  Neural network systems techniques and applications , 1998 .

[7]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[8]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[9]  Abdesselam Bouzerdoum,et al.  Neural network for quadratic optimization with bound constraints , 1993, IEEE Trans. Neural Networks.

[10]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[11]  Jun Wang,et al.  A recurrent neural network for nonlinear optimization with a continuously differentiable objective function and bound constraints , 2000, IEEE Trans. Neural Networks Learn. Syst..