A novel neural network for variational inequalities with linear and nonlinear constraints

Variational inequality is a uniform approach for many important optimization and equilibrium problems. Based on the sufficient and necessary conditions of the solution, this paper presents a novel neural network model for solving variational inequalities with linear and nonlinear constraints. Three sufficient conditions are provided to ensure that the proposed network with an asymmetric mapping is stable in the sense of Lyapunov and converges to an exact solution of the original problem. Meanwhile, the proposed network with a gradient mapping is also proved to be stable in the sense of Lyapunov and to have a finite-time convergence under some mild conditions by using a new energy function. Compared with the existing neural networks, the new model can be applied to solve some nonmonotone problems, has no adjustable parameter, and has lower complexity. Thus, the structure of the proposed network is very simple. Since the proposed network can be used to solve a broad class of optimization problems, it has great application potential. The validity and transient behavior of the proposed neural network are demonstrated by several numerical examples.

[1]  L. Liao,et al.  A neural network for a class of convex quadratic minimax problems with constraints , 2004, IEEE Transactions on Neural Networks.

[2]  B. He.  A class of projection and contraction methods for monotone variational inequalities , 1997 .

[3]  Terry L. Friesz,et al.  Day-To-Day Dynamic Network Disequilibria and Idealized Traveler Information Systems , 1994, Oper. Res..

[4]  Bingsheng He,et al.  A modified alternating direction method for convex minimization problems , 2000, Appl. Math. Lett..

[5]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[6]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[7]  Li-Zhi Liao,et al.  Solving nonlinear complementarity problems with neural networks: a reformulation method approach , 2001 .

[8]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[9]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[10]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[11]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[12]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[13]  H. K. Lo,et al.  New Alternating Direction Method for a Class of Nonlinear Variational Inequality Problems , 2002 .

[14]  Jun Wang,et al.  Global asymptotic and exponential stability of a dynamic neural system with asymmetric connection weights , 2001, IEEE Trans. Autom. Control..

[15]  Liqun Qi,et al.  Stability Analysis of Gradient-Based Neural Networks for Optimization Problems , 2001, J. Glob. Optim..

[16]  Christakis Charalambous,et al.  Nonlinear leastpth optimization and nonlinear programming , 1977, Math. Program..

[17]  Xing-Bao Gao,et al.  Exponential stability of globally projected dynamic systems , 2003, IEEE Trans. Neural Networks.

[18]  L. Liao,et al.  A neural network for monotone variational inequalities with linear constraints , 2003 .

[19]  Xing-Bao Gao,et al.  A novel neural network for nonlinear convex programming , 2004, IEEE Trans. Neural Networks.

[20]  Abdesselam Bouzerdoum,et al.  Neural network for quadratic optimization with bound constraints , 1993, IEEE Trans. Neural Networks.

[21]  Jun Wang,et al.  A general methodology for designing globally convergent optimization neural networks , 1998, IEEE Trans. Neural Networks.

[22]  Bingsheng He.  Solution and applications of a class of general linear variational inequalities , 1996 .

[23]  Masao Fukushima,et al.  Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems , 1992, Math. Program..

[24]  R. Rockafellar.  Linear-quadratic programming and optimal control , 1987 .

[25]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[26]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[27]  L. Liao,et al.  Improvements of Some Projection Methods for Monotone Nonlinear Variational Inequalities , 2002 .