Solving Pseudomonotone Variational Inequalities and Pseudoconvex Optimization Problems Using the Projection Neural Network

In recent years, a recurrent neural network called projection neural network was proposed for solving monotone variational inequalities and related convex optimization problems. In this paper, we show that the projection neural network can also be used to solve pseudomonotone variational inequalities and related pseudoconvex optimization problems. Under various pseudomonotonicity conditions and other conditions, the projection neural network is proved to be stable in the sense of Lyapunov and globally convergent, globally asymptotically stable, and globally exponentially stable. Since monotonicity is a special case of pseudomononicity, the projection neural network can be applied to solve a broader class of constrained optimization problems related to variational inequalities. Moreover, a new concept, called componentwise pseudomononicity, different from pseudomononicity in general, is introduced. Under this new concept, two stability results of the projection neural network for solving variational inequalities are also obtained. Finally, numerical examples show the effectiveness and performance of the projection neural network

[1]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[2]  P. Hartman.  Ordinary Differential Equations , 1965 .

[3]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[4]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[5]  Hector A. Rosales-Macedo.  Nonlinear Programming: Theory and Algorithms (2nd Edition) , 1993 .

[6]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[7]  L. Vandenberghe,et al.  The generalized linear complementarity problem applied to the complete analysis of resistive piecewise-linear circuits , 1989 .

[8]  Xue-Bin Liang,et al.  Global exponential stability of neural networks with globally Lipschitz continuous activations and its application to linear variational inequality problem , 2001, IEEE Trans. Neural Networks.

[9]  Naihua Xiu,et al.  Unified Framework of Extragradient-Type Methods for Pseudomonotone Variational Inequalities , 2001 .

[10]  吉川 恒夫,et al.  Foundations of robotics : analysis and control , 1990 .

[11]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[12]  Masao Fukushima,et al.  Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems , 1992, Math. Program..

[13]  Tsuneo Yoshikawa,et al.  A New End-effector for On-orbit Assembly of a Large Reflector , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[14]  Xiaolin Hu,et al.  Global stability of a recurrent neural network for solving pseudomonotone variational inequalities , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[15]  N. El Farouq,et al.  Pseudomonotone variational inequalities: convergence of proximal methods , 2001 .

[16]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[17]  Y. Xia,et al.  Further Results on Global Convergence and Stability of Globally Projected Dynamical Systems , 2004 .

[18]  Jun Wang,et al.  On the Stability of Globally Projected Dynamical Systems , 2000 .

[19]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[20]  P. Tseng,et al.  Modified Projection-Type Methods for Monotone Variational Inequalities , 1996 .

[21]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[22]  G. Mitra.  Variational Inequalities and Complementarity Problems — Theory and Application , 1980 .

[23]  Jong-Shi Pang,et al.  NE/SQP: A robust algorithm for the nonlinear complementarity problem , 1993, Math. Program..

[24]  Terry L. Friesz,et al.  Day-To-Day Dynamic Network Disequilibria and Idealized Traveler Information Systems , 1994, Oper. Res..

[25]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[26]  S. Karamardian,et al.  Seven kinds of monotone maps , 1990 .

[27]  Muhammad Aslam Noor.  Modified projection method for pseudomonotone variational inequalities , 2002, Appl. Math. Lett..

[28]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[29]  Torbjörn Larsson,et al.  A class of gap functions for variational inequalities , 1994, Math. Program..

[30]  Jean-Pierre Crouzeix,et al.  On the Pseudoconvexity of a Quadratic Fractional Function , 2002 .

[31]  Muhammad Aslam Noor,et al.  Implicit dynamical systems and quasi variational inequalities , 2003, Appl. Math. Comput..

[32]  Siegfried Schaible,et al.  On strong pseudomonotonicity and (semi)strict quasimonotonicity , 1993 .

[33]  Youshen Xia,et al.  A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[34]  Jun Wang,et al.  A recurrent neural network for solving linear projection equations , 2000, Neural Networks.

[35]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[36]  Xiaoming Yuan,et al.  An approximate proximal-extragradient type method for monotone variational inequalities , 2004 .

[37]  Rekha Govil,et al.  Neural Networks in Signal Processing , 2000 .

[38]  Edgar Sanchez-Sinencio,et al.  Nonlinear switched capacitor 'neural' networks for optimization problems , 1990 .

[39]  Michael C. Ferris,et al.  Engineering and Economic Applications of Complementarity Problems , 1997, SIAM Rev..