Wei–Yao–Liu conjugate gradient projection algorithm for nonlinear monotone equations with convex constraints

In this paper, the Wei–Yao–Liu (WYL) conjugate gradient projection algorithm will be studied for nonlinear monotone equations with convex constraints, which can be viewed as an extension of the WYL conjugate gradient method for solving unconstrained optimization problems. These methods can be applied to solving large-scale nonlinear equations due to the low storage requirement. We can obtain global convergence of our algorithm without requiring differentiability in the case that the equation is Lipschitz continuous. The numerical results show that the new algorithm is efficient.

[1]  Qingna Li,et al.  A class of derivative-free methods for large-scale nonlinear monotone equations , 2011 .

[2]  Jorge J. Moré,et al.  Benchmarking optimization software with performance profiles , 2001, Math. Program..

[3]  Guoyin Li,et al.  A modified Polak-Ribière-Polyak conjugate gradient algorithm for nonsmooth convex programs , 2014, J. Comput. Appl. Math..

[4]  Li Zhang,et al.  An improved Wei-Yao-Liu nonlinear conjugate gradient method for optimization computation , 2009, Appl. Math. Comput..

[5]  Jorge Nocedal,et al.  Global Convergence Properties of Conjugate Gradient Methods for Optimization , 1992, SIAM J. Optim..

[6]  M. V. Solodovy,et al.  Newton-type Methods with Generalized Distances For Constrained Optimization , 1997 .

[7]  E. H. Zarantonello.  Projections on Convex Sets in Hilbert Space and Spectral Theory: Part I. Projections on Convex Sets: Part II. Spectral Theory , 1971 .

[8]  Mikhail V. Solodov,et al.  A Globally Convergent Inexact Newton Method for Systems of Monotone Equations , 1998 .

[9]  Chuanwei Wang,et al.  A projection method for a system of nonlinear monotone equations with convex constraints , 2007, Math. Methods Oper. Res..

[10]  Li Zhang,et al.  Further studies on the Wei-Yao-Liu nonlinear conjugate gradient method , 2013, Appl. Math. Comput..

[11]  Zengxin Wei,et al.  The proof of the sufficient descent condition of the Wei-Yao-Liu conjugate gradient method under the strong Wolfe-Powell line search , 2007, Appl. Math. Comput..

[12]  W. Hager,et al.  A SURVEY OF NONLINEAR CONJUGATE GRADIENT METHODS , 2005 .

[13]  Yunhai Xiao,et al.  Spectral gradient projection method for monotone nonlinear equations with convex constraints , 2009 .

[14]  Gonglin Yuan,et al.  A Modified Hestenes-Stiefel Conjugate Gradient Algorithm for Large-Scale Optimization , 2013 .

[15]  Jianhua Ma,et al.  Multivariate spectral gradient projection methodfor nonlinear monotone equations with convex constraints , 2012 .

[16]  José Mario Martínez,et al.  Comparing Algorithms for Solving Sparse Nonlinear Systems of Equations , 1992, SIAM J. Sci. Comput..

[17]  Lian Zheng.  A NEW PROJECTION ALGORITHM FOR SOLVING A SYSTEM OF NONLINEAR EQUATIONS WITH CONVEX CONSTRAINTS , 2013 .

[18]  R. D. Murphy,et al.  Iterative solution of nonlinear equations , 1994 .

[19]  Zengxin Wei,et al.  A note about WYL's conjugate gradient method and its applications , 2007, Appl. Math. Comput..

[20]  Yunhai Xiao,et al.  A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing , 2013 .

[21]  Masao Fukushima,et al.  Modified Newton methods for solving a semismooth reformulation of monotone complementarity problems , 1996, Math. Program..

[22]  Marcos Raydan,et al.  The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem , 1997, SIAM J. Optim..

[24]  N. Xiu,et al.  Convergence Properties of Projection and Contraction Methods for Variational Inequality Problems , 2001 .

[25]  Fengming Ma,et al.  Modified projection method for solving a system of monotone equations with convex constraints , 2010 .

[26]  Zhongbo Sun,et al.  Another hybrid conjugate gradient method and its global convergence for unconstrained optimization , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[27]  Gaohang Yu.  A derivative-free method for solving large-scale nonlinearsystems of equations , 2009 .

[28]  Bernd Eggers,et al.  Nonlinear Functional Analysis And Its Applications , 2016 .

[29]  Alexander P. Morgan,et al.  Chemical equilibrium systems as numerical test problems , 1990, TOMS.

[30]  Liying Liu,et al.  The convergence properties of some new conjugate gradient methods , 2006, Appl. Math. Comput..

[31]  E. Zeidler.  Nonlinear Functional Analysis and Its Applications: II/ A: Linear Monotone Operators , 1989 .

[32]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[33]  Zengxin Wei,et al.  Some global convergence properties of the Wei-Yao-Liu conjugate gradient method with inexact line search , 2011, Appl. Math. Comput..