A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

In this paper, based on the three-term conjugate gradient method and the hybrid technique, we propose a hybrid three-term conjugate gradient projection method by incorporating the adaptive line search for solving large-scale nonlinear monotone equations with convex constraints. The search direction generated by the proposed method is close to the one yielded by the memoryless BFGS method, and has the sufficient descent property and the trust region property independent of line search technique. Under some mild conditions, we establish the global convergence of the proposed method. Our numerical experiments show the effectiveness and robustness of the proposed method in comparison with two existing algorithms in the literature. Moreover, we show applicability and encouraging efficiency of the proposed method by extending it to solve sparse signal restoration and image de-blurring problems.

[1]  J. Nocedal.  Updating Quasi-Newton Matrices With Limited Storage , 1980 .

[2]  Chuanwei Wang,et al.  A projection method for a system of nonlinear monotone equations with convex constraints , 2007, Math. Methods Oper. Res..

[3]  Yunhai Xiao,et al.  Spectral gradient projection method for monotone nonlinear equations with convex constraints , 2009 .

[4]  Weijun Zhou,et al.  Spectral gradient projection method for solving nonlinear monotone equations , 2006 .

[5]  Marcos Raydan,et al.  Nonmonotone Spectral Methods for Large-Scale Nonlinear Systems , 2003, Optim. Methods Softw..

[6]  Qingna Li,et al.  A class of derivative-free methods for large-scale nonlinear monotone equations , 2011 .

[7]  Chuanjiang He,et al.  An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints , 2018, Calcolo.

[8]  Jinbao Jian,et al.  A hybrid conjugate gradient method with descent property for unconstrained optimization , 2015 .

[9]  Bingsheng He,et al.  On the O(1/t) convergence rate of the projection and contraction methods for variational inequalities with Lipschitz continuous monotone operators , 2013, Computational Optimization and Applications.

[10]  D. Luenberger,et al.  Self-Scaling Variable Metric (SSVM) Algorithms , 1974 .

[11]  Yunhai Xiao,et al.  Non-smooth equations based method for l 1 -norm problems with applications to compressed sensing , 2011 .

[12]  Min Li,et al.  A modified Hestense–Stiefel conjugate gradient method close to the memoryless BFGS quasi-Newton method , 2018, Optim. Methods Softw..

[13]  David F. Shanno,et al.  Conjugate Gradient Methods with Inexact Searches , 1978, Math. Oper. Res..

[14]  Mingyang Sun,et al.  A Class of Derivative-Free CG Projection Methods for Nonsmooth Equations with an Application to the LASSO Problem , 2020, Bulletin of the Iranian Mathematical Society.

[15]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[16]  Hassan Mohammad,et al.  A Two-Step Spectral Gradient Projection Method for System of Nonlinear Monotone Equations and Image Deblurring Problems , 2020, Symmetry.

[17]  Yunhai Xiao,et al.  A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing , 2013 .

[18]  Poom Kumam,et al.  A hybrid conjugate gradient algorithm for constrained monotone equations with application in compressive sensing , 2020, Heliyon.

[20]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[21]  Jong-Shi Pang,et al.  Inexact Newton methods for the nonlinear complementarity problem , 1986, Math. Program..

[22]  Duan Li,et al.  Monotonicity of Fixed Point and Normal Mappings Associated with Variational Inequality and Its Application , 2000, SIAM J. Optim..

[23]  S. J. Li,et al.  A self-adaptive three-term conjugate gradient method for monotone nonlinear equations with convex constraints , 2016 .

[24]  S. Dirkse,et al.  Mcplib: a collection of nonlinear mixed complementarity problems , 1995 .

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Min Li.  A family of three-term nonlinear conjugate gradient methods close to the memoryless BFGS method , 2018, Optim. Lett..

[27]  L. Nazareth.  A conjugate direction algorithm without line searches , 1977 .

[28]  Yunhai Xiao,et al.  A class of conjugate gradient methods for convex constrained monotone equations , 2017 .

[29]  Dong Liang,et al.  Optimal weighted upwind finite volume method for convection-diffusion equations in 2D , 2019, J. Comput. Appl. Math..

[30]  Poom Kumam,et al.  A descent Dai-Liao conjugate gradient method for nonlinear equations , 2018, Numerical Algorithms.

[31]  Weijun Zhou,et al.  A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence , 2006 .

[32]  Min Sun,et al.  New hybrid conjugate gradient projection method for the convex constrained equations , 2016 .

[33]  Xin-Fang Zhang,et al.  The strong convergence theorems for split common fixed point problem ofasymptotically nonexpansive mappings in Hilbert spaces , 2015 .

[34]  Hassan Mohammad,et al.  A descent derivative-free algorithm for nonlinear monotone equations with convex constraints , 2020, RAIRO Oper. Res..

[35]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[36]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[37]  Yuming Feng,et al.  A derivative-free iterative method for nonlinear monotone equations with convex constraints , 2018, Numerical Algorithms.

[38]  Hassan Mohammad,et al.  A note on the spectral gradient projection method for nonlinear monotone equations with applications , 2020, Comput. Appl. Math..