A Modified Spectral PRP Conjugate Gradient Projection Method for Solving Large-Scale Monotone Equations and Its Application in Compressed Sensing

In this paper, we develop an algorithm to solve nonlinear system of monotone equations, which is a combination of a modified spectral PRP (Polak-Ribiere-Polyak) conjugate gradient method and a projection method. The search direction in this algorithm is proved to be sufficiently descent for any line search rule. A line search strategy in the literature is modified such that a better step length is more easily obtained without the difficulty of choosing an appropriate weight in the original one. Global convergence of the algorithm is proved under mild assumptions. Numerical tests and preliminary application in recovering sparse signals indicate that the developed algorithm outperforms the state-of-the-art similar algorithms available in the literature, especially for solving large-scale problems and singular ones.

[1]  Zhong Wan,et al.  New spectral PRP conjugate gradient method for unconstrained optimization , 2011, Appl. Math. Lett..

[2]  Keyvan Amini,et al.  A double-projection-based algorithm for large-scale nonlinear systems of monotone equations , 2014, Numerical Algorithms.

[3]  Gonglin Yuan,et al.  A conjugate gradient algorithm for large-scale unconstrained optimization problems and nonlinear equations , 2018, Journal of Inequalities and Applications.

[4]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[5]  Yunhai Xiao,et al.  Non-smooth equations based method for l 1 -norm problems with applications to compressed sensing , 2011 .

[6]  Jośe Mario Martinez,et al.  A family of quasi-Newton methods for nonlinear equations with direct secant updates of matrix factorizations , 1990 .

[7]  Shengjie Li,et al.  A projection method for convex constrained monotone nonlinear equations with applications , 2015, Comput. Math. Appl..

[8]  Masao Fukushima,et al.  A Globally and Superlinearly Convergent Gauss-Newton-Based BFGS Method for Symmetric Nonlinear Equations , 1999, SIAM J. Numer. Anal..

[9]  Wanyou Cheng,et al.  A PRP type method for systems of monotone equations , 2009, Math. Comput. Model..

[10]  Yigui Ou,et al.  A new derivative-free SCG-type projection method for nonlinear monotone equations with convex constraints , 2018 .

[11]  Yunhai Xiao,et al.  A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing , 2013 .

[12]  Dong-Hui Li,et al.  A globally convergent derivative-free method for solving large-scale nonlinear monotone equations , 2010, J. Comput. Appl. Math..

[13]  Sanja Rapajić,et al.  FR type methods for systems of large-scale nonlinear monotone equations , 2015, Appl. Math. Comput..

[14]  Zhong Wan,et al.  A new nonmonotone spectral residual method for nonsmooth nonlinear equations , 2017, J. Comput. Appl. Math..

[15]  Mikhail V. Solodov,et al.  A Globally Convergent Inexact Newton Method for Systems of Monotone Equations , 1998 .

[16]  Marco Sciandrone,et al.  A Truncated Nonmonotone Gauss-Newton Method for Large-Scale Nonlinear Least-Squares Problems , 2006, Comput. Optim. Appl..

[17]  Yong Li,et al.  A Modified Hestenes and Stiefel Conjugate Gradient Algorithm for Large-Scale Nonsmooth Minimizations and Nonlinear Equations , 2015, Journal of Optimization Theory and Applications.

[18]  Weijun Zhou,et al.  A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence , 2006 .

[19]  José Mario Martínez,et al.  Spectral residual method without gradient information for solving large-scale nonlinear systems of equations , 2006, Math. Comput..

[20]  Weiyi Liu,et al.  A modified spectral conjugate gradient projection method for signal recovery , 2018, Signal, Image and Video Processing.

[21]  Liqun Qi,et al.  On the Convergence of a Trust-Region Method for Solving Constrained Nonlinear Equations with Degenerate Solutions , 2004 .

[22]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[23]  Masoud Ahookhosh,et al.  Two derivative-free projection approaches for systems of large-scale nonlinear monotone equations , 2013, Numerical Algorithms.

[24]  Maojun Zhang,et al.  A three-terms Polak-Ribière-Polyak conjugate gradient algorithm for large-scale nonlinear equations , 2015, J. Comput. Appl. Math..

[25]  Zhong Wan,et al.  Bi-level programming approach to optimal strategy for vendor-managed inventory problems under random demand , 2017 .

[26]  Qingna Li,et al.  A class of derivative-free methods for large-scale nonlinear monotone equations , 2011 .

[27]  Weijun Zhou,et al.  Spectral gradient projection method for solving nonlinear monotone equations , 2006 .