A diagonal PRP-type projection method for convex constrained nonlinear monotone equations

Iterative methods for nonlinear monotone equations do not require the differentiability assumption on the residual function. This special property of the methods makes them suitable for solving large-scale nonsmooth monotone equations. In this work, we present a diagonal Polak-Ribeire-Polyk (PRP) conjugate gradient-type method for solving large-scale nonlinear monotone equations with convex constraints. The search direction is a combine form of a multivariate (diagonal) spectral method and a modified PRP conjugate gradient method. Proper safeguards are devised to ensure positive definiteness of the diagonal matrix associated with the search direction. Based on Lipschitz continuity and monotonicity assumptions the method is shown to be globally convergent. Numerical results are presented by means of comparative experiments with a recently proposed multivariate spectral conjugate gradient-type method.

[1]  Lingling Xu,et al.  Solving Nonadditive Traffic Assignment Problems: A Self-Adaptive Projection-Auxiliary Problem Method for Variational Inequalities , 2012 .

[2]  Yigui Ou,et al.  A new derivative-free SCG-type projection method for nonlinear monotone equations with convex constraints , 2018 .

[3]  Fei Wang,et al.  A PRP-based residual method for large-scale monotone nonlinear equations , 2015, Appl. Math. Comput..

[4]  Shengjie Li,et al.  A projection method for convex constrained monotone nonlinear equations with applications , 2015, Comput. Math. Appl..

[5]  Poom Kumam,et al.  A descent Dai-Liao conjugate gradient method for nonlinear equations , 2018, Numerical Algorithms.

[6]  Allen J. Wood,et al.  Power Generation, Operation, and Control , 1984 .

[7]  Hassan Mohammad,et al.  A Positive Spectral Gradient-Like Method For Large-Scale Nonlinear Monotone Equations , 2017 .

[8]  San-yang Liu,et al.  Sufficient Descent Conjugate Gradient Methods for Solving Convex Constrained Nonlinear Monotone Equations , 2014 .

[9]  Sanja Rapajić,et al.  FR type methods for systems of large-scale nonlinear monotone equations , 2015, Appl. Math. Comput..

[10]  Min Sun,et al.  Three derivative-free projection methods for nonlinear equations with convex constraints , 2015 .

[11]  Hongwei Liu,et al.  Some nonlinear conjugate gradient methods with sufficient descent condition and global convergence , 2015, Optim. Lett..

[12]  William La Cruz.  A spectral algorithm for large-scale systems of nonlinear monotone equations , 2017, Numerical Algorithms.

[13]  Qingna Li,et al.  A class of derivative-free methods for large-scale nonlinear monotone equations , 2011 .

[14]  Masao Fukushima,et al.  Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems , 1992, Math. Program..

[15]  Yunhai Xiao,et al.  Spectral gradient projection method for monotone nonlinear equations with convex constraints , 2009 .

[16]  Jakub Marecek,et al.  Optimal Power Flow as a Polynomial Optimization Problem , 2014, IEEE Transactions on Power Systems.

[17]  Xingming Sun,et al.  Segmentation-Based Image Copy-Move Forgery Detection Scheme , 2015, IEEE Transactions on Information Forensics and Security.

[18]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[19]  Fengming Ma,et al.  Modified projection method for solving a system of monotone equations with convex constraints , 2010 .

[20]  Le Han,et al.  Multivariate spectral gradient method for unconstrained optimization , 2008, Appl. Math. Comput..

[21]  Supermemory gradient methods for monotone nonlinear equations with convex constraints , 2017 .

[22]  Chuanwei Wang,et al.  A superlinearly convergent projection method for constrained systems of nonlinear equations , 2009, J. Glob. Optim..

[23]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[24]  José Mario Martínez,et al.  Spectral residual method without gradient information for solving large-scale nonlinear systems of equations , 2006, Math. Comput..

[25]  Jianhua Ma,et al.  Multivariate spectral gradient projection methodfor nonlinear monotone equations with convex constraints , 2012 .

[26]  J. K. Liu,et al.  A gradient projection method for the sparse signal reconstruction in compressive sensing , 2018 .

[27]  Chuanwei Wang,et al.  A projection method for a system of nonlinear monotone equations with convex constraints , 2007, Math. Methods Oper. Res..

[28]  Yaping Hu,et al.  Wei–Yao–Liu conjugate gradient projection algorithm for nonlinear monotone equations with convex constraints , 2015, Int. J. Comput. Math..

[29]  Wanyou Cheng,et al.  A PRP type method for systems of monotone equations , 2009, Math. Comput. Model..

[30]  Mikhail V. Solodov,et al.  A Globally Convergent Inexact Newton Method for Systems of Monotone Equations , 1998 .

[31]  Yunhai Xiao,et al.  A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing , 2013 .

[32]  Shengjie Li,et al.  Multivariate spectral DY-type projection method for convex constrained nonlinear monotone equations , 2016 .

[33]  Sohrab Effati,et al.  A Neurodynamic Model to Solve Nonlinear Pseudo-Monotone Projection Equation and Its Applications , 2017, IEEE Transactions on Cybernetics.

[34]  Jorge J. Moré,et al.  Benchmarking optimization software with performance profiles , 2001, Math. Program..

[35]  S. J. Li,et al.  A self-adaptive three-term conjugate gradient method for monotone nonlinear equations with convex constraints , 2016 .

[36]  Weijun,et al.  LIMITED MEMORY BFGS METHOD FOR NONLINEAR MONOTONE EQUATIONS , 2007 .

[37]  M. V. Solodovy,et al.  Newton-type Methods with Generalized Distances For Constrained Optimization , 1997 .

[38]  Dong-Hui Li,et al.  A globally convergent derivative-free method for solving large-scale nonlinear monotone equations , 2010, J. Comput. Appl. Math..

[39]  William La Cruz.  A projected derivative-free algorithm for nonlinear equations with convex constraints , 2014, Optim. Methods Softw..

[40]  Na Yuan.  A derivative-free projection method for solving convex constrained monotone equations , 2017 .

[41]  Jing Liu,et al.  Two spectral gradient projection methods for constrained equations and their linear convergence rate , 2015 .