A conjugate gradient projection method for solving equations with convex constraints

Abstract In this paper, we propose a derivative-free iterative method for a class of equations with convex constraints appearing in a variety of the practical problems such as compressing sensing, fluid mechanics, plasma physics, nonlinear optics and solid state. In the iteration, our search direction can be viewed as an extension of a modified three-term CG method. By an appropriate line search and the projection step, our method is convergent to the solution. Our method inherits the advantages of CG method and projection method, and thus is suitable for solving large-scale non-smooth problem. Under the assumption that F is Lipschitz continuous and satisfies a weaker condition of monotonicity, our method is globally convergent. Numerical results show the efficiency of the proposed method.

[1]  Yi-Tian Gao,et al.  Quintic time-dependent-coefficient derivative nonlinear Schrödinger equation in hydrodynamics or fiber optics: bilinear forms and dark/anti-dark/gray solitons , 2019, Nonlinear Dynamics.

[2]  Bo Tian,et al.  Solitons for the (2+1)-dimensional Konopelchenko–Dubrovsky equations , 2018 .

[3]  Chuanjiang He,et al.  An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints , 2018, Calcolo.

[4]  Yuming Feng,et al.  A derivative-free iterative method for nonlinear monotone equations with convex constraints , 2018, Numerical Algorithms.

[5]  Li Zhang,et al.  Some descent three-term conjugate gradient methods and their global convergence , 2007, Optim. Methods Softw..

[6]  J. B. Rosen.  The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints , 1960 .

[7]  Qingna Li,et al.  A class of derivative-free methods for large-scale nonlinear monotone equations , 2011 .

[8]  José Mario Martínez,et al.  Spectral residual method without gradient information for solving large-scale nonlinear systems of equations , 2006, Math. Comput..

[9]  Weijun Zhou,et al.  A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence , 2006 .

[10]  Zhong-Zhou Lan,et al.  Dark solitonic interactions for the (3 + 1)-dimensional coupled nonlinear Schrödinger equations in nonlinear optical fibers , 2019, Optics & Laser Technology.

[11]  Bo Tian,et al.  Rogue waves and solitons of the coherently-coupled nonlinear Schrödinger equations with the positive coherent coupling , 2018, Physica Scripta.

[12]  Weijun,et al.  LIMITED MEMORY BFGS METHOD FOR NONLINEAR MONOTONE EQUATIONS , 2007 .

[13]  B. Tian,et al.  Gramian solutions and soliton interactions for a generalized (3 + 1)-dimensional variable-coefficient Kadomtsev–Petviashvili equation in a plasma or fluid , 2019, Proceedings of the Royal Society A.

[14]  Yunhai Xiao,et al.  A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing , 2013 .

[15]  Yu. V. Malitsky,et al.  An Extragradient Algorithm for Monotone Variational Inequalities , 2014 .

[16]  Mikhail V. Solodov,et al.  A Globally Convergent Inexact Newton Method for Systems of Monotone Equations , 1998 .

[17]  Xin-Yi Gao,et al.  Mathematical view with observational/experimental consideration on certain (2+1)-dimensional waves in the cosmic/laboratory dusty plasmas , 2019, Appl. Math. Lett..

[18]  Yunhai Xiao,et al.  Spectral gradient projection method for monotone nonlinear equations with convex constraints , 2009 .

[19]  Marcos Raydan,et al.  Nonmonotone Spectral Methods for Large-Scale Nonlinear Systems , 2003, Optim. Methods Softw..

[20]  Jorge J. Moré,et al.  Benchmarking optimization software with performance profiles , 2001, Math. Program..

[21]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .

[22]  Bo Tian,et al.  Conservation laws, binary Darboux transformations and solitons for a higher-order nonlinear Schrödinger system , 2019, Chaos, Solitons & Fractals.

[23]  Dong-Hui Li,et al.  A globally convergent BFGS method for nonlinear monotone equations without any merit functions , 2008, Math. Comput..

[24]  Shengjie Li,et al.  A projection method for convex constrained monotone nonlinear equations with applications , 2015, Comput. Math. Appl..

[25]  Poom Kumam,et al.  A New Hybrid Spectral Gradient Projection Method for Monotone System of Nonlinear Equations with Convex Constraints , 2018 .

[26]  Hiroshi Yabe,et al.  A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization , 2015, Comput. Optim. Appl..

[27]  K. Toh,et al.  Superlinear Convergence of a Newton-Type Algorithm for Monotone Equations , 2005 .

[28]  Li,et al.  Spectral DY-Type Projection Method for Nonlinear Monotone Systems of Equations , 2015 .

[29]  Bo Tian,et al.  Lie group analysis, analytic solutions and conservation laws of the (3 + 1)-dimensional Zakharov-Kuznetsov-Burgers equation in a collisionless magnetized electron-positron-ion plasma , 2018, The European Physical Journal Plus.

[30]  Chuanwei Wang,et al.  A projection method for a system of nonlinear monotone equations with convex constraints , 2007, Math. Methods Oper. Res..

[32]  Michael A. Saunders,et al.  On projected newton barrier methods for linear programming and an equivalence to Karmarkar’s projective method , 1986, Math. Program..

[33]  Bo Tian,et al.  Solitons, Bäcklund transformation and Lax pair for a (2+1)-dimensional Davey-Stewartson system on surface waves of finite depth , 2018 .

[34]  Bingsheng He,et al.  A new inexact alternating directions method for monotone variational inequalities , 2002, Math. Program..

[35]  Robert J. Vanderbei,et al.  An Interior-Point Method for Semidefinite Programming , 1996, SIAM J. Optim..

[36]  Yang Bing,et al.  AN EFFICIENT IMPLEMENTATION OF MERRILL'S METHOD FOR SPARSE OR PARTIALLY SEPARABLE SYSTEMS OF NONLINEAR EQUATIONS* , 1991 .