An efficient Levenberg–Marquardt method with a new LM parameter for systems of nonlinear equations

Abstract A modified Levenberg–Marquardt method for solving singular systems of nonlinear equations was proposed by Fan [J Comput Appl Math. 2003;21;625–636]. Using trust region techniques, the global and quadratic convergence of the method were proved. In this paper, to improve this method, we decide to introduce a new Levenberg–Marquardt parameter while also incorporate a new nonmonotone technique to this method. The global and quadratic convergence of the new method is proved under the local error bound condition. Numerical results show the new algorithm is efficient and promising.

[1]  Keyvan Amini,et al.  A modified two steps Levenberg-Marquardt method for nonlinear equations , 2015, J. Comput. Appl. Math..

[2]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[3]  R. Schnabel,et al.  Tensor Methods for Nonlinear Equations. , 1984 .

[4]  Keyvan Amini,et al.  Three-steps modified Levenberg-Marquardt method with a new line search for systems of nonlinear equations , 2016, J. Comput. Appl. Math..

[5]  J. Fan,et al.  The convergence of a new Levenberg-Marquardt method , 2001 .

[6]  Philippe L. Toint,et al.  Non-monotone trust-region algorithms for nonlinear optimization subject to convex constraints , 1997, Math. Program..

[7]  Masoud Ahookhosh,et al.  Computers and Mathematics with Applications a Nonmonotone Trust Region Method with Adaptive Radius for Unconstrained Optimization Problems , 2022 .

[8]  V. N. Bogaevski,et al.  Matrix Perturbation Theory , 1991 .

[9]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[10]  N. Deng,et al.  Nonmonotonic trust region algorithm , 1993 .

[11]  L. Grippo,et al.  A truncated Newton method with nonmonotone line search for unconstrained optimization , 1989 .

[12]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[13]  Weijun Zhou,et al.  On the convergence of the modified Levenberg-Marquardt method with a nonmonotone second order Armijo type line search , 2013, J. Comput. Appl. Math..

[14]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[15]  M. Fukushima,et al.  On the Rate of Convergence of the Levenberg-Marquardt Method , 2001 .

[16]  M. Powell.  CONVERGENCE PROPERTIES OF A CLASS OF MINIMIZATION ALGORITHMS , 1975 .

[17]  C. G. Broyden.  Quasi-Newton methods and their application to function minimisation , 1967 .

[18]  D. Gleich.  TRUST REGION METHODS , 2017 .

[19]  Masoud Ahookhosh,et al.  An efficient nonmonotone trust-region method for unconstrained optimization , 2011, Numerical Algorithms.

[20]  Jin-yanFan.  A MODIFIED LEVENBERG-MARQUARDT ALGORITHM FOR SINGULAR SYSTEM OF NONLINEAR EQUATIONS , 2003 .

[21]  Philippe L. Toint,et al.  An Assessment of Nonmonotone Linesearch Techniques for Unconstrained Optimization , 1996, SIAM J. Sci. Comput..

[22]  Alfredo N. Iusem,et al.  The effect of calmness on the solution set of systems of nonlinear equations , 2013, Math. Program..