A Levenberg-Marquardt algorithm with correction for singular system of nonlinear equations

In this paper we propose a new LM algorithm for the singular system of nonlinear equations F(x)=0, where F(x):R^n->R^n is continuously differentiable and F^'(x) is Lipschitz continuous. At every iteration, not only a LM step but also a correction step are computed. The LM parameter is taken as @m"[email protected]?F"[email protected]?^@d, where @[email protected]?(0,2] and @m"k is updated by the trust region technique. Under the local error bound condition which is weaker than nonsingularity, we prove the convergence rate of the algorithm is min{2,[email protected]}. Numerical results show that the new LM algorithm performs very well.

[1]  Ya-Xiang Yuan,et al.  On the Quadratic Convergence of the Levenberg-Marquardt Method without Nonsingularity Assumption , 2005, Computing.

[2]  Ya-Xiang Yuan,et al.  Recent advances in numerical methods for nonlinear equations andnonlinear least squares , 2011 .

[3]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[4]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[5]  Jinyan Fan,et al.  The modified Levenberg-Marquardt method for nonlinear equations with cubic convergence , 2012, Math. Comput..

[6]  Jin-yanFan A MODIFIED LEVENBERG-MARQUARDT ALGORITHM FOR SINGULAR SYSTEM OF NONLINEAR EQUATIONS , 2003 .

[7]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[8]  R. Schnabel,et al.  Tensor Methods for Nonlinear Equations. , 1984 .

[9]  M. Powell CONVERGENCE PROPERTIES OF A CLASS OF MINIMIZATION ALGORITHMS , 1975 .

[10]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[11]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[12]  M. Fukushima,et al.  On the Rate of Convergence of the Levenberg-Marquardt Method , 2001 .

[13]  Ya-Xiang Yuan,et al.  Trust Region Algorithms for Nonlinear Equations , 1994 .

[14]  Jorge J. Moré,et al.  Recent Developments in Algorithms and Software for Trust Region Methods , 1982, ISMP.

[15]  Alfredo N. Iusem,et al.  The effect of calmness on the solution set of systems of nonlinear equations , 2013, Math. Program..