A Levenberg-Marquardt method with approximate projections

The projected Levenberg-Marquardt method for the solution of a system of equations with convex constraints is known to converge locally quadratically to a possibly nonisolated solution if a certain error bound condition holds. This condition turns out to be quite strong since it implies that the solution sets of the constrained and of the unconstrained system are locally the same.Under a pair of more reasonable error bound conditions this paper proves R-linear convergence of a Levenberg-Marquardt method with approximate projections. In this way, computationally expensive projections can be avoided. The new method is also applicable if there are nonsmooth constraints having subgradients. Moreover, the projected Levenberg-Marquardt method is a special case of the new method and shares its R-linear convergence.

[1]  Masao Fukushima,et al.  Convergence Properties of the Inexact Levenberg-Marquardt Method under Local Error Bound Conditions , 2002, Optim. Methods Softw..

[2]  Jinyan Fan,et al.  On the convergence rate of the inexact Levenberg-Marquardt method , 2011 .

[3]  Francisco Facchinei,et al.  A new error bound result for Generalized Nash Equilibrium Problems and its algorithmic application , 2014, Comput. Optim. Appl..

[4]  M. Fukushima,et al.  On the Rate of Convergence of the Levenberg-Marquardt Method , 2001 .

[5]  Andreas Fischer,et al.  Local behavior of an iterative framework for generalized equations with nonisolated solutions , 2002, Math. Program..

[6]  Jinyan Fan,et al.  Inexact Levenberg-Marquardt method for nonlinear equations , 2004 .

[7]  Andreas Fischer,et al.  A Levenberg-Marquardt algorithm for unconstrained multicriteria optimization , 2008, Oper. Res. Lett..

[8]  Alfredo N. Iusem,et al.  The effect of calmness on the solution set of systems of nonlinear equations , 2013, Math. Program..

[9]  Jinyan Fan.  On the Levenberg-Marquardt methods for convex constrained nonlinear equations , 2012 .

[10]  Francisco Facchinei,et al.  Generalized Nash equilibrium problems and Newton methods , 2008, Math. Program..

[11]  Ju-Liang Zhang.  On the convergence properties of the Levenberg–Marquardt method , 2003 .

[12]  A. Fischer,et al.  On the inexactness level of robust Levenberg–Marquardt methods , 2010 .

[13]  Francisco Facchinei,et al.  A family of Newton methods for nonsmooth constrained systems with nonisolated solutions , 2013, Math. Methods Oper. Res..

[14]  A. Hoffman.  On approximate solutions of systems of linear inequalities , 1952 .

[15]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[16]  Ya-Xiang Yuan,et al.  On the Quadratic Convergence of the Levenberg-Marquardt Method without Nonsingularity Assumption , 2005, Computing.

[17]  M. Fukushima,et al.  Levenberg–Marquardt methods with strong local convergence properties for solving nonlinear equations with convex constraints , 2004 .

[18]  Masao Fukushima.  An Outer Approximation Algorithm for Solving General Convex Programs , 1983, Oper. Res..

[19]  Andreas Fischer,et al.  A unified local convergence analysis of inexact constrained Levenberg–Marquardt methods , 2011, Optimization Letters.

[20]  C. Kanzow.  Levenberg-Marquardt methods for constrained nonlinear equations with strong local convergence properties , 2004 .

[21]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .