Convergence of the Gauss-Newton Method for Convex Composite Optimization under a Majorant Condition

Under the hypothesis that an initial point is a quasi-regular point, we use a majorant condition to present a new semilocal convergence analysis of an extension of the Gauss--Newton method for solving convex composite optimization problems. In this analysis the conditions and proof of convergence are simplified by using a simple majorant condition to define regions where a Gauss--Newton sequence is well behaved.

[1]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[2]  Orizon Pereira Ferreira,et al.  Kantorovich's Theorem on Newton's Method in Riemannian Manifolds , 2002, J. Complex..

[3]  Orizon Pereira Ferreira,et al.  Kantorovich’s majorants principle for Newton’s method , 2009, Comput. Optim. Appl..

[4]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[5]  S. M. Robinson.  Extension of Newton's method to nonlinear functions with values in a cone , 1972 .

[6]  Chong Li,et al.  Convergence analysis of the Gauss-Newton method for convex inclusion and convex-composite optimization problems , 2012 .

[7]  R. Tyrrell Rockafellar,et al.  Monotone processes of convex and concave type , 1967 .

[8]  Chong Li,et al.  Majorizing Functions and Convergence of the Gauss--Newton Method for Convex Composite Optimization , 2007, SIAM J. Optim..

[9]  Chong Li,et al.  On convergence of the Gauss-Newton method for convex composite optimization , 2002, Math. Program..

[10]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[11]  Paulo Roberto Oliveira,et al.  Local convergence analysis of the Gauss-Newton method under a majorant condition , 2011, J. Complex..

[12]  Orizon Pereira Ferreira,et al.  Local convergence analysis of inexact Gauss-Newton like methods under majorant condition , 2010, J. Comput. Appl. Math..

[13]  Michael C. Ferris,et al.  A Gauss—Newton method for convex composite optimization , 1995, Math. Program..

[14]  S. Smale.  Newton’s Method Estimates from Data at One Point , 1986 .

[15]  Xinghua Wang,et al.  Convergence of Newton's method and uniqueness of the solution of equations in Banach space , 2000 .