On the global stabilization of locally convergent algorithms

There are a number of algorithms in the literature which both theoretically and empirically are known to be only locally convergent. These include such well known algorithms as secant, Newton, quasi-Newton and primal-dual algorithms. Locally, these algorithms tend to be highly efficient. Consequently, it is very desirable to find ways of extending, or modifying, these algorithms, so that they become globally convergent while retaining their attractive local properties. This paper describes a set of techniques which have recently emerged for stabilizing such algorithms and illustrates their application by means of a number of examples.

[1]  L. Kantorovich,et al.  Functional analysis in normed spaces , 1952 .

[2]  E. Polak,et al.  NEWTON DERIVED METHODS FOR NONLINEAR EQUATIONS AND INEQUALITIES , 1975 .

[3]  Elijah Polak,et al.  A modified secant method for unconstrained minimization , 1974, Math. Program..

[4]  David Q. Mayne,et al.  Feasible directions algorithms for optimization problems with equality and inequality constraints , 1976, Math. Program..

[5]  D. Bertsekas On Penalty and Multiplier Methods for Constrained Minimization , 1976 .

[6]  D. Bertsekas COMBINED PRIMAL-DUAL AND PENALTY METHODS FOR CONSTRAINED MINIMIZATION* , 1975 .

[7]  Elijah Polak,et al.  A quadratically convergent primal-dual algorithm with global convergence properties for solving optimization problems with equality constraints , 1975, Math. Program..

[8]  S. M. Robinson Extension of Newton's method to nonlinear functions with values in a cone , 1972 .

[9]  R. Brent Some Efficient Algorithms for Solving Systems of Nonlinear Equations , 1973 .

[10]  J. Dennis,et al.  On Newton-like iteration functions: General convergence theorems and a specific algorithm , 1968 .

[11]  M. Hestenes Multiplier and gradient methods , 1969 .

[12]  Elijah Polak,et al.  Computational methods in optimization , 1971 .

[13]  B. N. Pshenichnyi Newton's method for the solution of systems of equalities and inequalities , 1970 .

[14]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[15]  C. G. Broyden Quasi-Newton methods and their application to function minimisation , 1967 .