Rates of convergence for adaptive Newton methods

We consider Newton-type methods for constrained optimization problems in infinite-dimensional spaces, where at each iteration the first and second derivatives and the feasible set are approximated. The approximations can change at each iteration and conditions are given under which linear and superlinear rates of convergence of the iterates to the optimal point hold. Several applications are discussed.

[1]  Boris Polyak,et al.  Constrained minimization methods , 1966 .

[2]  J C Dunn.  Diagonally modified conditional gradient methods for input constrained optimal control problems , 1986 .

[3]  M. Hestenes.  Optimization Theory: The Finite Dimensional Case , 1975 .

[4]  J. J. Moré,et al.  A Characterization of Superlinear Convergence and its Application to Quasi-Newton Methods , 1973 .

[5]  J. Dunn.  Rates of convergence for conditional gradient algorithms near singular and nonsingular extremals , 1979, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[6]  E. Polak,et al.  An adaptive precision gradient method for optimal control. , 1973 .

[7]  Minimization methods based on approximation of the initial functional by a convex functional , 1970 .

[8]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[9]  J. Dunn,et al.  The effect of perturbations on the convergence rates of optimization algorithms , 1983 .

[10]  J. Dunn.  Newton’s Method and the Goldstein Step-Length Rule for Constrained Minimization Problems , 1980 .

[11]  B. T. Polyak,et al.  Convergence of methods of feasible directions in extremal problems , 1971 .

[12]  E. Sachs.  Newton's method for singular constrained optimization problems , 1984 .

[13]  Ekkehard W. Sachs,et al.  Algorithmic methods in optimal control , 1981 .

[14]  Anthony V. Fiacco,et al.  Sensitivity analysis for nonlinear programming using penalty methods , 1976, Math. Program..

[15]  Stephen M. Robinson,et al.  Perturbed Kuhn-Tucker points and rates of convergence for a class of nonlinear-programming algorithms , 1974, Math. Program..

[16]  Ekkehard W. Sachs,et al.  On theoretical and numerical aspects of the bang-bang-principle , 1977 .

[17]  K. Schittkowski.  An Adaptive Precision Method for Nonlinear Optimization Problems , 1979 .