Multiplier Methods: a Survey*t

* Received 13 May 1975; revised 6 October 1975. The original version of this paper was presented at the 6th IFAC Congress which was held in Boston]Cambridge, MA, U.S.A., during August 1975. The published proceedings of this IFAC meeting may be ordered from the ISA (Instrument Society of America), 400 Stanwix Street, Pittsburgh, PA 15222, U.S.A. It was recommended for publication in revised form by associate editor S. J. Kahne.

[1]  K. Mårtensson,et al.  A new approach to constrained function optimization , 1973 .

[2]  V. T. Polyak TRET''''YAKOV: The method of penalty estimates for conditional extremum problems , 1974 .

[3]  M. J. D. Powell,et al.  Nonlinear Programming—Sequential Unconstrained Minimization Techniques , 1969 .

[4]  Elijah Polak,et al.  A quadratically convergent primal-dual algorithm with global convergence properties for solving optimization problems with equality constraints , 1975, Math. Program..

[5]  M. Powell A method for nonlinear constraints in minimization problems , 1969 .

[6]  R. Rockafellar The multiplier method of Hestenes and Powell applied to convex programming , 1973 .

[7]  Y. Sawaragi,et al.  Multiplier method and optimal control problems with terminal state constraints , 1975 .

[8]  D. Bertsekas,et al.  Combined Primal–Dual and Penalty Methods for Convex Programming , 1976 .

[9]  J. Cullum Perturbations of Optimal Control Problems , 1966 .

[10]  D. Bertsekas,et al.  A new penalty function method for constrained minimization , 1972, CDC 1972.

[11]  K. Narendra,et al.  Constrained optimization problems using multiplier methods , 1972 .

[12]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[13]  J. Cullum Discrete Approximations to Continuous Optimal Control Problems , 1969 .

[14]  J. Daniel On the convergence of a numerical method for optimal control problems , 1969 .

[15]  Barry Warren Kort,et al.  Combined primal-dual and penalty function algorithms for nonlinear programming , 1975 .

[16]  O. Mangasarian Unconstrained Lagrangians in Nonlinear Programming , 1975 .

[17]  Boris Polyak Iterative methods using lagrange multipliers for solving extremal problems with constraints of the equation type , 1970 .

[18]  B. Budak,et al.  Difference Approximations in Optimal Control Problems , 1969 .

[19]  E. Polak,et al.  An adaptive precision gradient method for optimal control. , 1973 .

[20]  P. C. Haarhoff,et al.  A New Method for the Optimization of a Nonlinear Function Subject to Nonlinear Constraints , 1970, Comput. J..

[21]  R. D. Rupp A method for solving a quadratic optimal control problem , 1972 .

[22]  R. D. Rupp Approximation of the classical isoperimetric problem , 1972 .

[23]  D. Bertsekas,et al.  Multiplier methods for convex programming , 1973, CDC 1973.

[24]  Floyd J. Gould,et al.  A general saddle point result for constrained optimization , 1973, Math. Program..

[25]  D. Bertsekas Convergence rate of penalty and multiplier methods , 1973, CDC 1973.

[26]  D. Bertsekas Approximation procedures based on the method of multipliers , 1977 .

[27]  R. Tyrrell Rockafellar,et al.  Penalty Methods and Augmented Lagrangians in Nonlinear Programming , 1973, Optimization Techniques.

[28]  E. Polak Introduction to linear and nonlinear programming , 1973 .

[29]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[30]  D. Bertsekas ON PENALTY AND MULTIPLIER METHODS FOR CONSTRAINED MINIMIZATION , 1976 .

[31]  B. W. Kort RATE OF CONVERGENCE OF THE METHOD OF MULTIPLIERS WITH INEXACT MINIMIZATION , 1975 .

[32]  Leon S. Lasdon,et al.  Optimization Theory of Large Systems , 1970 .

[33]  M. Hestenes Multiplier and gradient methods , 1969 .

[34]  R. Tyrrell Rockafellar,et al.  A dual approach to solving nonlinear programming problems by unconstrained optimization , 1973, Math. Program..

[35]  R. Fletcher,et al.  A Class of Methods for Nonlinear Programming II Computational Experience , 1970 .

[36]  E. M. L. Beale,et al.  Nonlinear Programming: A Unified Approach. , 1970 .

[37]  J. E. Nahra Balance function for the optimal control problem , 1971 .

[38]  D. Bertsekas Nondifferentiable optimization via approximation , 1975 .

[39]  D. Bertsekas On the method of multipliers for convex programming , 1975 .

[40]  J. Cullum Finite-Dimensional Approximations of State-Constrained Continuous Optimal Control Problems , 1972 .

[41]  Elijah Polak,et al.  Computational methods in optimization , 1971 .

[42]  D. Bertsekas COMBINED PRIMAL-DUAL AND PENALTY METHODS FOR CONSTRAINED MINIMIZATION* , 1975 .

[43]  R. Rockafellar Augmented Lagrange Multiplier Functions and Duality in Nonconvex Programming , 1974 .

[44]  R. Fletcher An Ideal Penalty Function for Constrained Optimization , 1975 .

[45]  R. D. Rupp A nonlinear optimal control minimization technique , 1973 .