A transformation technique for optimal control problems with a state variable inequality constraint

A slack variable is used to transform an optimal control problem with a scalar control and a scalar inequality constraint on the state variables into an unconstrained problem of higher dimension. It is shown that, for a p th order constraint, the p th time derivative of the slack variable becomes the new control variable. The usual Pontryagin principle or Lagrange multiplier rule gives necessary conditions of optimality. There are no discontinuities in the adjoint variables. A feature of the transformed problem is that any nominal control function produces a feasible trajectory. The optimal trajectory of the transformed problem exhibits singular arcs which correspond, in the original constrained problem, to arcs which lie along the constraint boundary.

[1]  L. Berkovitz Variational methods in problems of control and programming , 1961 .

[2]  R. V. Gamkrelidze,et al.  OPTIMAL PROCESSES WITH BOUNDED PHASE COORDINATES , 1961 .

[3]  Stuart E. Dreyfus,et al.  Variational problems with inequality constraints , 1962 .

[4]  Sheldon S. L. Chang,et al.  Optimal control in bounded phase space , 1963, Autom..

[5]  Arthur E. Bryson,et al.  Optimal programming problems with inequality constraints. ii - solution by steepest-ascent , 1964 .

[6]  S. Dreyfus,et al.  The equivalence of some necessary conditions for optimal control in problems with bounded state variables , 1965 .

[7]  Sanjoy K. Mitter,et al.  Successive approximation methods for the solution of optimal control problems , 1966, Autom..

[8]  M. J. Box A Comparison of Several Current Optimization Methods, and the use of Transformations in Constrained Problems , 1966, Comput. J..

[9]  L. Lasdon,et al.  An interior penalty method for inequality constrained optimal control problems , 1967, IEEE Transactions on Automatic Control.

[10]  S. Mcreynolds The successive sweep method and dynamic programming , 1967 .

[11]  S. Mitter,et al.  The conjugate gradient method for optimal control problems , 1967 .

[12]  D. Jacobson New second-order and first-order algorithms for determining optimal control: A differential dynamic programming approach , 1968 .

[13]  D. Jacobson Differential dynamic programming methods for solving bang-bang control problems , 1968 .

[14]  David H. Jacobson,et al.  A proof of the convergence of the Kelley-Bryson penalty function technique for state-constrained control problems , 1969 .