THEORY AND APPLICATIONS OF OPTIMAL CONTROL PROBLEMS WITH MULTIPLE TIME-DELAYS

In this paper we study optimal control problems with multiple time delays in control and state and mixed type control-state constraints. We derive necessary optimality conditions in the form of a Pontryagin type Minimum Principle. A discretization method is presented by which the delayed control problem is transformed into a nonlinear programming problem. It is shown that the associated Lagrange multipliers provide a consistent numerical approximation for the adjoint variables of the delayed optimal control problem. We illustrate the theory and numerical approach on an analytical example and an optimal control model from immunology.

[1]  J. Warga.  Optimal control of differential and functional equations , 1972 .

[2]  H. Maurer,et al.  Optimal control problems with delays in state and control variables subject to mixed control–state constraints , 2009 .

[3]  Moustafa A. Soliman,et al.  Optimal control of multivariable systems with pure time delays , 1971 .

[4]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[5]  Robert F. Stengel,et al.  Optimal control of innate immune response , 2002, Optimal Control Applications and Methods.

[6]  M. Hestenes.  Calculus of variations and optimal control theory , 1966 .

[7]  Lucien W. Neustadt,et al.  Optimization: A Theory of Necessary Conditions , 1976 .

[8]  Robert J. Vanderbei,et al.  An Interior-Point Algorithm for Nonconvex Nonlinear Programming , 1999, Comput. Optim. Appl..

[9]  W. L. Chan,et al.  Sufficient conditions for variational problems with delayed argument , 1993 .

[10]  M. Namik Oguztöreli,et al.  Time-lag control systems , 1966 .

[11]  Thomas S. Angell,et al.  On the necessary conditions for optimal control of retarded systems , 1990 .

[12]  W. Ray,et al.  The optimal control of processes containing pure time delays—I necessary conditions for an optimum , 1970 .

[13]  Rein Luus,et al.  Optimal control of time-delay systems by dynamic programming , 1992 .

[14]  Kok Lay Teo,et al.  An Optimization Approach to State-Delay Identification $ $ , 2010, IEEE Transactions on Automatic Control.

[15]  W. H. Ray,et al.  The optimal control of processes containing pure time delays , 1970 .

[16]  K. Teo,et al.  A class of optimal state-delay control problems , 2013 .

[17]  R. Vanderbei.  LOQO:an interior point code for quadratic programming , 1999 .

[18]  W. H. Ray,et al.  On the optimal control of systems having pure time delays and singular arcsI, Some necessary conditions for optimality† , 1972 .

[19]  L. Bittner.  L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, E. F. Mishechenko, The Mathematical Theory of Optimal Processes. VIII + 360 S. New York/London 1962. John Wiley & Sons. Preis 90/– , 1963 .

[20]  A. Halanay.  Optimal Controls for Systems with Time Lag , 1968 .

[21]  Harvey Thomas Banks,et al.  Necessary Conditions for Control Problems with Variable Time Lags , 1968 .

[22]  Robert M. May,et al.  Time‐Delay Versus Stability in Population Models with Two and Three Trophic Levels , 1973 .

[23]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[24]  Diederich Hinrichsen,et al.  Optimal Control of Functional Differential Systems , 1978 .

[25]  Boris S. Mordukhovich,et al.  Stability of Discrete Approximations and Necessary Optimality Conditions for Delay-Differential Inclusions , 2001, Ann. Oper. Res..

[26]  William W. Hager,et al.  Runge-Kutta methods in optimal control and the transformed adjoint system , 2000, Numerische Mathematik.

[27]  Raffaele Ghigliazza,et al.  Stochastic optimal therapy for enhanced immune response. , 2004, Mathematical biosciences.

[28]  T. Guinn.  Reduction of delayed optimal control problems to nondelayed problems , 1976 .

[29]  Brian W. Kernighan,et al.  AMPL: A Modeling Language for Mathematical Programming , 1993 .

[30]  Sheng-Chao Huang.  Optimal control problems with retardations and restricted phase coordinates , 1969 .

[31]  Rein Luus,et al.  Optimal feedback control of time‐delay systems , 1976 .

[32]  K. Teo,et al.  A unified parameter identification method for nonlinear time-delay systems , 2013 .

[33]  A. A. Mili︠u︡tin,et al.  Calculus of variations and optimal control , 1998 .