Optimal sojourn time control within an interval

In this paper we study the problem of finding the optimal feedback control that can keep an agent within an interval for at least a certain amount of expected time with the least energy. The dynamics of the agent are subject to the perturbation of random noises, and thus are given by a stochastic differential equation. By formulating the problem as an optimal control problem, we propose a solution by using the maximum principle and finding a first integral to the resulting differential equations. Some numerical simulations are presented to illustrate the results.

[1]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[2]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[3]  R. Durrett Stochastic Calculus: A Practical Introduction , 1996 .

[4]  George J. Pappas,et al.  Hybrid control in air traffic management systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.