论文信息 - Discrete-time drift counteraction stochastic optimal control: Theory and application-motivated examples

Discrete-time drift counteraction stochastic optimal control: Theory and application-motivated examples

We develop stochastic optimal control results for nonlinear discrete-time systems driven by disturbances modeled by a Markov chain. A characterization and a computational procedure for a control law which maximizes a cost functional, related to expected time-to-violate specified constraints or to expected total yield before constraint violation occurs, are discussed. Such an optimal control law may be viewed as providing drift counteraction and is, therefore, referred to as drift counteraction stochastic optimal control. Two simulation examples highlight opportunities for applications of these results to hybrid electric vehicle (HEV) powertrain management and to oil extraction.

[1] Ilya Kolmanovsky,et al. Optimization of powertrain operating policy for feasibility assessment and calibration: stochastic dynamic programming approach , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[2] E. Altman. Constrained Markov Decision Processes , 1999 .

[3] Ilya Kolmanovsky,et al. An Integrated Software Environment For Powertrain Feasibility Assessment Using Optimization And Optimal Control , 2006 .

[4] I. Kolmanovsky,et al. Control strategy optimization for a series hybrid vehicle , 2006 .

[5] Ilya V. Kolmanovsky,et al. Optimal containment control for a class of stochastic systems perturbed by poisson and wiener processes , 2002, IEEE Trans. Autom. Control..

[6] S. Fomin,et al. Elements of the Theory of Functions and Functional Analysis , 1961 .

[7] V. R. Nosov,et al. Mathematical theory of control systems design , 1996 .

[8] Huei Peng,et al. A stochastic control strategy for hybrid electric vehicles , 2004, Proceedings of the 2004 American Control Conference.

[9] Roberto Cipollone,et al. Control-Oriented Modeling and Fuel Optimal Control of a Series Hybrid Bus , 2005 .

[10] Clark G. Hochgraf,et al. Engine Control Strategy for a Series Hybrid Electric Vehicle Incorporating Load-Leveling and Computer Controlled Energy Management , 1996 .