On the stochastic linear quadratic control problem with piecewise constant admissible controls

Abstract A linear quadratic optimal control problem for a system described by Ito differential equations with state and control dependent white noise under the assumption that the set of admissible controls consists of a class of piecewise constant stochastic processes is considered. The considered LQ optimal control problem is converted into a LQ optimization problem for a stochastic controlled system with finite jumps and multiplicative white noise perturbations. One of the original contribution of this work is the proof of the equivalence between the solvability of the considered optimal control problem and the solvability of the problem with given terminal values associated to a matrix linear differential equation (MLDE) with finite jumps and constraints. Another original contribution consists in the proof of the global existence of the solution of the problem with given terminal value of the MLDE if the cost weights matrices are positive semidefinite. The results obtained in the case of a LQ optimal control for systems with finite jumps are then applied to derive explicit formulae of the optimal controls for the optimization problem under piecewise constant controls.

[1]  B. Øksendal Stochastic Differential Equations , 1985 .

[2]  P. Khargonekar,et al.  H∞ control and filtering for sampled-data systems , 1993, IEEE Trans. Autom. Control..

[3]  Quanxin Zhu,et al.  Stability analysis of Markov switched stochastic differential equations with both stable and unstable subsystems , 2017, Syst. Control. Lett..

[4]  N. Gunasekaran,et al.  State estimation of T-S fuzzy delayed neural networks with Markovian jumping parameters using sampled-data control , 2017, Fuzzy Sets Syst..

[5]  Akira Ichikawa,et al.  Linear Time Varying Systems and Sampled-data Systems , 2001 .

[6]  Vasile Dragan,et al.  Optimal H2 filtering for periodic linear stochastic systems with multiplicative white noise perturbations and sampled measurements , 2015, J. Frankl. Inst..

[7]  Quanxin Zhu,et al.  Stability analysis of stochastic delay differential equations with Lévy noise , 2018, Syst. Control. Lett..

[8]  Corentin Briat Convex conditions for robust stability analysis and stabilization of linear aperiodic impulsive and sampled-data systems under dwell-time constraints , 2013, Autom..

[9]  P. Shi,et al.  Stochastic stability and robust control for sampled-data systems with Markovian jump parameters , 2006 .

[10]  T. Damm Rational Matrix Equations in Stochastic Control , 2004 .

[11]  V. Dragan,et al.  Mathematical Methods in Robust Control of Linear Stochastic Systems , 2006 .

[12]  X. Mao,et al.  Stochastic Differential Equations and Applications , 1998 .

[13]  Akira Ichikawa,et al.  H2 and Hinfinity control for jump systems with application to sampled-data systems , 1998, Int. J. Syst. Sci..

[14]  W. Wonham On a Matrix Riccati Equation of Stochastic Control , 1968 .

[15]  Li-Sheng Hu,et al.  Constrained robust sampled‐data control for nonlinear uncertain systems , 2002 .

[16]  Quanxin Zhu,et al.  Exponential synchronization of Markovian jumping chaotic neural networks with sampled-data and saturating actuators , 2017 .

[17]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[18]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[19]  John B. Moore,et al.  Indefinite Stochastic Linear Quadratic Control and Generalized Differential Riccati Equation , 2002, SIAM J. Control. Optim..

[20]  Quanxin Zhu,et al.  Stability analysis of semi-Markov switched stochastic systems , 2018, Autom..

[21]  Corentin Briat,et al.  Stability analysis and stabilization of stochastic linear impulsive, switched and sampled-data systems under dwell-time constraints , 2016, Autom..

[22]  LEONID MIRKIN,et al.  H2 and Hinfinity Design of Sampled-Data Systems Using Lifting. Part I: General Framework and Solutions , 1999, SIAM J. Control. Optim..

[23]  A. Albert Conditions for Positive and Nonnegative Definiteness in Terms of Pseudoinverses , 1969 .