Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems

In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semidefinite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution for the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed to be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.

[1]  Andrew E. B. Lim,et al.  Stochastic optimal LQR control with integral quadratic constraints and indefinite control weights , 1999, IEEE Trans. Autom. Control..

[2]  Chun-Hua Guo,et al.  Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control , 2002 .

[3]  B. Beek,et al.  Techniques for automatic speaker identification , 1971 .

[4]  Gang George Yin,et al.  Markowitz's mean-variance portfolio selection with regime switching: from discrete-time models to their continuous-time limits , 2004, IEEE Transactions on Automatic Control.

[5]  H. H. Schaefer,et al.  Topological Vector Spaces , 1967 .

[6]  Carlos S. Kubrusly.  Mean Square Stability for Discrete Bounded Linear Systems in Hilbert Space , 1985 .

[7]  Oswaldo Luiz V. Costa,et al.  Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems , 2007, Autom..

[8]  Xun Yu Zhou,et al.  Characterizing all optimal controls for an indefinite stochastic linear quadratic control problem , 2002, IEEE Trans. Autom. Control..

[9]  Andrew E. B. Lim,et al.  Discrete time LQG controls with control dependent noise , 1999 .

[10]  Harry L. Trentelman,et al.  Linear quadratic problems with indefinite cost for discrete time systems , 1993 .

[11]  Hans Zwart,et al.  Solving the infinite-dimensional discrete-time algebraic riccati equation using the extended symplectic pencil , 1996, Math. Control. Signals Syst..

[12]  Gerhard Freiling,et al.  On a class of rational matrix differential equations arising in stochastic control , 2004 .

[13]  John B. Moore,et al.  Indefinite Stochastic Linear Quadratic Control and Generalized Differential Riccati Equation , 2002, SIAM J. Control. Optim..

[14]  V. V. Dombrovskii,et al.  Predictive control of random-parameter systems with multiplicative noise. Application to investment portfolio optimization , 2005 .

[15]  Hisham Abou-Kandil,et al.  On the solution of discrete-time Markovian jump linear quadratic control problems , 1995, Autom..

[16]  R. P. Marques,et al.  Markov Jump Linear Systems , 2005 .

[17]  K. Loparo,et al.  Stability and control of discrete-time jump linear systems , 1991 .

[18]  Vasile Dragan,et al.  Observability and detectability of a class of discrete-time stochastic linear systems , 2006, IMA J. Math. Control. Inf..

[19]  Christopher Edwards,et al.  Dynamic Sliding Mode Control for a Class of Systems with Mismatched Uncertainty , 2005, Eur. J. Control.

[20]  J. D. Do Val,et al.  Weak detectability and the linear-quadratic control problem of discrete-time Markov jump linear systems , 2002 .

[21]  Chun-Hua Guo,et al.  Newton's Method for Discrete Algebraic Riccati Equations when the Closed-Loop Matrix Has Eigenvalues on the Unit Circle , 1999, SIAM J. Matrix Anal. Appl..

[22]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[23]  Xi Chen,et al.  Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls , 2001, IEEE Trans. Autom. Control..

[24]  Uri Shaked,et al.  Static H2 and H∞ output-feedback of discrete-time LTI systems with state multiplicative noise , 2006, Syst. Control. Lett..

[25]  R. P. Marques,et al.  Discrete-Time Markov Jump Linear Systems , 2004, IEEE Transactions on Automatic Control.

[26]  V. Dragan,et al.  Stability and robust stabilization to linear stochastic systems described by differential equations with markovian jumping and multiplicative white noise , 2002 .

[27]  X. Chen,et al.  Discrete-time Indefinite LQ Control with State and Control Dependent Noises , 2002, J. Glob. Optim..

[28]  Gang George Yin,et al.  Markowitz's Mean-Variance Portfolio Selection with Regime Switching: A Continuous-Time Model , 2003, SIAM J. Control. Optim..

[29]  Süleyman Özekici,et al.  Portfolio optimization in stochastic markets , 2006, Math. Methods Oper. Res..

[30]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[31]  Xun Yu Zhou,et al.  Indefinite Stochastic Linear Quadratic Control with Markovian Jumps in Infinite Time Horizon , 2003, J. Glob. Optim..

[32]  Q. Zhang,et al.  Stock Trading: An Optimal Selling Rule , 2001, SIAM J. Control. Optim..

[33]  Diederich Hinrichsen,et al.  Newton's method for concave operators with resolvent positive derivatives in ordered Banach spaces , 2003 .

[34]  Steven Haberman,et al.  Optimal pension funding dynamics over infinite control horizon when stochastic rates of return are stationary , 2005 .

[35]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[36]  Adam Czornik,et al.  On the discrete JLQ and JLQG problems , 2001 .

[37]  Jinghao Zhu,et al.  On stochastic Riccati equations for the stochastic LQR problem , 2005, Syst. Control. Lett..

[38]  Oswaldo Luiz V. Costa,et al.  Maximal and Stabilizing Hermitian Solutions for Discrete-Time Coupled Algebraic Riccati Equations , 1999, Math. Control. Signals Syst..

[39]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[40]  X. Zhou,et al.  Continuous-Time Mean-Variance Portfolio Selection: A Stochastic LQ Framework , 2000 .

[41]  Nicole Bäuerle,et al.  Portfolio optimization with Markov-modulated stock prices and interest rates , 2004, IEEE Transactions on Automatic Control.

[42]  Domenico D'Alessandro,et al.  Discrete-Time Optimal Control with Control-Dependent Noise and Generalized Riccati Difference Equations , 1998, Autom..

[43]  Vasile Dragan,et al.  Mean Square Exponential Stability for some Stochastic Linear Discrete Time Systems , 2006, Eur. J. Control.

[44]  V. V. Dombrovskii,et al.  A Linear Quadratic Control for Discrete Systems with Random Parameters and Multiplicative Noise and Its Application to Investment Portfolio Optimization , 2003 .