Constrained stochastic LQ control on infinite time horizon with regime switching

This paper is concerned with a stochastic linear-quadratic (LQ) optimal control problem on infinite time horizon, with regime switching, random coefficients, and cone control constraint. To tackle the problem, two new extended stochastic Riccati equations (ESREs) on infinite time horizon are introduced. The existence of the nonnegative solutions, in both standard and singular cases, is proved through a sequence of ESREs on finite time horizon. Based on this result and some approximation techniques, we obtain the optimal state feedback control and optimal value for the stochastic LQ problem explicitly. Finally, we apply these results to solve a lifetime portfolio selection problem of tracking a given wealth level with regime switching and portfolio constraint.

[1]  Shanjian Tang,et al.  General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations , 2003, SIAM J. Control. Optim..

[2]  Xi Chen,et al.  Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon , 2004, SIAM J. Control. Optim..

[3]  Qing Zhang,et al.  Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach , 2012 .

[4]  P. Imkeller,et al.  Utility maximization in incomplete markets , 2005, math/0508448.

[5]  Xun Yu Zhou,et al.  Indefinite Stochastic Linear Quadratic Control with Markovian Jumps in Infinite Time Horizon , 2003, J. Glob. Optim..

[6]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[7]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[8]  Xun Yu Zhou,et al.  Relationship Between Backward Stochastic Differential Equations and Stochastic Controls: A Linear-Quadratic Approach , 2000, SIAM J. Control. Optim..

[9]  David D. Yao,et al.  Tracking a Financial Benchmark Using a Few Assets , 2006, Oper. Res..

[10]  Jiongmin Yong,et al.  Stochastic Linear Quadratic Optimal Control Problems in Infinite Horizon , 2016, Applied Mathematics & Optimization.

[11]  Xun Yu Zhou,et al.  Constrained Stochastic LQ Control with Random Coefficients, and Application to Portfolio Selection , 2005, SIAM J. Control. Optim..

[12]  X. Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs , 1998 .

[13]  Federica Masiero,et al.  Università di Milano – Bicocca Quaderni di Matematica Infinite Horizon and Ergodic Optimal Quadratic Control for an Affine Equation with Stochastic Coefficients , 2007 .

[14]  J. Bismut.  Linear Quadratic Optimal Stochastic Control with Random Coefficients , 1976 .

[15]  Gianmario Tessitore,et al.  Backward Stochastic Riccati Equations and Infinite Horizon L-Q Optimal Control with Infinite Dimensional State Space and Random Coefficients , 2008 .

[16]  M. Kobylanski.  Backward stochastic differential equations and partial differential equations with quadratic growth , 2000 .

[17]  Qi S. Zhang,et al.  Constrained Stochastic LQ Optimal Control Problem with Random Coefficients on Infinite Time Horizon , 2019, Applied Mathematics & Optimization.

[18]  David D. Yao,et al.  Stochastic Linear-Quadratic Control via Semidefinite Programming , 2001, SIAM J. Control. Optim..

[19]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[20]  Ying Hu,et al.  Constrained stochastic LQ control with regime switching and application to portfolio selection , 2020, The Annals of Applied Probability.