Linear quadratic regulation problem for discrete-time systems with multi-channel multiplicative noise

Abstract This paper investigates the linear quadratic regulation (LQR) problem for discrete-time systems with multiplicative noise. Multiplicative noise is usually assumed to be a scalar in existing literature works. Motivated by recent applications of networked control systems and MIMO communication technology, we consider multi-channel multiplicative noise represented by a diagonal matrix. We first show that the finite horizon LQR problem can be solved using a generalized Riccati equation. We then prove the convergence of the generalized Riccati equation under the conditions of stabilization and exact observability, and obtain the solution to the infinite horizon LQR problem. Finally, we provide a numerical example to demonstrate the proposed approach.

[1]  S. Joshi.  On Optimal Control of Linear Systems in the Presence of Multiplicative Noise , 1976, IEEE Transactions on Aerospace and Electronic Systems.

[2]  James A. Primbs,et al.  Stochastic Receding Horizon Control of Constrained Linear Systems With State and Control Multiplicative Noise , 2007, IEEE Transactions on Automatic Control.

[3]  Ling Shi,et al.  Convergence and Mean Square Stability of Suboptimal Estimator for Systems With Measurement Packet Dropping , 2010, IEEE Transactions on Automatic Control.

[4]  L. Ghaoui.  State-feedback control of systems with multiplicative noise via linear matrix inequalities , 1995 .

[5]  D. Hinrichsen,et al.  H∞-type control for discrete-time stochastic systems , 1999 .

[6]  Oswaldo Luiz V. Costa,et al.  Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems , 2007, Autom..

[7]  Li Qiu,et al.  Infinite-horizon linear quadratic optimal control for discrete-time LTI systems with random input gains , 2013, 2013 American Control Conference.

[8]  Nan Xiao,et al.  Feedback Stabilization of Discrete-Time Networked Systems Over Fading Channels , 2012, IEEE Transactions on Automatic Control.

[9]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[10]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[11]  Zhou Luan-jie,et al.  Delay-Dependent Robust Stabilization of Uncertain State-Delayed Systems , 2004 .

[12]  X. Chen,et al.  Discrete-time Indefinite LQ Control with State and Control Dependent Noises , 2002, J. Glob. Optim..

[13]  José M. Bioucas-Dias,et al.  Multiplicative Noise Removal Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[14]  Jean-Louis Thonnard,et al.  Improving the state estimation for optimal control of stochastic processes subject to multiplicative noise , 2011, Autom..

[15]  Xi Chen,et al.  Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls , 2001, IEEE Trans. Autom. Control..

[16]  Young Soo Moon,et al.  Delay-dependent robust stabilization of uncertain state-delayed systems , 2001 .

[17]  Domenico D'Alessandro,et al.  Discrete-Time Optimal Control with Control-Dependent Noise and Generalized Riccati Difference Equations , 1998, Autom..

[18]  Isaac Yaesh,et al.  Hinfinity control and filtering of discrete-time stochastic systems with multiplicative noise , 2001, Autom..

[19]  Huanshui Zhang,et al.  Infinite horizon linear quadratic optimal control for discrete‐time stochastic systems , 2008 .

[20]  V. Dragan,et al.  Mathematical Methods in Robust Control of Linear Stochastic Systems , 2006 .

[21]  Yingmin Jia,et al.  H2 control of discrete-time periodic systems with Markovian jumps and multiplicative noise , 2013, Int. J. Control.

[22]  L. Ghaoui,et al.  A cone complementarity linearization algorithm for static output-feedback and related problems , 1996, Proceedings of Joint Conference on Control Applications Intelligent Control and Computer Aided Control System Design.

[23]  Weihai Zhang,et al.  Discrete-Time Indefinite Stochastic LQ Control via SDP and LMI Methods , 2012, J. Appl. Math..

[24]  Oswaldo Luiz do Valle Costa,et al.  Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems , 2008, Eur. J. Control.

[25]  Bor-Sen Chen,et al.  ${\cal H}$-Representation and Applications to Generalized Lyapunov Equations and Linear Stochastic Systems , 2012, IEEE Transactions on Automatic Control.

[26]  Nicola Elia,et al.  Remote stabilization over fading channels , 2005, Syst. Control. Lett..

[27]  Oswaldo Luiz V. Costa,et al.  Optimal mean-variance control for discrete-time linear systems with Markovian jumps and multiplicative noises , 2012, Autom..