Output Feedback Control and Stabilization for Multiplicative Noise Systems With Intermittent Observations

This paper mainly focuses on the optimal output feedback control and stabilization problems for discrete-time multiplicative noise system with intermittent observations. The main contributions of this paper can be concluded as follows. First, different from the previous literatures, this paper overcomes the barrier of the celebrated separation principle for stochastic control problems of multiplicative noise systems. Based on the measurement process, the optimal estimation is presented, and by using dynamic programming principle, the optimal output feedback controller is designed with feedback gain based on the given coupled Riccati equations. Second, the necessary and sufficient stabilization conditions for multiplicative noise system with intermittent observation in the mean square sense are developed for the first time. Finally, the novel results developed in this paper can be applied to solve the output feedback control and stabilization problems for general networked control system of user datagram protocol network case. The range of packet losses rate and the allowable maximum packet losses rate are presented explicitly.

[1]  Horacio J. Marquez,et al.  Multirate Output Feedback Control of Nonlinear Networked Control Systems , 2015, IEEE Transactions on Automatic Control.

[2]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[3]  Peng Shi,et al.  Robust Estimation for Neural Networks With Randomly Occurring Distributed Delays and Markovian Jump Coupling , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  J. Bismut.  Linear Quadratic Optimal Stochastic Control with Random Coefficients , 1976 .

[5]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[6]  W. Wonham.  On the Separation Theorem of Stochastic Control , 1968 .

[7]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[8]  Nasser E. Nahi,et al.  Optimal recursive estimation with uncertain observation , 1969, IEEE Trans. Inf. Theory.

[9]  Peijie Yin,et al.  Human-inspired motion model of upper-limb with fast response and learning ability – a promising direction for robot system and control , 2016 .

[10]  Qingyuan Qi,et al.  Output Feedback Control and Stabilization for Networked Control Systems With Packet Losses. , 2017, IEEE transactions on cybernetics.

[11]  S. Joshi.  On Optimal Control of Linear Systems in the Presence of Multiplicative Noise , 1976, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Bruno Sinopoli,et al.  Optimal linear LQG control over lossy networks without packet acknowledgment , 2008 .

[13]  D. Luenberger.  An introduction to observers , 1971 .

[14]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[15]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[16]  Dong Yue,et al.  Output Feedback Control of Discrete-Time Systems in Networked Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Huanshui Zhang,et al.  Infinite horizon linear quadratic optimal control for discrete‐time stochastic systems , 2008 .

[18]  Babak Hassibi,et al.  Indefinite-Quadratic Estimation And Control , 1987 .

[19]  Peng Shi,et al.  Finite-Time Distributed State Estimation Over Sensor Networks With Round-Robin Protocol and Fading Channels , 2018, IEEE Transactions on Cybernetics.

[20]  D. Hinrichsen,et al.  H∞-type control for discrete-time stochastic systems , 1999 .

[21]  Guo-Xing Wen,et al.  Observer-Based Adaptive Backstepping Consensus Tracking Control for High-Order Nonlinear Semi-Strict-Feedback Multiagent Systems , 2016, IEEE Transactions on Cybernetics.

[22]  Frank L. Lewis,et al.  Optimal Output-Feedback Control of Unknown Continuous-Time Linear Systems Using Off-policy Reinforcement Learning , 2016, IEEE Transactions on Cybernetics.

[23]  X. Chen,et al.  Discrete-time Indefinite LQ Control with State and Control Dependent Noises , 2002, J. Glob. Optim..

[24]  Andrea J. Goldsmith,et al.  LQG Control for MIMO Systems Over Multiple Erasure Channels With Perfect Acknowledgment , 2012, IEEE Transactions on Automatic Control.

[25]  Renquan Lu,et al.  Asynchronous Dissipative State Estimation for Stochastic Complex Networks With Quantized Jumping Coupling and Uncertain Measurements , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[26]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[27]  Hongjiu Yang,et al.  Event-Driven Control for Networked Control Systems With Quantization and Markov Packet Losses. , 2017, IEEE transactions on cybernetics.

[28]  Nathan van de Wouw,et al.  Decentralized observer-based control via networked communication , 2013, Autom..

[29]  Tamer Basar,et al.  Optimal control of LTI systems over unreliable communication links , 2006, Autom..

[30]  Huanshui Zhang,et al.  Stabilization of networked control systems with both network-induced delay and packet dropout , 2015, Autom..

[31]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .