Optimal Control for Networked Control Systems with Markovian Packet Losses

This paper is concerned with the optimal output feedback control problem for networked control systems (NCSs) with Markovian packet losses. In this paper, the packet losses occur both between the sensor and controller and between the controller and actuator. Moreover, the packet loss channels are described with two-state Markov chains. Since the precise state information cannot be obtained, thus an optimal recursive estimator is designed. Furthermore, by adopting the dynamic programming approach, we derive the optimal output feedback control, which is based on the solution to a given modified Riccati equation. The obtained results can be seen as an important implementation of the control theory for NCSs with unreliable communication channels.

[1]  Jun Hu,et al.  Moving Horizon Estimation With Unknown Inputs Under Dynamic Quantization Effects , 2020, IEEE Transactions on Automatic Control.

[2]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[3]  Lei Zou,et al.  Moving Horizon Estimation for Networked Time-Delay Systems Under Round-Robin Protocol , 2019, IEEE Transactions on Automatic Control.

[4]  Jianliang Wang,et al.  H∞ Controller Design of Networked Control Systems with Markov Packet Dropouts , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Stephen P. Boyd,et al.  Future directions in control in an information-rich world , 2003 .

[6]  Nasser E. Nahi,et al.  Optimal recursive estimation with uncertain observation , 1969, IEEE Trans. Inf. Theory.

[7]  Huanshui Zhang,et al.  Optimal control and stabilisation for large-scale systems with imposed constraints , 2020 .

[8]  Donghua Zhou,et al.  Moving horizon estimation with non-uniform sampling under component-based dynamic event-triggered transmission , 2020, Autom..

[9]  Duanjin Zhang,et al.  H-Infinity Fault Detection for Delta Operator Systems With Random Two-Channels Packet Losses and Limited Communication , 2019, IEEE Access.

[10]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[11]  Huanshui Zhang,et al.  Stabilization of networked control systems with both network-induced delay and packet dropout , 2015, Autom..

[12]  S. Joshi.  On Optimal Control of Linear Systems in the Presence of Multiplicative Noise , 1976, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Jing Wu,et al.  Design of Networked Control Systems With Packet Dropouts , 2007, IEEE Transactions on Automatic Control.

[14]  Chong Lin,et al.  Fast Consensus Seeking on Networks with Antagonistic Interactions , 2018, Complex..

[15]  Tai C Yang,et al.  Networked control system: a brief survey , 2006 .

[16]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[17]  Peter J Seiler,et al.  Analysis of communication losses in vehicle control problems , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[18]  Lihua Xie,et al.  Optimal Control for Stochastic Systems With Multiple Controllers of Different Information Structures , 2021, IEEE Transactions on Automatic Control.

[19]  Huanshui Zhang,et al.  Output Feedback Control and Stabilization for Multiplicative Noise Systems With Intermittent Observations , 2018, IEEE Transactions on Cybernetics.

[20]  Duanjin Zhang,et al.  Fault Detection for Uncertain Delta Operator Systems with Two-Channel Packet Dropouts via a Switched Systems Approach , 2020, J. Syst. Sci. Complex..

[21]  Zhiyong Huang,et al.  Identification of Errors-in-Variables Systems with General Nonlinear Output Observations and with ARMA Observation Noises , 2020, J. Syst. Sci. Complex..

[22]  Huanshui Zhang,et al.  Output Feedback Control and Stabilization for Networked Control Systems With Packet Losses , 2017, IEEE Transactions on Cybernetics.

[23]  Dipesh Shah,et al.  Discrete-time sliding mode controller subject to real-time fractional delays and packet losses for networked control system , 2017 .

[24]  Andrzej Bartoszewicz,et al.  Event-Triggered Discrete Higher-Order SMC for Networked Control System Having Network Irregularities , 2020, IEEE Transactions on Industrial Informatics.

[25]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[26]  Huanshui Zhang,et al.  Stabilization Control for Linear Continuous-Time Mean-Field Systems , 2016, IEEE Transactions on Automatic Control.

[27]  Dong Yue,et al.  Output Feedback Control of Discrete-Time Systems in Networked Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.