LQG CONTROL WITH MISSING OBSERVATION AND CONTROL PACKETS

Abstract The paper considers the Linear Quadratic Gaussian (LQG) optimal control problem in the discrete time setting and when data loss may occur between the sensors and the estimation-control unit and between the latter and the actuation points. For protocols where packets are acknowledged at the receiver (e.g. TCP type protocols), the separation principle holds. Moreover, the optimal LQG control is a linear function of the state. Finally, building upon our previous results on estimation with unreliable communication, the paper shows the existence of critical arrival probabilities below which the optimal controller fails to stabilize the system. This is done by providing analytic upper and lower bounds on the cost functional, and stochastically characterizing their convergence properties in the infinite horizon. More interestingly, it turns out that when there is no feedback on whether a control packet has been delivered or not (e.g. UDP type protocols), the LQG optimal controller is in general nonlinear.

[1]  Qiang Ling,et al.  Soft real-time scheduling of networked control systems with dropouts governed by a Markov chain , 2003, Proceedings of the 2003 American Control Conference, 2003..

[2]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[3]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[4]  Qiang Ling,et al.  Optimal dropout compensation in networked control systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[5]  R. Murray,et al.  Optimal LQG Control Across a Packet-Dropping Link , 2004 .

[6]  Richard M. Murray,et al.  Optimal LQG control across packet-dropping links , 2007, Syst. Control. Lett..

[7]  Johan Nilsson,et al.  Real-Time Control Systems with Delays , 1998 .

[8]  Tamer Basar,et al.  Optimal control of dynamical systems over unreliable communication links , 2004 .

[9]  Bruno Sinopoli,et al.  Distributed control applications within sensor networks , 2003, Proc. IEEE.

[10]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[11]  S. Sastry,et al.  Optimal control with unreliable communication: the TCP case , 2005, Proceedings of the 2005, American Control Conference, 2005..

[12]  Christoforos N. Hadjicostis,et al.  Feedback control utilizing packet dropping network links , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..