Optimal Estimation in Networked Control Systems Subject to Random Delay and Packet Drop

In this note, we study optimal estimation design for sampled linear systems where the sensors measurements are transmitted to the estimator site via a generic digital communication network. Sensor measurements are subject to random delay or might even be completely lost. We show that the minimum error covariance estimator is time-varying, stochastic, and it does not converge to a steady state. Moreover, the architecture of this estimator is independent of the communication protocol and can be implemented using a finite memory buffer if the delivered packets have a finite maximum delay. We also present two alternative estimator architectures that are more computationally efficient and provide upper and lower bounds for the performance of the time-varying estimator. The stability of these estimators does not depend on packet delay but only on the overall packet loss probability. Finally, algorithms to compute critical packet loss probability and estimators performance in terms of their error covariance are given and applied to some numerical examples.

[1]  Nasser E. Nahi,et al.  Optimal recursive estimation with uncertain observation , 1969, IEEE Trans. Inf. Theory.

[2]  T. Katayama On the matrix Riccati equation for linear systems with random gain , 1976 .

[3]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[4]  Harold L. Alexander,et al.  State estimation for distributed systems with sensing delay , 1991, Defense, Security, and Sensing.

[5]  John N. Tsitsiklis,et al.  Optimization of multiclass queuing networks: polyhedral and nonlinear characterizations of achievable performance , 1994 .

[6]  P. R. Kumar,et al.  Performance bounds for queueing networks and scheduling policies , 1994, IEEE Trans. Autom. Control..

[7]  Sean P. Meyn,et al.  Duality and linear programs for stability and performance analysis of queueing networks and scheduling policies , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[8]  Guanrong Chen,et al.  Linear Stochastic Control Systems , 1995 .

[9]  Johan Nilsson,et al.  Stochastic Analysis and Control of Real-Time Systems with Random Time Delays , 1996 .

[10]  Björn Wittenmark,et al.  Stochastic Analysis and Control of Real-time Systems with Random Time Delays , 1999 .

[11]  Niels Kjølstad Poulsen,et al.  Incorporation of time delayed measurements in a discrete-time Kalman filter , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[12]  J. R. Morrison,et al.  New Linear Program Performance Bounds for Queueing Networks , 1999 .

[13]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[14]  Panganamala Ramana Kumar,et al.  New Linear Program Performance Bounds for Closed Queueing Networks , 2001, Discret. Event Dyn. Syst..

[15]  Nicola Elia,et al.  Stabilization of linear systems with limited information , 2001, IEEE Trans. Autom. Control..

[16]  H. Durrant-Whyte,et al.  Data Fusion in Decentralised Sensing Networks , 2001 .

[17]  Christoforos N. Hadjicostis,et al.  Feedback control utilizing packet dropping network links , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[18]  Nandit Soparkar,et al.  Trading computation for bandwidth: reducing communication in distributed control systems using state estimators , 2002, IEEE Trans. Control. Syst. Technol..

[19]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[20]  Gaurav S. Sukhatme,et al.  Connecting the Physical World with Pervasive Networks , 2002, IEEE Pervasive Comput..

[21]  James R. Morrison,et al.  Linear Programming Performance Bounds for Markov Chains With Polyhedrally Translation Invariant Probabilities and Applications to Unreliable Manufacturing Systems and Enhanced Wafer Fab Models , 2002 .

[22]  K.-E. Arzen,et al.  How does control timing affect performance? Analysis and simulation of timing using Jitterbug and TrueTime , 2003, IEEE Control Systems.

[23]  Bruno Sinopoli,et al.  Distributed control applications within sensor networks , 2003, Proc. IEEE.

[24]  Benjamin Van Roy,et al.  The Linear Programming Approach to Approximate Dynamic Programming , 2003, Oper. Res..

[25]  Michael I. Jordan,et al.  Kalman filtering with intermittent observations , 2003, IEEE Transactions on Automatic Control.

[26]  Chenyang Lu,et al.  SPEED: a stateless protocol for real-time communication in sensor networks , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[27]  Qiang Ling,et al.  Optimal dropout compensation in networked control systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[28]  Vladimir L. Kharitonov,et al.  Stability of Time-Delay Systems , 2003, Control Engineering.

[29]  Deborah Estrin,et al.  Habitat monitoring with sensor networks , 2004, CACM.

[30]  R. Murray,et al.  Optimal LQG Control Across a Packet-Dropping Link , 2004 .

[31]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[32]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[33]  Tamer Basar,et al.  Optimal control of dynamical systems over unreliable communication links , 2004 .

[34]  Dragan Nesic,et al.  Input-output stability properties of networked control systems , 2004, IEEE Transactions on Automatic Control.

[35]  Gyula Simon,et al.  The flooding time synchronization protocol , 2004, SenSys '04.

[36]  Long Wang,et al.  An LMI approach to networked control systems with data packet dropout and transmission delays , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[37]  Dong Yue,et al.  State feedback controller design of networked control systems , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[38]  D.M. Tilbury,et al.  Packet-based control , 2004, Proceedings of the 2004 American Control Conference.

[39]  Panos J. Antsaklis,et al.  Stability of model-based networked control systems with time-varying transmission times , 2004, IEEE Transactions on Automatic Control.

[40]  B. Hohlt,et al.  Flexible power scheduling for sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[41]  Michael Cw Kintner-Meyer Opportunities of Wireless Sensors and Controls for Building Operation , 2005 .

[42]  Wei Hong,et al.  A macroscope in the redwoods , 2005, SenSys '05.

[43]  S.J. Julier,et al.  Fusion of time delayed measurements with uncertain time delays , 2005, Proceedings of the 2005, American Control Conference, 2005..

[44]  J.P. Hespanha,et al.  Estimation under uncontrolled and controlled communications in Networked Control Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[45]  R. Murray,et al.  Estimation with Information Loss: Asymptotic Analysis and Error Bounds , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[46]  Andreas Willig,et al.  Wireless Technology in Industrial Networks , 2005, Proceedings of the IEEE.

[47]  L. Schenato Kalman Filtering for networked control systems with random delay and packet loss , 2005 .

[48]  Chenyang Lu,et al.  Mobile agent middleware for sensor networks: an application case study , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[49]  On the optimal density for real-time data gathering of spatio-temporal processes in sensor networks , 2005 .

[50]  Nicola Elia,et al.  Remote stabilization over fading channels , 2005, Syst. Control. Lett..

[51]  L. Schenato Optimal estimation in networked control systems subject to random delay and packet loss , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[52]  Tamer Basar,et al.  Optimal control of LTI systems over unreliable communication links , 2006, Autom..

[53]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[54]  J.P. Hespanha,et al.  Estimation over Communication Networks: Performance Bounds and Achievability Results , 2007, 2007 American Control Conference.

[55]  Luca Schenato,et al.  Optimal sensor fusion for distributed sensors subject to random delay and packet loss , 2007, 2007 46th IEEE Conference on Decision and Control.

[56]  Richard M. Murray,et al.  Optimal LQG control across packet-dropping links , 2007, Syst. Control. Lett..

[57]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[58]  S. Shankar Sastry,et al.  Tracking and Coordination of Multiple Agents Using Sensor Networks: System Design, Algorithms and Experiments , 2007, Proceedings of the IEEE.

[59]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.