On the optimality of threshold policies in event triggered estimation with packet drops

We consider a remote state estimation problem, where a sensor transmits local state estimates over an independent and identically distributed (i.i.d.) packet dropping link to a remote estimator. At each discrete time instant, the sensor can decide whether to transmit, with each transmission incurring a fixed energy cost. Performance is quantified via an optimization problem that minimizes a convex combination of the expected error covariance at the remote estimator and expected energy usage. For transmission schedules dependent only on the error covariance at the remote estimator, this work establishes that a threshold policy (i.e. transmit if the error covariance exceeds a certain threshold and don't transmit otherwise) is optimal. This provides a rigorous justification for the use of such threshold policies in event triggered estimation. An extension of the result to Markovian packet drops is also outlined.

[1]  M. Lemmon,et al.  Event-triggered state estimation in vector linear processes , 2010, Proceedings of the 2010 American Control Conference.

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[3]  Karl Henrik Johansson,et al.  Scheduling packets for Event-triggered control , 2009, 2009 European Control Conference (ECC).

[4]  Subhrakanti Dey,et al.  Stability of Kalman filtering with Markovian packet losses , 2007, Autom..

[5]  Ling Shi,et al.  Kalman Filtering Over a Packet-Dropping Network: A Probabilistic Perspective , 2010, IEEE Transactions on Automatic Control.

[6]  Daniel E. Quevedo,et al.  Stochastic Stability of Event-Triggered Anytime Control , 2013, IEEE Transactions on Automatic Control.

[7]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[8]  Ling Shi,et al.  Event-Based Sensor Data Scheduling: Trade-Off Between Communication Rate and Estimation Quality , 2013, IEEE Transactions on Automatic Control.

[9]  Panos J. Antsaklis,et al.  Networked state estimation over a shared communication medium , 2013, 2013 American Control Conference.

[10]  Karl Henrik Johansson,et al.  Design of State-Based Schedulers for a Network of Control Loops , 2012, IEEE Transactions on Automatic Control.

[11]  Swen Kortig,et al.  Stochastic Dynamic Programming And The Control Of Queueing Systems , 2016 .

[12]  Vikram Krishnamurthy,et al.  Optimality of threshold policies for transmission scheduling in correlated fading channels , 2009, IEEE Transactions on Communications.

[13]  Ling Shi,et al.  Stochastic event-triggered sensor scheduling for remote state estimation , 2013, 52nd IEEE Conference on Decision and Control.

[14]  Donald M. Topkis,et al.  Minimizing a Submodular Function on a Lattice , 1978, Oper. Res..

[15]  Sebastian Trimpe,et al.  Event-Based State Estimation With Variance-Based Triggering , 2012, IEEE Transactions on Automatic Control.

[16]  L. Sennott Stochastic Dynamic Programming and the Control of Queueing Systems , 1998 .

[17]  Paulo Tabuada,et al.  Event-Triggered Real-Time Scheduling of Stabilizing Control Tasks , 2007, IEEE Transactions on Automatic Control.