On the Optimality of Certainty Equivalence for Event-Triggered Control Systems

Digital control design is commonly constrained to time-triggered control systems with periodic sampling. The emergence of more and more complex and distributed systems urges the development of advanced triggering schemes that utilize communication, computation, and energy resources more efficiently. This technical note addresses the question whether certainty equivalence is optimal for an event-triggered control system with resource constraints. The problem setting is an extension of the stochastic linear quadratic system framework, where the joint design of the control law and the event-triggering law minimizing a common objective is considered. Three differing variants are studied that reflect the resource constraints: a penalty term to acquire the resource, a limitation on the number of resource acquisitions, and a constraint on the average number of resource acquisitions. By reformulating the underlying optimization problem, a characterization of the optimal control law is possible. This characterization shows that the certainty equivalence controller is optimal for all three optimization problems.

[1]  Sandra Hirche,et al.  Suboptimal Event-based Control of Linear Systems over Lossy Channels , 2010 .

[2]  V. Borkar,et al.  LQG Control with Communication Constraints , 1997 .

[3]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[4]  Charles D. Schaper,et al.  Communications, Computation, Control, and Signal Processing: A Tribute to Thomas Kailath , 1997 .

[5]  K. Åström.  Introduction to Stochastic Control Theory , 1970 .

[6]  T. Başar,et al.  Optimal Estimation with Limited Measurements , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[7]  H. Witsenhausen.  Separation of estimation and control for discrete time systems , 1971 .

[8]  E. Altman.  Constrained Markov Decision Processes , 1999 .

[9]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[10]  Nuno C. Martins,et al.  Remote State Estimation With Communication Costs for First-Order LTI Systems , 2011, IEEE Transactions on Automatic Control.

[11]  Karl Henrik Johansson,et al.  Event-triggered control for multi-agent systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[12]  H. Witsenhausen.  A Counterexample in Stochastic Optimum Control , 1968 .

[13]  Sandra Hirche,et al.  On LQG joint optimal scheduling and control under communication constraints , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[14]  Karl Henrik Johansson,et al.  Optimal stopping for event-triggered sensing and actuation , 2008, 2008 47th IEEE Conference on Decision and Control.

[15]  Sandra Hirche,et al.  Structural characterization of optimal event-based controllers for linear stochastic systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[16]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[17]  Hans S. Witsenhausen,et al.  A standard form for sequential stochastic control , 1973, Mathematical systems theory.

[18]  Paulo Tabuada,et al.  Event-Triggered Real-Time Scheduling of Stabilizing Control Tasks , 2007, IEEE Transactions on Automatic Control.

[19]  Karl Henrik Johansson,et al.  LQG and Medium Access Control , 2009 .

[20]  Tamer Basar,et al.  Optimal control with limited controls , 2006, 2006 American Control Conference.

[21]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[22]  J. Peschon,et al.  Optimal control of measurement subsystems , 1967, IEEE Transactions on Automatic Control.

[23]  Wei Wu,et al.  Optimal Sensor Querying: General Markovian and LQG Models With Controlled Observations , 2008, IEEE Transactions on Automatic Control.

[24]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[25]  John S. Baras,et al.  Adaptive Sampling for Linear State Estimation , 2009, SIAM J. Control. Optim..

[26]  Michael D. Lemmon,et al.  An event-triggered distributed primal-dual algorithm for Network Utility maximization , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[27]  Dimitri P. Bertsekas,et al.  Dynamic programming and optimal control, 3rd Edition , 2005 .

[28]  K. Åström,et al.  Comparison of Riemann and Lebesgue sampling for first order stochastic systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[29]  Anton Cervin,et al.  Scheduling of event-triggered controllers on a shared network , 2008, 2008 47th IEEE Conference on Decision and Control.