Value of Information in Feedback Control: Global Optimality

The rate-regulation tradeoff, defined between two objective functions, one penalizing the packet rate and one the regulation cost, can express the fundamental performance bound of networked control systems. However, the characterization of the set of globally optimal solutions in this tradeoff for multidimensional Gauss–Markov processes has been an open problem. In this article, we characterize a policy profile that belongs to this set without imposing any restrictions on the information structure or the policy structure. We prove that such a policy profile consists of a symmetric threshold triggering policy based on the value of information and a certainty-equivalent control policy based on a non-Gaussian linear estimator. These policies are deterministic and can be designed separately. Besides, we provide a global optimality analysis for the value of information <inline-formula><tex-math notation="LaTeX">$\mathbf{{VoI}}_{{\boldsymbol{k}}}$</tex-math></inline-formula>, a semantic metric that emerges from the rate-regulation tradeoff as the difference between the benefit and the cost of a data packet. We prove that it is globally optimal that a data packet containing sensory information at time <inline-formula><tex-math notation="LaTeX">${\boldsymbol{k}}$</tex-math></inline-formula> be transmitted to the controller only if <inline-formula><tex-math notation="LaTeX">$\mathbf{{VoI}}_{{\boldsymbol{k}}}$</tex-math></inline-formula> becomes nonnegative. These findings have important implications in the areas of communication and control.

[1]  V. Kostina,et al.  Optimal Causal Rate-Constrained Sampling for a Class of Continuous Markov Processes , 2020, 2020 IEEE International Symposium on Information Theory (ISIT).

[2]  V. Kostina,et al.  Optimal Causal Rate-Constrained Sampling of the Wiener Process , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[3]  J. Baras,et al.  Value of Information in Feedback Control: Quantification , 2018, IEEE Transactions on Automatic Control.

[4]  Daniel E. Quevedo,et al.  Transmission scheduling for remote state estimation and control with an energy harvesting sensor , 2018, Autom..

[5]  Daniel E. Quevedo,et al.  Tradeoffs in Stochastic Event-Triggered Control , 2017, IEEE Transactions on Automatic Control.

[6]  Yin Sun,et al.  Sampling of the Wiener Process for Remote Estimation Over a Channel With Random Delay , 2017, IEEE Transactions on Information Theory.

[7]  Daniel E. Quevedo,et al.  Event-Based Transmission Scheduling and LQG Control Over a Packet Dropping Link , 2017 .

[8]  Sandra Hirche,et al.  Event-Triggered State Estimation: An Iterative Algorithm and Optimality Properties , 2017, IEEE Transactions on Automatic Control.

[9]  Daniel E. Quevedo,et al.  Sensor Scheduling in Variance Based Event Triggered Estimation With Packet Drops , 2015, IEEE Transactions on Automatic Control.

[10]  Aditya Mahajan,et al.  Fundamental Limits of Remote Estimation of Autoregressive Markov Processes Under Communication Constraints , 2015, IEEE Transactions on Automatic Control.

[11]  Serdar Yüksel,et al.  Jointly Optimal LQG Quantization and Control Policies for Multi-Dimensional Systems , 2014, IEEE Transactions on Automatic Control.

[12]  Ling Shi,et al.  Stochastic event-triggered sensor scheduling for remote state estimation , 2013, 52nd IEEE Conference on Decision and Control.

[13]  Tamer Basar,et al.  Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints , 2013 .

[14]  Ling Shi,et al.  Event-Based Sensor Data Scheduling: Trade-Off Between Communication Rate and Estimation Quality , 2013, IEEE Transactions on Automatic Control.

[15]  Sandra Hirche,et al.  On the Optimality of Certainty Equivalence for Event-Triggered Control Systems , 2013, IEEE Transactions on Automatic Control.

[16]  Mircea Lazar,et al.  Event Based State Estimation With Time Synchronous Updates , 2012, IEEE Transactions on Automatic Control.

[17]  Karl Henrik Johansson,et al.  Design of State-Based Schedulers for a Network of Control Loops , 2012, IEEE Transactions on Automatic Control.

[18]  Nuno C. Martins,et al.  Remote State Estimation With Communication Costs for First-Order LTI Systems , 2011, IEEE Transactions on Automatic Control.

[19]  John S. Baras,et al.  Adaptive Sampling for Linear State Estimation , 2009, SIAM J. Control. Optim..

[20]  T. Başar,et al.  Optimal Estimation with Limited Measurements , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  V. Borkar,et al.  Optimal sequential vector quantization of Markov sources , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[22]  Pramod K. Varshney,et al.  Multisensor Data Fusion , 1997, IEA/AIE.

[23]  R. Tahraoui Symmetrization inequalities , 1996 .

[24]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[25]  P. Lions,et al.  Comparison results for elliptic and parabolic equations via symmetrization: a new approach , 1991, Differential and Integral Equations.

[26]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[27]  H. Witsenhausen On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[28]  Harold J. Kushner,et al.  On the optimum timing of observations for linear control systems with unknown initial state , 1964 .

[29]  Jiming Chen,et al.  Event-Based State Estimation: Optimal Algorithm With Generalized Closed Skew Normal Distribution , 2019, IEEE Transactions on Automatic Control.

[30]  F. Brock A general rearrangement inequality à la Hardy–Littlewood , 2000 .