Iterative Encoder-Controller Design for Feedback Control Over Noisy Channels

We study a closed-loop control system with state feedback transmitted over a noisy discrete memoryless channel. With the objective to minimize the expected linear quadratic cost over a finite horizon, we propose a joint design of the sensor measurement quantization, channel error protection, and controller actuation. It is argued that despite that this encoder-controller optimization problem is known to be hard in general, an iterative design procedure can be derived in which the controller is optimized for a fixed encoder, then the encoder is optimized for a fixed controller, etc. Several properties of such a scheme are discussed. For a fixed encoder, we study how to optimize the controller given that full or partial side-information is available at the encoder about the symbols received at the controller. It is shown that the certainty equivalence controller is optimal when the encoder is optimal and has full side-information. For a fixed controller, expressions for the optimal encoder are given and implications are discussed for the special cases when process, sensor, or channel noise is not present. Numerical experiments are carried out to demonstrate the performance obtained by employing the proposed iterative design procedure and to compare it with other relevant schemes.

[1]  S. Sahai,et al.  The necessity and sufficiency of anytime capacity for control over a noisy communication link , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  Robin J. Evans,et al.  Stabilizability of Stochastic Linear Systems with Finite Feedback Data Rates , 2004, SIAM J. Control. Optim..

[3]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[4]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[5]  Girish N. Nair,et al.  Internal stability of dynamic quantised control for stochastic linear plants , 2009, Autom..

[6]  V. Borkar,et al.  Optimal sequential vector quantization of Markov sources , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[7]  Daniel Liberzon,et al.  Quantized feedback stabilization of linear systems , 2000, IEEE Trans. Autom. Control..

[8]  Andrey V. Savkin,et al.  Analysis and synthesis of networked control systems: Topological entropy, observability, robustness and optimal control , 2005, Autom..

[9]  Andrey V. Savkin,et al.  An Analogue of Shannon Information Theory for Detection and Stabilization via Noisy Discrete Communication Channels , 2007, SIAM J. Control. Optim..

[10]  A.S. Matveev,et al.  An analogue of Shannon information theory for networked control systems: State estimation via a noisy discrete channel , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[11]  Sandro Zampieri,et al.  A Symbolic Approach to Performance Analysis of Quantized Feedback Systems: The Scalar Case , 2005, SIAM J. Control. Optim..

[12]  Sergio Verdú,et al.  The source-channel separation theorem revisited , 1995, IEEE Trans. Inf. Theory.

[13]  J. Baillieul,et al.  Time to Failure of Quantized Control via a Binary Symmetric Channel , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[14]  Daniel E. Quevedo,et al.  Simple coding for achieving mean square stability over bit-rate limited channels , 2008, 2008 47th IEEE Conference on Decision and Control.

[15]  Robert M. Gray,et al.  Global convergence and empirical consistency of the generalized Lloyd algorithm , 1986, IEEE Trans. Inf. Theory.

[16]  Jean-Charles Delvenne,et al.  An optimal quantized feedback strategy for scalar linear systems , 2006, IEEE Transactions on Automatic Control.

[17]  Karl Henrik Johansson,et al.  On Optimal System Design for Feedback Control over Noisy Channels , 2007, 2007 IEEE International Symposium on Information Theory.

[18]  D. Delchamps Stabilizing a linear system with quantized state feedback , 1990 .

[19]  Andrey V. Savkin,et al.  An analogue of Shannon information theory for networked control systems. Stabilization via a noisy discrete channel , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[20]  Demosthenis Teneketzis,et al.  Fixed Delay Optimal Joint Source-Channel Coding for Finite-Memory Systems , 2006, 2006 IEEE International Symposium on Information Theory.

[21]  T. Fischer,et al.  Optimal quantized control , 1982 .

[22]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[23]  Girish N. Nair,et al.  Internal stability of dynamically quantised control for stochastic scalar plants , 2008 .

[24]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[25]  A. Matveev,et al.  On a problem related to application of digital networked communication technology to stabilization of noisy plants over noisy channels , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[26]  R. Larson,et al.  Optimum quantization in dynamic systems , 1967, IEEE Transactions on Automatic Control.

[27]  Tamer Basar,et al.  Optimal control of LTI systems over unreliable communication links , 2006, Autom..

[28]  F. Fagnani,et al.  Stability analysis and synthesis for scalar linear systems with a quantized feedback , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[29]  J. T. Tou,et al.  Optimum Sampled-Data Systems with Quantized Control Signals , 1963, IEEE Transactions on Applications and Industry.

[30]  J. Baillieul Feedback coding for information-based control: operating near the data-rate limit , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[31]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[32]  Anant Sahai,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I: Scalar Systems , 2006, IEEE Transactions on Information Theory.

[33]  Wing Shing Wong,et al.  Systems with finite communication bandwidth constraints. II. Stabilization with limited information feedback , 1999, IEEE Trans. Autom. Control..

[34]  Qiang Ling,et al.  Optimal Dynamic Bit Assignment in Second-order Noise-free Quantized Linear Control Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[35]  J. A. Bather,et al.  Optimization of Stochastic Systems: Topics in Discrete-Time Dynamics , 1989 .

[36]  Robin J. Evans,et al.  Topological feedback entropy and Nonlinear stabilization , 2004, IEEE Transactions on Automatic Control.

[37]  Karl Henrik Johansson,et al.  Encoder-Decoder Design for Feedback Control over the Binary Symmetric Channel , 2006, 2006 IEEE International Symposium on Information Theory.

[38]  Qiang Ling,et al.  Optimal Dynamic Bit Assignment in Noise-free Quantized Linear Control Systems , 2005 .

[39]  Antonio Bicchi,et al.  Construction of invariant and attractive sets for quantized-input linear systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[40]  Lei Bao,et al.  Control over Low-Rate Noisy Channels , 2009 .

[41]  Massimo Franceschetti,et al.  Towards feedback stabilization over fading channels , 2007, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops.

[42]  D. Liberzon STABILIZATION BY QUANTIZED STATE OR OUTPUT FEEDBACK: A HYBRID CONTROL APPROACH , 2002 .

[43]  Nariman Farvardin,et al.  A study of vector quantization for noisy channels , 1990, IEEE Trans. Inf. Theory.

[44]  Q. Xu,et al.  The anytime capacity of AWGN+erasure channel with feedback , 2004 .

[45]  H. Witsenhausen Separation of estimation and control for discrete time systems , 1971 .

[46]  L. Meier Combined optimal control and estimation. , 1965 .

[47]  Andrey V. Savkin,et al.  The problem of LQG optimal control via a limited capacity communication channel , 2004, Syst. Control. Lett..

[48]  Sekhar Tatikonda,et al.  Control over noisy channels , 2004, IEEE Transactions on Automatic Control.

[49]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .

[50]  Lei Bao,et al.  A Scheme for Joint Quantization, Error Protection and Feedback Control over Noisy Channels , 2007, 2007 American Control Conference.

[51]  Charalambos D. Charalambous,et al.  LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels , 2008, Autom..

[52]  S. Mitter,et al.  Quantization of linear systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[53]  V. Borkar,et al.  LQG Control with Communication Constraints , 1997 .

[54]  Richard H. Middleton,et al.  Feedback stabilization over signal-to-noise ratio constrained channels , 2007, Proceedings of the 2004 American Control Conference.

[55]  Minyue Fu,et al.  Linear quadratic Gaussian control with quantized feedback , 2009, 2009 American Control Conference.

[56]  D. Bertsekas,et al.  Dynamic Programming and Stochastic Control , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[57]  Lei Bao,et al.  Encoder~Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels , 2006, 2006 American Control Conference.