Stochastic linear control over a communication channel

We examine linear stochastic control systems when there is a communication channel connecting the sensor to the controller. The problem consists of designing the channel encoder and decoder as well as the controller to satisfy some given control objectives. In particular, we examine the role communication has on the classical linear quadratic Gaussian problem. We give conditions under which the classical separation property between estimation and control holds and the certainty equivalent control law is optimal. We then present the sequential rate distortion framework. We present bounds on the achievable performance and show the inherent tradeoffs between control and communication costs. In particular, we show that optimal quadratic cost decomposes into two terms: A full knowledge cost and a sequential rate distortion cost.

[1]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[2]  H. Witsenhausen.  Separation of estimation and control for discrete time systems , 1971 .

[3]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .

[4]  Kyong-Hwa Lee,et al.  Optimal Linear Coding for Vector Channels , 1976, IEEE Trans. Commun..

[5]  Tamer Basar,et al.  Simultaneous design of measurement and control strategies for stochastic systems with feedback , 1989, Autom..

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  Sergio Verdú,et al.  The source-channel separation theorem revisited , 1995, IEEE Trans. Inf. Theory.

[8]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[9]  R. Brockett,et al.  Systems with finite communication bandwidth constraints. I. State estimation problems , 1997, IEEE Trans. Autom. Control..

[10]  V. Borkar,et al.  LQG Control with Communication Constraints , 1997 .

[11]  S. Mitter,et al.  Control of LQG systems under communication constraints , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[12]  S. Mitter,et al.  Control of LQG systems under communication constraints , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[13]  Wing Shing Wong,et al.  Systems with finite communication bandwidth constraints. II. Stabilization with limited information feedback , 1999, IEEE Trans. Autom. Control..

[14]  Daniel Liberzon,et al.  Quantized feedback stabilization of linear systems , 2000, IEEE Trans. Autom. Control..

[15]  Optimal Sequential Vector Quantization of Markov Sources , 2001, SIAM J. Control. Optim..

[16]  Nicola Elia,et al.  Stabilization of linear systems with limited information , 2001, IEEE Trans. Autom. Control..

[17]  Anant Sahai,et al.  Anytime information theory , 2001 .

[18]  Sekhar Tatikonda,et al.  Markov control problems under communication constraints , 2001, Commun. Inf. Syst..

[19]  R. Evans,et al.  Mean square stabilisability of stochastic linear systems with data rate constraints , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[20]  John Baillieul,et al.  Feedback Designs in Information-Based Control , 2002 .

[21]  T. Berger.  Rate-Distortion Theory , 2003 .

[22]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[23]  Sekhar Tatikonda,et al.  Control over noisy channels , 2004, IEEE Transactions on Automatic Control.

[24]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[25]  R. Manakkal.  Joint source-channel coding with feedback , 2005 .

[26]  Tamás Linder,et al.  Causal coding of stationary sources and individual sequences with high resolution , 2006, IEEE Transactions on Information Theory.