Jointly Optimal LQG quantization and control policies for multi-dimensional linear Gaussian sources

For controlled Rn-valued linear systems driven by Gaussian noise under quadratic cost criteria, we investigate the existence and the structure of optimal quantization and control policies. For a fully observed system, we show that an optimal quantization policy exists, provided that the quantizers allowed are ones which have convex codecells. Furthermore, optimal control policies are linear in the conditional estimate of the state. A form of separation and estimation applies. As a minor side result, towards obtaining the main results of the paper, structural results in the literature for optimal causal (zero-delay) quantization of Markov sources is extended to systems driven by control. For the partially observed case, structure of optimal coding and control policies is presented.

[1]  T. Fischer,et al.  Optimal quantized control , 1982 .

[2]  H. Witsenhausen.  On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[3]  A. Sahai,et al.  Sequential Source Coding: An optimization viewpoint , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[4]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[5]  Ramji Venkataramanan,et al.  Source Coding With Feed-Forward: Rate-Distortion Theorems and Error Exponents for a General Source , 2007, IEEE Transactions on Information Theory.

[6]  Demosthenis Teneketzis,et al.  On the design of globally optimal communication strategies for real-time noisy communication systems with noisy feedback , 2008, IEEE Journal on Selected Areas in Communications.

[7]  A. Matveev,et al.  Estimation and Control over Communication Networks , 2008 .

[8]  Tamer Basar,et al.  Simultaneous design of measurement and control strategies for stochastic systems with feedback , 1989, Autom..

[9]  Sekhar Tatikonda,et al.  A Counterexample in Distributed Optimal Sensing and Control , 2009, IEEE Transactions on Automatic Control.

[10]  Demosthenis Teneketzis,et al.  On the Structure of Optimal Real-Time Encoders and Decoders in Noisy Communication , 2006, IEEE Transactions on Information Theory.

[11]  K. Åström.  Introduction to Stochastic Control Theory , 1970 .

[12]  Ashutosh Nayyar,et al.  On the Structure of Real-Time Encoding and Decoding Functions in a Multiterminal Communication System , 2011, IEEE Transactions on Information Theory.

[13]  T. Başar,et al.  Stochastic Teams with Nonclassical Information Revisited: When is an Affine Law Optimal? , 1986, 1986 American Control Conference.

[14]  Serdar Yüksel,et al.  On Optimal Causal Coding of Partially Observed Markov Sources in Single and Multiterminal Settings , 2010, IEEE Transactions on Information Theory.

[15]  Tamás Linder,et al.  On optimal zero-delay quantization of vector Markov sources , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[16]  G. Wise,et al.  Convergence of Vector Quantizers with Applications to Optimal Quantization , 1984 .

[17]  V. Borkar,et al.  LQG Control with Communication Constraints , 1997 .

[18]  Minyue Fu,et al.  Lack of Separation Principle for Quantized Linear Quadratic Gaussian Control , 2012, IEEE Transactions on Automatic Control.

[19]  T. Linder,et al.  Codecell convexity in optimal entropy-constrained vector quantization , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[20]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[21]  George Gabor,et al.  On the Gaarder-Slepion 'tracking system' conjecture , 1991, IEEE Trans. Inf. Theory.

[22]  Todd P. Coleman,et al.  Source coding with feedforward using the posterior matching scheme , 2010, 2010 IEEE International Symposium on Information Theory.

[23]  David Pollard,et al.  Quantization and the method of k -means , 1982, IEEE Trans. Inf. Theory.

[24]  David L. Neuhoff,et al.  Causal source codes , 1982, IEEE Trans. Inf. Theory.

[25]  Tamás Linder,et al.  Codecell convexity in optimal entropy-constrained vector quantization , 2003, IEEE Transactions on Information Theory.

[26]  Tamás Linder,et al.  Causal coding of stationary sources and individual sequences with high resolution , 2006, IEEE Transactions on Information Theory.

[27]  Ashutosh Nayyar,et al.  On the Structure of Real-Time Encoders and Decoders in a Multi-Terminal Communication System , 2009, ArXiv.

[28]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[29]  Tamás Linder,et al.  Optimization and convergence of observation channels in stochastic control , 2010, Proceedings of the 2011 American Control Conference.

[30]  R. Curry.  Estimation and Control with Quantized Measurements , 1970 .

[31]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[32]  R. Phelps.  Lectures on Choquet's Theorem , 1966 .

[33]  Demosthenis Teneketzis,et al.  Optimal Design of Sequential Real-Time Communication Systems , 2009, IEEE Transactions on Information Theory.