On globally optimal real-time encoding and decoding strategies in multi-terminal communication systems

We consider a communication system consisting of two encoders communicating with a single receiver over a noiseless channel. The two encoders make distinct partial observations of a discrete-time Markov source. Each encoder must encode its observations into a sequence of discrete variables. The sequence is transmitted over a noiseless channel to a receiver which attempts to reproduce the output of the Markov source. The system must operate in real-time, that is, the encoding at each encoder and decoding at the receiver must be performed without any delay. The goal is to find globally optimal real-time encoding and decoding strategies to minimize an expected distortion metric over a finite time horizon. We determine qualitative properties of optimal real-time encoding and decoding strategies. Using these properties, we develop a sequential decomposition of the problem of finding globally optimal real-time encoding and decoding strategies. Such a sequential decomposition reduces the complexity of the global optimization problem.

[1]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[2]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[3]  Hans S. Witsenhausen,et al.  A standard form for sequential stochastic control , 1973, Mathematical systems theory.

[4]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[5]  Demosthenis Teneketzis,et al.  On the Structure of Optimal Real-Time Encoders and Decoders in Noisy Communication , 2006, IEEE Transactions on Information Theory.

[6]  Demosthenis Teneketzis,et al.  On Globally Optimal Encoding, Decoding, and Memory Update for Noisy Real-Time Communication Systems , 2008 .

[7]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[8]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[9]  Peter Whittle,et al.  Optimization Over Time , 1982 .

[10]  Demosthenis Teneketzis,et al.  On the design of globally optimal communication strategies for real-time noisy communication systems with noisy feedback , 2008, IEEE Journal on Selected Areas in Communications.

[11]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[12]  H. Witsenhausen Some Remarks on the Concept of State , 1976 .

[13]  H. Witsenhausen On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[14]  S. Sandeep Pradhan,et al.  Lattices for Distributed Source Coding: Jointly Gaussian Sources and Reconstruction of a Linear Function , 2007, IEEE Transactions on Information Theory.