On the Structure of Optimal Real-Time Encoders and Decoders in Noisy Communication

The output of a discrete-time Markov source must be encoded into a sequence of discrete variables. The encoded sequence is transmitted through a noisy channel to a receiver that must attempt to reproduce reliably the source sequence. Encoding and decoding must be done in real-time and the distortion measure does not tolerate delays. The structure of real-time encoding and decoding strategies that jointly minimize an average distortion measure over a finite horizon is determined. The results are extended to the real-time broadcast problem and a real-time variation of the Wyner-Ziv problem

[1]  Huan Liu,et al.  Customer Retention via Data Mining , 2000, Artificial Intelligence Review.

[2]  G. Lugosi,et al.  A "follow the perturbed leader"-type algorithm for zero-delay quantization of individual sequences , 2004, DCC 2004.

[3]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[4]  Katalin Marton,et al.  A coding theorem for the discrete memoryless broadcast channel , 1979, IEEE Trans. Inf. Theory.

[5]  John C. Kieffer,et al.  Stochastic stability for feedback quantization schemes , 1982, IEEE Trans. Inf. Theory.

[6]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[7]  Philippe Piret.  Causal sliding block encoders with feedback (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[8]  H. Witsenhausen.  On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[9]  Tamás Linder,et al.  A zero-delay sequential scheme for lossy coding of individual sequences , 2001, IEEE Trans. Inf. Theory.

[10]  John Rust.  Numerical dynamic programming in economics , 1996 .

[11]  Tamer Basar,et al.  Simultaneous design of measurement and control strategies for stochastic systems with feedback , 1989, Autom..

[12]  Shlomo Shamai,et al.  On the achievable throughput of a multiantenna Gaussian broadcast channel , 2003, IEEE Transactions on Information Theory.

[13]  Tamás Linder,et al.  Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding , 2004, IEEE Transactions on Signal Processing.

[14]  Sebastian Engell.  New results on the real-time transmission problem , 1987, IEEE Trans. Inf. Theory.

[15]  S. P. Lloyd.  Rate vs fidelity for the binary source , 1977, The Bell System Technical Journal.

[16]  Thomas M. Cover,et al.  Comments on Broadcast Channels , 1998, IEEE Trans. Inf. Theory.

[17]  Neri Merhav,et al.  Source coding exponents for zero-delay coding with finite memory , 2003, IEEE Trans. Inf. Theory.

[18]  Brockway Mcmillan,et al.  Communication systems which minimize coding noise , 1969 .

[19]  David L. Neuhoff,et al.  Causal source codes , 1982, IEEE Trans. Inf. Theory.

[20]  N. Zhang,et al.  Algorithms for partially observable markov decision processes , 2001 .

[21]  Michael I. Jordan,et al.  PEGASUS: A policy search method for large MDPs and POMDPs , 2000, UAI.

[22]  Robert G. Gallager,et al.  Capacity and coding for degraded broadcast channels , 1974 .

[23]  J. L. Devore.  A note on the observation of a Markov source through a noisy channel (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[24]  Anant Sahai,et al.  Anytime information theory , 2001 .

[25]  Polly S Nichols,et al.  Agreeing to disagree. , 2005, General dentistry.

[26]  Stuart P. Lloyd.  Bicausal isomorphism of Bernoulli processes , 1977 .

[27]  Demosthenis Teneketzis.  Communication in decentralized control , 1980 .

[28]  Gábor Lugosi,et al.  A zero-delay sequential quantizer for individual sequences , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[29]  Andrea J. Goldsmith,et al.  Duality, achievable rates, and sum-rate capacity of Gaussian MIMO broadcast channels , 2003, IEEE Trans. Inf. Theory.

[30]  Tamer Basar,et al.  Optimum design of measurement channels and control policies for linear-quadratic stochastic systems , 1994 .

[31]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[32]  Terrence L. Fine,et al.  Properties of an optimum digital system and applications , 1964, IEEE Trans. Inf. Theory.

[33]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[34]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[35]  Alvin W Drake,et al.  Observation of a Markov process through a noisy channel , 1962 .

[36]  Jerry D. Gibson,et al.  Preposterior analysis for differential encoder design , 1986, IEEE Trans. Inf. Theory.

[37]  W. Lovejoy.  A survey of algorithmic methods for partially observed Markov decision processes , 1991 .

[38]  Craig Boutilier,et al.  Value-Directed Compression of POMDPs , 2002, NIPS.

[39]  Ram Zamir,et al.  Causal source coding of stationary sources with high resolution , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[40]  John C. Kieffer,et al.  On a type of stochastic stability for a class of encoding schemes , 1983, IEEE Trans. Inf. Theory.

[41]  Demosthenis Teneketzis,et al.  A Decision Theoretic Framework for Real-Time Communication , 2005, ArXiv.

[42]  Tamás Linder,et al.  A "follow the perturbed leader"-type algorithm for zero-delay quantization of individual sequences , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[43]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[44]  E. J. Sondik,et al.  The Optimal Control of Partially Observable Markov Decision Processes. , 1971 .

[45]  D. Teneketzis,et al.  Asymptotic Agreement among Communicating Decisionmakers , 1983, 1983 American Control Conference.

[46]  Pravin Varaiya,et al.  Efficient market mechanisms and simulation-based learning for multi-agent systems , 2004 .

[47]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[48]  John Rust,et al.  Structural estimation of markov decision processes , 1986 .

[49]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[50]  William S. Lovejoy,et al.  Computationally Feasible Bounds for Partially Observed Markov Decision Processes , 1991, Oper. Res..

[51]  Tsachy Weissman,et al.  On limited-delay lossy coding and filtering of individual sequences , 2002, IEEE Trans. Inf. Theory.

[52]  Pravin Varaiya,et al.  Simulation-based Uniform Value Function Estimates of Markov Decision Processes , 2006, SIAM J. Control. Optim..

[53]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[54]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[55]  A. Sridharan.  Broadcast Channels , 2022 .

[56]  George Gabor,et al.  On the Gaarder-Slepion 'tracking system' conjecture , 1991, IEEE Trans. Inf. Theory.

[57]  Chelsea C. White,et al.  Solution Procedures for Partially Observed Markov Decision Processes , 1989, Oper. Res..

[58]  N. THOMAS GAARDER,et al.  On optimal finite-state digital transmission systems , 1982, IEEE Trans. Inf. Theory.