Balancing forward and feedback error correction for erasure channels with unreliable feedback

The traditional information theoretic approach to studyin g feedback is to consider ideal instantaneous high-rate feedback of the channel outputs to the encoder. This was acceptable in classical work because the results were negative: Shannon pointed out that even perfect feedback often does not improve capacity and in the context of symmetric DMCs, Dobrushin showed that it does not improve the fixed block-coding error exponents in the interesting high rate regime. However, it has recently been shown that perfect feedback does allow great improvements in the asymptotic tradeoff between end-to-end delay and probability of error, even for symmetric channels at high rate. Since gains are claimed with ideal instantaneous feed back, it is natural to wonder whether these improvements remain if the feedback is unreliable or otherwise limited. Here, packet-erasure channels are considered on both the forward and feedback links. First, the feedback channel is considered as a given and a strategy is given to balance forward and feedback error correction in the suitable information-theoretic limit of long end-to-end d elays. At high enough rates, perfect-feedback performance is asymptotically attainable despite having only unreliab le feedback! Second, the results are interpreted in the zero sum case of “half-duplex” nodes where the allocation of bandwidth or time to the feedback channel comes at the direct expense of the forward channel. It turns out that even here, feedback is worthwhile since dramatically lower asymptotic delays are possible by appropriately balancing forward and feedback error correction. The results easily generalize to channels with strictly pos itive zero-undeclared-error capacities.

[1]  R. Gallager Information Theory and Reliable Communication , 1968 .

[2]  Randy H. Katz,et al.  OverQoS: An Overlay Based Architecture for Enhancing Internet QoS , 2004, NSDI.

[3]  Thomas Kailath,et al.  A coding scheme for additive noise channels with feedback-I: No bandwidth constraint , 1966, IEEE Trans. Inf. Theory.

[4]  Tsachy Weissman,et al.  Coding for Additive White Noise Channels With Feedback Corrupted by Quantization or Bounded Noise , 2008, IEEE Transactions on Information Theory.

[5]  Anant Sahai,et al.  Variable-length coding with noisy feedback , 2007 .

[6]  Kohji Itoh,et al.  Correction to 'Asymptotic Performance of a Modified Schalkwijk-Barron Scheme for Channels with Noiseless Feedback' , 1980, IEEE Trans. Inf. Theory.

[7]  Rangasami L. Kashyap Feedback coding schemes for an additive noise channel with a noisy feedback link , 1968, IEEE Trans. Inf. Theory.

[8]  Tsachy Weissman,et al.  Coding for Additive White Noise Channels with Feedback Corrupted by Uniform Quantization or Bounded Noise , 2006, ArXiv.

[9]  Anant Sahai,et al.  Noisy feedback improves communication reliability , 2006, 2006 IEEE International Symposium on Information Theory.

[10]  G. David Forney,et al.  Convolutional Codes II. Maximum-Likelihood Decoding , 1974, Inf. Control..

[11]  Kannan Ramchandran,et al.  Attaining Maximal Reliability with Minimal Feedback via Joint Channel-code and Hash-Function Design , 2005 .

[12]  Leonard J. Schulman Coding for interactive communication , 1996, IEEE Trans. Inf. Theory.

[13]  E. Berlekamp Block coding with noiseless feedback , 1964 .

[14]  G. David Forney,et al.  Exponential error bounds for erasure, list, and decision feedback schemes , 1968, IEEE Trans. Inf. Theory.

[15]  Anant Sahai,et al.  On the variable-delay reliability function of discrete memoryless channels with access to noisy feedback , 2004, Information Theory Workshop.

[16]  Leonard J. Schulman,et al.  A coding theorem for distributed computation , 1994, STOC '94.

[17]  Frederick Jelinek Upper bounds on sequential decoding performance parameters , 1974, IEEE Trans. Inf. Theory.

[18]  Munther A. Dahleh,et al.  Feedback stabilization of uncertain systems in the presence of a direct link , 2006, IEEE Transactions on Automatic Control.

[19]  Anthony J. Kramer,et al.  Improving communication reliability by use of an intermittent feedback channel , 1969, IEEE Trans. Inf. Theory.

[20]  Stephen S. Lavenberg Feedback communication using orthogonal signals , 1969, IEEE Trans. Inf. Theory.

[21]  Robert W. Lucky A survey of the communication theory literature: 1968-1973 , 1973, IEEE Trans. Inf. Theory.

[22]  Anant Sahai Why Do Block Length and Delay Behave Differently if Feedback Is Present? , 2008, IEEE Transactions on Information Theory.

[23]  Claude E. Shannon,et al.  The zero error capacity of a noisy channel , 1956, IRE Trans. Inf. Theory.

[24]  Kohji Itoh,et al.  Asymptotic performance of a modified Schalkwijk-Barron scheme for channels with noiseless feedback (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[25]  SahaiA.,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I , 2006 .

[26]  Stephen S. Lavenberg,et al.  Repetitive signaling using a noisy feedback channel , 1971, IEEE Trans. Inf. Theory.

[27]  Anant Sahai,et al.  The Necessity and Sufficiency of Anytime Capacity for Stabilization of a Linear System Over a Noisy Communication Link—Part I: Scalar Systems , 2006, IEEE Transactions on Information Theory.

[28]  J. Pieter M. Schalkwijk,et al.  A coding scheme for additive noise channels with feedback-II: Band-limited signals , 1966, IEEE Trans. Inf. Theory.