Asymptotic expansion and error exponent for two-phase feedback codes on DMCs

This paper studies variable-length coding with noise-less feedback for discrete memoryless channels. Yamamoto and Itoh's two-phase scheme achieves the optimal error-exponent, but due to the block-coding nature it is not optimal in the expansion of the message size logM. Polyanskiy et al. showed that with feedback, the back-off from capacity is logarithmic in the expected latency ℓ. The O(log ℓ) back-off is achieved by using an incremental redundancy (IR) scheme that only utilizes feedback to determine the stopping time. However, the achievable error-exponent of the IR scheme is not optimal. This paper shows that a two-phase coding scheme where each phase uses an IR scheme achieves the optimal error-exponent while maintaining an expansion on the message size that yields the O(log ℓ) back-off.

[1]  Adam Williamson,et al.  Reliability-output Decoding and Low-latency Variable-length Coding Schemes for Communication with Feedback , 2014 .

[2]  G. David Forney,et al.  Exponential error bounds for erasure, list, and decision feedback schemes , 1968, IEEE Trans. Inf. Theory.

[3]  Masahito Hayashi,et al.  Information Spectrum Approach to Second-Order Coding Rate in Channel Coding , 2008, IEEE Transactions on Information Theory.

[4]  Tara Javidi,et al.  Active Sequential Hypothesis Testing , 2012, ArXiv.

[5]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[6]  H. Vincent Poor,et al.  Feedback in the Non-Asymptotic Regime , 2011, IEEE Transactions on Information Theory.

[7]  H. Chernoff Sequential Analysis and Optimal Design , 1987 .

[8]  Richard D. Wesel,et al.  Feedback Communication Systems with Limitations on Incremental Redundancy , 2013, ArXiv.

[9]  David M. Mandelbaum,et al.  An adaptive-feedback coding scheme using incremental redundancy (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[10]  Gou Hosoya,et al.  国際会議参加報告:2014 IEEE International Symposium on Information Theory , 2014 .

[11]  Tara Javidi,et al.  Sequentiality and Adaptivity Gains in Active Hypothesis Testing , 2012, IEEE Journal of Selected Topics in Signal Processing.

[12]  Richard D. Wesel,et al.  Reliability-based error detection for feedback communication with low latency , 2013, 2013 IEEE International Symposium on Information Theory.

[13]  Claude E. Shannon,et al.  The zero error capacity of a noisy channel , 1956, IRE Trans. Inf. Theory.

[14]  Kohji Itoh,et al.  Asymptotic performance of a modified Schalkwijk-Barron scheme for channels with noiseless feedback (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[15]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.