Accumulate-turbo codes for redundant data

Accumulate-turbo codes are proposed for use in channel coding of data that contains redundancy. Accumulate-turbo codes are nonsystematic channel codes that consist of a cascade of an outer accumulator, an interleaver, and an inner turbo code. The outer accumulator acts as a rate one source code, which allows better utilization of redundancy already in the data in channel decoding than in other previously proposed joint source-channel coding methods. Initial simulations performed on independent and identically distributed (i.i.d.) sequences demonstrate performance that is less than 1 dB away from the theoretical limits for different non-uniformities for moderately long blocks. The performance achieved also for relatively short blocks is better than that achieved in recent works that address this problem. Unlike many of the recently proposed approaches, accumulate-turbo codes appear to be very robust to the data non-uniformity, yet, without sacrificing performance.

[1]  Alain Glavieux,et al.  Reflections on the Prize Paper : "Near optimum error-correcting coding and decoding: turbo codes" , 1998 .

[2]  Gil I. Shamir,et al.  EXIT Chart Analysis for Split-LDPC Codes , 2006, 2006 IEEE International Symposium on Information Theory.

[3]  Gil I. Shamir,et al.  Context and denoising based decoding of non-systematic turbo codes for redundant data , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[4]  D.J.C. MacKay,et al.  Good error-correcting codes based on very sparse matrices , 1997, Proceedings of IEEE International Symposium on Information Theory.

[5]  David J. C. MacKay,et al.  Good Codes Based on Very Sparse Matrices , 1995, IMACC.

[6]  Sae-Young Chung,et al.  On the design of low-density parity-check codes within 0.0045 dB of the Shannon limit , 2001, IEEE Communications Letters.

[7]  Gil I. Shamir,et al.  Universal source controlled channel decoding with nonsystematic quick-look-in turbo codes , 2009, IEEE Transactions on Communications.

[8]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[9]  Daniel J. Costello,et al.  Nonsystematic turbo codes , 2005, IEEE Transactions on Communications.

[10]  Gil I. Shamir,et al.  Non-systematic low-density parity-check codes for nonuniform sources , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[11]  Fady Alajaji,et al.  On the joint source-channel coding error exponent for discrete memoryless systems , 2006, IEEE Transactions on Information Theory.

[12]  Fady Alajaji,et al.  Joint source-channel turbo coding for binary Markov sources , 2006, IEEE Transactions on Wireless Communications.

[13]  Fady Alajaji,et al.  Transmission of nonuniform memoryless sources via nonsystematic turbo codes , 2004, IEEE Transactions on Communications.

[14]  Gil I. Shamir,et al.  Design of non-systematic turbo codes for universal source controlled channel decoding , 2005, IEEE Information Theory Workshop, 2005..

[15]  Richard Demo Souza,et al.  Unequal Energy Allocation with Turbo Codes for Nonuniform Sources , 2006 .

[16]  Javier Garcia-Frías,et al.  Joint turbo decoding and estimation of hidden Markov sources , 2001, IEEE J. Sel. Areas Commun..

[17]  Amira Alloum,et al.  Non-Systematic LDPC Codes for Redundant Data , 2006 .

[18]  Shlomo Shamai,et al.  Systematic Lossy Source/Channel Coding , 1998, IEEE Trans. Inf. Theory.

[19]  Joseph J. Boutros,et al.  High Rate Non-Systematic LDPC Codes for Nonuniform Sources , 2006 .

[20]  Kai Xie,et al.  Split-Turbo Codes for Nonuniform Sequences , 2007, 2007 IEEE Information Theory Workshop.

[21]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[22]  D. J. Costello,et al.  Turbo codes with recursive nonsystematic quick-look-in constituent codes , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[23]  Richard Demo Souza,et al.  Turbo coding of strongly nonuniform memoryless sources with unequal energy allocation and PAM signaling , 2006, IEEE Transactions on Signal Processing.

[24]  R. Gallager Information Theory and Reliable Communication , 1968 .

[25]  Richard Demo Souza,et al.  Non-systematic turbo coding with unequal energy allocation for nonuniform memoryless sources , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[26]  S. Shamai,et al.  The empirical distribution of good codes , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.