Error Recovery Properties and Soft Decoding of Quasi-Arithmetic Codes

This paper first introduces a new set of aggregated state models for soft-input decoding of quasi arithmetic (QA) codes with a termination constraint. The decoding complexity with these models is linear with the sequence length. The aggregation parameter controls the tradeoff between decoding performance and complexity. It is shown that close-to-optimal decoding performance can be obtained with low values of the aggregation parameter, that is, with a complexity which is significantly reduced with respect to optimal QA bit/symbol models. The choice of the aggregation parameter depends on the synchronization recovery properties of the QA codes. This paper thus describes a method to estimate the probability mass function (PMF) of the gain/loss of symbols following a single bit error (i.e., of the difference between the number of encoded and decoded symbols). The entropy of the gain/loss turns out to be the average amount of information conveyed by a length constraint on both the optimal and aggregated state models. This quantity allows us to choose the value of the aggregation parameter that will lead to close-to-optimal decoding performance. It is shown that the optimum position for the length constraint is not the last time instant of the decoding process. This observation leads to the introduction of a new technique for robust decoding of QA codes with redundancy which turns out to outperform techniques based on the concept of forbidden symbol.

[1]  S. J. Mason Feedback Theory-Further Properties of Signal Flow Graphs , 1956, Proceedings of the IRE.

[2]  Jorma Rissanen,et al.  Generalized Kraft Inequality and Arithmetic Coding , 1976, IBM J. Res. Dev..

[3]  J. Anderson,et al.  Architecture and Construction of a Hardware Sequential Encoder for Speech , 1977, IEEE Trans. Commun..

[4]  Glen G. Langdon,et al.  An Introduction to Arithmetic Coding , 1984, IBM J. Res. Dev..

[5]  John P. Robinson,et al.  Error recovery for variable length codes , 1985, IEEE Trans. Inf. Theory.

[6]  J. Vitter,et al.  Practical Implementations of Arithmetic Coding , 1991 .

[7]  Michael J. Gormish,et al.  Finite State Machine Binary Entropy Coding , 1993 .

[8]  Michael Joseph Gormish,et al.  Source coding with channel, distortion, and complexity constraints , 1994 .

[9]  Peter F. Swaszek,et al.  More on the error recovery for variable-length codes , 1995, IEEE Trans. Inf. Theory.

[10]  John G. Cleary,et al.  Integrating error detection into arithmetic coding , 1997, IEEE Trans. Commun..

[11]  G. F. Elmasry Arithmetic coding algorithm with embedded channel coding , 1997 .

[12]  Kannan Ramchandran,et al.  Image transmission using arithmetic coding based continuous error detection , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[13]  Zhen Zhang,et al.  Synchronization recovery of variable-length codes , 2002, IEEE Trans. Inf. Theory.

[14]  Thomas Guionnet,et al.  Soft and Joint Source-Channel Decoding of Quasi-Arithmetic Codes , 2004, EURASIP J. Adv. Signal Process..

[15]  G. Olmo,et al.  Joint source/channel coding and MAP decoding of arithmetic codes , 2005, IEEE Transactions on Communications.

[16]  Jörg Kliewer,et al.  Iterative joint source-channel decoding of variable-length codes using residual source redundancy , 2005, IEEE Transactions on Wireless Communications.

[17]  H. Jégou,et al.  Trellis state aggregation for soft decoding of variable length codes , 2005, IEEE Workshop on Signal Processing Systems Design and Implementation, 2005..

[18]  Michel Kieffer,et al.  Asymptotic Error-Correcting Performance of Joint Source-Channel Schemes based on Arithmetic Coding , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[19]  Hervé Jégou,et al.  Synchronization Recovery and State Model Reduction for Soft Decoding of Variable Length Codes , 2007, IEEE Transactions on Information Theory.