Design considerations for iteratively-decoded source-channel coding schemes

We address outer variable-length encoding of afirst-order Markov source in a serially concatenated codingscheme with an inner recursive convolutional code. Decodingis carried out iteratively between the constituent decoders forvariable-length and convolutional code. While variable-lengthcodes are commonly known to be sensitive to transmissionerrors, we show that they can lead to significant performanceimprovements compared to fixed-length source encoding withoptimized mappings. Specifically, we propose a simple variablelengthcode construction with a free distance of two and goodcompression properties at the same time. Numerical resultsshow that the performance gain of the proposed approach alsoholds for precoded ISI channels where iterative joint sourcechannel equalization and decoding is employed at the receiver.

[1]  David J. Miller,et al.  Joint source-channel decoding for variable-length encoded data by exact and approximate MAP sequence estimation , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[2]  John D. Villasenor,et al.  On design of error-correcting reversible variable length codes , 2002, IEEE Communications Letters.

[3]  Stephan ten Brink,et al.  Extrinsic information transfer functions: model and erasure channel properties , 2004, IEEE Transactions on Information Theory.

[4]  Ja-Ling Wu,et al.  On constructing the Huffman-code-based reversible variable-length codes , 2001, IEEE Trans. Commun..

[5]  Peter Vary,et al.  Iterative Source-Channel Decoding: Improved System Design Using EXIT Charts , 2005, EURASIP J. Adv. Signal Process..

[6]  Catherine Lamy,et al.  Reduced complexity maximum a posteriori decoding of variable-length codes , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[7]  Peter Vary,et al.  Softbit speech decoding: a new approach to error concealment , 2001, IEEE Trans. Speech Audio Process..

[8]  Christine Guillemot,et al.  Joint source-channel turbo decoding of entropy-coded sources , 2001, IEEE J. Sel. Areas Commun..

[9]  Jörg Kliewer,et al.  Low-complexity iterative joint source-channel decoding for variable-length encoded Markov sources , 2005, IEEE Transactions on Communications.

[10]  K. P. Subbalakshmi,et al.  On the joint source-channel decoding of variable-length encoded sources: the BSC case , 2001, IEEE Trans. Commun..

[11]  Lisa Perros-Meilhac,et al.  Huffman tree based metric derivation for a low-complexity sequential soft VLC decoding , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[12]  Marion Jeanne,et al.  Source and joint source-channel decoding of variable length codes , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[13]  Victor Buttigieg,et al.  On variable-length error-correcting codes , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[14]  Susanna Kaiser,et al.  . Soft source decoding with applications , 2001, IEEE Trans. Circuits Syst. Video Technol..

[15]  S. M. Heinen.  An optimal MMSE-estimator for source codec parameters using intra-frame and inter-frame correlation , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[16]  Thomas Fuja,et al.  Robust transmission of MELP-compressed speech: an illustrative example of joint source-channel decoding , 2003, IEEE Trans. Commun..

[17]  John D. Villasenor,et al.  Reversible variable length codes for efficient and robust image and video coding , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[18]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[19]  Aria Nosratinia,et al.  Concatenated error-correcting entropy codes and channel codes , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[20]  David J. Miller,et al.  Joint source-channel decoding for variable-length encoded data by exact and approximate MAP sequence estimation , 2000, IEEE Trans. Commun..

[21]  Norbert Goertz,et al.  The turbo principle in joint source-channel coding , 2003, Proceedings 2003 IEEE Information Theory Workshop (Cat. No.03EX674).

[22]  John G. Proakis,et al.  Digital Communications , 1983 .

[23]  Khalid Sayood,et al.  Joint source/channel coding for variable length codes , 2000, IEEE Trans. Commun..

[24]  Patrick G. Farrell,et al.  Variable-length error-correcting codes , 2000 .

[25]  John D. Villasenor,et al.  Soft-input soft-output decoding of variable length codes , 2002, IEEE Trans. Commun..

[26]  Andrew C. Singer,et al.  Turbo equalization: principles and new results , 2002, IEEE Trans. Commun..

[27]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[28]  Dariush Divsalar,et al.  Serial Concatenation of Interleaved Codes: Performance Analysis, Design, and Iterative Decoding , 1997, IEEE Trans. Inf. Theory.

[29]  Joachim Hagenauer,et al.  On variable length codes for iterative source/channel decoding , 2001, Proceedings DCC 2001. Data Compression Conference.

[30]  SystemsXiao-Ming Cheny,et al.  Blind Turbo Equalization for Wireless DPSK , 2002 .

[31]  Jörg Kliewer,et al.  Robust decoding of variable-length encoded Markov sources using a three-dimensional trellis , 2003, IEEE Communications Letters.

[32]  Thomas E. Fuja,et al.  Robust transmission of variable-length encoded sources , 1999, WCNC. 1999 IEEE Wireless Communications and Networking Conference (Cat. No.99TH8466).

[33]  Markus Kaindl,et al.  Iterative source and channel decoding for GSM , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[34]  Joachim Hagenauer,et al.  Symbol-by-Symbol MAP Decoding of Variable Length Codes , 2000 .

[35]  Jörg Kliewer,et al.  Iterative joint source-channel decoding of variable-length codes using residual source redundancy , 2005, IEEE Transactions on Wireless Communications.

[36]  Stephan ten Brink,et al.  Code characteristic matching for iterative decoding of serially concatenated codes , 2001, Ann. des Télécommunications.

[37]  Marion Jeanne,et al.  Joint source-channel decoding of variable-length codes for convolutional codes and turbo codes , 2005, IEEE Transactions on Communications.

[38]  Richard D. Wesel,et al.  Robust joint Huffman and convolutional decoding , 1999, Gateway to 21st Century Communications Village. VTC 1999-Fall. IEEE VTS 50th Vehicular Technology Conference (Cat. No.99CH36324).

[39]  Jörg Kliewer,et al.  On the achievable extrinsic information of inner decoders in serial concatenation , 2006, 2006 IEEE International Symposium on Information Theory.

[40]  V. Balakirsky.  Joint source-channel coding with variable length codes , 1997, Proceedings of IEEE International Symposium on Information Theory.

[41]  Lisa Perros-Meilhac,et al.  LOW COMPLEXITY ITERATIVE DECODING OF VARIABLE-LENGTH CODES , 2003 .

[42]  Joachim Hagenauer,et al.  Iterative decoding of binary block and convolutional codes , 1996, IEEE Trans. Inf. Theory.

[43]  T.E. Fuja,et al.  Channel codes that exploit the residual redundancy in CELP-encoded speech , 1996, IEEE Trans. Speech Audio Process..

[44]  Norbert Goertz.  On the iterative approximation of optimal joint source-channel decoding , 2001, IEEE J. Sel. Areas Commun..

[45]  John D. Villasenor,et al.  Combining variable length codes and turbo codes , 2002, Vehicular Technology Conference. IEEE 55th Vehicular Technology Conference. VTC Spring 2002 (Cat. No.02CH37367).

[46]  M. Wada,et al.  Reversible variable length codes , 1995, IEEE Trans. Commun..

[47]  N. Gortz.  On the iterative approximation of optimal joint source-channel decoding , 2001 .