High-performance iterative Viterbi algorithm for conventional serial concatenated codes

The Viterbi algorithm (1967) and conventional serial concatenated codes (CSCC) have been widely applied in digital communication systems over the last 30 years. We show that the Shannon capacity of additive white Gaussian noise (AWGN) channels can be approached by CSCCs and the iterative VA (IVA). We firstly study the algebraic properties of CSCCs. We then present the IVA to decode these codes. We also analyze the performance of the IVA and conclude that a better performance can be achieved if we replace the powerful block codes by some simple parity codes. One of the key results in this paper shows that by using a proper design for the decoding method, codes with small loops can be very efficiently decoded using a min-sum type algorithm. The numerical results show that the IVA can closely approach the Shannon sphere-packing lower bound and the Shannon limit. For block sizes ranging from 56 information bits to 11970 information bits, the IVA can perform to within about 1 dB of the Shannon sphere-packing lower bound at a block error rate of 10/sup -4/. We show that the IVA has a very low complexity and can be applied to many current standard systems, for example, the Qualcomm code-division multiple-access (CDMA) system and the NASA concatenated system, with very little modification or, for some cases, without any modification.

[1]  Lei Wei,et al.  Near-optimal limited-search detection on ISI/CDMA channels and decoding of long convolutional codes , 2000, IEEE Trans. Inf. Theory.

[2]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[3]  Joachim Hagenauer,et al.  Iterative decoding of binary block and convolutional codes , 1996, IEEE Trans. Inf. Theory.

[4]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .

[5]  Qi Wang Near optimal decoding for trellis coded modulation , 2000 .

[6]  Shu Lin,et al.  Error control coding : fundamentals and applications , 1983 .

[7]  Brendan J. Frey,et al.  Signal-space characterization of iterative decoding , 2001, IEEE Trans. Inf. Theory.

[8]  Yufei W. Blankenship,et al.  A simple stopping criterion for turbo decoding , 2000, IEEE Communications Letters.

[9]  Rüdiger L. Urbanke,et al.  Design of capacity-approaching irregular low-density parity-check codes , 2001, IEEE Trans. Inf. Theory.

[10]  Lei Wei,et al.  On bootstrap iterative Viterbi algorithm , 1999, 1999 IEEE International Conference on Communications (Cat. No. 99CH36311).

[11]  A. N. Willson,et al.  Low-power Viterbi decoder for CDMA mobile terminals , 1998 .

[12]  Frederick Jelinek Bootstrap trellis decoding , 1975, IEEE Trans. Inf. Theory.

[13]  Alain Glavieux,et al.  Reflections on the Prize Paper : "Near optimum error-correcting coding and decoding: turbo codes" , 1998 .

[14]  G. Forney,et al.  Iterative Decoding of Tail-Biting Trellises and Connections with Symbolic Dynamics , 2001 .

[15]  Niclas Wiberg,et al.  Codes and Decoding on General Graphs , 1996 .

[16]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[17]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[18]  David J. C. MacKay,et al.  Good Error-Correcting Codes Based on Very Sparse Matrices , 1997, IEEE Trans. Inf. Theory.

[19]  Qi Wang,et al.  Graph-based iterative decoding algorithms for parity-concatenated trellis codes , 2001, IEEE Trans. Inf. Theory.

[20]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[21]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[22]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[23]  Dariush Divsalar,et al.  Serial Concatenation of Interleaved Codes: Performance Analysis, Design, and Iterative Decoding , 1997, IEEE Trans. Inf. Theory.

[24]  Rodney A. Kennedy,et al.  Near Optimal Decoding for TCM Using the BIVA and Trellis Shaping , 1999, AAECC.

[25]  Lei Wei Iterative Viterbi Algorithm : Algorithm and Implementation-A simple Turbo decoding method using VA decoding hardware , 2022 .

[26]  Teresa H. Meng,et al.  A 1-Gb/s, four-state, sliding block Viterbi decoder , 1997, IEEE J. Solid State Circuits.

[27]  Radford M. Neal,et al.  Near Shannon limit performance of low density parity check codes , 1996 .

[28]  Shu Lin,et al.  Soft-decision decoding of linear block codes based on ordered statistics , 1994, IEEE Trans. Inf. Theory.

[29]  John Cocke,et al.  Bootstrap Hybrid Decoding for Symmetrical Binary Input Channels , 1971, Inf. Control..

[30]  Rodney A. Kennedy,et al.  Iterative Viterbi decoding, trellis shaping, and multilevel structure for high-rate parity-concatenated TCM , 2002, IEEE Trans. Commun..

[31]  Daniel J. Costello,et al.  Bootstrap hybrid decoding using the multiple stack algorithm , 1997, Proceedings of IEEE International Symposium on Information Theory.

[32]  John B. Anderson,et al.  Tailbiting MAP Decoders , 1998, IEEE J. Sel. Areas Commun..

[33]  Shu Lin,et al.  Computationally efficient soft-decision decoding of linear block codes based on ordered statistics , 1996, IEEE Trans. Inf. Theory.

[34]  Sergio Benedetto,et al.  Unveiling turbo codes: some results on parallel concatenated coding schemes , 1996, IEEE Trans. Inf. Theory.

[35]  Joachim Hagenauer,et al.  A Viterbi algorithm with soft-decision outputs and its applications , 1989, IEEE Global Telecommunications Conference, 1989, and Exhibition. 'Communications Technology for the 1990s and Beyond.

[36]  Brendan J. Frey,et al.  Introduction to the special issue on codes on graphs and iterative algorithms , 2001, IEEE Trans. Inf. Theory.