Turbo Decoding as an Approximative Iterative Solution to Maximum Likelihood Sequence Detection

Despite the considerable research effort towards the analysis and understanding of the nature of turbo decoding, a clear identification of the underlying optimization problem the turbo decoder attempts to solve is still missing. In this paper, we link the turbo decoding algorithm to maximum likelihood (ML) sequence detection by demonstrating how the turbo decoder can be systematically derived starting from the ML sequence detection criterion. In particular, we show that a method to solve the ML sequence detection problem is to iteratively solve the corresponding critical point equations of an equivalent unconstrained estimation problem by means of fixed-point iterations. The turbo decoding algorithm is obtained by approximating the overall a posteriori probabilities, such that the fixed-point iteration becomes feasible and the optimum ML solution is still a solution of the corresponding approximate critical point equations.

[1]  Shun-ichi Amari,et al.  Information geometry of turbo and low-density parity-check codes , 2004, IEEE Transactions on Information Theory.

[2]  Joachim Hagenauer,et al.  A Viterbi algorithm with soft-decision outputs and its applications , 1989, IEEE Global Telecommunications Conference, 1989, and Exhibition. 'Communications Technology for the 1990s and Beyond.

[3]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Process. Mag..

[4]  Phillip A. Regalia,et al.  Turbo Decoding as Constrained Optimization ∗ , 1992 .

[5]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[6]  Payam Pakzad,et al.  Belief Propagation and Statistical Physics , 2002 .

[7]  Heinrich Meyr,et al.  Digital communication receivers - synchronization, channel estimation, and signal processing , 1997, Wiley series in telecommunications and signal processing.

[8]  C. Richard Johnson,et al.  A convergence proof for the turbo decoder as an instance of the gauss-seidel iteration , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[9]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.

[10]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[11]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[12]  Sergio Benedetto,et al.  Unveiling turbo codes: some results on parallel concatenated coding schemes , 1996, IEEE Trans. Inf. Theory.

[13]  Stephan ten Brink,et al.  Convergence behavior of iteratively decoded parallel concatenated codes , 2001, IEEE Trans. Commun..

[14]  T. Richardson,et al.  Thresholds for turbo codes , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[15]  W. Freeman,et al.  Bethe free energy, Kikuchi approximations, and belief propagation algorithms , 2001 .

[16]  Thomas J. Richardson,et al.  The geometry of turbo-decoding dynamics , 2000, IEEE Trans. Inf. Theory.