A convergence proof for the turbo decoder as an instance of the gauss-seidel iteration

Many previous attempts at analyzing the convergence behavior of turbo and iterative decoding, such as EXIT style analysis (S. ten Brink, Oct. 2001) and density evolution (H. El Gamal and A. R. Hammons, Jr, Feb. 2001), ultimately appeal to results which become valid only when the block length grows rather large, while still other attempts, such as connections to factor graphs (F. R. Kshischang, et al., Feb. 2001) and belief propagation (R. J. McEliece, et al., Feb. 1998), have been largely unsuccessful at showing convergence due to loops in the turbo coding graph. The information geometric attempts (M. Moher and T. A. Gulliver, Nov. 1998), (T. Richardson, Jan. 2000), (S. Ikeda, et al., June 2004), (B. Muquest, et al., June 2002), and (J. Walsh, et al., March 2005), in turn have been inhibited by inability to efficiently describe intrinsic information extraction as an information projection. This paper recognizes turbo decoding as an instance of a Gauss-Seidel iteration on a particular nonlinear system of equations. This interpretation holds regardless of block length, and allows a connection to existing convergence results for nonlinear block Gauss Seidel iterations. We thus adapt existing convergence theory for the Gauss Seidel iteration to give sufficient conditions for the convergence of the turbo decoder that hold regardless of the block length

[1]  Stephan ten Brink,et al.  Convergence behavior of iteratively decoded parallel concatenated codes , 2001, IEEE Trans. Commun..

[2]  P. Moqvist,et al.  Turbo-decoding as a numerical analysis problem , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[3]  P. Turner,et al.  Numerical methods and analysis , 1992 .

[4]  Hesham El Gamal,et al.  Analyzing the turbo decoder using the Gaussian approximation , 2001, IEEE Trans. Inf. Theory.

[5]  R. Strichartz The way of analysis , 1995 .

[6]  W. Rudin Principles of mathematical analysis , 1964 .

[7]  Thomas J. Richardson,et al.  The geometry of turbo-decoding dynamics , 2000, IEEE Trans. Inf. Theory.

[8]  Shun-ichi Amari,et al.  Information geometry of turbo and low-density parity-check codes , 2004, IEEE Transactions on Information Theory.

[9]  R. D. Murphy,et al.  Iterative solution of nonlinear equations , 1994 .

[10]  Forman S. Acton,et al.  Numerical methods that work , 1970 .

[11]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[12]  C. Richard Johnson,et al.  A refined information geometric interpretation of turbo decoding , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[13]  T. Aaron Gulliver,et al.  Cross-Entropy and Iterative Decoding , 1998, IEEE Trans. Inf. Theory.

[14]  Marion Kee,et al.  Analysis , 2004, Machine Translation.

[15]  Golub Gene H. Et.Al Matrix Computations, 3rd Edition , 2007 .

[16]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[17]  O. Axelsson Iterative solution methods , 1995 .

[18]  P. Duhamel,et al.  Geometrical interpretation of iterative turbo decoding , 2002, Proceedings IEEE International Symposium on Information Theory,.

[19]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[20]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[21]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[22]  Jung-Fu Cheng,et al.  Turbo Decoding as an Instance of Pearl's "Belief Propagation" Algorithm , 1998, IEEE J. Sel. Areas Commun..

[23]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[24]  W. Rheinboldt On M-functions and their application to nonlinear Gauss-Seidel iterations and to network flows☆ , 1970 .

[25]  J. J. Moré Nonlinear generalizations of matrix diagonal dominance with application to Gauss-Seidel iterations. , 1972 .

[26]  W. Rheinboldt ON CLASSES OF n-DIMENSIONAL NONLINEAR MAPPINGS GENERALIZING SEVERAL TYPES OF MATRICES , 1971 .