Information Theory On extrinsic information of good binary codes operating over Gaussian channels

We show that the extrinsic information about the coded bits of any good (capacity achieving) binary code operating over a Gaussian channel is zero when the channel capacity is lower than the code rate and unity when capacity exceeds the code rate, that is, the extrinsic information transfer (EXIT) chart is a step function of the signal to noise ratio and independent of the code. It follows that, for a common class of iterative receivers where the error correcting decoder must operate at first iteration at rate above capacity (such as in turbo equalization, iterative channel estimation, parallel and serial concatenated coding and the like), classical good codes which achieve capacity over the Additive White Gaussian Noise Channel are not effective and should be replaced by different new ones. Copyright © 2006 AEIT.

[1]  Shlomo Shamai,et al.  LDPC coded MIMO multiple access with iterative joint decoding , 2005, IEEE Transactions on Information Theory.

[2]  Sergio Verdú,et al.  Approximation theory of output statistics , 1993, IEEE Trans. Inf. Theory.

[3]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[4]  G. Kramer,et al.  Code rate and the area under extrinsic information transfer curves , 2002, Proceedings IEEE International Symposium on Information Theory,.

[5]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[6]  Andrea Montanari,et al.  Life Above Threshold: From List Decoding to Area Theorem and MSE , 2004, ArXiv.

[7]  Shlomo Shamai,et al.  Extremes of information combining , 2005, IEEE Transactions on Information Theory.

[8]  Shlomo Shamai,et al.  The empirical distribution of good codes , 1997, IEEE Trans. Inf. Theory.

[9]  Shlomo Shamai,et al.  Efficient Communication Over the Discrete-Time Memoryless Rayleigh Fading Channel with Turbo Coding/Decoding , 2000, Eur. Trans. Telecommun..

[10]  Stephan ten Brink,et al.  Designing Iterative Decoding Schemes with the Extrinsic Information Transfer Chart , 2001 .

[11]  Krishna R. Narayanan,et al.  An MSE Based Ttransfer Chart to Analyze Iterative Decoding Schemes , 2005, ArXiv.

[12]  Shlomo Shamai,et al.  On Extrinsic Information of Good Codes Operating Over Discrete Memoryless Channels , 2005, ArXiv.