EXIT Charts for System Design and Analysis

Near-capacity performance may be achieved with the aid of iterative decoding, where extrinsic soft information is exchanged between the constituent decoders in order to improve the attainable system performance. Extrinsic Information Transfer (EXIT) charts constitute a powerful semi-analytical tool used for analysing and designing iteratively decoded systems. In this tutorial, we commence by providing a rudimentary overview of the iterative decoding principle and the concept of soft information exchange. We then elaborate on the concept of EXIT charts using three iteratively decoded prototype systems as design examples. We conclude by illustrating further applications of EXIT charts, including near-capacity designs, the concept of irregular codes and the design of modulation schemes.

[1]  Xiaodong Wang,et al.  EXIT chart analysis of turbo multiuser detection , 2005, IEEE Trans. Wirel. Commun..

[2]  Lajos Hanzo,et al.  TCM, TTCM, BICM and iterative BICM assisted OFDM-based digital video broadcasting to mobile receivers , 2001, IEEE VTS 53rd Vehicular Technology Conference, Spring 2001. Proceedings (Cat. No.01CH37202).

[3]  T. H. Liew,et al.  Turbo Coding, Turbo Equalisation and Space-Time Coding: EXIT-Chart-Aided Near-Capacity Designs for Wireless Channels , 2011 .

[4]  Hideki Imai,et al.  A new multilevel coding method using error-correcting codes , 1977, IEEE Trans. Inf. Theory.

[5]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.

[6]  Lajos Hanzo,et al.  Efficient Computation of EXIT Functions for Nonbinary Iterative Decoding , 2006, IEEE Transactions on Communications.

[7]  Jian Song,et al.  Labeling Optimization for BICM-ID Systems , 2010, IEEE Communications Letters.

[8]  Lajos Hanzo,et al.  On the MIMO channel capacity of multidimensional signal sets , 2006, IEEE Transactions on Vehicular Technology.

[9]  Xiaodong Li,et al.  Bit-interleaved coded modulation with iterative decoding , 1997, IEEE Communications Letters.

[10]  Lajos Hanzo,et al.  Near-Capacity Wireless Transceivers and Cooperative Communications in the MIMO Era: Evolution of Standards, Waveform Design, and Future Perspectives , 2011, Proceedings of the IEEE.

[11]  S. Brink Convergence of iterative decoding , 1999 .

[12]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[13]  Sarah J. Johnson,et al.  Iterative Error Correction: Turbo, Low-Density Parity-Check and Repeat-Accumulate Codes , 2009 .

[14]  F. Pollara,et al.  Serial concatenation of interleaved codes: performance analysis, design and iterative decoding , 1996, Proceedings of IEEE International Symposium on Information Theory.

[15]  Joachim Hagenauer,et al.  On variable length codes for iterative source/channel decoding , 2001, Proceedings DCC 2001. Data Compression Conference.

[16]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[17]  Daniel J. Costello,et al.  A distance spectrum interpretation of turbo codes , 1996, IEEE Trans. Inf. Theory.

[18]  Lajos Hanzo,et al.  EXIT-chart aided near-capacity Irregular Bit-Interleaved Coded Modulation design , 2009, IEEE Transactions on Wireless Communications.

[19]  Lajos Hanzo,et al.  The super-trellis structure of turbo codes , 2000, IEEE Trans. Inf. Theory.

[20]  Peter Adam Hoeher,et al.  Computation of symbol-wise mutual information in transmission systems with LogAPP decoders and application to EXIT charts , 2015 .

[21]  Michael Tüchler Convergence prediction for iterative decoding of threefold concatenated systems , 2002, GLOBECOM.

[22]  Lajos Hanzo,et al.  Three-Dimensional EXIT Chart Analys'is of Iteraltive Detecltion Aided Coded Modulaltion Schemes , 2006, 2006 IEEE 63rd Vehicular Technology Conference.

[23]  Lajos Hanzo,et al.  Near-Capacity Multi-Functional MIMO Systems: Sphere-Packing, Iterative Detection and Cooperation , 2009 .

[24]  Sae-Young Chung,et al.  On the design of low-density parity-check codes within 0.0045 dB of the Shannon limit , 2001, IEEE Communications Letters.

[25]  C. Richard Johnson,et al.  Turbo Decoding as Iterative Constrained Maximum-Likelihood Sequence Detection , 2006, IEEE Transactions on Information Theory.

[26]  S. ten Brink,et al.  Iterative demapping and decoding for multilevel modulation , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[27]  Siavash M. Alamouti,et al.  A simple transmit diversity technique for wireless communications , 1998, IEEE J. Sel. Areas Commun..

[28]  Alexander M. Haimovich,et al.  EXIT charts for turbo trellis-coded modulation , 2004, IEEE Communications Letters.

[29]  Giuseppe Caire,et al.  Bit-Interleaved Coded Modulation , 2008, Found. Trends Commun. Inf. Theory.

[30]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[31]  Alain Glavieux,et al.  Reflections on the Prize Paper : "Near optimum error-correcting coding and decoding: turbo codes" , 1998 .

[32]  Sergio Benedetto,et al.  Design of parallel concatenated convolutional codes , 1996, IEEE Trans. Commun..

[33]  Lajos Hanzo,et al.  EXIT Chart Aided Design of Near-Capacity Self-Concatenated Trellis Coded Modulation Using Iterative Decoding , 2008, VTC Spring 2008 - IEEE Vehicular Technology Conference.

[34]  V. Balakirsky Joint source-channel coding with variable length codes , 1997, Proceedings of IEEE International Symposium on Information Theory.

[35]  Soon Xin Ng,et al.  Quadrature Amplitude Modulation: From Basics to Adaptive Trellis-Coded, Turbo-Equalised and Space-Time Coded OFDM, CDMA and MC-CDMA Systems , 2004 .

[36]  Xiaodong Li,et al.  Trellis-coded modulation with bit interleaving and iterative decoding , 1999, IEEE J. Sel. Areas Commun..

[37]  John M. Wozencraft,et al.  Sequential decoding for reliable communication , 1957 .

[38]  Stephan Bäro,et al.  Turbo detection for MIMO systems: bit labeling and pre-coding , 2004, Eur. Trans. Telecommun..

[39]  Lajos Hanzo,et al.  Near-capacity irregular variable length coding and irregular unity rate coding , 2009, IEEE Transactions on Wireless Communications.

[40]  Peter Vary,et al.  BER prediction using EXIT charts for BICM with iterative decoding , 2006, IEEE Communications Letters.

[41]  James A. Ritcey,et al.  EXIT chart analysis of BICM-ID over AWGN channels with SNR mismatch , 2004, IEEE Communications Letters.

[42]  Lajos Hanzo,et al.  Near-Capacity Cooperative Space-Time Coding Employing Irregular Design and Successive Relaying , 2010, IEEE Transactions on Communications.

[43]  Michael Tuchler,et al.  EXIT charts of irregular codes , 2002 .

[44]  Dariush Divsalar,et al.  Low Complexity Turbo-like Codes , 2000 .

[45]  Branka Vucetic,et al.  Recent Advances in Turbo Code Design and Theory , 2007, Proceedings of the IEEE.

[46]  A. Grant,et al.  Convergence of non-binary iterative decoding , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[47]  Lajos Hanzo,et al.  Lookup-Table-Based Deferred-Iteration Aided Low-Complexity Turbo Hybrid ARQ , 2011, IEEE Transactions on Vehicular Technology.

[48]  Sergio Benedetto,et al.  Convergence properties of iterative decoders working at bit and symbol level , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[49]  Patrick Robertson,et al.  Bandwidth-Efficient Turbo Trellis-Coded Modulation Using Punctured Component Codes , 1998, IEEE J. Sel. Areas Commun..

[50]  Lajos Hanzo,et al.  Near-Capacity Multi-Functional MIMO Systems , 2009 .

[51]  Sergio Benedetto,et al.  Unveiling turbo codes: some results on parallel concatenated coding schemes , 1996, IEEE Trans. Inf. Theory.

[52]  Joachim Hagenauer,et al.  Iterative decoding of binary block and convolutional codes , 1996, IEEE Trans. Inf. Theory.

[53]  Stephan ten Brink,et al.  Convergence behavior of iteratively decoded parallel concatenated codes , 2001, IEEE Trans. Commun..

[54]  Alex J. Grant,et al.  Convergence analysis and optimal scheduling for multiple concatenated codes , 2005, IEEE Transactions on Information Theory.

[55]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[56]  Dariush Divsalar,et al.  Self-concatenated trellis coded modulation with self-iterative decoding , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[57]  Dariush Divsalar,et al.  The design of trellis coded MPSK for fading channels: performance criteria , 1988, IEEE Trans. Commun..

[58]  Fred Daneshgaran,et al.  Interleaver design for serially concatenated convolutional codes: theory and application , 2004, IEEE Transactions on Information Theory.

[59]  Dariush Divsalar,et al.  Analysis, Design, and Iterative Decoding of Double Serially Concatenated Codes with Interleavers , 1998, IEEE J. Sel. Areas Commun..

[60]  Richard D. Wesel,et al.  Serially concatenated trellis coded modulation for the compound periodic erasures channel , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[61]  Marie-Laure Boucheret,et al.  Interleaver design for serial concatenated convolutional codes , 2004, IEEE Communications Letters.

[62]  D. Mackay,et al.  Low density parity check codes over GF(q) , 1998, 1998 Information Theory Workshop (Cat. No.98EX131).

[63]  Stephan ten Brink,et al.  Design of Serially Concatenated Codes based on Iterative Decoding Convergence , 2000 .

[64]  James A. Ritcey,et al.  Design, analysis, and performance evaluation for BICM-ID with square QAM constellations in Rayleigh fading channels , 2001, IEEE J. Sel. Areas Commun..

[65]  Lajos Hanzo,et al.  Burst-by-burst adaptive decision feedback equalized TCM, TTCM, and BICM for H.263-assisted wireless video telephony , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[66]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[67]  Joachim Hagenauer,et al.  The exit chart - introduction to extrinsic information transfer in iterative processing , 2004, 2004 12th European Signal Processing Conference.

[68]  Roberto Garello,et al.  A search for good convolutional codes to be used in the construction of turbo codes , 1998, IEEE Trans. Commun..

[69]  Joachim Hagenauer,et al.  The turbo principle-tutorial introduction and state of the art , 1997 .

[70]  Lajos Hanzo,et al.  EXIT-Chart-Aided Three-Stage Concatenated Ultrawideband Time-Hopping Spread-Spectrum Impulse Radio Design , 2009, IEEE Transactions on Vehicular Technology.

[71]  Lie-Liang Yang,et al.  On the Performance and Complexity of Irregular Variable Length Codes for Near-Capacity Joint Source and Channel Coding , 2008, IEEE Transactions on Wireless Communications.

[72]  Hesham El Gamal,et al.  Analyzing the turbo decoder using the Gaussian approximation , 2001, IEEE Trans. Inf. Theory.

[73]  Robert M. Gray,et al.  Coding for noisy channels , 2011 .

[74]  D. Divsalar,et al.  Multiple turbo codes for deep-space communications , 1995 .

[75]  Hideki Imai,et al.  Correction to 'A New Multilevel Coding Method Using Error-Correcting Codes' , 1977, IEEE Trans. Inf. Theory.

[76]  Lajos Hanzo,et al.  Maximum-Throughput Irregular Distributed Space-Time Code for Near-Capacity Cooperative Communications , 2010, IEEE Transactions on Vehicular Technology.

[77]  Daniel J. Costello,et al.  Nonsystematic turbo codes , 2005, IEEE Transactions on Communications.

[78]  Shlomo Shamai,et al.  On interleaved, differentially encoded convolutional codes , 1999, IEEE Trans. Inf. Theory.

[79]  Gottfried Ungerboeck,et al.  Channel coding with multilevel/phase signals , 1982, IEEE Trans. Inf. Theory.

[80]  Richard E. Blahut,et al.  Convergence Analysis and BER Performance of Finite-Length Turbo Codes , 2007, IEEE Transactions on Communications.

[81]  T. Giles,et al.  Improving the constituent codes of turbo encoders , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[82]  Lajos Hanzo,et al.  Near-capacity turbo trellis coded modulation design based on EXIT charts and union bounds - [transactions papers] , 2008, IEEE Transactions on Communications.

[83]  Robert G. Maunder,et al.  Layered Steered Space–Time-Spreading-Aided Generalized MC DS-CDMA , 2010, IEEE Transactions on Vehicular Technology.

[84]  Patrick Robertson,et al.  A comparison of optimal and sub-optimal MAP decoding algorithms operating in the log domain , 1995, Proceedings IEEE International Conference on Communications ICC '95.

[85]  Lajos Hanzo,et al.  Iterative Near-Maximum-Likelihood Detection in Rank-Deficient Downlink SDMA Systems , 2008, IEEE Transactions on Vehicular Technology.

[86]  Lajos Hanzo,et al.  Turbo Decoding and Detection for Wireless Applications , 2007, Proceedings of the IEEE.

[87]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .

[88]  Ha H. Nguyen,et al.  Design and performance of BICM-ID systems with hypercube constellations , 2006, IEEE Transactions on Wireless Communications.

[89]  K. J. Ray Liu,et al.  Space-time signal design for time-correlated Rayleigh fading channels , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[90]  Michael Tüchler Design of serially concatenated systems for long or short block lengths , 2003, ICC.

[91]  Martin Bossert,et al.  Multidimensional 16-QAM constellation labeling of BI-STCM-ID with the Alamouti scheme , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[92]  S. ten Brink Convergence of multidimensional iterative decoding schemes , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[93]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[94]  Lie-Liang Yang,et al.  Iterative Detection of Unity-Rate Precoded FFH-MFSK and Irregular Variable-Length Coding , 2009, IEEE Transactions on Vehicular Technology.

[95]  Lajos Hanzo,et al.  Near-Capacity Variable-Length Coding: Regular and EXIT-Chart-Aided Irregular Designs , 2010 .

[96]  Takashi Yokokawa,et al.  An optimization method for designing high rate and high performance SCTCM systems with in-line interleavers , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[97]  Lajos Hanzo,et al.  Self-Concatenated Code Design and its Application in Power-Efficient Cooperative Communications , 2012, IEEE Communications Surveys & Tutorials.

[98]  Richard E. Blahut,et al.  Lower bound on BER of finite-length turbo codes based on EXIT characteristics , 2004, IEEE Communications Letters.

[99]  V. Kuhn,et al.  Analysis of iterative multi-user detection schemes with EXIT charts , 2004, Eighth IEEE International Symposium on Spread Spectrum Techniques and Applications - Programme and Book of Abstracts (IEEE Cat. No.04TH8738).

[100]  G. David Forney,et al.  Concatenated codes , 2009, Scholarpedia.

[101]  Ha H. Nguyen,et al.  Improving the performance of QPSK BICM-ID by mapping on the hypercube , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[102]  Ephraim Zehavi,et al.  8-PSK trellis codes for a Rayleigh channel , 1992, IEEE Trans. Commun..

[103]  Michael Tüchler,et al.  Design of Serially Concatenated Systems Depending on the Block Length , 2004, IEEE Trans. Commun..

[104]  Robert Mario Fano,et al.  A heuristic discussion of probabilistic decoding , 1963, IEEE Trans. Inf. Theory.

[105]  Johannes B. Huber,et al.  Design of \Multiple{Turbo{Codes" with Transfer Characteristics of Component Codes , 2002 .

[106]  Stephan ten Brink,et al.  Extrinsic information transfer functions: A model and two properties , 2002 .

[107]  Peter Vary,et al.  Iterative source-channel decoder using extrinsic information from softbit-source decoding , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[108]  James A. Ritcey,et al.  EXIT chart analysis of BICM-ID with imperfect channel state information , 2003, IEEE Communications Letters.

[109]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[110]  Patrick Robertson,et al.  Illuminating the structure of code and decoder of parallel concatenated recursive systematic (turbo) codes , 1994, 1994 IEEE GLOBECOM. Communications: The Global Bridge.

[111]  Lars K. Rasmussen,et al.  Optimal scheduling for multiple serially concatenated codes , 2003 .

[112]  Sergio Benedetto,et al.  Serial concatenation of block and convolutional codes , 1996 .

[113]  X. Li Bit-interleaved coded modulation with iterative decoding using soft feedback , 1998 .

[114]  Lie-Liang Yang,et al.  Comparative study of TCM, TTCM, BICM and BICM-ID schemes , 2001, IEEE VTS 53rd Vehicular Technology Conference, Spring 2001. Proceedings (Cat. No.01CH37202).

[115]  Stephan ten Brink,et al.  Extrinsic information transfer functions: model and erasure channel properties , 2004, IEEE Transactions on Information Theory.

[116]  S. Dolinar,et al.  Weight distributions for turbo codes using random and nonrandom permutations , 1995 .

[117]  Henk Wymeersch,et al.  Multidimensional mapping for bit-interleaved coded modulation with BPSK/QPSK signaling , 2005, IEEE Communications Letters.

[118]  Lajos Hanzo,et al.  Evolutionary Algorithm Aided Interleaver Design for Serially Concatenated Codes , 2011, IEEE Transactions on Communications.

[119]  Stephan ten Brink,et al.  Designing Iterative Decoding Schemes with the Extrinsic Information Transfer Chart , 2001 .

[120]  Michael Moher,et al.  An iterative multiuser decoder for near-capacity communications , 1998, IEEE Trans. Commun..

[121]  Soon Xin Ng,et al.  On Multidimensional BICM-ID Constellation Labelling , 2010, 2010 IEEE International Conference on Communications.

[122]  Rüdiger L. Urbanke,et al.  Design of capacity-approaching irregular low-density parity-check codes , 2001, IEEE Trans. Inf. Theory.

[123]  Alain Glavieux,et al.  Iterative correction of intersymbol interference: Turbo-equalization , 1995, Eur. Trans. Telecommun..

[124]  Hamid Jafarkhani,et al.  Space-Time Coding - Theory and Practice , 2010 .

[125]  Stephan ten Brink,et al.  Code characteristic matching for iterative decoding of serially concatenated codes , 2001, Ann. des Télécommunications.

[126]  Dariush Divsalar,et al.  The design of trellis coded MPSK for fading channels: set partitioning for optimum code design , 1988, IEEE Trans. Commun..