Single and joint iterative decoding for higher order modulation schemes

The research project described in this thesis concentrates on the study, and application of specific channel coding techniques, in particular, low-density parity-check (LDPC) codes, iterative decoding on Tanner graphs, and their application on joint iterative receivers based on the turbo principle, previously proposed. The construction of random LDPC codes that fulfil certain desirable characteristics, such as large girth, specific p and -y values, and acceptable BER and FER performance for short code lengths, traditionally requires a high degree of processing power (i. e. CPU cycles) to run stochastic routines that firstly search within all the possible combinations for those ones that match the desired characteristics of the LDPC matrix, and secondly determines the bit-error rate (BER) and frame-error rate (FER) performance. The construction of well structured LDPC codes by means of algebraic methods has provided LDPC codes that achieve excellent performance, with desirable structure on their LDPC matrices. However, from the universe of LDPC matrices, those ones created through well structured procedures are a small group. Multiple procedures to modify their characteristics such as length and rate have assisted to increase the pool of LDPC codes based on well structured procedures. This thesis study the problem of constructing random LDPC codes with particular length, girth, and column weight as design parameters, with reduced processing power, while providing, at the same time, a desirable structure to allow efficient use of the memory and of the parallel processing capacity to reduce delay through efficient encoding and decoding. Based on previous studies that analysed the same problem, an algorithm is introduced to construct the Girth-Partition and Shift (GPS) LDPC codes, which are half-rate quasi-cyclic (QC) LDPC codes. Several GPS constructions are analysed over the AWGN channel and the flat-fading channel. The effect on the BER and FER performance from variations on their design parameters, is included in this study. This work also includes the BER and FER performance of the concatenation in parallel of different LDPC codes, some of which are based on well structured procedures, such as Euclidean Geometries (EG) and Projective Geomtries (PG), and Margulis constructions based on the Cayley graph, while the rest are based on random procedures, such as Graphical Models (GM) and GPS-LDPC codes. The aim of the analysis of this scheme, combined with the referred LDPC code constructions, include the improvement of the BER and FER performance for short code lengths and the reduction of the encoding complexity. The BER and FER performance achieved by the parallel concatenation of the previously mentioned LDPC codes, is further analysed in a joint demapping, parallel channel decoding and source decoding system. The impact of each component on the overall system performance is also examined.

[1]  José M. F. Moura,et al.  The design of structured regular LDPC codes with large girth , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[2]  B. Shahrrava,et al.  An Improved Max-Log-MAP Algorithm for Turbo Decoding and Turbo Equalization , 2007, IEEE Transactions on Instrumentation and Measurement.

[3]  Lang Tong,et al.  On the Error Exponent and the Use of LDPC Codes for Cooperative Sensor Networks With Misinformed Nodes , 2007, IEEE Transactions on Information Theory.

[4]  Sae-Young Chung,et al.  Analysis of sum-product decoding of low-density parity-check codes using a Gaussian approximation , 2001, IEEE Trans. Inf. Theory.

[5]  Peter A. Hoeher,et al.  Bounds on information combining for the accumulator of repeat-accumulate codes without Gaussian assumption , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[6]  Lajos Hanzo,et al.  Turbo Coding, Turbo Equalisation and Space-Time Coding for Transmission over Fading Channels , 2002 .

[7]  N. Gortz Iterative source-channel decoding using soft-in/soft-out decoders , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[8]  Shu Lin,et al.  Low-density parity-check codes based on finite geometries: A rediscovery and new results , 2001, IEEE Trans. Inf. Theory.

[9]  Bahram Honary,et al.  Migration to capacity approaching codes for digital video broadcasting , 2005 .

[10]  Yu Kou,et al.  On circulant low density parity check codes , 2002, Proceedings IEEE International Symposium on Information Theory,.

[11]  Zhongfeng Wang,et al.  Low-Complexity High-Speed Decoder Design for Quasi-Cyclic LDPC Codes , 2007, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[12]  Javier Garcia-Frías,et al.  Joint source-channel decoding of correlated sources over noisy channels , 2001, Proceedings DCC 2001. Data Compression Conference.

[13]  J. Hagenauer,et al.  To compress or not to compress? , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[14]  W. W. Lu,et al.  Open wireless architecture - the core to 4G mobile communications , 2003, International Conference on Communication Technology Proceedings, 2003. ICCT 2003..

[15]  F. Lemmermeyer Error-correcting Codes , 2005 .

[16]  Bahram Honary,et al.  New constructions of quasi-cyclic LDPC codes based on special classes of BIDBs for the AWGN and binary erasure channels , 2007, IEEE Trans. Commun..

[17]  Robert Michael Tanner,et al.  A transform theory for a class of group-invariant codes , 1988, IEEE Trans. Inf. Theory.

[18]  Koduvayur P. Subbalakshmi,et al.  An integrated joint source-channel decoder for MPEG-4 coded video , 2003, 2003 IEEE 58th Vehicular Technology Conference. VTC 2003-Fall (IEEE Cat. No.03CH37484).

[20]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[21]  David J. C. MacKay,et al.  Good Error-Correcting Codes Based on Very Sparse Matrices , 1997, IEEE Trans. Inf. Theory.

[22]  Jon-Lark Kim,et al.  Explicit construction of families of LDPC codes with no 4-cycles , 2004, IEEE Transactions on Information Theory.

[23]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[24]  Paul H. Siegel,et al.  Turbo decoding for PR4: parallel versus serial concatenation , 1999, 1999 IEEE International Conference on Communications (Cat. No. 99CH36311).

[25]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[26]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Process. Mag..

[27]  Stephen B. Wicker,et al.  Turbo Coding , 1998 .

[28]  Manabu Hagiwara,et al.  Comment on "Quasi-Cyclic Low Density Parity Check Codes From Circulant Permutation Matrices" , 2009, IEEE Trans. Inf. Theory.

[29]  Zongwang Li,et al.  Efficient encoding of quasi-cyclic low-density parity-check codes , 2005, IEEE Transactions on Communications.

[30]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.

[31]  P. Vontobel,et al.  Constructions of LDPC Codes using Ramanujan Graphs and Ideas from Margulis , 2000 .

[32]  Jung-Fu Cheng,et al.  Turbo Decoding as an Instance of Pearl's "Belief Propagation" Algorithm , 1998, IEEE J. Sel. Areas Commun..

[33]  Hatim M. Behairy,et al.  Parallel concatenated Gallager codes , 2000 .

[34]  S. ten Brink,et al.  Iterative demapping and decoding for multilevel modulation , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[35]  Paul Strauch,et al.  Low complexity source controlled channel decoding in a GSM system , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[36]  Mike Brookes,et al.  Soft decisions for DQPSK demodulation for the Viterbi decoding of the convolutional codes , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[37]  Leon Garcia,et al.  Probability and Random Processes for Electrical Engineering , 1993 .

[38]  José M. F. Moura,et al.  Geometry based designs of LDPC codes , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[39]  Stephan ten Brink,et al.  Design of low-density parity-check codes for modulation and detection , 2004, IEEE Transactions on Communications.

[40]  Shu Lin,et al.  Codes on finite geometries , 2005, IEEE Transactions on Information Theory.

[41]  Hatim M. Behairy,et al.  Parallel concatenated Gallager codes for CDMA applications , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[42]  Wei Yu,et al.  Bilayer LDPC Codes for the Relay Channel , 2006, 2006 IEEE International Conference on Communications.

[43]  Wayne E. Stark,et al.  Unified design of iterative receivers using factor graphs , 2001, IEEE Trans. Inf. Theory.

[44]  Johannes B. Huber,et al.  Bounds on information combining , 2005, IEEE Transactions on Information Theory.

[45]  Radford M. Neal,et al.  Near Shannon limit performance of low density parity check codes , 1996 .

[46]  Simon Litsyn,et al.  Lazy scheduling forLDPC decoding , 2007, IEEE Communications Letters.

[47]  Stephan ten Brink,et al.  Convergence behavior of iteratively decoded parallel concatenated codes , 2001, IEEE Trans. Commun..

[48]  Joachim Hagenauer,et al.  Source-controlled channel decoding , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[49]  Baoming Bai,et al.  Fast encodable and decodable irregular repeat accumulate codes from circulant permutation matrices , 2007 .

[50]  G. David Forney,et al.  Concatenated codes , 2009, Scholarpedia.

[51]  Rüdiger L. Urbanke,et al.  Design of capacity-approaching irregular low-density parity-check codes , 2001, IEEE Trans. Inf. Theory.

[52]  Shu Lin,et al.  Construction of low-density parity-check codes by superposition , 2005, IEEE Transactions on Communications.

[53]  Timothy O'Farrell,et al.  Joint demapping and source decoding for multilevel modulation , 2006, IEEE Wireless Communications and Networking Conference, 2006. WCNC 2006..

[54]  Exhibitor,et al.  International Conference On Acoustics, Speech, And Signal Processing , 1993, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[55]  John B. Anderson,et al.  On the BCJR algorithm for rate-distortion source coding , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[56]  Mohamad Assaad,et al.  TCP performance over UMTS-HSDPA systems , 2006 .

[57]  Niclas Wiberg,et al.  Codes and Decoding on General Graphs , 1996 .

[58]  R. M. Tanner Spectral graphs for quasi-cyclic LDPC codes , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[59]  T. O’Farrell,et al.  Structured Parallel Concatenated LDPC Codes , 2006 .

[60]  Alexander Vardy,et al.  Which codes have cycle-free Tanner graphs? , 1999, IEEE Trans. Inf. Theory.

[61]  Willie W. Lu 4G mobile research in Asia , 2003, IEEE Communications Magazine.

[62]  Simon Litsyn,et al.  Efficient Serial Message-Passing Schedules for LDPC Decoding , 2007, IEEE Transactions on Information Theory.

[63]  Sooyoung Kim,et al.  Rate adaptation with hybrid ARQ based on cross layer information for satellite communication systems , 2004, IEEE International Symposium on Consumer Electronics, 2004.

[64]  A. Robert Calderbank,et al.  Applications of LDPC Codes to the Wiretap Channel , 2004, IEEE Transactions on Information Theory.

[65]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[66]  S. Brink Convergence of iterative decoding , 1999 .

[67]  Khaled A. S. Abdel-Ghaffar,et al.  Stopping set analysis for Hamming codes , 2005, IEEE Information Theory Workshop, 2005..

[68]  Zhongfeng Wang,et al.  Low complexity, high speed decoder architecture for quasi-cyclic LDPC codes , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[69]  David J. C. MacKay,et al.  Low-density parity check codes over GF(q) , 1998, IEEE Communications Letters.

[70]  Bahram Honary,et al.  Construction of low density parity check codes: a combinatoric design approach , 2002, Proceedings IEEE International Symposium on Information Theory,.

[71]  Khaled A. S. Abdel-Ghaffar,et al.  On algebraic construction of Gallager and circulant low-density parity-check codes , 2004, IEEE Transactions on Information Theory.

[72]  Ali N. Akansu,et al.  Density evolution for low-density parity-check codes under Max-Log-MAP decoding , 2001 .

[73]  Hamid Jafarkhani,et al.  On the EXIT chart analysis of low-density parity-check codes , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[74]  Zongwang Li,et al.  Efficient encoding of quasi-cyclic low-density parity-check codes , 2006, IEEE Trans. Commun..

[75]  Ian J. Wassell,et al.  Comparison Between Serial and Parallel Concatenated Channel Coding Schemes Using Continuous Phase Modulation over AWGN and Fading Channels , 2002 .

[76]  Sarah J. Johnson,et al.  Construction of low-density parity-check codes from Kirkman triple systems , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[77]  Rüdiger L. Urbanke,et al.  Density Evolution, Thresholds and the Stability Condition for Non-binary LDPC Codes , 2005, ArXiv.

[78]  K. Yamaguchi,et al.  Density Evolution for GF(q) LDPC Codes Via Simplified Message-passing Sets , 2007, 2007 Information Theory and Applications Workshop.

[79]  L. Litwin,et al.  Error control coding , 2001 .

[80]  G. Caire,et al.  Joint Source-Channel Coding: a Practical Approach and an implementation Example , 2007, 2007 Information Theory and Applications Workshop.

[81]  Hannes Persson,et al.  Utilizing soft information in image decoding , 2003, 14th IEEE Proceedings on Personal, Indoor and Mobile Radio Communications, 2003. PIMRC 2003..

[82]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[83]  Hatim M. Behairy,et al.  Analysis and design of parallel concatenated Gallager codes , 2002 .

[84]  Bahram Honary,et al.  Construction of low-density parity-check codes based on balanced incomplete block designs , 2004, IEEE Transactions on Information Theory.

[85]  Bahram Honary,et al.  Construction of well-structured quasi-cyclic low-density parity check codes , 2005 .

[86]  Shu Lin,et al.  Near-Shannon-limit quasi-cyclic low-density parity-check codes , 2003, IEEE Transactions on Communications.

[87]  Hatim M. Behairy,et al.  On the design, simulation and analysis of parallel concatenated Gallager codes , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[88]  Bane V. Vasic,et al.  Combinatorial constructions of low-density parity-check codes for iterative decoding , 2002, IEEE Transactions on Information Theory.

[89]  G. A. Margulis,et al.  Explicit constructions of graphs without short cycles and low density codes , 1982, Comb..

[90]  J. Moura,et al.  Structured low-density parity-check codes , 2004, IEEE Signal Processing Magazine.

[91]  Keshab K. Parhi,et al.  Area efficient decoding of quasi-cyclic low density parity check codes , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[92]  Jose M. F. Moura,et al.  Large-girth LDPC codes based on graphical models , 2003, 2003 4th IEEE Workshop on Signal Processing Advances in Wireless Communications - SPAWC 2003 (IEEE Cat. No.03EX689).

[93]  MOHAMAD ASSAAD,et al.  TCP Performance over UMTS-HSDPA System , 2004, Telecommun. Syst..

[94]  R. Koetter,et al.  A factor graph framework for joint source-channel decoding of images , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[95]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[96]  Emre Telatar,et al.  Finite-length analysis of low-density parity-check codes on the binary erasure channel , 2002, IEEE Trans. Inf. Theory.

[97]  李幼升,et al.  Ph , 1989 .

[98]  Jianhua Lu,et al.  LDPC-based joint source-channel coding scheme for multimedia communications , 2002, The 8th International Conference on Communication Systems, 2002. ICCS 2002..

[99]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[100]  Alexander Vardy,et al.  On the stopping distance and the stopping redundancy of codes , 2006, IEEE Transactions on Information Theory.