Efficient QP-ADMM Decoder for Binary LDPC Codes and Its Performance Analysis

This paper presents an efficient quadratic programming (QP) decoder via the alternating direction method of multipliers (ADMM) technique, called QP-ADMM, for binary low-density parity-check (LDPC) codes. Its main contents are as follows: first, we relax the maximum likelihood (ML) decoding problem to a non-convex quadratic program. Then, we develop an ADMM solving algorithm for the formulated non-convex QP decoding model. In the proposed QP-ADMM decoder, complex Euclidean projections onto the check polytope are eliminated and variables in each updated step can be solved analytically in parallel. Moreover, it is proved that the proposed ADMM algorithm converges to a stationary point of the non-convex QP problem under the assumption of sequence convergence. We also verify that the proposed decoder satisfies the favorable property of the all-zeros assumption. Furthermore, by exploiting the inside structures of the QP model, the complexity of the proposed algorithm in each iteration is shown to be linear in terms of LDPC code length. Simulation results demonstrate the effectiveness of the proposed QP-ADMM decoder.

[1]  Xiaopeng Jiao,et al.  Reduced-Complexity Linear Programming Decoding Based on ADMM for LDPC Codes , 2015, IEEE Communications Letters.

[2]  Haiyang Liu,et al.  On the Decomposition Method for Linear Programming Decoding of LDPC Codes , 2010 .

[3]  Stark C. Draper,et al.  Hardware-based linear programming decoding via the alternating direction method of multipliers , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Jon Feldman,et al.  A New Linear Programming Approach to Decoding Linear Block Codes , 2008, IEEE Transactions on Information Theory.

[5]  Yang Liu,et al.  Parameter-free 𝓵 p -Box Decoding of LDPC Codes. , 2017 .

[6]  Michael Chertkov,et al.  Pseudo-codeword Landscape , 2007, 2007 IEEE International Symposium on Information Theory.

[7]  David Burshtein Iterative approximate linear programming decoding of LDPC codes with linear complexity , 2009, IEEE Trans. Inf. Theory.

[8]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[9]  Paul H. Siegel,et al.  Adaptive Methods for Linear Programming Decoding , 2008, IEEE Transactions on Information Theory.

[10]  Thomas J. Richardson,et al.  Error Floors of LDPC Codes , 2003 .

[11]  Biao Wang,et al.  Improved Penalty Functions of ADMM Penalized Decoder for LDPC Codes , 2017, IEEE Communications Letters.

[12]  Xiaopeng Jiao,et al.  Reduced Complexity Node-Wise Scheduling of ADMM Decoding for LDPC Codes , 2017, IEEE Communications Letters.

[13]  Ichi Takumi,et al.  A cutting plane method based on redundant rows for improving fractional distance , 2008, 2008 5th International Symposium on Turbo Codes and Related Topics.

[14]  Mohamad Sawan,et al.  Delayed Stochastic Decoding of LDPC Codes , 2011, IEEE Transactions on Signal Processing.

[15]  David Burshtein,et al.  Improved Linear Programming Decoding of LDPC Codes and Bounds on the Minimum and Fractional Distance , 2010, IEEE Transactions on Information Theory.

[16]  Shu Lin,et al.  Channel Codes: Classical and Modern , 2009 .

[17]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[18]  Paul H. Siegel,et al.  Efficient iterative LP decoding of LDPC codes with alternating direction method of multipliers , 2013, 2013 IEEE International Symposium on Information Theory.

[19]  David J. C. MacKay,et al.  Encyclopedia of Sparse Graph Codes , 1999 .

[20]  Stark C. Draper,et al.  Multi-stage decoding of LDPC codes , 2009, 2009 IEEE International Symposium on Information Theory.

[21]  Alexandros G. Dimakis,et al.  Guessing Facets: Polytope Structure and Improved LP Decoder , 2009, IEEE Transactions on Information Theory.

[22]  Frank Kienle,et al.  A Separation Algorithm for Improved LP-Decoding of Linear Block Codes , 2008, IEEE Transactions on Information Theory.

[23]  Tadashi Wadayama,et al.  Interior Point Decoding for Linear Vector Channels Based on Convex Optimization , 2008, IEEE Transactions on Information Theory.

[24]  Radford M. Neal,et al.  Near Shannon limit performance of low density parity check codes , 1996 .

[25]  Rüdiger L. Urbanke,et al.  Modern Coding Theory , 2008 .

[26]  David Burshtein,et al.  Iterative Approximate Linear Programming Decoding of LDPC Codes With Linear Complexity , 2008, IEEE Transactions on Information Theory.

[27]  Chao Chen,et al.  Improved ADMM Penalized Decoder for Irregular Low-Density Parity-Check Codes , 2015, IEEE Communications Letters.

[28]  Paul H. Siegel,et al.  Adaptive Cut Generation Algorithm for Improved Linear Programming Decoding of Binary Linear Codes , 2011, IEEE Transactions on Information Theory.

[29]  Stark C. Draper,et al.  ML decoding via mixed-integer adaptive linear programming , 2007, 2007 IEEE International Symposium on Information Theory.

[30]  Stark C. Draper,et al.  Hardware based projection onto the parity polytope and probability simplex , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[31]  Bertrand Le Gal,et al.  Fast Converging ADMM-Penalized Algorithm for LDPC Decoding , 2016, IEEE Communications Letters.

[32]  Shie Mannor,et al.  Majority-Based Tracking Forecast Memories for Stochastic LDPC Decoding , 2010, IEEE Transactions on Signal Processing.

[33]  Shie Mannor,et al.  Fully Parallel Stochastic LDPC Decoders , 2008, IEEE Transactions on Signal Processing.

[34]  Stark C. Draper,et al.  Decomposition methods for large scale LP decoding , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[35]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[36]  David J. C. MacKay,et al.  Good Codes Based on Very Sparse Matrices , 1995, IMACC.

[37]  Emre Telatar,et al.  Finite-length analysis of low-density parity-check codes on the binary erasure channel , 2002, IEEE Trans. Inf. Theory.

[38]  Asi Lifshitz,et al.  Efficient Linear Programming Decoding of HDPC Codes , 2011, IEEE Trans. Commun..

[39]  Akin Tanatmis,et al.  Mathematical Programming Decoding of Binary Linear Codes: Theory and Algorithms , 2011, IEEE Transactions on Information Theory.

[40]  Richard Heusdens,et al.  Large Scale LP Decoding with Low Complexity , 2013, IEEE Communications Letters.

[41]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  P. Vontobel,et al.  Graph-Cover Decoding and Finite-Length Analysis of Message-Passing Iterative Decoding of LDPC Codes , 2005, ArXiv.

[43]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[44]  Yu-Cheng He,et al.  Memory-Reduced Look-Up Tables for Efficient ADMM Decoding of LDPC Codes , 2018, IEEE Signal Processing Letters.

[45]  Francis C. M. Lau,et al.  Minimum-Polytope-Based Linear Programming Decoder for LDPC Codes via ADMM Approach , 2019, IEEE Wireless Communications Letters.

[46]  Amir H. Banihashemi,et al.  An Iterative Check Polytope Projection Algorithm for ADMM-Based LP Decoding of LDPC Codes , 2018, IEEE Communications Letters.

[47]  Stark C. Draper,et al.  The ADMM Penalized Decoder for LDPC Codes , 2014, IEEE Transactions on Information Theory.

[48]  Stark C. Draper,et al.  Hardware-Based Linear Program Decoding With the Alternating Direction Method of Multipliers , 2016, IEEE Transactions on Signal Processing.