Noisy Gradient Descent Bit-Flip Decoding for LDPC Codes

A modified Gradient Descent Bit Flipping (GDBF) algorithm is proposed for decoding Low Density Parity Check (LDPC) codes on the binary-input additive white Gaussian noise channel. The new algorithm, called Noisy GDBF (NGDBF), introduces a random perturbation into each symbol metric at each iteration. The noise perturbation allows the algorithm to escape from undesirable local maxima, resulting in improved performance. A combination of heuristic improvements to the algorithm are proposed and evaluated. When the proposed heuristics are applied, NGDBF performs better than any previously reported GDBF variant, and comes within 0.5 dB of the belief propagation algorithm for several tested codes. Unlike other previous GDBF algorithms that provide an escape from local maxima, the proposed algorithm uses only local, fully parallelizable operations and does not require computing a global objective function or a sort over symbol metrics, making it highly efficient in comparison. The proposed NGDBF algorithm requires channel state information which must be obtained from a signal to noise ratio (SNR) estimator. Architectural details are presented for implementing the NGDBF algorithm. Complexity analysis and optimizations are also discussed.

[1]  Vincent C. Gaudet,et al.  A Markov chain model for Edge Memories in stochastic decoding of LDPC codes , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[2]  Shie Mannor,et al.  Dithered Belief Propagation Decoding , 2012, IEEE Transactions on Communications.

[3]  Xianjun Jiao.  An Improved Stochastic Decoding Algorithm of LTE Turbo Codes , 2012, WASA.

[4]  Marco Dorigo,et al.  Ant Colony Optimization and Stochastic Gradient Descent , 2002, Artificial Life.

[5]  Warren J. Gross,et al.  Reduced-latency stochastic decoding of LDPC codes over GF(q) , 2010, 2010 European Wireless Conference (EW).

[6]  Paramin Sangwongngam,et al.  Improved Gradient Descent Bit Flipping algorithms for LDPC decoding , 2012, 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP).

[7]  Wei Zhou,et al.  A Improved Decoding Algorithm for Low-Density Parity-Check Codes , 2006, 2006 International Conference on Communication Technology.

[8]  S. Mitter,et al.  Recursive stochastic algorithms for global optimization in R d , 1991 .

[9]  Martin J. Wainwright,et al.  An Efficient 10GBASE-T Ethernet LDPC Decoder Design With Low Error Floors , 2010, IEEE Journal of Solid-State Circuits.

[10]  L BrandonTyler,et al.  A compact 1.1-Gb/s encoder and a memory-based 600-Mb/s decoder for LDPC convolutional codes , 2009 .

[11]  Vincent C. Gaudet,et al.  Lowering Error Floors in Stochastic Decoding of LDPC Codes Based on Wire-Delay Dependent Asynchronous Updating , 2013, 2013 IEEE 43rd International Symposium on Multiple-Valued Logic.

[12]  Vincent C. Gaudet,et al.  A scaling method for stochastic LDPC decoding over the binary symmetric channel , 2013, 2013 47th Annual Conference on Information Sciences and Systems (CISS).

[13]  Vincent C. Gaudet,et al.  Stochastic iterative decoders , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[14]  Jean-Luc Danger,et al.  Generic Description and Synthesis of LDPC Decoders , 2007, IEEE Transactions on Communications.

[15]  Mohamad Sawan,et al.  Delayed Stochastic Decoding of LDPC Codes , 2011, IEEE Transactions on Signal Processing.

[16]  Xiaohu You,et al.  New insights into weighted bit-flipping decoding , 2009, IEEE Transactions on Communications.

[17]  Chris Winstead,et al.  A Probabilistic LDPC-Coded Fault Compensation Technique for Reliable Nanoscale Computing , 2009, IEEE Transactions on Circuits and Systems II: Express Briefs.

[18]  W. Gardner.  Learning characteristics of stochastic-gradient-descent algorithms: A general study, analysis, and critique , 1984 .

[19]  Shie Mannor,et al.  Majority-Based Tracking Forecast Memories for Stochastic LDPC Decoding , 2010, IEEE Transactions on Signal Processing.

[20]  Vincent C. Gaudet,et al.  Iterative decoding using stochastic computation , 2003 .

[21]  Yusuf Leblebici,et al.  A 5.35 mm2 10GBASE-T Ethernet LDPC decoder chip in 90 nm CMOS , 2010, 2010 IEEE Asian Solid-State Circuits Conference.

[22]  Xiaohu You,et al.  Towards Understanding Weighted Bit-Flipping Decoding , 2007, 2007 IEEE International Symposium on Information Theory.

[23]  Shie Mannor,et al.  Stochastic Chase Decoding of Reed-Solomon Codes , 2010, IEEE Communications Letters.

[24]  David Declercq,et al.  Min-Sum-based decoders running on noisy hardware , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[25]  David Declercq,et al.  Unconventional behavior of the noisy min-sum decoder over the binary symmetric channel , 2014, 2014 Information Theory and Applications Workshop (ITA).

[26]  Nenad Miladinovic,et al.  Improved bit-flipping decoding of low-density parity-check codes , 2002, IEEE Transactions on Information Theory.

[27]  Xiaohu You,et al.  Parallel Weighted Bit-Flipping Decoding , 2007, IEEE Communications Letters.

[28]  Chi-Ying Tsui,et al.  A low power layered decoding architecture for LDPC decoder implementation for IEEE 802.11n LDPC codes , 2008, Proceeding of the 13th international symposium on Low power electronics and design (ISLPED '08).

[29]  Warren J. Gross,et al.  Efficient Stochastic Decoding of Non-Binary LDPC Codes with Degree-Two Variable Nodes , 2012, IEEE Communications Letters.

[30]  Shie Mannor,et al.  An Area-Efficient FPGA-Based Architecture for Fully-Parallel Stochastic LDPC Decoding , 2007, 2007 IEEE Workshop on Signal Processing Systems.

[31]  V. Gaudet,et al.  On the simulation of stochastic iterative decoder architectures , 2005, Canadian Conference on Electrical and Computer Engineering, 2005..

[32]  Justin P. Coon,et al.  Low latency low power bit flipping algorithms for LDPC decoding , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[33]  Shu Lin,et al.  Low-density parity-check codes based on finite geometries: A rediscovery and new results , 2001, IEEE Trans. Inf. Theory.

[34]  Marc P. C. Fossorier,et al.  A modified weighted bit-flipping decoding of low-density Parity-check codes , 2004, IEEE Communications Letters.

[35]  Shie Mannor,et al.  Stochastic decoding of LDPC codes , 2006, IEEE Communications Letters.

[36]  Shie Mannor,et al.  Fully Parallel Stochastic LDPC Decoders , 2008, IEEE Transactions on Signal Processing.

[37]  Tinoosh Mohsenin,et al.  A Low-Complexity Message-Passing Algorithm for Reduced Routing Congestion in LDPC Decoders , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[38]  Shantanu Chakrabartty,et al.  Noise-Shaping Gradient Descent-Based Online Adaptation Algorithms for Digital Calibration of Analog Circuits , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[40]  Justin P. Coon,et al.  Low Power Decoding of LDPC Codes , 2013 .

[41]  Shogo Usami,et al.  Multi-bit flip type gradient descent bit flipping decoding using no thresholds , 2012, 2012 International Symposium on Information Theory and its Applications.

[42]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[43]  Shie Mannor,et al.  A Relaxed Half-Stochastic Iterative Decoder for LDPC Codes , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[44]  Naresh R. Shanbhag,et al.  High-throughput LDPC decoders , 2003, IEEE Trans. Very Large Scale Integr. Syst..

[45]  Shie Mannor,et al.  Tracking Forecast Memories for Stochastic Decoding , 2011, J. Signal Process. Syst..

[46]  C. Winstead.  Stochastic Iterative Decoding on Factor Graphs , 2003 .

[47]  Vincent C. Gaudet,et al.  Clockless Stochastic Decoding of Low-Density Parity-Check Codes: Architecture and Simulation Model , 2014, J. Signal Process. Syst..

[48]  Tong Zhang,et al.  Solving large scale linear prediction problems using stochastic gradient descent algorithms , 2004, ICML.

[49]  Mohammad M. Mansour,et al.  A 640-Mb/s 2048-bit programmable LDPC decoder chip , 2006, IEEE Journal of Solid-State Circuits.

[50]  Vincent C. Gaudet,et al.  Asynchronous Stochastic Decoding of Low-Density Parity-Check Codes , 2012, 2012 IEEE 42nd International Symposium on Multiple-Valued Logic.

[51]  Christophe Jégo,et al.  Stochastic Decoding of Turbo Codes , 2010, IEEE Transactions on Signal Processing.

[52]  Ming Jiang,et al.  An improvement on the modified weighted bit flipping decoding algorithm for LDPC codes , 2005, IEEE Communications Letters.

[53]  Bo Zhu,et al.  Stochastic Decoding of Linear Block Codes With High-Density Parity-Check Matrices , 2008, IEEE Transactions on Signal Processing.

[54]  WadayamaTadashi,et al.  Gradient descent bit flipping algorithms for decoding LDPC codes , 2010 .

[55]  Christophe Jégo,et al.  Stochastic Multiple Stream Decoding of Cortex Codes , 2011, IEEE Transactions on Signal Processing.

[56]  Radford M. Neal,et al.  Near Shannon limit performance of low density parity check codes , 1996 .

[57]  Shyh-Jye Jou,et al.  A 5.79-Gb/s Energy-Efficient Multirate LDPC Codec Chip for IEEE 802.15.3c Applications , 2012, IEEE Journal of Solid-State Circuits.

[58]  Deng Yongqiang,et al.  An improved decoding algorithm of low-density parity-check codes , 2005, Proceedings. 2005 International Conference on Wireless Communications, Networking and Mobile Computing, 2005..

[59]  Shie Mannor,et al.  Relaxation Dynamics in Stochastic Iterative Decoders , 2010, IEEE Transactions on Signal Processing.

[60]  Ichi Takumi,et al.  Gradient descent bit flipping algorithms for decoding LDPC codes , 2007, IEEE Transactions on Communications.

[61]  Shie Mannor,et al.  Tracking Forecast Memories in stochastic decoders , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[62]  Bruce F. Cockburn,et al.  A Compact 1.1-Gb/s Encoder and a Memory-Based 600-Mb/s Decoder for LDPC Convolutional Codes , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[63]  Xiaohu You,et al.  Fast Weighted Bit-Flipping Decoding of Finite-Geometry LDPC Codes , 2006, 2006 IEEE Information Theory Workshop - ITW '06 Chengdu.

[64]  Zhenyu Liu,et al.  Low complexity decoding of finite geometry LDPC codes , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[65]  David J. C. MacKay,et al.  Encyclopedia of Sparse Graph Codes , 1999 .

[66]  Joseph R. Cavallaro,et al.  Scalable and low power LDPC decoder design using high level algorithmic synthesis , 2009, 2009 IEEE International SOC Conference (SOCC).

[67]  Hsie-Chia Chang,et al.  Stochastic decoding for LDPC convolutional codes , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[68]  A. Blanksby,et al.  A 690-mW 1-Gb/s 1024-b, rate-1/2 low-density parity-check code decoder , 2001, IEEE J. Solid State Circuits.

[69]  Carla E. Brodley,et al.  Proceedings of the twenty-first international conference on Machine learning , 2004, International Conference on Machine Learning.