Pruning Neural Belief Propagation Decoders

We consider near maximum-likelihood (ML) decoding of short linear block codes based on neural belief propagation (BP) decoding recently introduced by Nachmani et al.. While this method significantly outperforms conventional BP decoding, the underlying parity-check matrix may still limit the overall performance. In this paper, we introduce a method to tailor an overcomplete parity-check matrix to (neural) BP decoding using machine learning. We consider the weights in the Tanner graph as an indication of the importance of the connected check nodes (CNs) to decoding and use them to prune unimportant CNs. As the pruning is not tied over iterations, the final decoder uses a different parity-check matrix in each iteration. For ReedMuller and short low-density parity-check codes, we achieve performance within 0.27dB and 1.5dB of the ML performance while reducing the complexity of the decoder.

[1]  Yair Be'ery,et al.  Learning to decode linear codes using deep learning , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Marc P. C. Fossorier,et al.  Iterative reliability-based decoding of linear block codes with adaptive belief propagation , 2005, IEEE Communications Letters.

[3]  David Burshtein,et al.  Deep Learning Methods for Improved Decoding of Linear Codes , 2017, IEEE Journal of Selected Topics in Signal Processing.

[4]  Keith M. Chugg,et al.  Random Redundant Soft-In Soft-Out Decoding of Linear Block Codes , 2006, 2006 IEEE International Symposium on Information Theory.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Henry D. Pfister,et al.  Learned Belief-Propagation Decoding with Simple Scaling and SNR Adaptation , 2019, 2019 IEEE International Symposium on Information Theory (ISIT).

[7]  Henry D. Pfister,et al.  Decoding Reed-Muller Codes Using Minimum- Weight Parity Checks , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[8]  Johannes B. Huber,et al.  Multiple-bases belief-propagation decoding of high-density cyclic codes , 2009, IEEE Transactions on Communications.

[9]  Krishna R. Narayanan,et al.  Iterative Soft-Input Soft-Output Decoding of Reed-Solomon Codes by Adapting the , 2005 .

[10]  Krishna R. Narayanan,et al.  Iterative Soft-Input Soft-Output Decoding of Reed–Solomon Codes by Adapting the Parity-Check Matrix , 2005, IEEE Transactions on Information Theory.