Model-Driven DNN Decoder for Turbo Codes: Design, Simulation, and Experimental Results

This paper presents a novel model-driven deep learning (DL) architecture, called TurboNet, for turbo decoding that integrates DL into the traditional max-log-maximum a posteriori (MAP) algorithm. The TurboNet inherits the superiority of the max-log-MAP algorithm and DL tools and thus presents excellent error-correction capability with low training cost. To design the TurboNet, the original iterative structure is unfolded as deep neural network (DNN) decoding units, where trainable weights are introduced to the max-log-MAP algorithm and optimized through supervised learning. To efficiently train the TurboNet, a loss function is carefully designed to prevent tricky gradient vanishing issue. To further reduce the computational complexity and training cost of the TurboNet, we can prune it into TurboNet+. Compared with the existing black-box DL approaches, the TurboNet+ has considerable advantage in computational complexity and is conducive to significantly reducing the decoding overhead. Furthermore, we also present a simple training strategy to address the overfitting issue, which enable efficient training of the proposed TurboNet+. Simulation results demonstrate TurboNet+’s superiority in error-correction ability, signal-to-noise ratio generalization, and computational overhead. In addition, an experimental system is established for an over-the-air (OTA) test with the help of a 5G rapid prototyping system and demonstrates TurboNet’s strong learning ability and great robustness to various scenarios.

[1]  Warren J. Gross,et al.  Neural offset min-sum decoding , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[2]  Yuping Zhao,et al.  Learning to Denoise and Decode: A Novel Residual Neural Network Decoder for Polar Codes , 2019, 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall).

[3]  Robert M. Gray,et al.  Coding for noisy channels , 2011 .

[4]  David Burshtein,et al.  Deep Learning Methods for Improved Decoding of Linear Codes , 2017, IEEE Journal of Selected Topics in Signal Processing.

[5]  B. Shahrrava,et al.  An Improved Max-Log-MAP Algorithm for Turbo Decoding and Turbo Equalization , 2007, IEEE Transactions on Instrumentation and Measurement.

[6]  Sreeram Kannan,et al.  DEEPTURBO: Deep Turbo Decoder , 2019, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[7]  Shi Jin,et al.  RaPro: A Novel 5G Rapid Prototyping System Architecture , 2017, IEEE Wireless Communications Letters.

[8]  Dwijendra K. Ray-Chaudhuri,et al.  Binary mixture flow with free energy lattice Boltzmann methods , 2022, arXiv.org.

[9]  Geoffrey Ye Li,et al.  ComNet: Combination of Deep Learning and Expert Knowledge in OFDM Receivers , 2018, IEEE Communications Letters.

[10]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[11]  Biing-Hwang Juang,et al.  Deep Learning in Physical Layer Communications , 2018, IEEE Wireless Communications.

[12]  David E. Muller,et al.  Application of Boolean algebra to switching circuit design and to error detection , 1954, Trans. I R E Prof. Group Electron. Comput..

[13]  Yair Be'ery,et al.  Learning to decode linear codes using deep learning , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  Stephan ten Brink,et al.  On deep learning-based channel decoding , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[15]  Patrick Robertson,et al.  Optimal and sub-optimal maximum a posteriori algorithms suitable for turbo decoding , 1997, Eur. Trans. Telecommun..

[16]  J. Vogt,et al.  Improving the max-log-MAP turbo decoder , 2000 .

[17]  P. Glenn Gulak,et al.  Reduced complexity symbol detectors with parallel structure for ISI channels , 1994, IEEE Trans. Commun..

[18]  F. Moore,et al.  Polynomial Codes Over Certain Finite Fields , 2017 .

[19]  Yair Be'ery,et al.  Active Deep Decoding of Linear Codes , 2019, IEEE Transactions on Communications.

[20]  Sreeram Kannan,et al.  Communication Algorithms via Deep Learning , 2018, ICLR.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[23]  Geoffrey Ye Li,et al.  Deep Learning-Based CSI Feedback Approach for Time-Varying Massive MIMO Channels , 2018, IEEE Wireless Communications Letters.

[24]  Erdal Arikan,et al.  Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels , 2008, IEEE Transactions on Information Theory.

[25]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[26]  Biing-Hwang Juang,et al.  Deep Learning-Based End-to-End Wireless Communication Systems With Conditional GANs as Unknown Channels , 2019, IEEE Transactions on Wireless Communications.

[27]  Geoffrey Ye Li,et al.  Artificial Intelligence-aided OFDM Receiver: Design and Experimental Results , 2018, ArXiv.

[28]  Shi Jin,et al.  TurboNet: A Model-driven DNN Decoder Based on Max-Log-MAP Algorithm for Turbo Code , 2019, 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS).

[29]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[30]  Geoffrey Ye Li,et al.  Artificial Intelligence-Aided Receiver for a CP-Free OFDM System: Design, Simulation, and Experimental Test , 2019, IEEE Access.

[31]  T. Charles Clancy,et al.  Over-the-Air Deep Learning Based Radio Signal Classification , 2017, IEEE Journal of Selected Topics in Signal Processing.

[32]  John Cocke,et al.  Optimal decoding of linear codes for minimizing symbol error rate (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[33]  Stephen B. Wicker,et al.  Path Output Register Selection Register 4 t Maximum Path Metric Selection , 2004 .

[34]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[35]  Geoffrey Ye Li,et al.  Model-Driven Deep Learning for MIMO Detection , 2020, IEEE Transactions on Signal Processing.

[36]  Geoffrey Ye Li,et al.  Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems , 2017, IEEE Wireless Communications Letters.

[37]  Tao Jiang,et al.  Deep learning for wireless physical layer: Opportunities and challenges , 2017, China Communications.

[38]  Daniel J. Costello,et al.  Channel coding: The road to channel capacity , 2006, Proceedings of the IEEE.

[39]  Shi Jin,et al.  Deep Learning for Massive MIMO CSI Feedback , 2017, IEEE Wireless Communications Letters.