Deep Ensemble of Weighted Viterbi Decoders for Tail-Biting Convolutional Codes

Tail-biting convolutional codes extend the classical zero-termination convolutional codes: Both encoding schemes force the equality of start and end states, but under the tail-biting each state is a valid termination. This paper proposes a machine-learning approach to improve the state-of-the-art decoding of tail-biting codes, focusing on the widely employed short length regime as in the LTE standard. This standard also includes a CRC code.First, we parameterize the circular Viterbi algorithm, a baseline decoder that exploits the circular nature of the underlying trellis. An ensemble combines multiple such weighted decoders, each decoder specializes in decoding words from a specific region of the channel words’ distribution. A region corresponds to a subset of termination states; the ensemble covers the entire states space. A non-learnable gating satisfies two goals: it filters easily decoded words and mitigates the overhead of executing multiple weighted decoders. The CRC criterion is employed to choose only a subset of experts for decoding purpose. Our method achieves FER improvement of up to 0.75dB over the CVA in the waterfall region for multiple code lengths, adding negligible computational complexity compared to the circular Viterbi algorithm in high SNRs.

[1]  Shu Lin,et al.  Two decoding algorithms for tailbiting codes , 2003, IEEE Trans. Commun..

[2]  T. Moon Error Correction Coding: Mathematical Methods and Algorithms , 2005 .

[3]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[4]  Jack K. Wolf,et al.  On Tail Biting Convolutional Codes , 1986, IEEE Trans. Commun..

[5]  Stephan ten Brink,et al.  On Recurrent Neural Networks for Sequence-based Processing in Communications , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[6]  Yair Be’ery,et al.  Deep Ensemble of Weighted Viterbi Decoders for Tail-Biting Convolutional Codes , 2020, 2020 IEEE Information Theory Workshop (ITW).

[7]  Carl-Erik W. Sundberg,et al.  List Viterbi decoding algorithms with applications , 1994, IEEE Trans. Commun..

[8]  Yair Be'ery,et al.  Learning to decode linear codes using deep learning , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  Yair Be'ery,et al.  Data-Driven Ensembles for Deep and Hard-Decision Hybrid Decoding , 2020, 2020 IEEE International Symposium on Information Theory (ISIT).

[10]  R. V. Cox,et al.  An efficient adaptive circular Viterbi algorithm for decoding generalized tailbiting convolutional codes , 1994 .

[11]  Rolf Johannesson,et al.  Optimal and near-optimal encoders for short and moderate-length tail-biting trellises , 1999, IEEE Trans. Inf. Theory.

[12]  Robert G. Maunder A Vision for 5G Channel Coding , 2016 .

[13]  David Burshtein,et al.  Deep Learning Methods for Improved Decoding of Linear Codes , 2017, IEEE Journal of Selected Topics in Signal Processing.