Joint Coding and Modulation in the Ultra-Short Blocklength Regime for Bernoulli-Gaussian Impulsive Noise Channels Using Autoencoders

This paper develops a joint coding and modulation scheme for end-to-end communication system design using an autoencoder architecture in the ultra-short blocklength regime. Unlike the classical approach of separately designing error correction codes and modulation schemes for a given channel, the approach here is to learn an optimal mapping directly from messages to channel inputs while simultaneously learning an optimal mapping directly from channel outputs to estimated messages. The block error rate (BLER) of this approach is compared against classical short blocklength linear block codes with binary phase shift keying (BPSK) modulation in additive white Gaussian noise (AWGN) and Bernoulli-Gaussian impulsive noise (BGIN) channels. For AWGN channels, numerical results show that the autoencoder can achieve better BLER performance than BPSK modulated Hamming codes with maximum likelihood decoding. For BGIN channels, numerical results show the autoencoder achieves uniformly better BLER performance than conventional block codes with BPSK modulation, even with impulsive noise mitigation techniques such as blanking and clipping. The proposed architecture is general and can be modified for comparison against other block coding schemes and higher-order modulations.

[1]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[2]  Albert Guillén i Fàbregas,et al.  Saddlepoint approximation of random-coding bounds , 2011, 2011 Information Theory and Applications Workshop.

[3]  Dario Fertonani,et al.  On reliable communications over channels impaired by bursty impulse noise , 2008, IEEE Transactions on Communications.

[4]  Der-Feng Tseng,et al.  Robust turbo decoding in single-carrier systems over memoryless impulse noise channels , 2016, 2016 International Conference on Advanced Technologies for Communications (ATC).

[5]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[6]  A. J. Han Vinck,et al.  On impulse noise and its models , 2014, 18th IEEE International Symposium on Power Line Communications and Its Applications.

[7]  Sreeram Kannan,et al.  Deepcode: Feedback Codes via Deep Learning , 2018, IEEE Journal on Selected Areas in Information Theory.

[8]  G. David Forney Trellis shaping , 1992, IEEE Trans. Inf. Theory.

[9]  Khaled M. Rabie,et al.  Improving blanking/clipping based impulsive noise mitigation over powerline channels , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[10]  Timothy J. O'Shea,et al.  Physical Layer Communications System Design Over-the-Air Using Adversarial Networks , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[11]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[12]  Le Song,et al.  Learning towards Minimum Hyperspherical Energy , 2018, NeurIPS.

[13]  Mihaela van der Schaar,et al.  Machine Learning in the Air , 2019, IEEE Journal on Selected Areas in Communications.

[14]  G. Ndo,et al.  Adaptive Noise Mitigation in Impulsive Environment: Application to Power-Line Communications , 2010, IEEE Transactions on Power Delivery.

[15]  Ghassan M. Kraidy,et al.  Performance analysis of convolutional codes over the Bernoulli-Gaussian impulsive noise channel , 2017, 2017 15th Canadian Workshop on Information Theory (CWIT).

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Gianluigi Ferrari,et al.  Fundamental performance limits of communications systems impaired by impulse noise , 2009, IEEE Transactions on Communications.

[19]  Stephan ten Brink,et al.  OFDM-Autoencoder for End-to-End Learning of Communications Systems , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[20]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[21]  Stéphane Y. Le Goff,et al.  Error probability analysis of M-QAM on Rayleigh fading channels with impulsive noise , 2016, 2016 IEEE 17th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[22]  Suju Rajan,et al.  Geometry Aware Mappings for High Dimensional Sparse Factors , 2016, AISTATS.

[23]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[24]  Patrick Schulte,et al.  Bandwidth Efficient and Rate-Matched Low-Density Parity-Check Coded Modulation , 2015, IEEE Transactions on Communications.

[25]  Tomaso Erseghe,et al.  Coding in the Finite-Blocklength Regime: Bounds Based on Laplace Integrals and Their Asymptotic Approximations , 2015, IEEE Transactions on Information Theory.

[26]  Jakob Hoydis,et al.  End-to-End Learning of Communications Systems Without a Channel Model , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.