DeepRx: Fully Convolutional Deep Learning Receiver

Deep learning has solved many problems that are out of reach of heuristic algorithms. It has also been successfully applied in wireless communications, even though the current radio systems are well-understood and optimal algorithms exist for many tasks. While some gains have been obtained by learning individual parts of a receiver, a better approach is to jointly learn the whole receiver. This, however, often results in a challenging nonlinear problem, for which the optimal solution is infeasible to implement. To this end, we propose a deep fully convolutional neural network, DeepRx, which executes the whole receiver pipeline from frequency domain signal stream to uncoded bits in a 5G-compliant fashion. We facilitate accurate channel estimation by constructing the input of the convolutional neural network in a very specific manner using both the data and pilot symbols. Also, DeepRx outputs soft bits that are compatible with the channel coding used in 5G systems. Using 3GPP-defined channel models, we demonstrate that DeepRx outperforms traditional methods. We also show that the high performance can likely be attributed to DeepRx learning to utilize the known constellation points of the unknown data symbols, together with the local symbol distribution, for improved detection accuracy.

[1]  Jing Wang,et al.  A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs , 2017, 2017 IEEE International Conference on Communications (ICC).

[2]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[3]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[4]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[5]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[6]  Manuel Eugenio Morocho-Cayamcela,et al.  Machine Learning for 5 G / B 5 G Mobile and Wireless Communications : Potential , Limitations , and Future Directions , 2019 .

[7]  Jakob Hoydis,et al.  Trainable Communication Systems: Concepts and Prototype , 2020, IEEE Transactions on Communications.

[8]  Wolfgang Utschick,et al.  Learning the MMSE Channel Estimator , 2017, IEEE Transactions on Signal Processing.

[9]  Cheng-Xiang Wang,et al.  Artificial Intelligence to Manage Network Traffic of 5G Wireless Networks , 2018, IEEE Network.

[10]  Hao Li,et al.  Complex CNN-Based Equalization for Communication Signal , 2019, 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP).

[11]  Wansu Lim,et al.  Machine Learning for 5G/B5G Mobile and Wireless Communications: Potential, Limitations, and Future Directions , 2019, IEEE Access.

[12]  Ami Wiesel,et al.  Learning to Detect , 2018, IEEE Transactions on Signal Processing.

[13]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[14]  Geoffrey Ye Li,et al.  Deep Learning-Based Channel Estimation for Beamspace mmWave Massive MIMO Systems , 2018, IEEE Wireless Communications Letters.

[15]  Nei Kato,et al.  On Removing Routing Protocol from Future Wireless Networks: A Real-time Deep Learning Approach for Intelligent Traffic Control , 2018, IEEE Wireless Communications.

[16]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[17]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Zhongyuan Zhao,et al.  Deep-Waveform: A Learned OFDM Receiver Based on Deep Complex Convolutional Networks , 2018, ArXiv.

[19]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[20]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[21]  Geoffrey Ye Li,et al.  ComNet: Combination of Deep Learning and Expert Knowledge in OFDM Receivers , 2018, IEEE Communications Letters.

[22]  Jakob Hoydis,et al.  End-to-End Learning of Communications Systems Without a Channel Model , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  James Demmel,et al.  Large Batch Optimization for Deep Learning: Training BERT in 76 minutes , 2019, ICLR.

[25]  Moussa Abdi,et al.  Interference rejection combining in LTE networks , 2012, Bell Labs Technical Journal.

[26]  Geoffrey Ye Li,et al.  Model-Driven Deep Learning for Physical Layer Communications , 2018, IEEE Wireless Communications.

[27]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[28]  Stéphane Mallat,et al.  Rotation, Scaling and Deformation Invariant Scattering for Texture Discrimination , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Marco Pavone,et al.  Cellular Network Traffic Scheduling With Deep Reinforcement Learning , 2018, AAAI.

[30]  Jakob Hoydis,et al.  "Machine LLRning": Learning to Softly Demodulate , 2019, 2019 IEEE Globecom Workshops (GC Wkshps).

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  Geoffrey Ye Li,et al.  Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems , 2017, IEEE Wireless Communications Letters.

[33]  W. Marsden I and J , 2012 .

[34]  Gunther Auer,et al.  Optimized Iterative Channel Estimation for OFDM , 2006, IEEE Vehicular Technology Conference.

[35]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..