Progressive Transmission using Recurrent Neural Networks

In this paper, we investigate a new machine learning based transmission strategy called progressive transmission or ProgTr. In ProgTr, there are b variables that should be transmitted using at most T channel uses. The transmitter aims to send the data to the receiver as fast as possible and with as few channel uses as possible (as channel conditions permit) while the receiver refines its estimate after each channel use. We use recurrent neural networks as the building block of both the transmitter and receiver where the SNR is provided as an input that represents the channel conditions. To show how ProgTr works, the proposed scheme was simulated in different scenarios including single/multi-user settings, different channel conditions, and for both discrete and continuous input data. The results show that ProgTr can achieve better performance compared to conventional modulation methods. In addition to performance metrics such as BER, bit-wise mutual information is used to provide some interpretation to how the transmitter and receiver operate in ProgTr.

[1]  G. David Forney,et al.  Multidimensional constellations. I. Introduction, figures of merit, and generalized cross constellations , 1989, IEEE J. Sel. Areas Commun..

[2]  Stephan ten Brink,et al.  On Recurrent Neural Networks for Sequence-based Processing in Communications , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[3]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[4]  Kiran Karra,et al.  Learning to communicate: Channel auto-encoders, domain specific regularizers, and attention , 2016, 2016 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[5]  Xiang Zhou,et al.  High Spectral Efficiency 400 Gb/s Transmission Using PDM Time-Domain Hybrid 32–64 QAM and Training-Assisted Carrier Recovery , 2013 .

[6]  Sercan Ö. Arik,et al.  High-dimensional modulation for coherent optical communications systems. , 2014, Optics express.

[7]  Amin Shokrollahi,et al.  Raptor codes , 2011, IEEE Transactions on Information Theory.

[8]  Adel A. M. Saleh,et al.  Frequency-Independent and Frequency-Dependent Nonlinear Models of TWT Amplifiers , 1981, IEEE Trans. Commun..

[9]  Sreeram Kannan,et al.  LEARN Codes: Inventing Low-Latency Codes via Recurrent Neural Networks , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[10]  Alex Graves,et al.  DRAW: A Recurrent Neural Network For Image Generation , 2015, ICML.

[11]  Sreeram Kannan,et al.  Communication Algorithms via Deep Learning , 2018, ICLR.

[12]  Michael Gastpar,et al.  Uncoded transmission is exactly optimal for a simple Gaussian "sensor" network , 2008, 2007 Information Theory and Applications Workshop.

[13]  Andrea J. Goldsmith,et al.  Deep Learning for Joint Source-Channel Coding of Text , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Shi Jin,et al.  Deep Learning for Massive MIMO CSI Feedback , 2017, IEEE Wireless Communications Letters.

[15]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[16]  Halim Yanikomeroglu,et al.  Multidimensional Constellations for Uplink SCMA Systems—A Comparative Study , 2018, IEEE Communications Surveys & Tutorials.

[17]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[18]  Tim Schenk,et al.  RF Imperfections in High-rate Wireless Systems: Impact and Digital Compensation , 2008 .

[19]  Alfred O. Hero,et al.  Scalable Mutual Information Estimation Using Dependence Graphs , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Alekh Karkada Ashok,et al.  Autoencoders with Variable Sized Latent Vector for Image Compression , 2018, CVPR Workshops.

[21]  Benyuan Zhu,et al.  High Spectral Efficiency 400 Gb/s Transmission Using PDM Time-Domain Hybrid 32–64 QAM and Training-Assisted Carrier Recovery , 2013, Journal of Lightwave Technology.

[22]  Joong Bum Rhim,et al.  Fountain Codes , 2010 .

[23]  Inder Monga,et al.  Beyond 100 Gb/s: capacity, flexibility, and network optimization [Invited] , 2017, IEEE/OSA Journal of Optical Communications and Networking.