Accelerating wireless channel autoencoders for short coherence-time communications

Traditional wireless communication theory is based on complex probabilistic models and fixed conjectures, which limit the optimal utilization of spectrum resources. Deep learning has been used to design end-to-end communication systems using an encoder to replace the transmitter and a decoder for the receiver. We address the challenge to update the parameters of a wireless channel autoencoder (AE) under a time-varying channel with short coherence-time. We suggest an optimized training algorithm that updates the learning rate value on a per-dimension basis, restricting the past gradients instead of accumulating them. We also scale the initial weights of our AE by sampling them from a normalized uniform distribution. While recently proposed AE configurations might fail to converge at a few number of epochs, our setting attains a fast convergence maintaining its robustness to large gradients, oscillations, and vanishing problems. By simulation results, we demonstrate that our proposed AE configuration improves the bit reconstruction accuracy in shorter training time.

[1]  Satoshi Suyama,et al.  5G Mobile and Wireless Communications Technology , 2016 .

[2]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[3]  Wansu Lim,et al.  Machine Learning for 5G/B5G Mobile and Wireless Communications: Potential, Limitations, and Future Directions , 2019, IEEE Access.

[4]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[5]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Wansu Lim,et al.  Artificial Intelligence in 5G Technology: A Survey , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[8]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[9]  Kiran Karra,et al.  Learning to communicate: Channel auto-encoders, domain specific regularizers, and attention , 2016, 2016 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[10]  Martin Maier,et al.  Breaking Wireless Propagation Environmental Uncertainty With Deep Learning , 2020, IEEE Transactions on Wireless Communications.

[11]  Lei Wang,et al.  QoE Oriented Cognitive Network Based on Machine Learning and SDN , 2019, 2019 IEEE 11th International Conference on Communication Software and Networks (ICCSN).

[12]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[13]  Wansu Lim,et al.  Machine Learning to Improve Multi-Hop Searching and Extended Wireless Reachability in V2X , 2020, IEEE Communications Letters.

[14]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[15]  Wansu Lim,et al.  Learning to Communicate with Autoencoders: Rethinking Wireless Systems with Deep Learning , 2020, 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[16]  Yi Shi,et al.  Deep Learning for Wireless Communications , 2019, Development and Analysis of Deep Learning Architectures.

[17]  Timothy J. O'Shea,et al.  Physical layer deep learning of encodings for the MIMO fading channel , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[18]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[19]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[20]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[21]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .