End-to-End Learning-Based Framework for Amplify-and-Forward Relay Networks

We study end-to-end learning-based frameworks for amplify-and-forward (AF) relay networks, with and without the channel state information (CSI) knowledge. The designed framework resembles an autoencoder (AE) where all the components of the neural network (NN)-based source and destination nodes are optimized together in an end-to-end manner, and the signal transmission takes place with an AF relay node. Unlike the literature that employs an NN-based relay node with full CSI knowledge, we consider a conventional relay node that only amplifies the received signal using CSI gains. Without the CSI knowledge, we employ power normalization-based amplification that normalizes the transmission power of each block of symbols. We propose and compare symbol-wise and bit-wise AE frameworks by minimizing categorical and binary cross-entropy loss that maximizes the symbol-wise and bit-wise mutual information (MI), respectively. We determine the estimated MI and examine the convergence of both AE frameworks with signal-to-noise ratio (SNR). For both these AE frameworks, we design coded modulation and differential coded modulation, depending upon the availability of CSI at the destination node, that obtains symbols in 2n-dimensions, where n is the block length. To explain the properties of the 2n-dimensional designs, we utilize various metrics like minimum Euclidean distance, normalized second-order and fourth-order moments, and constellation figures of merit. We show that both these AE frameworks obtain similar spherical coded-modulation designs in 2n-dimensions, and bit-wise AE that inherently obtains the optimal bit-labeling outperforms symbol-wise AE (with faster convergence under low SNR) and the conventional AF relay network with a considerable SNR margin.

[1]  Erik G. Larsson,et al.  Physical Adversarial Attacks Against End-to-End Autoencoder Communication Systems , 2019, IEEE Communications Letters.

[2]  Liuqing Yang,et al.  Optimum Resource Allocation for Amplify-and-Forward Relay Networks With Differential Modulation , 2008, IEEE Transactions on Signal Processing.

[3]  Mathini Sellathurai,et al.  Time-Switching EH-Based Joint Relay Selection and Resource Allocation Algorithms for Multi-User Multi-Carrier AF Relay Networks , 2019, IEEE Transactions on Green Communications and Networking.

[4]  Wei Xiang,et al.  A Differential ML Combiner for Differential Amplify-and-Forward System in Time-Selective Fading Channels , 2016, IEEE Transactions on Vehicular Technology.

[5]  Ertugrul Basar,et al.  Impact of I/Q Imbalance on Amplify-and-Forward Relaying: Optimal Detector Design and Error Performance , 2019, IEEE Transactions on Communications.

[6]  Lutz H.-J. Lampe,et al.  Bit-Interleaved Coded Modulation with Mismatched Decoding Metrics , 2011, IEEE Transactions on Communications.

[7]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[8]  Wai Ho Mow,et al.  A Learning Approach to Cooperative Communication System Design , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Toshiaki Koike-Akino,et al.  Optimized constellations for two-way wireless relaying with physical network coding , 2009, IEEE Journal on Selected Areas in Communications.

[10]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[11]  Tharmalingam Ratnarajah,et al.  QoS-Driven Resource Allocation and EE-Balancing for Multiuser Two-Way Amplify-and-Forward Relay Networks , 2017, IEEE Transactions on Wireless Communications.

[12]  Yue Wang,et al.  Deep Learning-Based Autoencoder for m-User Wireless Interference Channel Physical Layer Design , 2020, IEEE Access.

[13]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[14]  Xudong Wang,et al.  A CNN-Based End-to-End Learning Framework Toward Intelligent Communication Systems , 2019, IEEE Access.

[15]  Tim Schenk,et al.  RF Imperfections in High-rate Wireless Systems: Impact and Digital Compensation , 2008 .

[16]  Mamoun F. Al-Mistarihi,et al.  Dual Hop Differential Amplify-and-Forward relaying with selection combining cooperative diversity over Nakagami-m fading channels , 2016, 2016 8th IEEE International Conference on Communication Software and Networks (ICCSN).

[17]  Xiao Chen,et al.  Data-Rate Driven Transmission Strategies for Deep Learning-Based Communication Systems , 2018, IEEE Transactions on Communications.

[18]  Ha H. Nguyen,et al.  Selection Combining for Differential Amplify-and-Forward Relaying Over Rayleigh-Fading Channels , 2013, IEEE Signal Processing Letters.

[19]  Michail Matthaiou,et al.  I/Q Imbalance in AF Dual-Hop Relaying: Performance Analysis in Nakagami-m Fading , 2014, IEEE Transactions on Communications.

[20]  Sheetal Kalyani,et al.  Design of Communication Systems Using Deep Learning: A Variational Inference Perspective , 2019, IEEE Transactions on Cognitive Communications and Networking.

[21]  Wai Ho Mow,et al.  Deep Multi-Task Learning for Cooperative NOMA: System Design and Principles , 2020, IEEE Journal on Selected Areas in Communications.

[22]  Jakob Hoydis,et al.  Trainable Communication Systems: Concepts and Prototype , 2020, IEEE Transactions on Communications.

[23]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[24]  Wansu Lim,et al.  Accelerating wireless channel autoencoders for short coherence-time communications , 2020, Journal of Communications and Networks.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[27]  K. J. Ray Liu,et al.  Differential transmission for amplify-and-forward Cooperative communications , 2005, IEEE Signal Processing Letters.

[28]  Ha H. Nguyen,et al.  Performance of Selection Combining for Differential Amplify-and-Forward Relaying Over Time-Varying Channels , 2014, IEEE Transactions on Wireless Communications.

[29]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[30]  Lei Wang,et al.  A frequency domain differential modulation scheme for asynchronous amplify-and-forward relay networks , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[31]  Tharmalingam Ratnarajah,et al.  QoS-Driven Energy-Efficient Resource Allocation in Multiuser Amplify-and-Forward Relay Networks , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[32]  Ye Wang,et al.  Deep Learning-Based Constellation Optimization for Physical Network Coding in Two-Way Relay Networks , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[33]  Mathini Sellathurai,et al.  A Stacked-Autoencoder Based End-to-End Learning Framework for Decode-and-Forward Relay Networks , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Mathini Sellathurai,et al.  End-to-End Learning-based Amplify-and-Forward Relay Networks using Autoencoders , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[35]  Wai Ho Mow,et al.  Deep Autoencoder Learning for Relay-Assisted Cooperative Communication Systems , 2020, IEEE Transactions on Communications.

[36]  Jakob Hoydis,et al.  Model-Free Training of End-to-End Communication Systems , 2018, IEEE Journal on Selected Areas in Communications.

[37]  Tharmalingam Ratnarajah,et al.  A General Approach Toward Green Resource Allocation in Relay-Assisted Multiuser Communication Networks , 2018, IEEE Transactions on Wireless Communications.

[38]  Nikhil Ketkar,et al.  Introduction to Keras , 2017 .