Iterative Algorithm Induced Deep-Unfolding Neural Networks: Precoding Design for Multiuser MIMO Systems

Optimization theory assisted algorithms have received great attention for precoding design in multiuser multiple-input multiple-output (MU-MIMO) systems. Although the resultant optimization algorithms are able to provide excellent performance, they generally require considerable computational complexity, which gets in the way of their practical application in real-time systems. In this work, in order to address this issue, we first propose a framework for deep-unfolding, where a general form of iterative algorithm induced deep-unfolding neural network (IAIDNN) is developed in matrix form to better solve the problems in communication systems. Then, we implement the proposed deepunfolding framework to solve the sum-rate maximization problem for precoding design in MU-MIMO systems. An efficient IAIDNN based on the structure of the classic weighted minimum mean-square error (WMMSE) iterative algorithm is developed. Specifically, the iterative WMMSE algorithm is unfolded into a layer-wise structure, where a number of trainable parameters are introduced to replace the highcomplexity operations in the forward propagation. To train the network, a generalized chain rule of the IAIDNN is proposed to depict the recurrence relation of gradients between two adjacent layers in the back propagation. Moreover, we discuss the computational complexity and generalization ability of the proposed scheme. Simulation results show that the proposed IAIDNN efficiently achieves the performance of the iterative WMMSE algorithm with reduced computational complexity.

[1]  Stephan ten Brink,et al.  Scaling Deep Learning-Based Decoding of Polar Codes via Partitioning , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[2]  Zhi-Quan Luo,et al.  An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Emil Björnson,et al.  Optimal Design of Energy-Efficient Multi-User MIMO Systems: Is Massive MIMO the Answer? , 2014, IEEE Transactions on Wireless Communications.

[4]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[5]  Gang Wang,et al.  Real-Time Power System State Estimation and Forecasting via Deep Unrolled Neural Networks , 2018, IEEE Transactions on Signal Processing.

[6]  Emil Björnson,et al.  Toward Massive MIMO 2.0: Understanding Spatial Correlation, Interference Suppression, and Pilot Contamination , 2019, IEEE Transactions on Communications.

[7]  Wei Yu,et al.  FDMA capacity of the Gaussian multiple access channel with ISI , 2000, 2000 IEEE International Conference on Communications. ICC 2000. Global Convergence Through Communications. Conference Record.

[8]  Alejandro Ribeiro,et al.  Learning Optimal Resource Allocations in Wireless Systems , 2018, IEEE Transactions on Signal Processing.

[9]  Alexios Balatsoukas-Stimming,et al.  Deep Unfolding for Communications Systems: A Survey and Some New Directions , 2019, 2019 IEEE International Workshop on Signal Processing Systems (SiPS).

[10]  Sundeep Rangan,et al.  AMP-Inspired Deep Networks for Sparse Linear Inverse Problems , 2016, IEEE Transactions on Signal Processing.

[11]  Vincent K. N. Lau,et al.  Online Successive Convex Approximation for Two-Stage Stochastic Nonconvex Optimization , 2018, IEEE Transactions on Signal Processing.

[12]  Wei Cui,et al.  Spatial Deep Learning for Wireless Scheduling , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[13]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[14]  Geoffrey Ye Li,et al.  A Model-Driven Deep Learning Network for MIMO Detection , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[15]  Nikos D. Sidiropoulos,et al.  Transmit beamforming for physical-layer multicasting , 2006, IEEE Transactions on Signal Processing.

[16]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[17]  Tony Q. S. Quek,et al.  Deep Learning for Distributed Optimization: Applications to Wireless Resource Management , 2019, IEEE Journal on Selected Areas in Communications.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Minjian Zhao,et al.  An AMP-Based Network With Deep Residual Learning for mmWave Beamspace Channel Estimation , 2019, IEEE Wireless Communications Letters.

[20]  Cong Shen,et al.  Towards Optimal Power Control via Ensembling Deep Neural Networks , 2018, IEEE Transactions on Communications.

[21]  Mingyi Hong,et al.  Spectral Efficiency Optimization For Millimeter Wave Multiuser MIMO Systems , 2018, IEEE Journal of Selected Topics in Signal Processing.

[22]  Jen-Tzung Chien,et al.  Deep Unfolding for Topic Models , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Sergio Barbarossa,et al.  IEEE TRANSACTIONS ON SIGNAL PROCESSING (ACCEPTED) 1 The MIMO Iterative Waterfilling Algorithm , 2022 .

[24]  Rick S. Blum,et al.  Optimized signaling for MIMO interference systems with feedback , 2003, IEEE Trans. Signal Process..

[25]  Xin Fan,et al.  Deep Proximal Unrolling: Algorithmic Framework, Convergence Analysis and Applications , 2019, IEEE Transactions on Image Processing.

[26]  Ami Wiesel,et al.  Learning to Detect , 2018, IEEE Transactions on Signal Processing.

[27]  Geoffrey Ye Li,et al.  Deep Learning-Based Channel Estimation for Beamspace mmWave Massive MIMO Systems , 2018, IEEE Wireless Communications Letters.

[28]  Shobhit Maheshwari,et al.  Energy and Spectral Efficiency of Very Large Multiuser MIMO Systems , 2015 .

[29]  Qihui Wu,et al.  A survey of machine learning for big data processing , 2016, EURASIP Journal on Advances in Signal Processing.

[30]  Jonathan Le Roux,et al.  Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures , 2014, ArXiv.

[31]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[32]  John M. Cioffi,et al.  Weighted Sum-Rate Maximization Using Weighted MMSE for MIMO-BC Beamforming Design , 2008, 2009 IEEE International Conference on Communications.

[33]  Yonina C. Eldar,et al.  Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing , 2021, IEEE Signal Processing Magazine.

[34]  Geoffrey Ye Li,et al.  Graph Embedding-Based Wireless Link Scheduling With Few Training Samples , 2019, IEEE Transactions on Wireless Communications.

[35]  Wei Yu,et al.  FDMA capacity of Gaussian multiple-access channels with ISI , 2002, IEEE Trans. Commun..

[36]  Zhi Ding,et al.  Exploiting Bi-Directional Channel Reciprocity in Deep Learning for Low Rate Massive MIMO CSI Feedback , 2019, IEEE Wireless Communications Letters.

[37]  Erik G. Larsson,et al.  Energy and Spectral Efficiency of Very Large Multiuser MIMO Systems , 2011, IEEE Transactions on Communications.