Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks

Intelligent reflecting surface (IRS) has been recently employed to reshape the wireless channels by controlling individual scattering elements' phase shifts, namely, passive beamforming. Due to the large size of scattering elements, the passive beamforming is typically challenged by the high computational complexity and inexact channel information. In this article, we focus on machine learning (ML) approaches for performance maximization in IRS-assisted wireless networks. In general, ML approaches provide enhanced flexibility and robustness against uncertain information and imprecise modeling. Practical challenges still remain mainly due to the demand for a large dataset in offline training and slow convergence in online learning. These observations motivate us to design a novel optimization-driven ML framework for IRS-assisted wireless networks, which takes both advantages of the efficiency in model-based optimization and the robustness in model-free ML approaches. By splitting the decision variables into two parts, one part is obtained by the outer-loop ML approach, while the other part is optimized efficiently by solving an approximate problem. Numerical results verify that the optimization-driven ML approach can improve both the convergence and the reward performance compared to conventional model-free learning approaches.

[1]  Ahmet M. Elbir,et al.  Deep Channel Learning for Large Intelligent Surfaces Aided mm-Wave Massive MIMO Systems , 2020, IEEE Wireless Communications Letters.

[2]  Qisheng Wang,et al.  Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for MISO Communication Systems , 2020, IEEE Wireless Communications Letters.

[3]  Alessio Zappone,et al.  Model-Aided Wireless Artificial Intelligence: Embedding Expert Knowledge in Deep Neural Networks for Wireless System Optimization , 2019, IEEE Vehicular Technology Magazine.

[4]  Qingqing Wu,et al.  Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming , 2018, IEEE Transactions on Wireless Communications.

[5]  Liang Xiao,et al.  Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless Communications , 2020, IEEE Transactions on Wireless Communications.

[6]  Ahmed Alkhateeb,et al.  Deep Learning for Large Intelligent Surfaces in Millimeter Wave and Massive MIMO Systems , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[7]  Dinh Thai Hoang,et al.  Optimization-driven Deep Reinforcement Learning for Robust Beamforming in IRS-assisted Wireless Communications , 2020, ArXiv.

[8]  Ronghong Mo,et al.  Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning , 2020, IEEE Journal on Selected Areas in Communications.

[9]  Soo Young Shin,et al.  Deep-Learning-aided Detection for Reconfigurable Intelligent Surfaces , 2019 .

[10]  Dinh Thai Hoang,et al.  Wireless Powered Intelligent Reflecting Surfaces for Enhancing Wireless Communications , 2020, IEEE Transactions on Vehicular Technology.

[11]  Xiao Lu,et al.  Toward Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary Survey , 2019, IEEE Communications Surveys & Tutorials.

[12]  Walid Saad,et al.  Deep Reinforcement Learning for Energy-Efficient Networking with Reconfigurable Intelligent Surfaces , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[13]  Robert Schober,et al.  Enabling Secure Wireless Communications via Intelligent Reflecting Surfaces , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[14]  Caijun Zhong,et al.  Unsupervised Learning for Passive Beamforming , 2020, IEEE Communications Letters.

[15]  Dong In Kim,et al.  Intelligent Reflecting Surface-aided Phase-Shift Backscatter Communication , 2020, 2020 14th International Conference on Ubiquitous Information Management and Communication (IMCOM).