A Novel Deep Reinforcement Learning-based Approach for Enhancing Spectral Efficiency of IRS-assisted Wireless Systems

This letter investigates an intelligent reflecting surfaces (IRS)-enhanced network from spectral efficiency enhancement point of view for downlink multi-user (MU) multi-input-single-output systems (MISO). In contrast to previous works which mainly focused on alternative optimization methods, we investigate the non-convex joint optimization problem of the active transmit beamforming matrix at the base station together with the passive phase shift matrix at the IRS by utilizing two deep reinforcement learning frameworks, i. e., deep deterministic policy gradient (DDPG) and twin delayed DDPG (TD3). Simulation results reveal that the neural networks in the latter scheme perform generally more satisfactorily in various situations.

[1]  Wali Ullah Khan,et al.  Swarm of UAVs for Network Management in 6G: A Technical Review , 2022, IEEE Transactions on Network and Service Management.

[2]  Shashank Shekhar,et al.  SINR Analysis of an IRS Assisted MU-MISO System , 2022, ArXiv.

[3]  Y. Eldar,et al.  Beamforming in Integrated Sensing and Communication Systems With Reconfigurable Intelligent Surfaces , 2022, IEEE Transactions on Wireless Communications.

[4]  A. L. Swindlehurst,et al.  An Overview of Signal Processing Techniques for RIS/IRS-Aided Wireless Systems , 2021, IEEE Journal of Selected Topics in Signal Processing.

[5]  Derrick Wing Kwan Ng,et al.  Energy Efficiency and Spectral Efficiency Tradeoff in RIS-Aided Multiuser MIMO Uplink Transmission , 2020, IEEE Transactions on Signal Processing.

[6]  Mohsen Guizani,et al.  Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks , 2020, ArXiv.

[7]  N. Al-Dhahir,et al.  Reconfigurable Intelligent Surfaces: Principles and Opportunities , 2020, IEEE Communications Surveys & Tutorials.

[8]  Liang Xiao,et al.  Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless Communications , 2020, IEEE Transactions on Wireless Communications.

[9]  Xiao Lu,et al.  Toward Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary Survey , 2019, IEEE Communications Surveys & Tutorials.

[10]  Qingqing Wu,et al.  Intelligent Reflecting Surface Enhanced Wireless Network: Joint Active and Passive Beamforming Design , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[11]  Herke van Hoof,et al.  Addressing Function Approximation Error in Actor-Critic Methods , 2018, ICML.

[12]  Ji-Sung Jung,et al.  Intelligent Reflecting Surface for Spectral Efficiency Maximization in the Multi-User MISO Communication Systems , 2021, IEEE Access.

[13]  C. Yuen,et al.  Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning , 2020, IEEE Journal on Selected Areas in Communications.