Resource Management for Transmit Power Minimization in UAV-Assisted RIS HetNets Supported by Dual Connectivity

This paper proposes a novel approach to improve the performance of a heterogeneous network (HetNet) supported by dual connectivity (DC) by adopting multiple unmanned aerial vehicles (UAVs) as passive relays that carry reconfigurable intelligent surfaces (RISs). More specifically, RISs are deployed under the UAVs termed as UAVs-RISs that operate over the micro-wave (B5W) channel in the sky to sustain a strong line-of-sight (LoS) connection with the ground users. The macro-cell operates over the B5W channel based on orthogonal multiple access (OMA), while small base stations (SBSs) operate over the millimeter-wave (mmW) channel based on non-orthogonal multiple access (NOMA). We study the problem of total transmit power minimization by jointly optimizing the trajectory/velocity of each UAV, RISs’ phase shifts, subcarrier allocations, and active beamformers at each BS. The underlying problem is highly non-convex and the global optimal solution is intractable. To handle it, we decompose the original problem into two subproblems, i.e., a subproblem which deals with the UAVs’ trajectories/velocities, RISs’ phase shifts, and subcarrier allocations for B5W; and a subproblem for active beamforming design and subcarrier allocation for mmW. In particular, we solve the first subproblem via the dueling deep Q-Network (DQN) learning approach by developing a distributed algorithm which leads to a better policy evaluation. Then, we solve the active beamforming design and subcarrier allocation for the mmW via the successive convex approximation (SCA) method. Simulation results exhibit the effectiveness of the proposed resource allocation scheme compared to other baseline schemes. In particular, it is revealed that by deploying UAVs-RISs, the transmit power can be reduced by 6 dBm while maintaining similar guaranteed QoS.

[1]  Qisheng Wang,et al.  Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for MISO Communication Systems , 2020, IEEE Wireless Communications Letters.

[2]  Derrick Wing Kwan Ng,et al.  Power Efficient Resource Allocation for Full-Duplex Radio Distributed Antenna Networks , 2015, IEEE Transactions on Wireless Communications.

[3]  Qingqing Wu,et al.  Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming , 2018, IEEE Transactions on Wireless Communications.

[4]  Halim Yanikomeroglu,et al.  Aerial Platforms with Reconfigurable Smart Surfaces for 5G and Beyond , 2020, ArXiv.

[5]  Nader Mokari,et al.  Robust Energy-Efficient Resource Management, SIC Ordering, and Beamforming Design for MC MISO-NOMA Enabled 6G , 2021, IEEE Transactions on Signal Processing.

[6]  Mohamed-Slim Alouini,et al.  Large Intelligent Surface Assisted MIMO Communications , 2019 .

[7]  Walid Saad,et al.  Millimeter Wave Communications With an Intelligent Reflector: Performance Optimization and Distributional Reinforcement Learning , 2020, IEEE Transactions on Wireless Communications.

[8]  Yunfei Chen,et al.  Optimum Placement of UAV as Relays , 2018, IEEE Communications Letters.

[9]  Yiyang Pei,et al.  Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks , 2019, IEEE Transactions on Wireless Communications.

[10]  Rui Zhang,et al.  Intelligent Reflecting Surface-Assisted Multiple Access With User Pairing: NOMA or OMA? , 2020, IEEE Communications Letters.

[11]  Haixia Zhang,et al.  Joint Beamforming and Phase Shift Design in Downlink UAV Networks with IRS-Assisted NOMA , 2020, J. Commun. Inf. Networks.

[12]  Rui Zhang,et al.  Wireless communications with unmanned aerial vehicles: opportunities and challenges , 2016, IEEE Communications Magazine.

[13]  Shuowen Zhang,et al.  Intelligent Reflecting Surface Aided Multiple Access: Capacity Region and Deployment Strategy , 2020, 2020 IEEE 21st International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[14]  Rui Zhang,et al.  Throughput Maximization for UAV-Enabled Mobile Relaying Systems , 2016, IEEE Transactions on Communications.

[15]  Yuanming Shi,et al.  Intelligent Reflecting Surface for Downlink Non-Orthogonal Multiple Access Networks , 2019, 2019 IEEE Globecom Workshops (GC Wkshps).

[16]  Rui Zhang,et al.  Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network , 2019, IEEE Communications Magazine.

[17]  Jiaheng Wang,et al.  On Optimal Power Allocation for Downlink Non-Orthogonal Multiple Access Systems , 2017, IEEE Journal on Selected Areas in Communications.

[18]  Zhiguo Ding,et al.  A Simple Design of IRS-NOMA Transmission , 2019, IEEE Communications Letters.

[19]  Lav Gupta,et al.  Survey of Important Issues in UAV Communication Networks , 2016, IEEE Communications Surveys & Tutorials.

[20]  Derrick Wing Kwan Ng,et al.  Resource Allocation for Power-Efficient IRS-Assisted UAV Communications , 2020, 2020 IEEE International Conference on Communications Workshops (ICC Workshops).

[21]  Mohamed-Slim Alouini,et al.  A Survey of Channel Modeling for UAV Communications , 2018, IEEE Communications Surveys & Tutorials.

[22]  Derrick Wing Kwan Ng,et al.  Joint User Association and Resource Allocation in the Uplink of Heterogeneous Networks , 2020, IEEE Wireless Communications Letters.

[23]  Zhiguo Ding,et al.  A General Power Allocation Scheme to Guarantee Quality of Service in Downlink and Uplink NOMA Systems , 2016, IEEE Transactions on Wireless Communications.

[24]  Michele Zorzi,et al.  Joint Access and Fronthaul Radio Resource Allocation in PD-NOMA-Based 5G Networks Enabling Dual Connectivity and CoMP , 2018, IEEE Transactions on Communications.

[25]  Rui Zhang,et al.  Energy Efficiency Maximization via Joint Active and Passive Beamforming Design for Multiuser MISO IRS-Aided SWIPT , 2021, IEEE Wireless Communications Letters.

[26]  Pingzhi Fan,et al.  On the Performance of Non-Orthogonal Multiple Access in 5G Systems with Randomly Deployed Users , 2014, IEEE Signal Processing Letters.

[27]  H. Vincent Poor,et al.  Energy-Efficient Wireless Communications With Distributed Reconfigurable Intelligent Surfaces , 2020, IEEE Transactions on Wireless Communications.

[28]  Moritz Diehl,et al.  Local Convergence of Sequential Convex Programming for Nonconvex Optimization , 2010 .

[29]  Qi Liu,et al.  An Effective Coverage Scheme With Passive-Reflectors for Urban Millimeter-Wave Communication , 2016, IEEE Antennas and Wireless Propagation Letters.

[30]  Walid Saad,et al.  A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems , 2019, IEEE Network.

[31]  Sheyda Zarandi,et al.  Joint Resource Allocation and Offloading Decision in Mobile Edge Computing , 2019, IEEE Communications Letters.

[32]  Ekram Hossain,et al.  Optimization of Wireless Relaying With Flexible UAV-Borne Reflecting Surfaces , 2020, IEEE Transactions on Communications.

[33]  Lajos Hanzo,et al.  Reconfigurable Intelligent Surface Aided NOMA Networks , 2020, IEEE Journal on Selected Areas in Communications.

[34]  Jie Xu,et al.  Energy Minimization for Wireless Communication With Rotary-Wing UAV , 2018, IEEE Transactions on Wireless Communications.

[35]  Christodoulos A. Floudas,et al.  Mixed Integer Nonlinear Programming , 2009, Encyclopedia of Optimization.

[36]  Di Yuan,et al.  Power and Channel Allocation for Non-Orthogonal Multiple Access in 5G Systems: Tractability and Computation , 2016, IEEE Transactions on Wireless Communications.

[37]  Kezhi Wang,et al.  Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach , 2020 .

[38]  Qianqian Zhang,et al.  Reflections in the Sky: Millimeter Wave Communication with UAV-Carried Intelligent Reflectors , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[39]  Walid Saad,et al.  Wireless Communication Using Unmanned Aerial Vehicles (UAVs): Optimal Transport Theory for Hover Time Optimization , 2017, IEEE Transactions on Wireless Communications.

[40]  Geoffrey Ye Li,et al.  An Overview of Sustainable Green 5G Networks , 2016, IEEE Wireless Communications.

[41]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[42]  Ying-Chang Liang,et al.  Reconfigurable Intelligent Surface Assisted UAV Communication: Joint Trajectory Design and Passive Beamforming , 2022 .

[43]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[44]  L. Hanzo,et al.  Non-Orthogonal Multiple Access for 5G and Beyond , 2018 .

[45]  Anass Benjebbour,et al.  Non-Orthogonal Multiple Access (NOMA) for Cellular Future Radio Access , 2013, 2013 IEEE 77th Vehicular Technology Conference (VTC Spring).

[46]  Mohammad Shikh-Bahaei,et al.  Reflections in the Sky: Joint Trajectory and Passive Beamforming Design for Secure UAV Networks with Reconfigurable Intelligent Surface , 2020 .

[47]  Derrick Wing Kwan Ng,et al.  Multi-Objective Resource Allocation for IRS-Aided SWIPT , 2021, IEEE Wireless Communications Letters.

[48]  Yuan Wu,et al.  Energy-Efficient NOMA-Enabled Traffic Offloading via Dual-Connectivity in Small-Cell Networks , 2017, IEEE Communications Letters.

[49]  Derrick Wing Kwan Ng,et al.  Optimal Joint Power and Subcarrier Allocation for MC-NOMA Systems , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[50]  A. Lee Swindlehurst,et al.  UAV-Assisted Intelligent Reflecting Surface Symbiotic Radio System , 2020, IEEE Transactions on Wireless Communications.

[51]  Chau Yuen,et al.  Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication , 2018, IEEE Transactions on Wireless Communications.

[52]  Lingyang Song,et al.  Joint Trajectory and Power Optimization for UAV Relay Networks , 2018, IEEE Communications Letters.

[53]  John W. Chinneck,et al.  Feasibility and Infeasibility in Optimization:: Algorithms and Computational Methods , 2007 .

[54]  Mahbub Hassan,et al.  Enhancing Cellular Communications for UAVs via Intelligent Reflective Surface , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[55]  Derrick Wing Kwan Ng,et al.  Optimal Resource Allocation for Power-Efficient MC-NOMA With Imperfect Channel State Information , 2017, IEEE Transactions on Communications.

[56]  Qingqing Wu,et al.  Beamforming Optimization for Intelligent Reflecting Surface with Discrete Phase Shifts , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[57]  Mohamed-Slim Alouini,et al.  Wireless Communications Through Reconfigurable Intelligent Surfaces , 2019, IEEE Access.

[58]  Ming-Min Zhao,et al.  Efficiency Maximization for UAV-Enabled Mobile Relaying Systems With Laser Charging , 2020, IEEE Transactions on Wireless Communications.

[59]  Lei Wang,et al.  UAV-Enabled Reliable Mobile Relaying Based on Downlink NOMA , 2020, IEEE Access.

[60]  Abbas Jamalipour,et al.  Modeling air-to-ground path loss for low altitude platforms in urban environments , 2014, 2014 IEEE Global Communications Conference.