Examination of User Pairing NOMA System Considering the DQN Scheme over Time-Varying Fading Channel Conditions

— In this paper, we employ the deep Q -network (DQN) algorithm to study user pairing downlink (D/L) non-orthogonal multiple access (NOMA) system considering the multiple user equipment (UEs). In this work, the independent and identically distributed ( i.i.d. ) fading links are considered. The channel is expected to become time-varying as a result of node mobility. User pairing and optimum power distribution algorithms based on reinforcement learning (RL) are investigated initially in NOMA systems. To make the analysis simpler and for reducing the computational complexity the Q -learning-based scheme is used jointly to investigate the user pairing and optimal power allocation problems. In real-time propagation conditions with numerous users, DQN was employed to conduct user pairing and power allocation at the same time. When the learning rate is 0.2000, the DQN method, on the other hand, converges quicker but does not reach the maximum throughput (or average sum rate). In our simulation, we have eight UEs, and it has been observed that employing near-user far-user (N-F) results in a better sum rate. The symbol error rate (SER) performance falls dramatically as the node velocity increases, according to simulation curves. This is because, when node mobility increases, the channel will change extremely quickly. The simulation results confirm the derived analytical expressions. cancellation (SIC), deep learning (DL), deep neural network (DNN), SER, time selective fading, DQN.

[1]  Mardeni Roslee,et al.  Simulated Annealing for Resource Allocation in Downlink NOMA Systems in 5G Networks , 2021, Applied Sciences.

[2]  Changyin Sun,et al.  Dynamic User Pairing and Power Allocation for NOMA with Deep Reinforcement Learning , 2021, 2021 IEEE Wireless Communications and Networking Conference (WCNC).

[3]  Ajay Rupani,et al.  Channel capacity analysis of non-orthogonal multiple access and massive multiple-input multiple-output wireless communication networks considering perfect and imperfect channel state information , 2021, The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology.

[4]  Pawani Porambage,et al.  A Survey on Mobile Augmented Reality With 5G Mobile Edge Computing: Architectures, Applications, and Technical Aspects , 2021, IEEE Communications Surveys & Tutorials.

[5]  Mate Boban,et al.  A Tutorial on 5G NR V2X Communications , 2021, IEEE Communications Surveys & Tutorials.

[6]  Ritesh Kumar Mishra,et al.  A tutorial on cooperative non-orthogonal multiple access networks , 2021, The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology.

[7]  Jaewoo So,et al.  Reinforcement Learning-Based Joint User Pairing and Power Allocation in MIMO-NOMA Systems , 2020, Sensors.

[8]  Yik-Chung Wu,et al.  Sum Rate Maximization of Secure NOMA Transmission with Imperfect CSI , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[9]  Liang Xiao,et al.  Fast Reinforcement Learning for Anti-jamming Communications , 2020, ArXiv.

[10]  Keping Long,et al.  Deep Neural Network for Resource Management in NOMA Networks , 2020, IEEE Transactions on Vehicular Technology.

[11]  Hyundong Shin,et al.  Power Allocation in Cache-Aided NOMA Systems: Optimization and Deep Reinforcement Learning Approaches , 2019, IEEE Transactions on Communications.

[12]  Yang Hu,et al.  Joint Power Allocation and Channel Assignment for NOMA With Deep Reinforcement Learning , 2019, IEEE Journal on Selected Areas in Communications.

[13]  Wei Li,et al.  Spectrum Resource and Power Allocation With Adaptive Proportional Fair User Pairing for NOMA Systems , 2019, IEEE Access.

[14]  Tiejun Lv,et al.  Multi-Agent Reinforcement Learning-Based User Pairing in Multi-Carrier NOMA Systems , 2019, 2019 IEEE International Conference on Communications Workshops (ICC Workshops).

[15]  Ekram Hossain,et al.  A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell Networks , 2019, ArXiv.

[16]  Guo Li,et al.  User Pairing and Pair Scheduling in Massive MIMO-NOMA Systems , 2018, IEEE Communications Letters.

[17]  Ying-Chang Liang,et al.  Applications of Deep Reinforcement Learning in Communications and Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[18]  Günes Karabulut-Kurt,et al.  A Tutorial on Nonorthogonal Multiple Access for 5G and Beyond , 2018, Wirel. Commun. Mob. Comput..

[19]  Guan Gui,et al.  Deep Learning for an Effective Nonorthogonal Multiple Access Scheme , 2018, IEEE Transactions on Vehicular Technology.

[20]  H. Vincent Poor,et al.  Reinforcement Learning-Based NOMA Power Allocation in the Presence of Smart Jamming , 2018, IEEE Transactions on Vehicular Technology.

[21]  Hsiao-Hwa Chen,et al.  Joint User Pairing and Power Allocation in Virtual MIMO Systems , 2018, IEEE Transactions on Wireless Communications.

[22]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[23]  Bhaskar Krishnamachari,et al.  Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks , 2018, IEEE Transactions on Cognitive Communications and Networking.

[24]  Nam-I Kim,et al.  Deep Learning-Aided SCMA , 2018, IEEE Communications Letters.

[25]  Xiangyang Wang,et al.  User Pairing and Power Allocation for Downlink Non-Orthogonal Multiple Access , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[26]  Haijian Sun,et al.  A NOMA and MU-MIMO Supported Cellular Network with Underlaid D2D Communications , 2016, 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring).

[27]  Marina Petrova,et al.  Proportional fairness-based user pairing and power allocation for non-orthogonal multiple access , 2015, 2015 IEEE 26th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[28]  Zhengang Pan,et al.  On the Ergodic Capacity of MIMO NOMA Systems , 2015, IEEE Wireless Communications Letters.

[29]  Ioannis Krikidis,et al.  Fairness for Non-Orthogonal Multiple Access in 5G Systems , 2015, IEEE Signal Processing Letters.

[30]  Felipe A. P. de Figueiredo,et al.  Multi-Agent Deep Learning for Multi-Channel Access in Slotted Wireless Networks , 2020, IEEE Access.

[31]  Ravi Shankar,et al.  S-DF Cooperative Communication System Over Time Selective Fading Channels , 2019, J. Inf. Sci. Eng..

[32]  Qi Zhu,et al.  Joint User-Channel Assignment and Power Allocation for Non-Orthogonal Multiple Access Relaying Networks , 2019, IEEE Access.