An Optimal Reflective Elements Grouping Model for RIS-Assisted IoT Networks Using Q-Learning

One of the critical challenges of the next-generation Internet of Things (IoT) network is to ensure reliable and low latency data transfer at the IoT devices (IoD), while minimizing the overall power consumption. Data latency and throughput performance degrade in a dense IoT network due to obstacles between IoD and the access point (AP). Therefore, an efficient signal processing model needs to be developed to address the aforementioned challenges. Towards this end, in this brief, an optimal reflective elements (RE) grouping model over reconfigurable intelligent surface (RIS)-assisted IoT network is proposed. The proposed RE grouping model enhances the signal strength at the IoD when the direct link between AP and IoD is blocked. Additionally, in case of reliable direct link between AP and IoD, reflected beam power is controlled over RIS-IoD link, resulting in minimized power consumption. Hence, in this brief, a novel method to regularize the power consumption over the IoT network is proposed. The proposed method groups the RE to reflect the incident signal. This grouping is based on the joint common group phase-shift and channel correlation between RE. Moreover, an optimization problem is formulated to minimize the total latency with respect to the received power and RIS reflection matrix. Due to the coupled nature of constraints, the optimization problem is non-convex and is solved using the Q-learning. Finally, the performance of the proposed method is compared with the benchmark methods, taking various network parameters into account.

[1]  Miaowen Wen,et al.  Joint RIS Grouping Design Assisted Generalized Quadrature Reflection Modulation , 2023, IEEE Transactions on Vehicular Technology.

[2]  Mustafa K. Taher Al-Nuaimi,et al.  Reconfigurable Full-Metal Circularly-Polarized Cavity-Backed Slot Antenna and Array With Frequency and Polarization Agility , 2023, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  S. Hwang,et al.  Low Latency Implementations of CNN for Resource-Constrained IoT Devices , 2022, IEEE Transactions on Circuits and Systems - II - Express Briefs.

[4]  C. Assi,et al.  Latency and Reliability Aware Edge Computation Offloading via an Intelligent Reflecting Surface , 2021, IEEE Communications Letters.

[5]  Symeon Papavassiliou,et al.  The Joint Power of NOMA and Reconfigurable Intelligent Surfaces in SWIPT Networks , 2021, 2021 IEEE 22nd International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[6]  Octavia A. Dobre,et al.  Deep Learning-Based RIS Channel Extrapolation With Element-Grouping , 2021, IEEE Wireless Communications Letters.

[7]  G. C. Alexandropoulos,et al.  Multi-Hop RIS-Empowered Terahertz Communications: A DRL-Based Hybrid Beamforming Design , 2021, IEEE Journal on Selected Areas in Communications.

[8]  Bruno Clerckx,et al.  Modeling and Architecture Design of Reconfigurable Intelligent Surfaces Using Scattering Parameter Network Analysis , 2020, IEEE Transactions on Wireless Communications.

[9]  H. Vincent Poor,et al.  Physics-Based Modeling and Scalable Optimization of Large Intelligent Reflecting Surfaces , 2020, IEEE Transactions on Communications.

[10]  Caijun Zhong,et al.  Unsupervised Learning for Passive Beamforming , 2020, IEEE Communications Letters.

[11]  Yong Zhou,et al.  Reconfigurable Intelligent Surface for Green Edge Inference , 2019, IEEE Transactions on Green Communications and Networking.

[12]  M. Elkashlan,et al.  Latency Minimization for Intelligent Reflecting Surface Aided Mobile Edge Computing , 2019, IEEE Journal on Selected Areas in Communications.

[13]  Sherali Zeadally,et al.  Securing Internet of Things (IoT) with machine learning , 2019, Int. J. Commun. Syst..

[14]  Ahmed Alkhateeb,et al.  Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination , 2019, IEEE Transactions on Communications.

[15]  Rui Zhang,et al.  Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network , 2019, IEEE Communications Magazine.

[16]  M. Omair Ahmad,et al.  Joint Data and Pilot Power Allocation for Massive MU-MIMO Downlink TDD Systems , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[17]  Chau Yuen,et al.  Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication , 2018, IEEE Transactions on Wireless Communications.

[18]  Sven Koenig,et al.  Complexity Analysis of Real-Time Reinforcement Learning , 1992, AAAI.

[19]  C. Zhong,et al.  Element-Grouping Intelligent Reflecting Surface: Electromagnetic-Compliant Model and Geometry-Based Optimization , 2022, IEEE Transactions on Wireless Communications.

[20]  Gaofeng Cui,et al.  Latency and Energy Optimization for MEC Enhanced SAT-IoT Networks , 2020, IEEE Access.