Learning-Based Adaptive IRS Control with Limited Feedback Codebooks

Intelligent reflecting surfaces (IRS) consist of configurable meta-atoms, which can change the wireless propagation environment through design of their reflection coefficients. We consider a practical setting where (i) the IRS reflection coefficients are achieved by adjusting tunable elements embedded in the meta-atoms, (ii) the IRS reflection coefficients are affected by the incident angles of the incoming signals, (iii) the IRS is deployed in multi-path, time-varying channels, and (iv) the feedback link from the base station to the IRS has a low data rate. Conventional optimization-based IRS control protocols, which rely on channel estimation and conveying the optimized variables to the IRS, are not applicable in this setting due to the difficulty of channel estimation and the low feedback rate. Therefore, we develop a novel adaptive codebook-based limited feedback protocol where only a codeword index is transferred to the IRS. We propose two solutions for adaptive codebook design: random adjacency (RA) and deep neural network policy-based IRS control (DPIC), both of which only require the end-toend compound channels. We further develop several augmented schemes based on the RA and DPIC. Numerical evaluations show that the data rate and average data rate over one coherence time are improved substantially by our schemes.

[1]  Chau Yuen,et al.  Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication , 2018, IEEE Transactions on Wireless Communications.

[2]  Vincent K. N. Lau,et al.  On the design of MIMO block-fading channels with feedback-link capacity constraint , 2004, IEEE Transactions on Communications.

[3]  Emil Björnson,et al.  Prospective Multiple Antenna Technologies for Beyond 5G , 2020, IEEE Journal on Selected Areas in Communications.

[4]  David James Love,et al.  Multi-IRS-assisted Multi-Cell Uplink MIMO Communications under Imperfect CSI: A Deep Reinforcement Learning Approach , 2021, 2021 IEEE International Conference on Communications Workshops (ICC Workshops).

[5]  Y. Rahmat-Samii,et al.  Loss quantification for microstrip reflectarray: Issue of high fields and currents , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[6]  Slawomir Koziel,et al.  Surrogate-Based Modeling and Optimization , 2013 .

[7]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[8]  Julius Georgiou,et al.  Programmable Metamaterials for Software-Defined Electromagnetic Control: Circuits, Systems, and Architectures , 2020, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Rui Zhang,et al.  Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network , 2019, IEEE Communications Magazine.

[11]  Guy Lever,et al.  Deterministic Policy Gradient Algorithms , 2014, ICML.

[12]  Huaiyu Dai,et al.  From Federated to Fog Learning: Distributed Machine Learning over Heterogeneous Wireless Networks , 2020, IEEE Communications Magazine.

[13]  Emil Björnson,et al.  RIS-Aided Wireless Communications: Prototyping, Adaptive Beamforming, and Indoor/Outdoor Field Trials , 2021, IEEE Transactions on Communications.

[14]  Robert W. Heath,et al.  Grassmannian beamforming for multiple-input multiple-output wireless systems , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[15]  David James Love,et al.  On the performance of random vector quantization limited feedback beamforming in a MISO system , 2007, IEEE Transactions on Wireless Communications.

[16]  Mérouane Debbah,et al.  Overhead-Aware Design of Reconfigurable Intelligent Surfaces in Smart Radio Environments , 2020, IEEE Transactions on Wireless Communications.

[17]  Michael L. Honig,et al.  Capacity of a Multiple-Antenna Fading Channel With a Quantized Precoding Matrix , 2007, IEEE Transactions on Information Theory.

[18]  Linda Shao,et al.  Electrically Reconfigurable Microwave Metasurfaces With Active Lumped Elements: A Mini Review , 2021, Frontiers in Materials.

[19]  Bruno Clerckx,et al.  MIMO Systems with Limited Rate Differential Feedback in Slowly Varying Channels , 2011, IEEE Transactions on Communications.

[20]  Chau Yuen,et al.  Intelligent Reflecting Surface: Practical Phase Shift Model and Beamforming Optimization , 2019, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[21]  R.W. Heath,et al.  Channel Adaptive Quantization for Limited Feedback MIMO Beamforming Systems , 2006, IEEE Transactions on Signal Processing.

[22]  Raghuraman Mudumbai,et al.  On the Feasibility of Distributed Beamforming in Wireless Networks , 2007, IEEE Transactions on Wireless Communications.

[23]  Bo O. Zhu,et al.  Active impedance metasurface with full 360° reflection phase tuning , 2013, Scientific Reports.

[24]  R. Kaul,et al.  Microwave engineering , 1989, IEEE Potentials.

[25]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[26]  Qingqing Wu,et al.  Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming , 2018, IEEE Transactions on Wireless Communications.

[27]  Shuowen Zhang,et al.  Intelligent Reflecting Surface Meets OFDM: Protocol Design and Rate Maximization , 2019, IEEE Transactions on Communications.

[28]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[29]  Henk Wymeersch,et al.  Adaptive Beamforming Design for mmWave RIS-Aided Joint Localization and Communication , 2019, 2020 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[30]  Rui Zhang,et al.  Secure Wireless Communication via Intelligent Reflecting Surface , 2019, IEEE Wireless Communications Letters.

[31]  Qiang Cheng,et al.  Wireless Communications With Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement , 2019, IEEE Transactions on Wireless Communications.

[32]  Ian F. Akyildiz,et al.  A New Wireless Communication Paradigm through Software-Controlled Metasurfaces , 2018, IEEE Communications Magazine.

[33]  Gregory W. Wornell,et al.  Efficient use of side information in multiple-antenna data transmission over fading channels , 1998, IEEE J. Sel. Areas Commun..

[34]  Filippo Costa,et al.  Electromagnetic Model of Reflective Intelligent Surfaces , 2021, IEEE Open Journal of the Communications Society.

[35]  Robert W. Heath,et al.  An overview of limited feedback in wireless communication systems , 2008, IEEE Journal on Selected Areas in Communications.

[36]  Constantinos Psomas,et al.  Low-Complexity Random Rotation-Based Schemes for Intelligent Reflecting Surfaces , 2019, IEEE Transactions on Wireless Communications.

[37]  Stefan Parkvall,et al.  5G New Radio: Unveiling the Essentials of the Next Generation Wireless Access Technology , 2018, IEEE Communications Standards Magazine.

[38]  Wankai Tang,et al.  Angle-Dependent Phase Shifter Model for Reconfigurable Intelligent Surfaces: Does the Angle-Reciprocity Hold? , 2020, IEEE Communications Letters.

[39]  Robert W. Heath,et al.  Equal gain transmission in multiple-input multiple-output wireless systems , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[40]  James V. Krogmeier,et al.  Millimeter Wave Beamforming for Wireless Backhaul and Access in Small Cell Networks , 2013, IEEE Transactions on Communications.