MetaSensing: Intelligent Metasurface Assisted RF 3D Sensing by Deep Reinforcement Learning

Using RF signals for wireless sensing has gained increasing attention. However, due to the unwanted multi-path fading in uncontrollable radio environments, the accuracy of RF sensing is limited. Instead of passively adapting to the environment, in this paper, we consider the scenario where an intelligent metasurface is deployed for sensing the existence and locations of 3D objects. By programming its beamformer patterns, the metasurface can provide desirable propagation properties. However, achieving a high sensing accuracy is challenging, since it requires the joint optimization of the beamformer patterns and mapping of the received signals to the sensed outcome. To tackle this challenge, we formulate an optimization problem for minimizing the cross-entropy loss of the sensing outcome, and propose a deep reinforcement learning algorithm to jointly compute the optimal beamformer patterns and the mapping of the received signals. Simulation results verify the effectiveness of the proposed algorithm and show how the sizes of the metasurface and the target space influence the sensing accuracy.

[1]  Andrea Alù,et al.  Machine-learning reprogrammable metasurface imager , 2019, Nature Communications.

[2]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[3]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[4]  Zhu Han,et al.  Reconfigurable Intelligent Surfaces Assisted Communications With Limited Phase Shifts: How Many Phase Shifts Are Enough? , 2020, IEEE Transactions on Vehicular Technology.

[5]  Dina Katabi,et al.  Enabling Identification and Behavioral Sensing in Homes using Radio Reflections , 2019, CHI.

[6]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[7]  Mianxiong Dong,et al.  QUOIN: Incentive Mechanisms for Crowd Sensing Networks , 2018, IEEE Network.

[8]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[9]  Mohamed-Slim Alouini,et al.  Wireless Communications Through Reconfigurable Intelligent Surfaces , 2019, IEEE Access.

[10]  HuWenjun,et al.  Programmable Radio Environments with Large Arrays of Inexpensive Antennas , 2020 .

[11]  Hwee Pink Tan,et al.  Wireless Sensing Without Sensors – An Experimental Approach , 2009 .

[12]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[13]  Haris Gacanin,et al.  Wireless 2.0: Toward an Intelligent Radio Environment Empowered by Reconfigurable Meta-Surfaces and Artificial Intelligence , 2020, IEEE Vehicular Technology Magazine.

[14]  Mohamed-Slim Alouini,et al.  Smart radio environments empowered by reconfigurable AI meta-surfaces: an idea whose time has come , 2019, EURASIP Journal on Wireless Communications and Networking.

[15]  Longfei Shangguan,et al.  Programmable Radio Environments with Large Arrays of Inexpensive Antennas , 2020, GetMobile Mob. Comput. Commun..

[16]  Mohamed-Slim Alouini,et al.  Smart Radio Environments Empowered by AI Reconfigurable Meta-Surfaces: An Idea Whose Time Has Come , 2019, ArXiv.

[17]  Nei Kato,et al.  Intelligent Reflecting Surface Placement Optimization in Air-Ground Communication Networks Toward 6G , 2020, IEEE Wireless Communications.

[18]  Gang Zhou,et al.  VigilNet: An integrated sensor network system for energy-efficient surveillance , 2006, TOSN.

[19]  Qiang Cheng,et al.  Wireless Communications With Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement , 2019, IEEE Transactions on Wireless Communications.

[20]  James C. Bezdek,et al.  Convergence of Alternating Optimization , 2003, Neural Parallel Sci. Comput..

[21]  Antonio Torralba,et al.  RF-based 3D skeletons , 2018, SIGCOMM.

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Geoffrey Ye Li,et al.  Reconfigurable Intelligent Surfaces for Wireless Communications: Principles, Challenges, and Opportunities , 2020, IEEE Transactions on Cognitive Communications and Networking.

[24]  F. Hirtenfelder,et al.  Effective Antenna Simulations using CST MICROWAVE STUDIO® , 2007, 2007 2nd International ITG Conference on Antennas.

[25]  Frédo Durand,et al.  Capturing the human figure through a wall , 2015, ACM Trans. Graph..

[26]  Mérouane Debbah,et al.  Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both? , 2019, IEEE Transactions on Communications.

[27]  Swarun Kumar,et al.  On the Feasibility of Wi-Fi Based Material Sensing , 2019, MobiCom.

[28]  Mianxiong Dong,et al.  Deep Reinforcement Scheduling for Mobile Crowdsensing in Fog Computing , 2019, ACM Trans. Internet Techn..

[29]  Chenglin Miao,et al.  Towards Environment Independent Device Free Human Activity Recognition , 2018, MobiCom.

[30]  Zhijin Qin,et al.  Reconfigurable Intelligent Surfaces: Principles and Opportunities , 2020, IEEE Communications Surveys and Tutorials.

[31]  Vittorio Rampa,et al.  Device-Free RF Human Body Fall Detection and Localization in Industrial Workplaces , 2017, IEEE Internet of Things Journal.

[32]  Lingyang Song,et al.  Beyond Intelligent Reflecting Surfaces: Reflective-Transmissive Metasurface Aided Communications for Full-Dimensional Coverage Extension , 2020, IEEE Transactions on Vehicular Technology.

[33]  Wotao Yin,et al.  Block Stochastic Gradient Iteration for Convex and Nonconvex Optimization , 2014, SIAM J. Optim..

[34]  Michael Boyarsky,et al.  Orthogonal Coded Active Illumination for Millimeter Wave, Massive-MIMO Computational Imaging With Metasurface Antennas , 2018, IEEE Transactions on Computational Imaging.

[35]  Robert N. McDonough,et al.  Detection of signals in noise , 1971 .

[36]  Alessio Zappone,et al.  Model-Aided Wireless Artificial Intelligence: Embedding Expert Knowledge in Deep Neural Networks for Wireless System Optimization , 2019, IEEE Vehicular Technology Magazine.

[37]  Kaigui Bian,et al.  Towards Ubiquitous Positioning by Leveraging Reconfigurable Intelligent Surface , 2021, IEEE Communications Letters.

[38]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[39]  Moshe Sipper,et al.  A serial complexity measure of neural networks , 1993, IEEE International Conference on Neural Networks.

[40]  Chan-Byoung Chae,et al.  Reconfigurable Intelligent Surface-Based Wireless Communications: Antenna Design, Prototyping, and Experimental Results , 2019, IEEE Access.

[41]  Zhu Han,et al.  Hybrid Beamforming for Reconfigurable Intelligent Surface based Multi-User Communications: Achievable Rates With Limited Discrete Phase Shifts , 2019, IEEE Journal on Selected Areas in Communications.

[42]  Predrag S. Stanimirović,et al.  Generalized matrix inversion is not harder than matrix multiplication , 2009 .

[43]  Zhu Han,et al.  Reconfigurable Intelligent Surfaces based RF Sensing: Design, Optimization, and Implementation , 2019, ArXiv.

[44]  Timothy J. Purcell Sorting and searching , 2005, SIGGRAPH Courses.

[45]  John Frederick Bailyn,et al.  Generalized Inversion , 2004 .

[46]  Naoki Honma,et al.  Human Monitoring Using MIMO Radar , 2018, 2018 IEEE International Workshop on Electromagnetics:Applications and Student Innovation Competition (iWEM).

[47]  Pineda,et al.  Generalization of back-propagation to recurrent neural networks. , 1987, Physical review letters.

[48]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.