Learn to See: A Microwave-based Object Recognition System Using Learning Techniques

The capability to recognize nearby objects automatically has numerous applications including asset tracking, lifestyle analysis, and navigation assistance for blind people. In recent years, several approaches were proposed, but they are either limited to electric objects or objects instrumented with tags, which cannot scale. There are also acoustic or vision-based techniques for recognizing uninstrumented objects, but they may have privacy issues. In this paper, we present a microwave-based object detection and recognition approach. Specifically, the proposed system leverages Universal Software Radio Peripherals (USRPs) to transmit microwave signals through the target object and capture them on the opposite side. To reduce the privacy impact, we use a single antenna for receiving a single-pixel “image”. Then, a Random Forest classifier learns the characteristics of the received signals altered by a given object, enabling object recognition. Using a wide range of microwave frequencies, we evaluated the proposed system’s capability to detect and differentiate between four different objects of different materials. The evaluation results show that, using only a signal, the system can correctly detect the presence of the object 98.7% of the time. The system can also differentiate between different objects 92% of the time.

[1]  Chieko Asakawa,et al.  People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges , 2017, CHI.

[2]  Bryan Nousain,et al.  Wavelet Fingerprinting of Radio-Frequency Identification (RFID) Tags , 2012, IEEE Transactions on Industrial Electronics.

[3]  Taesik Gong,et al.  Knocker , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[4]  Michael Hutter,et al.  Radio Frequency Identification , 2013, Lecture Notes in Computer Science.

[5]  Reza Zoughi,et al.  Wideband Microwave Camera for Real-Time 3-D Imaging , 2017, IEEE Transactions on Antennas and Propagation.

[6]  Gierad Laput,et al.  Deus EM Machina: On-Touch Contextual Functionality for Smart IoT Appliances , 2017, CHI.

[7]  Gierad Laput,et al.  EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects , 2015, UIST.

[8]  I. Křivánek Dielectric properties of materials at microwave frequencies , 2008 .

[9]  Darko Kirovski,et al.  RF Fingerprinting Physical Objects for Anticounterfeiting Applications , 2011, IEEE Transactions on Microwave Theory and Techniques.

[10]  D. Pommerenke,et al.  Portable Real-Time Microwave Camera at 24 GHz , 2012, IEEE Transactions on Antennas and Propagation.

[11]  Wenyao Xu,et al.  FerroTag: a paper-based mmWave-scannable tagging infrastructure , 2019, ACM International Conference on Embedded Networked Sensor Systems.

[12]  Alexander Kmentt 2017 , 2018, The Treaty Prohibiting Nuclear Weapons.

[13]  Kaspar Althoefer,et al.  Knock-Knock: Acoustic object recognition by using stacked denoising autoencoders , 2017, Neurocomputing.

[14]  Alanson P. Sample,et al.  EM-ID: Tag-less identification of electrical devices via electromagnetic emissions , 2016, 2016 IEEE International Conference on RFID (RFID).