Radar Image Reconstruction from Raw ADC Data using Parametric Variational Autoencoder with Domain Adaptation

This paper presents a parametric variational autoencoder-based human target detection and localization framework working directly with the raw analog-to-digital converter data from the frequency modulated continuous wave radar. We propose a parametrically constrained variational autoencoder, with residual and skip connections, capable of generating the clustered and localized target detections on the range-angle image. Furthermore, to circumvent the problem of training the proposed neural network on all possible scenarios using real radar data, we propose domain adaptation strategies whereby we first train the neural network using ray tracing based model data and then adapt the network to work on real sensor data. This strategy ensures better generalization and scalability of the proposed neural network even though it is trained with limited radar data. We demonstrate the superior detection and localization performance of our proposed solution compared to the conventional signal processing pipeline and earlier state-of-art deep U-Net architecture with range-doppler images as inputs.

[1]  F. Fioranelli,et al.  Human Activity Classification With Radar: Optimization and Noise Robustness With Iterative Convolutional Neural Networks Followed With Random Forests , 2018, IEEE Sensors Journal.

[2]  Robert Weigel,et al.  Automotive Radar Interference Mitigation using a Convolutional Autoencoder , 2020, 2020 IEEE International Radar Conference (RADAR).

[3]  Avik Santra,et al.  Continuous Human Activity Classification With Unscented Kalman Filter Tracking Using FMCW Radar , 2020, IEEE Sensors Letters.

[4]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Sung Ho Cho,et al.  People Counting Based on an IR-UWB Radar Sensor , 2017, IEEE Sensors Journal.

[6]  Vishal Garg,et al.  Smart occupancy sensors to reduce energy consumption , 2000 .

[7]  Georg Fischer,et al.  Human Target Detection and Localization with Radars Using Deep Learning , 2021 .

[8]  Raja Giryes,et al.  Deep Radar Detector , 2019, 2019 IEEE Radar Conference (RadarConf).

[9]  Qingmin Liao,et al.  A Study on Radar Target Detection Based on Deep Neural Networks , 2019, IEEE Sensors Letters.

[10]  Avik Santra,et al.  Short-Range Millimetric-Wave Radar System for Occupancy Sensing Application , 2018, IEEE Sensors Letters.

[11]  Amin Ansari,et al.  Vehicle Detection With Automotive Radar Using Deep Learning on Range-Azimuth-Doppler Tensors , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[12]  George Shaker,et al.  Low-cost low-power in-vehicle occupant detection with mm-wave FMCW radar , 2019, 2019 IEEE SENSORS.

[13]  Trevor Cohn,et al.  Low Resource Dependency Parsing: Cross-lingual Parameter Sharing in a Neural Network Parser , 2015, ACL.

[14]  Avik Santra,et al.  Radar-Based Human Target Detection using Deep Residual U-Net for Smart Home Applications , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[15]  Yoshua Bengio,et al.  Speaker Recognition from Raw Waveform with SincNet , 2018, 2018 IEEE Spoken Language Technology Workshop (SLT).

[16]  Changzhi Li,et al.  A Portable FMCW Interferometry Radar With Programmable Low-IF Architecture for Localization, ISAR Imaging, and Vital Sign Tracking , 2017, IEEE Transactions on Microwave Theory and Techniques.

[17]  Haopeng Li,et al.  Object Detection and 3d Estimation Via an FMCW Radar Using a Fully Convolutional Network , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Changzhan Gu,et al.  A Hybrid FMCW-Interferometry Radar for Indoor Precise Positioning and Versatile Life Activity Monitoring , 2014, IEEE Transactions on Microwave Theory and Techniques.

[19]  Thomas Stadelmayer,et al.  Parametric Convolutional Neural Network for Radar-based Human Activity Classification Using Raw ADC Data , 2020 .