Generating Synthetic Short-Range FMCW Range-Doppler Maps Using Generative Adversarial Networks and Deep Convolutional Autoencoders

In this paper, we discuss the usage of Generative Adversarial Networks (GANs) and Deep Convolutional Autoen-coders (CAE) for creating synthetic Range-Doppler (RD) maps of Frequency-Modulated Continuous-Wave (FMCW) radars for a short-range situation with moving objects, based on measured RD maps of pedestrians and cyclists. Instead of using regular mathematical functions or heavy radar simulations, we have used an Artificial Neural Network (ANN) model to generate new data. By using our synthetic data, we can automatically have ground-truth data without the need for manual labor; easily create large synthetic datasets; hardly use much computational power after training. To evaluate our method, we have trained a detector system with just synthetic data, and it was capable of detecting moving objects correctly, on actual Range-Doppler maps, 11.6% better than when using a small dataset.

[1]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[2]  Luca Fanucci,et al.  Fully convolutional denoising autoencoder for 3D scene reconstruction from a single depth image , 2017, 2017 4th International Conference on Systems and Informatics (ICSAI).

[3]  Corina Nafornita,et al.  A method for building the range-Doppler map for multiple automotive radar targets , 2014, 2014 11th International Symposium on Electronics and Telecommunications (ISETC).

[4]  Dietmar Kissinger,et al.  Millimeter wave FMCW radar system simulations including a 3D ray tracing channel simulator , 2010, 2010 Asia-Pacific Microwave Conference.

[5]  Lovedeep Gondara,et al.  Medical Image Denoising Using Convolutional Denoising Autoencoders , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[6]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  Mark D. McDonnell,et al.  Understanding Data Augmentation for Classification: When to Warp? , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[9]  Marcio L. Lima de Oliveira,et al.  Deep Convolutional Autoencoder Applied for Noise Reduction in Range-Doppler Maps of FMCW Radars , 2020, 2020 IEEE International Radar Conference (RADAR).

[10]  Moeness Amin,et al.  Fall Detection Using Deep Learning in Range-Doppler Radars , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[11]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  Yuhui Zheng,et al.  Recent Progress on Generative Adversarial Networks (GANs): A Survey , 2019, IEEE Access.

[13]  Huiyu Zhou,et al.  Vehicle Detection in Aerial Images Based on Lightweight Deep Convolutional Network and Generative Adversarial Network , 2019, IEEE Access.

[14]  Martin Vossiek,et al.  MIMO-FMCW Radar-Based Parking Monitoring Application With a Modified Convolutional Neural Network With Spatial Priors , 2018, IEEE Access.

[15]  Xiaogang Wang,et al.  StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Moeness G. Amin,et al.  GAN-based Synthetic Radar Micro-Doppler Augmentations for Improved Human Activity Recognition , 2019, 2019 IEEE Radar Conference (RadarConf).

[17]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[18]  A.G. Huizing,et al.  Gesture recognition with a low power FMCW radar and a deep convolutional neural network , 2017, 2017 European Radar Conference (EURAD).

[19]  Mohammed Ghanbari,et al.  Investigating the PSNR calculation methods for video sequences with source and channel distortions , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[20]  Andrew Gerald Stove,et al.  Linear FMCW radar techniques , 1992 .