Learning from Natural Noise to Denoise Micro-Doppler Spectrogram

Micro-Doppler analysis has become increasingly popular in recent years owning to the ability of the technique to enhance classification strategies. Applications include recognising everyday human activities, distinguishing drone from birds, and identifying different types of vehicles. However, noisy timefrequency spectrograms can significantly affect the performance of the classifier and must be tackled using appropriate denoising algorithms. In recent years, deep learning algorithms have spawned many deep neural network-based denoising algorithms. For these methods, noise modelling is the most important part and is used to assist in training. In this paper, we decompose the problem and propose a novel denoising scheme: first, a Generative Adversarial Network (GAN) is used to learn the noise distribution and correlation from the real-world environment; then, a simulator is used to generate clean Micro-Doppler spectrograms; finally, the generated noise and clean simulation data are combined as the training data to train a Convolutional Neural Network (CNN) denoiser. In experiments, we qualitatively and quantitatively analyzed this procedure on both simulation and measurement data. Besides, the idea of learning from natural noise can be applied well to other existing frameworks and demonstrate greater performance than other noise models.

[1]  Yangdi Xu,et al.  Passive wireless sensing for unsupervised human activity recognition in healthcare , 2017, 2017 13th International Wireless Communications and Mobile Computing Conference (IWCMC).

[2]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Marcio L. Lima de Oliveira,et al.  Deep Convolutional Autoencoder Applied for Noise Reduction in Range-Doppler Maps of FMCW Radars , 2020, 2020 IEEE International Radar Conference (RADAR).

[4]  Robert J. Piechocki,et al.  Passive WiFi Radar for Human Sensing Using a Stand-Alone Access Point , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Zheng Bao,et al.  Target classification with low-resolution radar based on dispersion situations of eigenvalue spectra , 2010, Science China Information Sciences.

[7]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[10]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[11]  Hongwei Liu,et al.  Robust Classification Scheme for Airplane Targets With Low Resolution Radar Based on EMD-CLEAN Feature Extraction Method , 2013, IEEE Sensors Journal.

[12]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  C.J. Baker,et al.  Naïve Bayesian radar micro-doppler recognition , 2008, 2008 International Conference on Radar.

[14]  Kevin Chetty,et al.  Occupancy Detection and People Counting Using WiFi Passive Radar , 2020, 2020 IEEE Radar Conference (RadarConf20).

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[17]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[18]  Yuan He,et al.  A Deep-Learning Method for Radar Micro-Doppler Spectrogram Restoration , 2020, Sensors.

[19]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[20]  Ming Yang,et al.  Image Blind Denoising with Generative Adversarial Network Based Noise Modeling , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Franz Pernkopf,et al.  Complex Signal Denoising and Interference Mitigation for Automotive Radar Using Convolutional Neural Networks , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[22]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[23]  Yang Wang,et al.  When AWGN-based Denoiser Meets Real Noises , 2019, AAAI.

[24]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[26]  Masayuki Arai,et al.  GAN-Based Noise Model for Denoising Real Images , 2020, ACCV.

[27]  SimHumalator: An Open Source WiFi Based Passive Radar Human Simulator For Activity Recognition , 2021, 2103.01677.

[28]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[29]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[30]  Yang Yang,et al.  Micro-Doppler Spectrogram Denoising Based on Generative Adversarial Network , 2018, 2018 48th European Microwave Conference (EuMC).

[31]  Franz Pernkopf,et al.  Deep Interference Mitigation and Denoising of Real-World FMCW Radar Signals , 2020, 2020 IEEE International Radar Conference (RADAR).