Deep Learning-based identification of human gait by radar micro-Doppler measurements

The radar micro-Doppler (m-D) signature of human gait has already been used successfully for a few classification tasks of human gait, for instance walking versus running and determining the number of humans under observation. owever, the more challenging problem of personnel identification has not been solved yet. The aim of this study is to prove that the human walking gait differs between individuals and that it can be used for personnel identification using CW X-band radar measurements. This study investigates the effect of human walking gait characteristics such as speed and stride as well as the gender on leading to distinctive m-D signatures. Both simulated data and measurements of 22 subjects walking from and towards the radar were used. Unsupervised earning based on Adversarial Autoencoders was used to map the m-D ignatures to a latent space. T-Distributed Stochastic Neighbor Embedding and Uniform Manifold Approximation and Projection were then used for clustering and visualization. This study shows that even very slight changes in the walking gait characteristics mentioned above lead to distinctive m-D signatures mapped into closely located points in the latent space. A VGG-16 convolutional neural network was used to identify the walking subjects based on their easured m-D signature. Accuracy of above 93.5% was achieved, proving that CW X-band radar m-D signature of human walking gait can be used for accurate personnel identification which is reliable for 22 participants.

[1]  Abdelhak M. Zoubir,et al.  Subspace Classification of Human Gait Using Radar Micro-Doppler Signatures , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[2]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[3]  Ming Ye,et al.  Radar‐ID: human identification based on radar micro‐Doppler signatures using deep convolutional neural networks , 2018, IET Radar, Sonar & Navigation.

[4]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction , 2018, ArXiv.

[5]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[8]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  L. Cifola,et al.  Multi-target human gait classification using deep convolutional neural networks on micro-doppler spectrograms , 2016, 2016 European Radar Conference (EuRAD).

[11]  Hans Driessen,et al.  Human motion classification using a particle filter approach: Multiple model particle filtering applied to the micro-Doppler spectrum , 2013 .

[12]  Francesco Fioranelli,et al.  Feature Diversity for Optimized Human Micro-Doppler Classification Using Multistatic Radar , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Bin Yang,et al.  A Study of Human Body Characteristics Effect on Micro-Doppler-Based Person Identification using Deep Learning , 2018, ArXiv.