Accurate Person Identification Based on Combined Sit-to-Stand and Stand-to-Sit Movements Measured Using Doppler Radars

This article demonstrates the identification of 10 persons with 99% accuracy achieved by combining micro-Doppler signatures of sit-to-stand and stand-to-sit movements. Data from these movements are measured using two radars installed above and behind the person. Images of Doppler spectrograms generated using the measured data are combined and input to a convolutional neural network. Experimental results show the significantly better accuracy of the proposed method compared with conventional methods that do not perform data combination. The accuracy of identifying 10 participants having similar ages and physical features was 96–99%, despite the relatively small training set (number of training samples: 50–90 Doppler radar images per person). These results suggest that combining sit-to-stand and stand-to-sit movements provides sufficient information for accurate person identification and such information can be remotely acquired using Doppler radar measurements.

[1]  Moeness G. Amin,et al.  Radar-Based Human-Motion Recognition With Deep Learning: Promising applications for indoor monitoring , 2019, IEEE Signal Processing Magazine.

[2]  Mineichi Kudo,et al.  Soft authentication and behavior analysis using a chair with sensors attached: hipprint authentication , 2009, Pattern Analysis and Applications.

[3]  Carlos D. Castillo,et al.  An Automatic System for Unconstrained Video-Based Face Recognition , 2018, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[4]  Wenbin Ye,et al.  Human Activity Classification Based on Micro-Doppler Signatures by Multiscale and Multitask Fourier Convolutional Neural Network , 2020, IEEE Sensors Journal.

[5]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[6]  Yudong Zhang,et al.  DenseNet-201-Based Deep Neural Network with Composite Learning Factor and Precomputation for Multiple Sclerosis Classification , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[7]  Gang Li,et al.  Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[8]  André Bourdoux,et al.  Indoor Person Identification Using a Low-Power FMCW Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Abderrahim El Qadi,et al.  Bag-of-features for image memorability evaluation , 2016, IET Comput. Vis..

[10]  Zhe Guo,et al.  Medical image segmentation based on multi-modal convolutional neural network: Study on image fusion schemes , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[11]  Susan Elias,et al.  Template-based gait authentication through Bayesian thresholding , 2019, IEEE/CAA Journal of Automatica Sinica.

[12]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  David Menotti,et al.  Deep Representations for Iris, Face, and Fingerprint Spoofing Detection , 2014, IEEE Transactions on Information Forensics and Security.

[14]  Shilin Zhu,et al.  Gait Recognition for Co-Existing Multiple People Using Millimeter Wave Sensing , 2020, AAAI.

[15]  Einar Snekkenes,et al.  Gait Authentication and Identification Using Wearable Accelerometer Sensor , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[16]  Xiaosong Zhang,et al.  Evaluating the Performance of ResNet Model Based on Image Recognition , 2018, ICCAI 2018.

[17]  Yu Sun,et al.  Multi-Input Convolutional Neural Network for Flower Grading , 2017, J. Electr. Comput. Eng..

[18]  Thomas Wennekers,et al.  Gait-based person and gender recognition using micro-doppler signatures , 2011, 2011 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[19]  Matjaz B. Juric,et al.  An Efficient HOS-Based Gait Authentication of Accelerometer Data , 2015, IEEE Transactions on Information Forensics and Security.

[20]  Uday Pratap Singh,et al.  Vision-Based Gait Recognition: A Survey , 2018, IEEE Access.

[21]  Kenshi Saho,et al.  Person Identification Based on Micro-Doppler Signatures of Sit-to-Stand and Stand-to-Sit Movements Using a Convolutional Neural Network , 2020, IEEE Sensors Letters.

[22]  N. Maffiuletti,et al.  Reproducibility of gait parameters at different surface inclinations and speeds using an instrumented treadmill system. , 2016, Gait & posture.

[23]  Yuan He,et al.  Person Identification Using Micro-Doppler Signatures of Human Motions and UWB Radar , 2019, IEEE Microwave and Wireless Components Letters.

[24]  T. Sakamoto Personal Identification Using a Convolutional Neural Network and Ultra-Wideband Radar Measurement of Walking and Sitting Motion , 2020 .

[25]  Rama Chellappa,et al.  Continuous User Authentication on Mobile Devices: Recent progress and remaining challenges , 2016, IEEE Signal Processing Magazine.

[26]  Ali Cafer Gürbüz,et al.  Knowledge Exploitation for Human Micro-Doppler Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[27]  Stefan Poslad,et al.  Human Activity Detection and Coarse Localization Outdoors Using Micro-Doppler Signatures , 2019, IEEE Sensors Journal.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Waleed Ejaz,et al.  ADLAuth: Passive Authentication Based on Activity of Daily Living Using Heterogeneous Sensing in Smart Cities , 2019, Sensors.

[30]  Imed Bouchrika,et al.  On Using Gait in Forensic Biometrics , 2011, Journal of forensic sciences.

[31]  Vaclav Cejka,et al.  The repeatability of the instrumented timed Up & Go test: The performance of older adults and parkinson’s disease patients under different conditions , 2020 .

[32]  Peter Corcoran,et al.  Smart Speaker Design and Implementation with Biometric Authentication and Advanced Voice Interaction Capability , 2022, AICS.

[33]  Alessio Balleri,et al.  Classification of personnel targets by acoustic micro-Doppler signatures , 2011 .

[34]  Ming Ye,et al.  Radar‐ID: human identification based on radar micro‐Doppler signatures using deep convolutional neural networks , 2018, IET Radar, Sonar & Navigation.

[35]  M. K. Haldar,et al.  A Survey on Biometrics and Cancelable Biometrics Systems , 2018, Int. J. Image Graph..