Hand Gesture Recognition based on Radar Micro-Doppler Signature Envelopes

We introduce a simple but effective technique in automatic hand gesture recognition using radar. The proposed technique classifies hand gestures based on the envelopes of their micro-Doppler (MD) signatures. These envelopes capture the distinctions among different hand movements and their corresponding positive and negative Doppler frequencies that are generated during each gesture act. We detect the positive and negative frequency envelopes of MD separately, and form a feature vector of their augmentation. We use the k-nearest neighbor (kNN) classifier and Manhattan distance (L1) measure, in lieu of Euclidean distance (L2), so as not to diminish small but critical envelope values. It is shown that this method outperforms both low-dimension representation techniques based on principal component analysis (PCA) and sparse reconstruction using Gaussian-windowed Fourier dictionary, and can achieve very high classification rates.

[1]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[2]  Leon N. Cooper,et al.  Improving nearest neighbor rule with a simple adaptive distance measure , 2006, Pattern Recognit. Lett..

[3]  Gang Li,et al.  Effect of sparsity‐aware time–frequency analysis on dynamic hand gesture classification with radar micro‐Doppler signatures , 2018, IET Radar, Sonar & Navigation.

[4]  S. Z. Gürbüz,et al.  Deep convolutional autoencoder for radar-based classification of similar aided and unaided human activities , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[5]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[6]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[8]  John Zolock,et al.  The Use of Stationary Object Radar Sensor Data from Advanced Driver Assistance Systems (ADAS) in Accident Reconstruction , 2016 .

[9]  Bijan G. Mobasseri,et al.  A time-frequency classifier for human gait recognition , 2009, Defense + Commercial Sensing.

[10]  R Weston,et al.  HUMAN FACTORS IN AIR TRAFFIC CONTROL , 1982 .

[11]  Yue Zhang,et al.  A Vehicular Mobile Standard Instrument for Field Verification of Traffic Speed Meters Based on Dual-Antenna Doppler Radar Sensor , 2018, Sensors.

[12]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[13]  Abdesselam Bouzerdoum,et al.  Human Motion Classification with Micro-Doppler Radar and Bayesian-Optimized Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Frans C. A. Groen,et al.  Feature-based human motion parameter estimation with radar , 2008 .

[15]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[16]  Boualem Boashash,et al.  Range-Doppler radar sensor fusion for fall detection , 2017, 2017 IEEE Radar Conference (RadarConf).

[17]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[18]  Gang Li,et al.  Dynamic hand gesture classification based on radar micro-Doppler signatures , 2016, 2016 CIE International Conference on Radar (RADAR).

[19]  Carmine Clemente,et al.  Micro-doppler-based in-home aided and unaided walking recognition with multiple radar and sonar systems , 2017 .

[20]  Cyrus Shahabi,et al.  Image Similarity Measures , 2003 .

[21]  Moeness G. Amin,et al.  Analysis of micro-Doppler signals using linear FM basis decomposition , 2006, SPIE Defense + Commercial Sensing.

[22]  Abdelhak M. Zoubir,et al.  Radar classification of human gait abnormality based on sum-of-harmonics analysis , 2018, 2018 IEEE Radar Conference (RadarConf18).

[23]  William Stafford Noble,et al.  Support vector machine , 2013 .

[24]  Moeness G. Amin,et al.  Minimum variance time-frequency distribution kernels for signals in additive noise , 1996, IEEE Trans. Signal Process..

[25]  Moeness Amin,et al.  Fall Detection Using Deep Learning in Range-Doppler Radars , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[26]  H. D. Griffiths,et al.  Hand gesture classification using 24 GHz FMCW dual polarised radar , 2017 .

[27]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[28]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .

[29]  Youngwook Kim,et al.  Human Detection Using Doppler Radar Based on Physical Characteristics of Targets , 2015, IEEE Geoscience and Remote Sensing Letters.

[30]  Carlo Tomasi,et al.  The Earth Mover’s Distance , 2001 .

[31]  Takuya Sakamoto,et al.  Hand Gesture Recognition Using a Radar Echo IQ Plot and a Convolutional Neural Network , 2018, IEEE Sensors Letters.

[32]  Abdelhak M. Zoubir,et al.  Subspace Classification of Human Gait Using Radar Micro-Doppler Signatures , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[33]  Boualem Boashash,et al.  Radar fall detection using principal component analysis , 2016, SPIE Defense + Security.

[34]  Josef Kittler,et al.  Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Gang Li,et al.  Sparsity aware dynamic gesture recognition using radar sensors with angular diversity , 2018, IET Radar, Sonar & Navigation.

[36]  Gang Li,et al.  Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[37]  Moeness G. Amin,et al.  Automatic Data-Driven Frequency-Warped Cepstral Feature Design for Micro-Doppler Classification , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Moeness Amin,et al.  Suitability of Data Representation Domains in Expressing Human Motion Radar Signals , 2017, IEEE Geoscience and Remote Sensing Letters.

[39]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[40]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[41]  Gang Li,et al.  Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.