Automatic Arm Motion Recognition Using Radar for Smart Home Technologies

In considering man-machine interface for smart home technology, we introduce a simple but effective technique in automatic arm motion recognition using radar. The proposed technique classifies arm motions based on the envelopes of their micro-Doppler (MD) signatures. These envelopes capture the distinctions among different arm movements and their corresponding positive and negative Doppler frequencies that are generated during each arm motion. We detect the positive and negative frequency envelopes of MD separately, and form a feature vector of their augmentation. We use the k-nearest neighbor (k NN) classifier and Manhattan distance (L1) measure, in lieu of Euclidean distance (L2), so as not to diminish small but critical envelope values. It is shown that this method can achieve higher than 99% classification rates when choosing specific arm motion articulations from a sitting down position.

[1]  Zhengxin Zeng,et al.  Hand Gesture Recognition based on Radar Micro-Doppler Signature Envelopes , 2018, 2019 IEEE Radar Conference (RadarConf).

[2]  Moeness Amin,et al.  Fall Detection Using Deep Learning in Range-Doppler Radars , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Moeness G. Amin,et al.  Minimum variance time-frequency distribution kernels for signals in additive noise , 1996, IEEE Trans. Signal Process..

[4]  Abdelhak M. Zoubir,et al.  Subspace Classification of Human Gait Using Radar Micro-Doppler Signatures , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[5]  Carmine Clemente,et al.  Micro-doppler-based in-home aided and unaided walking recognition with multiple radar and sonar systems , 2017 .

[6]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[7]  Gang Li,et al.  Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Boualem Boashash,et al.  Radar fall detection using principal component analysis , 2016, SPIE Defense + Security.

[9]  Gang Li,et al.  Sparsity aware dynamic gesture recognition using radar sensors with angular diversity , 2018, IET Radar, Sonar & Navigation.

[10]  Moeness G. Amin,et al.  Analysis of micro-Doppler signals using linear FM basis decomposition , 2006, SPIE Defense + Commercial Sensing.

[11]  Gang Li,et al.  Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[12]  Takuya Sakamoto,et al.  Hand Gesture Recognition Using a Radar Echo IQ Plot and a Convolutional Neural Network , 2018, IEEE Sensors Letters.

[13]  Moeness G. Amin,et al.  Automatic Data-Driven Frequency-Warped Cepstral Feature Design for Micro-Doppler Classification , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[14]  S. Z. Gürbüz,et al.  Deep convolutional autoencoder for radar-based classification of similar aided and unaided human activities , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[16]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[17]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[18]  Boualem Boashash,et al.  Range-Doppler radar sensor fusion for fall detection , 2017, 2017 IEEE Radar Conference (RadarConf).

[19]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[20]  Gang Li,et al.  Effect of sparsity‐aware time–frequency analysis on dynamic hand gesture classification with radar micro‐Doppler signatures , 2018, IET Radar, Sonar & Navigation.

[21]  Bijan G. Mobasseri,et al.  A time-frequency classifier for human gait recognition , 2009, Defense + Commercial Sensing.

[22]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[23]  Abdesselam Bouzerdoum,et al.  Human Motion Classification with Micro-Doppler Radar and Bayesian-Optimized Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Frans C. A. Groen,et al.  Feature-based human motion parameter estimation with radar , 2008 .

[25]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[26]  Gang Li,et al.  Dynamic hand gesture classification based on radar micro-Doppler signatures , 2016, 2016 CIE International Conference on Radar (RADAR).

[27]  Youngwook Kim,et al.  Human Detection Using Doppler Radar Based on Physical Characteristics of Targets , 2015, IEEE Geoscience and Remote Sensing Letters.

[28]  Carlo Tomasi,et al.  The Earth Mover’s Distance , 2001 .

[29]  Abdelhak M. Zoubir,et al.  Radar classification of human gait abnormality based on sum-of-harmonics analysis , 2018, 2018 IEEE Radar Conference (RadarConf18).

[30]  Leon N. Cooper,et al.  Improving nearest neighbor rule with a simple adaptive distance measure , 2006, Pattern Recognit. Lett..

[31]  H. D. Griffiths,et al.  Hand gesture classification using 24 GHz FMCW dual polarised radar , 2017 .

[32]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.