Micro-Doppler Gesture Recognition using Doppler, Time and Range Based Features

This paper presents micro-Doppler analysis and classification results from radar measurements of various hand gestures. A new database of 6 individuals completing 4 separate gestures with over 3,000 repetitions was recorded using a 24 GHz Ancortek radar system. The micro-Doppler signatures from these gestures were generated, features extracted and multiple different classifiers applied to this gesture data. A typical micro-Doppler classification process aims to use either a single range bin of data, average over a series of range bins or align all the target signal to a single bin. Different to previous techniques, the paper presents a method that uses multiple ranges bins to produce a spectrogram per range bin in order to represent the observed gesture over all four dimensions of time, Doppler, space and polarization. A comparison of the traditional and the newly proposed technique is shown and the improvements demonstrated are observed to be significant.

[1]  Noh Hoon Myung,et al.  Automatic algorithm for estimating the jet engine blade number from the radar target signature of aircraft targets , 2015, IEEE Aerospace and Electronic Systems Magazine.

[2]  Kevin Chetty,et al.  On the Application of Digital Moving Target Indication Techniques to Short-Range FMCW Radar Data , 2018, IEEE Sensors Journal.

[3]  Youngwook Kim,et al.  Human Detection Using Doppler Radar Based on Physical Characteristics of Targets , 2015, IEEE Geoscience and Remote Sensing Letters.

[4]  Dimitrios Lymberopoulos,et al.  3D Gesture Recognition Through RF Sensing , 2014 .

[5]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Francesco Fioranelli,et al.  Classification of Unarmed/Armed Personnel Using the NetRAD Multistatic Radar for Micro-Doppler and Singular Value Decomposition Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[7]  Carmine Clemente,et al.  On Model, Algorithms, and Experiment for Micro-Doppler-Based Recognition of Ballistic Targets , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[9]  Dave Tahmoush,et al.  Radar micro-doppler for long range front-view gait recognition , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[10]  Pietro Zanuttigh,et al.  Hand gesture recognition with jointly calibrated Leap Motion and depth sensor , 2015, Multimedia Tools and Applications.

[11]  Hugh D. Griffiths,et al.  Classification of Birds and UAVs Based on Radar Polarimetry , 2016, IEEE Geoscience and Remote Sensing Letters.

[12]  J. J. Jones,et al.  Classification of stationary movers with MTI radar , 1996, Proceedings of the 1996 IEEE National Radar Conference.

[13]  Francesco Fioranelli,et al.  Activity Classification Using Raw Range and I & Q Radar Data with Long Short Term Memory Layers , 2018, 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[14]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Seong-Ook Park,et al.  Drone Classification Using Convolutional Neural Networks With Merged Doppler Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[16]  H. D. Griffiths,et al.  Hand gesture classification using 24 GHz FMCW dual polarised radar , 2017 .

[17]  Yi Liu,et al.  Holoscopic 3D Micro-Gesture Database for Wearable Device Interaction , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[18]  Francesco Fioranelli,et al.  Centroid features for classification of armed/unarmed multiple personnel using multistatic human micro-Doppler , 2016 .