Spectrum-Based Hand Gesture Recognition Using Millimeter-Wave Radar Parameter Measurements

Radar sensors offer several advantages over optical sensors in the gesture recognition for remote control of electronic devices. In this paper, we investigate the feasibility of human gesture recognition using the spectra of radar measurement parameters. With the combination of radar theory and classification methods, we found that the frequencies of different gestures’ parameters could be utilized as features for gesture recognition. Six kinds of periodic dynamic gestures are designed to avoid the complexity of defining and extracting the start and end of the dynamic gesture. In addition to the frequency ratio, we also extracted some features related to motion range and detection coherence to eliminate the interferences brought by the unintended gestures. The decision tree classifier designed on the basis of experimental phenomena can guarantee effective classification between different gestures, and in general, the correct recognition rate of each gesture is higher than 90%. Finally, we collected the position and the Doppler velocity information of hand for classification by a W-band millimeter wave radar in the experiment and verified the usability of the proposed method.

[1]  Muhammad Younus Javed,et al.  A statistical feature based decision tree approach for hand gesture recognition , 2009, FIT.

[2]  Hong Cheng,et al.  Image-to-Class Dynamic Time Warping for 3D hand gesture recognition , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Tae-Seong Kim,et al.  3-D hand motion tracking and gesture recognition using a data glove , 2009, 2009 IEEE International Symposium on Industrial Electronics.

[4]  Avik Santra,et al.  Robust Gesture Recognition Using Millimetric-Wave Radar System , 2018, IEEE Sensors Letters.

[5]  Dan Wang,et al.  Hidden Markov model-based gesture recognition with FMCW radar , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[6]  Eunmi Choi,et al.  Hand gesture recognition algorithm based on grayscale histogram of the image , 2010, 2010 4th International Conference on Application of Information and Communication Technologies.

[7]  Yiran Li,et al.  Gesture recognition for smart home applications using portable radar sensors , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Jiangtao Huangfu,et al.  Doppler-Radar Based Hand Gesture Recognition System Using Convolutional Neural Networks , 2017, CSPS.

[9]  Changzhan Gu,et al.  A Two-Tone Radar Sensor for Concurrent Detection of Absolute Distance and Relative Movement for Gesture Sensing , 2017, IEEE Sensors Letters.

[10]  Qun Zhang,et al.  Motion compensation for SISAR based on contrast maximization , 2007, 2007 1st Asian and Pacific Conference on Synthetic Aperture Radar.

[11]  Minas V. Liarokapis,et al.  Single-Grasp, Model-Free Object Classification using a Hyper-Adaptive Hand, Google Soli, and Tactile Sensors , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Pavlo Molchanov,et al.  Short-range FMCW monopulse radar for hand-gesture sensing , 2015, 2015 IEEE Radar Conference (RadarCon).

[13]  Yiming Pi,et al.  Dynamic Gesture Recognition with a Terahertz Radar Based on Range Profile Sequences and Doppler Signatures , 2017, Sensors.

[14]  Songcheol Hong,et al.  Feature-Based Hand Gesture Recognition Using an FMCW Radar and its Temporal Feature Analysis , 2018, IEEE Sensors Journal.

[15]  Gang Li,et al.  Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Jong-Hwan Kim,et al.  Short-Range Radar Based Real-Time Hand Gesture Recognition Using LSTM Encoder , 2019, IEEE Access.

[17]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Songcheol Hong,et al.  24 GHz FMCW Radar System for Real-Time Hand Gesture Recognition Using LSTM , 2018, 2018 Asia-Pacific Microwave Conference (APMC).

[19]  Robin J. Evans,et al.  Hand-Gesture Recognition Using Two-Antenna Doppler Radar With Deep Convolutional Neural Networks , 2019, IEEE Sensors Journal.

[20]  Friedrich Jondral,et al.  Feature-based gesture classification by means of high resolution radar measurements , 2017, 2017 18th International Radar Symposium (IRS).

[21]  Yimin Liu,et al.  Micro Hand Gesture Recognition System Using Ultrasonic Active Sensing , 2017, IEEE Access.

[22]  Serban Oprisescu,et al.  Automatic static hand gesture recognition using ToF cameras , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[23]  Zhu Wang,et al.  Gesture-Radar: Enabling Natural Human-Computer Interactions with Radar-Based Adaptive and Robust Arm Gesture Recognition , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Evaggelos Spyrou,et al.  Hand Gesture Recognition using a Convolutional Neural Network , 2018 .

[25]  Changzhi Li,et al.  Radar and ultrasound hybrid system for human computer interaction , 2018, 2018 IEEE Radar Conference (RadarConf18).

[26]  Karly A. Smith,et al.  Gesture Recognition Using mm-Wave Sensor for Human-Car Interface , 2018, IEEE Sensors Letters.

[27]  Christian Waldschmidt,et al.  RCS measurements of a human hand for radar-based gesture recognition at E-band , 2016, 2016 German Microwave Conference (GeMiC).

[28]  Gang Li,et al.  Effect of sparsity‐aware time–frequency analysis on dynamic hand gesture classification with radar micro‐Doppler signatures , 2018, IET Radar, Sonar & Navigation.

[29]  Yong Wang,et al.  TS-I3D Based Hand Gesture Recognition Method With Radar Sensor , 2019, IEEE Access.

[30]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[31]  Ali M. Niknejad,et al.  A 94 GHz mm-Wave-to-Baseband Pulsed-Radar Transceiver with Applications in Imaging and Gesture Recognition , 2013, IEEE Journal of Solid-State Circuits.

[32]  Murat Torlak,et al.  Automotive Radars: A review of signal processing techniques , 2017, IEEE Signal Processing Magazine.

[33]  Gang Li,et al.  Sparsity-based dynamic hand gesture recognition using micro-Doppler signatures , 2017, 2017 IEEE Radar Conference (RadarConf).

[34]  Yuliang Sun,et al.  Automatic Radar-based Gesture Detection and Classification via a Region-based Deep Convolutional Neural Network , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Olga Boric-Lubecke,et al.  Barcode based hand gesture classification using AC coupled quadrature Doppler radar , 2016, 2016 IEEE MTT-S International Microwave Symposium (IMS).

[36]  Sandeep Rao 77 GHz single chip radar sensor enables automotive body and chassis applications , 2018 .

[37]  Jobin Francis,et al.  Significance of Hand Gesture Recognition Systems in Vehicular Automation-A Survey , 2014 .

[38]  Taehyub Kim,et al.  Using Binary Decision Tree and Multiclass SVM for Human Gesture Recognition , 2013, 2013 International Conference on Information Science and Applications (ICISA).

[39]  H. D. Griffiths,et al.  Hand gesture classification using 24 GHz FMCW dual polarised radar , 2017 .

[40]  A.G. Huizing,et al.  Gesture recognition with a low power FMCW radar and a deep convolutional neural network , 2017, 2017 European Radar Conference (EURAD).

[41]  Sung Ho Cho,et al.  Hand-Based Gesture Recognition for Vehicular Applications Using IR-UWB Radar , 2017, Sensors.

[42]  Chen-Chiung Hsieh,et al.  A real time hand gesture recognition system using motion history image , 2010, 2010 2nd International Conference on Signal Processing Systems.

[43]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[44]  Gang Li,et al.  Dynamic hand gesture classification based on radar micro-Doppler signatures , 2016, 2016 CIE International Conference on Radar (RADAR).

[45]  Sandeep Rao,et al.  Real-Time Multi-Gesture Recognition using 77 GHz FMCW MIMO Single Chip Radar , 2019, 2019 IEEE International Conference on Consumer Electronics (ICCE).