Static Hand Gesture Recognition With Electromagnetic Scattered Field via Complex Attention Convolutional Neural Network

We present a novel learning-based static gesture recognition framework using electromagnetic (EM) scattered field data, which can efficiently address some significant issues in traditional vision-based recognition approaches. An end-to-end complex-valued attention convolutional neural network (CNN) is devised to train the gesture recognizer, wherein the attention module is designed to learn robust region-of-interest-aware features. Extensive numerical experiments are conducted on a public static hand gesture dataset. Both full and limited aperture measurements with transverse magnetic wave illumination are investigated. It is numerically shown that: first, both complex-valued convolutional and attention module contribute to the excellent performance. The recognition accuracy is above 99.0% for full aperture and even about 95.32% under the limited one-eighth aperture, respectively, and second, the proposed method not only has good scalability to the case with limited aperture, but also performs much better than previous state-of-the-art deep networks.

[1]  Shengchang Lan,et al.  Hand Gesture Recognition Using Convolutional Neural Networks , 2018, 2018 USNC-URSI Radio Science Meeting (Joint with AP-S Symposium).

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  Xudong Chen,et al.  Computational Methods for Electromagnetic Inverse Scattering , 2018 .

[4]  Kathrin Abendroth,et al.  Computational Methods For Electromagnetics , 2016 .

[5]  Tie Jun Cui,et al.  A Probabilistic Model for the Nonlinear Electromagnetic Inverse Scattering: TM Case , 2017, IEEE Transactions on Antennas and Propagation.

[6]  Akira Hirose,et al.  Millimeter-Wave Adaptive Glucose Concentration Estimation With Complex-Valued Neural Networks , 2017, IEEE Transactions on Biomedical Engineering.

[7]  Xudong Chen,et al.  Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Liang Zhang,et al.  Redundancy and Attention in Convolutional LSTM for Gesture Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Jun Yu,et al.  Image Recognition by Predicted User Click Feature With Multidomain Multitask Transfer Deep Network , 2019, IEEE Transactions on Image Processing.

[11]  Sandeep Subramanian,et al.  Deep Complex Networks , 2017, ICLR.

[12]  R. W. Lau,et al.  The dielectric properties of biological tissues: II. Measurements in the frequency range 10 Hz to 20 GHz. , 1996, Physics in medicine and biology.

[13]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[14]  Fernando L. Teixeira,et al.  Performance Analysis and Dynamic Evolution of Deep Convolutional Neural Network for Electromagnetic Inverse Scattering , 2019, IEEE Antennas and Wireless Propagation Letters.

[15]  Lars-Erik Wernersson,et al.  Millimeter-Wave Pulse Radar Scattering Measurements on the Human Hand , 2019, IEEE Antennas and Wireless Propagation Letters.

[16]  Adnan Khashman,et al.  Deep learning in vision-based static hand gesture recognition , 2017, Neural Computing and Applications.

[17]  Shengen Yan,et al.  Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes , 2019, ArXiv.