RF Micro-Doppler Classification with Multiple Spectrograms from Angular Subspace Projections

Radio Frequency (RF) sensors present distinct ad-vantages over cameras or wearables for hand gesture recognition providing high resolution radial range and velocity measurement, being able to operate in dark and through the objects with high temporal and frequency resolutions. Moreover, the flexibility of the complex formatted data allows users to develop their own algorithms to generate various data representations such as time-frequency (Micro-Doppler - μD) maps, or range-Doppler or - angle as a function of time. However, conventional μ-D generation does not regard the angular information of the multiple targets existing in the RF data. Hence, multiple targets with different μ-D signatures at various angular positions create a mixed spec-trogram output reducing recognition performance. This paper proposes an angular projection approach on radar data cubes (RDCs) to generate raw radar data for defined angular subspaces. Hence multiple μ-D spectrograms for each angular subspace can be constructed from the projected data. The proposed approach has been tested on RF data for gross body movement and American Sign Language (ASL) recognition. It has been showed that the utilization of angular projected spectrograms increases classification accuracy for ASL and achieves recognition accuracy of 92.6% for 20 word ASL signs.

[1]  Chris S. Crawford,et al.  Sequential Classification of ASL Signs in the Context of Daily Living Using RF Sensing , 2021, 2021 IEEE Radar Conference (RadarConf21).

[2]  Mohammad Mahbubur Rahman,et al.  American Sign Language Recognition Using RF Sensing , 2020, IEEE Sensors Journal.

[3]  Shi Yan,et al.  Leap Motion Hand Gesture Recognition Based on Deep Neural Network , 2020, 2020 Chinese Control And Decision Conference (CCDC).

[4]  Yuliang Sun,et al.  Real-Time Radar-Based Gesture Detection and Recognition Built in an Edge-Computing Platform , 2020, IEEE Sensors Journal.

[5]  Robiulhossain Mdrafi,et al.  A Linguistic Perspective on Radar Micro-Doppler Analysis of American Sign Language , 2020, 2020 IEEE International Radar Conference (RADAR).

[6]  Kevin Gimpel,et al.  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations , 2019, ICLR.

[7]  Moeness G. Amin,et al.  DNN Transfer Learning From Diversified Micro-Doppler for Motion Classification , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Abdelhak M. Zoubir,et al.  Radar classification of human gait abnormality based on sum-of-harmonics analysis , 2018, 2018 IEEE Radar Conference (RadarConf18).

[9]  Takuya Sakamoto,et al.  Doppler Radar Techniques for Accurate Respiration Characterization and Subject Identification , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[10]  S. Z. Gürbüz,et al.  Deep convolutional autoencoder for radar-based classification of similar aided and unaided human activities , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[12]  Raffaele Solimene,et al.  Through the Wall Breathing Detection by Means of a Doppler Radar and MUSIC Algorithm , 2017, IEEE Sensors Letters.

[13]  Carmine Clemente,et al.  Micro-doppler-based in-home aided and unaided walking recognition with multiple radar and sonar systems , 2017 .

[14]  Karen Emmorey,et al.  ASL-LEX: A lexical database of American Sign Language , 2017, Behavior research methods.

[15]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[16]  Carmine Clemente,et al.  'The Micro-Doppler Effect in Radar' by V.C. Chen , 2012 .

[17]  Sung-Tae Jung,et al.  Real-time gesture recognition using 3D depth camera , 2011, 2011 IEEE 2nd International Conference on Software Engineering and Service Science.

[18]  O. Boric-Lubecke,et al.  Assessment of Heart Rate Variability and Respiratory Sinus Arrhythmia via Doppler Radar , 2009, IEEE Transactions on Microwave Theory and Techniques.

[19]  Jake K. Aggarwal,et al.  Spatio-temporal relationship match: Video structure comparison for recognition of complex human activities , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Khaled Assaleh,et al.  Vision-based system for continuous Arabic Sign Language recognition in user dependent mode , 2008, 2008 5th International Symposium on Mechatronics and Its Applications.