Multiscale Residual Attention Network for Distinguishing Stationary Humans and Common Animals Under Through-Wall Condition Using Ultra-Wideband Radar

Distinguishing between humans and common animals through a wall is necessary for facilitating successful rescue of survivors and enhancing the confidence of rescuers in post-disaster search and rescue operations. However, few existing solutions are available with only dogs considered in this scenario. This poses an issue in ensuring the recognition accuracy involving different animal species. This work proposed a novel multiscale residual attention network for distinguishing between stationary humans and common animals under a through-wall condition based on ultra-wideband radar, which is yet to be performed by existing research using deep learning. Humans, dogs, cats, rabbits, and no target data are collected and distinguished. The overall architecture of the proposed method differed from conventional deep learning methods as it is constructed by parallel $3\times 3$ and $5\times 5$ kernels incorporated with the residual attention learning mechanism. The effect of the slow-time dimension on the classification performance is analyzed, thereby producing an optimal input size. The overall F1-score of the proposed network can reach a high value of 0.9064 and the recognition accuracy of human targets can reach 0.983 satisfying the requirements for post-disaster rescue. Then, the effectiveness and advancement of the three components of the overall network architecture are validated by ablation studies. Finally, the proposed method is compared with three state-of-the-art methods. Comparison results indicate that the proposed method achieve a better performance. The network and its results are envisioned to be applied in various practical situations, such as earthquake rescue and intelligent homecare.

[1]  Xinyu Li,et al.  A Survey of Deep Learning-Based Human Activity Recognition in Radar , 2019, Remote. Sens..

[2]  Changzhi Li,et al.  Microwave Noncontact Motion Sensing and Analysis: Li/Microwave Noncontact Motion Sensing and Analysis , 2013 .

[3]  Kai Tan,et al.  Improved human respiration detection method via ultra-wideband radar in through-wall or other similar conditions , 2016 .

[4]  Hao Chen,et al.  Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[5]  Hao Lv,et al.  Bioradar Technology: Recent Research and Advancements , 2019, IEEE Microwave Magazine.

[6]  Erik Blasch,et al.  Micro-Doppler radar classification of humans and animals in an operational environment , 2018, Expert Syst. Appl..

[7]  Yuan He,et al.  Joint Motion Classification and Person Identification via Multitask Learning for Smart Homes , 2019, IEEE Internet of Things Journal.

[8]  Zhao Li,et al.  A Novel Method for Respiration-Like Clutter Cancellation in Life Detection by Dual-Frequency IR-UWB Radar , 2013, IEEE Transactions on Microwave Theory and Techniques.

[9]  James D. Taylor Ultra-wideband Radar Technology , 2000 .

[10]  Hao Lv,et al.  Method for Distinguishing Humans and Animals in Vital Signs Monitoring Using IR-UWB Radar , 2019, International journal of environmental research and public health.

[11]  Xiaohua Zhu,et al.  Microwave Sensing and Sleep: Noncontact Sleep-Monitoring Technology With Microwave Biomedical Radar , 2019, IEEE Microwave Magazine.

[12]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[13]  Éric Gaussier,et al.  A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation , 2005, ECIR.

[14]  Joel W. Burdick,et al.  Human detection and tracking via Ultra-Wideband (UWB) radar , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Tom Schaul,et al.  Rainbow: Combining Improvements in Deep Reinforcement Learning , 2017, AAAI.

[18]  Xinyu Li,et al.  A Mutiscale Residual Attention Network for Multitask Learning of Human Activity Using Radar Micro-Doppler Signatures , 2019, Remote. Sens..

[19]  Songcheol Hong,et al.  Feature-Based Hand Gesture Recognition Using an FMCW Radar and its Temporal Feature Analysis , 2018, IEEE Sensors Journal.

[20]  Ming Ye,et al.  Radar‐ID: human identification based on radar micro‐Doppler signatures using deep convolutional neural networks , 2018, IET Radar, Sonar & Navigation.

[21]  Hao Lv,et al.  A new ultra‐wideband radar for detecting survivors buried under earthquake rubbles , 2010 .

[22]  Henrik Petersson,et al.  Target classification in perimeter protection with a micro-Doppler radar , 2016, 2016 17th International Radar Symposium (IRS).

[23]  Gianluca Gennarelli,et al.  Real-Time Through-Wall Situation Awareness Using a Microwave Doppler Radar Sensor , 2016, Remote. Sens..

[24]  Yang Zhang,et al.  An Accurate Method to Distinguish Between Stationary Human and Dog targets Under Through-Wall Condition Using UWB Radar , 2019, Remote. Sens..

[25]  André Bourdoux,et al.  Indoor Person Identification Using a Low-Power FMCW Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Zhao Li,et al.  Using Wavelet Entropy to Distinguish Between Humans and Dogs Detected by UWB Radar , 2013 .

[27]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.