Range-Max Enhanced Ultra-Wideband Micro-Doppler Signatures of Behind Wall Indoor Human Activities

Penetrating detection and recognition of behind wall indoor human activities has drawn great attentions from social security and emergency service department in recent years since intelligent surveillance aforehand could avail the proper decision making before operations being carried out. However, due to the influence of the wall effects, the obtained micro-Doppler signatures would be severely degenerated by strong near zero-frequency DC components, which would inevitably smear the detailed characteristic features of different behind wall motions in time-frequency (TF) map and further hinder the motion recognition and classification. In this paper, an ultra-wideband (UWB) radar system is first employed to probe through the opaque wall to detect the behind wall motions, which often span a certain number of range bin cells. By employing such a system, a high resolution range map can be obtained, in which the embedded rich range information is expected to be fully exploited to improve the subsequent recognition and classification performance. Secondly, a high-pass filter is applied to remove the effect of the wall in the raw range map. Then, with the aim of enhancing the characteristic features of different behind wall motions in TF maps, a novel range-max enhancement strategy is proposed to extract the most significant micro-Doppler feature of each TF cell along all range bins for a specific motion. Lastly, the effectiveness of the proposed micro-Doppler signature enhancement strategy is investigated by means of onsite experiments and comparative classification. Both the feature enhanced TF maps and classification results show that the proposed approach outperforms other state-of-art Short-Time Fourier Transform (STFT) based TF feature extraction methods.

[1]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[2]  Hao Ling,et al.  Simulation and Analysis of Human Micro-Dopplers in Through-Wall Environments , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Branka Jokanovic,et al.  Multiple joint-variable domains recognition of human motion , 2017, 2017 IEEE Radar Conference (RadarConf).

[4]  S. S. Ram,et al.  Micro-Doppler signatures of underwater vehicles using acoustic radar , 2015, 2015 IEEE Radar Conference (RadarCon).

[5]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[6]  Moeness G. Amin,et al.  Micro-Doppler processing for ultra-wideband radar data , 2012, Defense + Commercial Sensing.

[7]  Abdelhak M. Zoubir,et al.  Detection of Gait Asymmetry Using Indoor Doppler Radar , 2019, 2019 IEEE Radar Conference (RadarConf).

[8]  Alessio Balleri,et al.  Classification of personnel targets by acoustic micro-Doppler signatures , 2011 .

[9]  Gang Li,et al.  Dynamic hand gesture classification based on radar micro-Doppler signatures , 2016, 2016 CIE International Conference on Radar (RADAR).

[10]  Moeness Amin,et al.  Suitability of Data Representation Domains in Expressing Human Motion Radar Signals , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Carmine Clemente,et al.  Micro-doppler-based in-home aided and unaided walking recognition with multiple radar and sonar systems , 2017 .

[12]  Chi-Chih Chen,et al.  Micro-Doppler characteristics of pedestrians and bicycles for automotive radar sensors at 77 GHz , 2017, 2017 11th European Conference on Antennas and Propagation (EUCAP).

[13]  Yuan He,et al.  Range-Doppler surface: a tool to analyse human target in ultra-wideband radar , 2015 .

[14]  Pietro Siciliano,et al.  A Radar-Based Smart Sensor for Unobtrusive Elderly Monitoring in Ambient Assisted Living Applications , 2017, Biosensors.

[15]  Erik Blasch,et al.  Micro-Doppler radar classification of humans and animals in an operational environment , 2018, Expert Syst. Appl..

[16]  Guy W. Mineau,et al.  A simple KNN algorithm for text categorization , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[17]  Jun Zhang,et al.  Human micro-Doppler signature extraction in the foliage-penetration environment , 2016, 2016 21st International Conference on Microwave, Radar and Wireless Communications (MIKON).

[18]  Yazhou Wang,et al.  Micro-Doppler signatures for intelligent human gait recognition using a UWB impulse radar , 2011, 2011 IEEE International Symposium on Antennas and Propagation (APSURSI).

[19]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[20]  Zhengxin Zeng,et al.  Hand Gesture Recognition based on Radar Micro-Doppler Signature Envelopes , 2018, 2019 IEEE Radar Conference (RadarConf).

[21]  Wenbing Tao,et al.  Radar-based fall detection based on Doppler time-frequency signatures for assisted living , 2015 .

[22]  Yang Li,et al.  Measurement and analysis of human micro-Doppler features in foliaged environments , 2016, 2016 Texas Symposium on Wireless and Microwave Circuits and Systems (WMCS).

[23]  Kenshi Saho,et al.  Remote Assessment of Gait Deterioration Due to Memory Impairment in Elderly Adults Using Micro-Doppler Radar , 2018, 2018 IEEE 18th International Conference on Bioinformatics and Bioengineering (BIBE).

[24]  Alexander Charlish,et al.  Micro-Doppler based detection and tracking of UAVs with multistatic radar , 2016, 2016 IEEE Radar Conference (RadarConf).

[25]  Yiran Li,et al.  Gesture recognition for smart home applications using portable radar sensors , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Allen M. Waxman,et al.  Acoustic Micro-Doppler Gait Signatures of Humans and Animals , 2007, 2007 41st Annual Conference on Information Sciences and Systems.

[27]  Boualem Boashash,et al.  Wideband radar based fall motion detection for a generic elderly , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[28]  Hao Lv,et al.  Detection and Classification of Finer-Grained Human Activities Based on Stepped-Frequency Continuous-Wave Through-Wall Radar , 2016, Sensors.

[29]  Kenshi Saho,et al.  Using Micro-Doppler Radar to Measure Gait Features Associated With Cognitive Functions in Elderly Adults , 2019, IEEE Access.

[30]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[31]  Dave Tahmoush,et al.  Remote detection of humans and animals , 2009, 2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).

[32]  Traian Dogaru,et al.  Doppler Processing with Ultra-wideband (UWB) Impulse Radar , 2013 .

[33]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[34]  M. Bradley,et al.  Extraction of the velocity of walking human's body segments using ultrasonic Doppler. , 2010, The Journal of the Acoustical Society of America.

[35]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[36]  Moeness G. Amin,et al.  Radar Data Cube Analysis for Fall Detection , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[37]  Hao Ling,et al.  Microdoppler signature simulation of computer animated human and animal motions , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[38]  Francesco Fioranelli,et al.  Classification of loaded/unloaded micro-drones using multistatic radar , 2015 .

[39]  Moeness G. Amin,et al.  Radar Data Cube Processing for Human Activity Recognition Using Multisubspace Learning , 2019, IEEE Transactions on Aerospace and Electronic Systems.

[40]  Kenshi Saho,et al.  Gait Classification of Healthy Young and Elderly Adults Using Micro-Doppler Radar Remote Sensing , 2018, 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS).

[41]  Ram M. Narayanan,et al.  Radar micro-Doppler signatures of various human activities , 2015 .

[42]  Abdelhak M. Zoubir,et al.  Radar-based human gait recognition in cane-assisted walks , 2017, 2017 IEEE Radar Conference (RadarConf).

[43]  J. Högbom,et al.  APERTURE SYNTHESIS WITH A NON-REGULAR DISTRIBUTION OF INTERFEROMETER BASELINES. Commentary , 1974 .

[44]  Vinh Dang,et al.  Analysis of Moving Human Micro-Doppler Signature in Forest Environments , 2014 .

[45]  Helge Langen,et al.  Ultra-Wideband Radar Simulator for classifying Humans and Animals based on Micro-Doppler Signatures , 2016 .

[46]  Abdelhak M. Zoubir,et al.  New analysis of radar micro-Doppler gait signatures for rehabilitation and assisted living , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  A. Waxman,et al.  Acoustic micro-Doppler radar for human gait imaging. , 2007, The Journal of the Acoustical Society of America.

[48]  Gang Li,et al.  Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[49]  Moeness Amin,et al.  Generalized PCA Fusion for Improved Radar Human Motion Recognition , 2019, 2019 IEEE Radar Conference (RadarConf).

[50]  M. Bradley,et al.  Classification of Animals and People Ultrasonic Signatures , 2013, IEEE Sensors Journal.

[51]  Francesco Fioranelli,et al.  Multistatic human micro-Doppler classification of armed/unarmed personnel , 2015 .

[52]  G. E. Smith,et al.  Combined high range resolution and micro-Doppler analysis of human gait , 2015, 2015 IEEE Radar Conference (RadarCon).

[53]  Vinh Dang,et al.  Detection of moving human micro‐Doppler signature in forest environments with swaying tree components by wind , 2015 .

[54]  Zhao Li,et al.  Wavelet Based human target detection in complex ruins using a low center frequency UWB radar , 2016, 2016 Progress in Electromagnetic Research Symposium (PIERS).

[55]  Zhengxin Zeng,et al.  Automatic Arm Motion Recognition Based on Radar Micro-Doppler Signature Envelopes , 2019, IEEE Sensors Journal.

[56]  David Tahmoush,et al.  Radar micro-doppler signatures , 2014 .

[57]  J. J. M. de Wit,et al.  Classification of small UAVs and birds by micro-Doppler signatures , 2013, 2013 European Radar Conference.

[58]  Bin Yang,et al.  Towards Adversarial Denoising of Radar Micro-Doppler Signatures , 2018, 2019 International Radar Conference (RADAR).

[59]  Youngwook Kim,et al.  Human Detection Using Doppler Radar Based on Physical Characteristics of Targets , 2015, IEEE Geoscience and Remote Sensing Letters.

[60]  Anders Liland,et al.  A radar simulator for generating micro-Doppler datasets to be used for Automatic Target Recognition , 2018 .

[61]  Meng Li,et al.  Detection of multi‐people micro‐motions based on range–velocity–time points , 2019, Electronics Letters.

[62]  Wenji Zhang,et al.  Range Coherence Factor for Down Range Sidelobes Suppression in Radar Imaging Through Multilayered Dielectric Media , 2019, IEEE Access.

[63]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[64]  Abdesselam Bouzerdoum,et al.  A Subspace Projection Approach for Wall Clutter Mitigation in Through-the-Wall Radar Imaging , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Carmine Clemente,et al.  Developments in target micro-Doppler signatures analysis: radar imaging, ultrasound and through-the-wall radar , 2013, EURASIP J. Adv. Signal Process..

[66]  H. Wechsler,et al.  Analysis of micro-Doppler signatures , 2003 .

[67]  Shie Qian,et al.  Joint time-frequency transform for radar range-Doppler imaging , 1998 .

[68]  Moeness G. Amin,et al.  Fall motion detection using combined range and Doppler features , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).