Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar

Radar-based human motion recognition is crucial for many applications, such as surveillance, search and rescue operations, smart homes, and assisted living. Continuous human motion recognition in real-living environment is necessary for practical deployment, i.e., classification of a sequence of activities transitioning one into another, rather than individual activities. In this paper, a novel dynamic range-Doppler trajectory (DRDT) method based on the frequency-modulated continuous-wave (FMCW) radar system is proposed to recognize continuous human motions with various conditions emulating real-living environment. This method can separate continuous motions and process them as single events. First, range-Doppler frames consisting of a series of range-Doppler maps are obtained from the backscattered signals. Next, the DRDT is extracted from these frames to monitor human motions in time, range, and Doppler domains in real time. Then, a peak search method is applied to locate and separate each human motion from the DRDT map. Finally, range, Doppler, radar cross section (RCS), and dispersion features are extracted and combined in a multidomain fusion approach as inputs to a machine learning classifier. This achieves accurate and robust recognition even in various conditions of distance, view angle, direction, and individual diversity. Extensive experiments have been conducted to show its feasibility and superiority by obtaining an average accuracy of 91.9% on continuous classification.

[1]  Antonio I Cuesta-Vargas,et al.  The use of inertial sensors system for human motion analysis , 2010, Physical therapy reviews : PTR.

[2]  Youngwook Kim,et al.  Application of ultra-wide band radar for classification of human activities , 2012 .

[3]  Xiaohua Zhu,et al.  Non-Contact Human Motion Recognition Based on UWB Radar , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[4]  Aly E. Fathy,et al.  Contactless monitoring and classification of human motion activities by using SFCW radar , 2016, 2016 IEEE International Symposium on Antennas and Propagation (APSURSI).

[5]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[6]  Melda Yuksel,et al.  Information-Theoretic Feature Selection for Human Micro-Doppler Signature Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Changzhi Li,et al.  FMCW radar fall detection based on ISAR processing utilizing the properties of RCS, range, and Doppler , 2016, 2016 IEEE MTT-S International Microwave Symposium (IMS).

[8]  Unver Kaynak,et al.  Design study of a short-range airborne UAV radar for human monitoring , 2014, 2014 48th Asilomar Conference on Signals, Systems and Computers.

[9]  Ennio Gambi,et al.  Radar and RGB-Depth Sensors for Fall Detection: A Review , 2017, IEEE Sensors Journal.

[10]  Tin Kam Ho,et al.  Nearest Neighbors in Random Subspaces , 1998, SSPR/SPR.

[11]  Branka Jokanovic,et al.  Radar fall motion detection using deep learning , 2016, 2016 IEEE Radar Conference (RadarConf).

[12]  Yiran Li,et al.  Potential Active Shooter Detection Based on Radar Micro-Doppler and Range-Doppler Analysis Using Artificial Neural Network , 2019, IEEE Sensors Journal.

[13]  André Bourdoux,et al.  Indoor Person Identification Using a Low-Power FMCW Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  M. Amin Through-the-Wall Radar Imaging , 2011 .

[15]  Changzhi Li,et al.  Remote Blind Motion Separation Using a Single-Tone SIMO Doppler Radar Sensor , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  S. Z. Gürbüz,et al.  Deep convolutional autoencoder for radar-based classification of similar aided and unaided human activities , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Victor C. Chen,et al.  Doppler signatures of radar backscattering from objects with micro-motions , 2008 .

[18]  Yazhou Wang,et al.  CW and Pulse–Doppler Radar Processing Based on FPGA for Human Sensing Applications , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Francesco Fioranelli,et al.  Classification of Unarmed/Armed Personnel Using the NetRAD Multistatic Radar for Micro-Doppler and Singular Value Decomposition Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[21]  F. Fioranelli,et al.  Human Activity Classification With Radar: Optimization and Noise Robustness With Iterative Convolutional Neural Networks Followed With Random Forests , 2018, IEEE Sensors Journal.

[22]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Marjorie Skubic,et al.  Doppler Radar Fall Activity Detection Using the Wavelet Transform , 2015, IEEE Transactions on Biomedical Engineering.

[24]  Changzhan Gu,et al.  A Hybrid FMCW-Interferometry Radar for Indoor Precise Positioning and Versatile Life Activity Monitoring , 2014, IEEE Transactions on Microwave Theory and Techniques.

[25]  Aly E. Fathy,et al.  Phase based motion characteristics measurement for fall detection by using stepped-frequency continuous wave radar , 2016, 2016 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems (BioWireleSS).

[26]  Gang Li,et al.  Classification of Personnel Targets with Baggage Using Dual-band Radar , 2017, Remote. Sens..

[27]  Igal Bilik,et al.  Pedestrian motion direction estimation using simulated automotive MIMO radar , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[28]  G. Bergen,et al.  Falls and Fall Injuries Among Adults Aged ≥65 Years - United States, 2014. , 2016, MMWR. Morbidity and mortality weekly report.

[29]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[30]  J. Nicolas,et al.  Radar high resolution range & micro-Doppler analysis of human motions , 2009, 2009 International Radar Conference "Surveillance for a Safer World" (RADAR 2009).

[31]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[32]  Ram M. Narayanan,et al.  A Portable Real-Time Digital Noise Radar System for Through-the-Wall Imaging , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[34]  Moeness G. Amin,et al.  Radar Data Cube Analysis for Fall Detection , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).