Real-Time Human Motion Behavior Detection via CNN Using mmWave Radar

A real-time behavior detection system using millimeter wave radar is presented in this article. Radar is used to sense the micro-Doppler information of targets. A convolution neural network (CNN) is further implemented in the detection and classification of the human motion behaviors using this information. Both the convolution layers and architecture of CNNs are presented. The analysis on loss and accuracy of training results is also shown. The experimental result indicates a precise determination of human motion behavior detection using the proposed system.

[1]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[2]  Karl Woodbridge,et al.  Radar Micro-Doppler Signature Classification using Dynamic Time Warping , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Abdelhak M. Zoubir,et al.  Radar classification of human gait abnormality based on sum-of-harmonics analysis , 2018, 2018 IEEE Radar Conference (RadarConf18).

[4]  M. Shamim Hossain,et al.  Patient status monitoring for smart home healthcare , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[5]  Ashish Kumar Singh,et al.  Analysis of Human Kinetics Using Millimeter-Wave Micro-Doppler Radar , 2015, IHCI.

[6]  E. Skafidas,et al.  Consumer radar: Opportunities and challenges , 2014, 2014 11th European Radar Conference.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  T. Zwick,et al.  Millimeter-Wave Technology for Automotive Radar Sensors in the 77 GHz Frequency Band , 2012, IEEE Transactions on Microwave Theory and Techniques.

[9]  Chi-Chih Chen,et al.  Micro-Doppler characteristics of pedestrians and bicycles for automotive radar sensors at 77 GHz , 2017, 2017 11th European Conference on Antennas and Propagation (EUCAP).

[10]  Yuichi Motai,et al.  Human Behavior-Based Target Tracking With an Omni-Directional Thermal Camera , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[11]  Thomas Wagner,et al.  Radar Signal Processing for Jointly Estimating Tracks and Micro-Doppler Signatures , 2017, IEEE Access.

[12]  Ennio Gambi,et al.  Feature diversity for fall detection and human indoor activities classification using radar systems , 2017 .

[13]  Dominique Schreurs,et al.  Radar-Based Health Monitoring , 2013, 2013 IEEE MTT-S International Microwave Workshop Series on RF and Wireless Technologies for Biomedical and Healthcare Applications (IMWS-BIO).

[14]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  S. Stanko,et al.  Synthetic aperture radar at millimeter wavelength for UAV surveillance applications , 2015, 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI).