Human Motion Classification Based on Range Information with Deep Convolutional Neural Network

In this paper, we investigate the feasibility of recognizing human motions by high resolution range information using a deep convolutional neural network (DCNN). Most existing schemes for radar-based human motion classification exploited the handcrafted features extracted from the microdoppler signature which may be weak or indistinctive in some motions. In contrast to conventional methods, we utilize the high resolution range information to classify human motions which is more robust than the micro-doppler signature, especially when the radial velocity is not obvious, and it has a better tolerance for the incident angles. A DCNN, one of the most successful deep learning algorithms, is employed to solve the classification problem without any handcrafted features. Real data of six human subjects performing seven motions were collected using an ultra-wideband (UWB) radar with only range information. The experimental results illustrate that the DCNN can achieve an accuracy rate of 95.24% on classification of human motions based on the high resolution range information.

[1]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[2]  F. Groen,et al.  Human walking estimation with radar , 2003 .

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[5]  Oleg I. Sukharevsky,et al.  - UWB Pulse Backscattering from Objects Located near Uniform Half-Space , 2017 .

[6]  James D. Taylor,et al.  Novelda Nanoscale Impulse Radar , 2017 .

[7]  Cagatay Candan,et al.  Classification of human motion using radar micro-Doppler signatures with hidden Markov models , 2016, 2016 IEEE Radar Conference (RadarConf).

[8]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jun Zhang,et al.  Range information for reducing fall false alarms in assisted living , 2016, 2016 IEEE Radar Conference (RadarConf).

[10]  Francesco Fioranelli,et al.  Performance Analysis of Centroid and SVD Features for Personnel Recognition Using Multistatic Micro-Doppler , 2016, IEEE Geoscience and Remote Sensing Letters.

[11]  Ram M. Narayanan,et al.  Radar micro-Doppler signatures of various human activities , 2015 .

[12]  Hongwei Liu,et al.  Radar HRRP target recognition with deep networks , 2017, Pattern Recognit..

[13]  Boualem Boashash,et al.  Human gait recognition with cane assistive device using quadratic time–frequency distributions , 2015 .

[14]  Moeness G. Amin,et al.  Radar Signal Processing for Elderly Fall Detection , 2015 .

[15]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Youngwook Kim,et al.  Human Detection Using Doppler Radar Based on Physical Characteristics of Targets , 2015, IEEE Geoscience and Remote Sensing Letters.

[17]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[20]  Branka Jokanovic,et al.  Effect of data representations on deep learning in fall detection , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[21]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[22]  S. T. Gandhe,et al.  Human Action Recognition: An Overview , 2017 .

[23]  Melda Yuksel,et al.  Information-Theoretic Feature Selection for Human Micro-Doppler Signature Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.