Radar Data Cube Processing for Human Activity Recognition Using Multisubspace Learning

In recent years, radar has been employed as a fall detector because of its effective sensing capabilities and penetration through walls. In this paper, we introduce a multilinear subspace human activity recognition scheme that exploits the three radar signal variables: slow-time, fast-time, and Doppler frequency. The proposed approach attempts to find the optimum subspaces that minimize the reconstruction error for different modes of the radar data cube. A comprehensive analysis of the optimization considerations is performed, such as initialization, number of projections, and convergence of the algorithms. Finally, a boosting scheme is proposed combining the unsupervised multilinear principal component analysis (PCA) with the supervised methods of linear discriminant analysis and shallow neural networks. Experimental results based on real radar data obtained from multiple subjects, different locations, and aspect angles (0<inline-formula><tex-math notation="LaTeX">$^{\circ }$</tex-math></inline-formula>, 30<inline-formula><tex-math notation="LaTeX">$^{\circ }$</tex-math></inline-formula>, 45<inline-formula><tex-math notation="LaTeX">$^{\circ }$</tex-math></inline-formula>, 60<inline-formula><tex-math notation="LaTeX">$^{\circ }$</tex-math></inline-formula>, and 90<inline-formula><tex-math notation="LaTeX">$^{\circ }$</tex-math></inline-formula>) demonstrate that the proposed algorithm yields the highest overall classification accuracy among spectrogram-based methods including predefined physical features, one- and two-dimensional PCA and convolutional neural networks.

[1]  F. R. Dickey,et al.  Development of airborne moving target radar for long range surveillance , 1991 .

[2]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[3]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[4]  Jieping Ye,et al.  GPCA: an efficient dimension reduction scheme for image compression and retrieval , 2004, KDD.

[5]  Michael F. Otero,et al.  Application of a continuous wave radar for human gait recognition , 2005, SPIE Defense + Commercial Sensing.

[6]  Haiping Lu,et al.  Multilinear Principal Component Analysis of Tensor Objects for Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Neil Genzlinger A. and Q , 2006 .

[8]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[9]  Dong Xu,et al.  Multilinear Discriminant Analysis for Face Recognition , 2007, IEEE Transactions on Image Processing.

[10]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[11]  Bijan G. Mobasseri,et al.  A time-frequency classifier for human gait recognition , 2009, Defense + Commercial Sensing.

[12]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[14]  Liang Liu,et al.  Automatic fall detection based on Doppler radar motion signature , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[15]  Dave Tahmoush,et al.  Time-integrated range-Doppler maps for visualizing and classifying radar data , 2011, 2011 IEEE RadarCon (RADAR).

[16]  Jaakko Astola,et al.  Ground moving target classification by using DCT coefficients extracted from micro-Doppler radar signatures and artificial neuron network , 2011, 2011 MICROWAVES, RADAR AND REMOTE SENSING SYMPOSIUM.

[17]  Haiping Lu,et al.  Multilinear Subspace Learning: Dimensionality Reduction of Multidimensional Data , 2013 .

[18]  Carmine Clemente,et al.  Robust PCA micro-doppler classification using SVM on embedded systems , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Hiroyoshi Yamada,et al.  Human motion detection and extraction by using FM-CW range-Doppler radar , 2014, 2014 International Symposium on Antennas and Propagation Conference Proceedings.

[20]  J. Stevens,et al.  Circumstances and outcomes of falls among high risk community-dwelling older adults , 2014, Injury epidemiology.

[21]  Carmine Clemente,et al.  A novel algorithm for radar classification based on doppler characteristics exploiting orthogonal Pseudo-Zernike polynomials , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[22]  Abdesselam Bouzerdoum,et al.  Classification of micro-Doppler signatures of human motions using log-Gabor filters , 2015 .

[23]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[24]  Marjorie Skubic,et al.  Doppler Radar Fall Activity Detection Using the Wavelet Transform , 2015, IEEE Transactions on Biomedical Engineering.

[25]  Yuan He,et al.  Range-Doppler surface: a tool to analyse human target in ultra-wideband radar , 2015 .

[26]  Alessio Balleri,et al.  Recognition of humans based on radar micro-Doppler shape spectrum features , 2015 .

[27]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[28]  Boualem Boashash,et al.  Radar fall detection using principal component analysis , 2016, SPIE Defense + Security.

[29]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[30]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[31]  Moeness G. Amin,et al.  Diversified radar micro-Doppler simulations as training data for deep residual neural networks , 2018, 2018 IEEE Radar Conference (RadarConf18).

[32]  Moeness Amin,et al.  Fall Detection Using Deep Learning in Range-Doppler Radars , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[33]  Abdelhak M. Zoubir,et al.  Subspace Classification of Human Gait Using Radar Micro-Doppler Signatures , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).