Activity Classification Using Raw Range and I & Q Radar Data with Long Short Term Memory Layers

This paper presents the first initial results of using radar raw I & Q data and range profiles combined with Long Short Term Memory layers to classify human activities. Although tested only on simple classification problems, this is an innovative approach that enables to bypass the conventional usage of Doppler-time patterns (spectrograms) as inputs of the Long Short Term Memory layers, and adopt instead sequences of range profiles or even raw complex data as inputs. A maximum 99.56% accuracy and a mean accuracy of 97.67% was achieved by treating the radar data as these time sequences, in an effective scheme using a deep learning approach that did not require the pre-processing of the radar data to generate spectrograms and treat them as images. The prediction time needed for a given input testing sample is also reported, showing a promising path for real-time implementation once the Long Short Term Memory layers network is properly trained.

[1]  Gang Li,et al.  Model-based sparse recovery method for automatic classification of helicopters , 2015, 2015 IEEE Radar Conference (RadarCon).

[2]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Moeness Amin,et al.  Fall Detection Using Deep Learning in Range-Doppler Radars , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  Gang Li,et al.  Micro-Doppler Parameter Estimation via Parametric Sparse Representation and Pruned Orthogonal Matching Pursuit , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Gang Li,et al.  Label Consistent K-SVD for sparse micro-Doppler classification , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[8]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[9]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[10]  H. Robbins A Stochastic Approximation Method , 1951 .

[11]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[12]  Francesco Fioranelli,et al.  Feature Diversity for Optimized Human Micro-Doppler Classification Using Multistatic Radar , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Ennio Gambi,et al.  Radar and RGB-Depth Sensors for Fall Detection: A Review , 2017, IEEE Sensors Journal.

[14]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[15]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.