Cross-Frequency Classification of Indoor Activities with DNN Transfer Learning

Remote, non-contact recognition of human motion and activities is central to health monitoring in assisted living facilities, but current systems face the problems of training compatibility, minimal training data sets and a lack of interoperability between radar sensors at different frequencies. This paper represents a first work to consider the efficacy of deep neural networks (DNNs) and transfer learning to bridge the gap in phenomenology that results when multiple types of radars simultaneously observe human activity. Six different human activities are recorded indoors simultaneously with 5.8 GHz and 25 GHz radars. Firstly, the bottleneck feature performance of the DNNs show that a baseline of 76% is achieved. On models trained only with 25 GHz data when 5.8 GHz data is used for testing 81% accuracy is achieved. in absence of a large dataset for radar at a certain frequency, we demonstrate information from a different frequency radar is better suited for generating the classification models than optical images and by using time-velocity diagrams (TVD), a degree of interoperability can be achieved.

[1]  S. Z. Gürbüz,et al.  Deep Neural Network Initialization Methods for Micro-Doppler Classification With Low Training Sample Support , 2017, IEEE Geoscience and Remote Sensing Letters.

[2]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[3]  Shobha Sundar Ram,et al.  Dictionary Learning With Low Computational Complexity for Classification of Human Micro-Dopplers Across Multiple Carrier Frequencies , 2018, IEEE Access.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Francesco Fioranelli,et al.  Practical classification of different moving targets using automotive radar and deep neural networks , 2018, IET Radar, Sonar & Navigation.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Francesco Fioranelli,et al.  Multistatic radar classification of armed vs unarmed personnel using neural networks , 2018, Evol. Syst..

[11]  Moeness G. Amin,et al.  Diversified radar micro-Doppler simulations as training data for deep residual neural networks , 2018, 2018 IEEE Radar Conference (RadarConf18).

[12]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[13]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[14]  Ennio Gambi,et al.  Radar and RGB-Depth Sensors for Fall Detection: A Review , 2017, IEEE Sensors Journal.

[15]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Hadi Heidari,et al.  A Multisensory Approach for Remote Health Monitoring of Older People , 2018, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[17]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[18]  Carmine Clemente,et al.  'The Micro-Doppler Effect in Radar' by V.C. Chen , 2012 .