A Deep Multi-task Network for Activity Classification and Person Identification with Micro-Doppler Signatures

In prior work, both person identification and activity classification in radar have been investigated. In this paper, we go one step beyond separate radar-based person identification and activity classification by proposing a deep multi-task network to complete the two tasks simultaneously. MOCAP dataset, from Carnegie Mellon University, is used for micro-Doppler signatures simulation. Six activities performed by six persons are adopted. 99.54% activity classification accuracy and 96.25% person identification accuracy is achieved with the network. To understand the networks impact on performance, ablation study is performed and experiment shows that each component in the network can facilitate the multi-task learning.

[1]  H. Wechsler,et al.  Micro-Doppler effect in radar: phenomenon, model, and simulation study , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[2]  Andrea Cavallaro,et al.  Online Cross-Modal Adaptation for Audio–Visual Person Identification With Wearable Cameras , 2017, IEEE Transactions on Human-Machine Systems.

[3]  Carmine Clemente,et al.  Developments in target micro-Doppler signatures analysis: radar imaging, ultrasound and through-the-wall radar , 2013, EURASIP J. Adv. Signal Process..

[4]  Luc Van Gool,et al.  Temporal Segment Networks: Towards Good Practices for Deep Action Recognition , 2016, ECCV.

[5]  Larry S. Davis,et al.  Multi-Task Learning with Low Rank Attribute Embedding for Person Re-Identification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  J. Nicolas,et al.  Radar high resolution range & micro-Doppler analysis of human motions , 2009, 2009 International Radar Conference "Surveillance for a Safer World" (RADAR 2009).

[7]  Mohan S. Kankanhalli,et al.  Hierarchical Clustering Multi-Task Learning for Joint Human Action Grouping and Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[9]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[10]  Yuan He,et al.  Range-Doppler surface: a tool to analyse human target in ultra-wideband radar , 2015 .

[11]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Subramanian Ramanathan,et al.  A Multi-Task Learning Framework for Head Pose Estimation under Target Motion , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  André Bourdoux,et al.  Indoor Person Identification Using a Low-Power FMCW Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.