Omnidirectional Motion Classification With Monostatic Radar System Using Micro-Doppler Signatures

In remote sensing, micro-Doppler signatures are widely used in moving target detection and automatic target recognition. However, since Doppler signatures are easily affected by the moving direction of the target, prior information of aspect angle is essential for spectral analysis. Thus, a micro-Doppler-based classifier is considered to be “angle-sensitive.” In this article, we propose an angle-insensitive classifier for the omnidirectional classification problem using the monostatic radar through a proposed new convolutional neural network. We further provide a sensible definition of “angle sensitivity,” and perform experiments on two data sets obtained through simulations and measurements. The results demonstrate that the proposed algorithm outperforms both feature-based and existing deep-learning-based counterparts, and resolve the issue of angle sensitivity in micro-Doppler-based classification.

[1]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jürgen Beyerer,et al.  Low Resolution Person Detection with a Moving Thermal Infrared Camera by Hot Spot Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[4]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Yuan He,et al.  Person Identification Using Micro-Doppler Signatures of Human Motions and UWB Radar , 2019, IEEE Microwave and Wireless Components Letters.

[7]  Alexander Charlish,et al.  Micro-Doppler based detection and tracking of UAVs with multistatic radar , 2016, 2016 IEEE Radar Conference (RadarConf).

[8]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[9]  Youngwook Kim,et al.  Micro-Doppler Based Classification of Human Aquatic Activities via Transfer Learning of Convolutional Neural Networks , 2016, Sensors.

[10]  Melda Yuksel,et al.  Information-Theoretic Feature Selection for Human Micro-Doppler Signature Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[12]  Zhouchen Lin,et al.  Convolutional Neural Networks with Alternately Updated Clique , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Carmine Clemente,et al.  'The Micro-Doppler Effect in Radar' by V.C. Chen , 2012 .

[14]  Yang Yang,et al.  Unsupervised Domain Adaptation for Micro-Doppler Human Motion Classification via Feature Fusion , 2019, IEEE Geoscience and Remote Sensing Letters.

[15]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[16]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[17]  Eugene F. Greneker,et al.  High-resolution Doppler model of the human gait , 2002, SPIE Defense + Commercial Sensing.

[18]  Youngwook Kim,et al.  Classification of human activity on water through micro-Dopplers using deep convolutional neural networks , 2016, SPIE Defense + Security.

[19]  André Bourdoux,et al.  Indoor Person Identification Using a Low-Power FMCW Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Ramakant Nevatia,et al.  Pedestrian Detection in Infrared Images based on Local Shape Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Byung-Tak Lee,et al.  Object classification of UWB responses using S T-CNN , 2016, 2016 International Conference on Information and Communication Technology Convergence (ICTC).

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Branka Jokanovic,et al.  Radar fall motion detection using deep learning , 2016, 2016 IEEE Radar Conference (RadarConf).

[25]  Hugh Griffiths,et al.  Multistatic micro-Doppler radar signatures of personnel targets , 2010 .

[26]  Francesco Fioranelli,et al.  Feature Diversity for Optimized Human Micro-Doppler Classification Using Multistatic Radar , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[27]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[28]  Limin Wang,et al.  Action recognition with trajectory-pooled deep-convolutional descriptors , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  A. Cohen,et al.  GMM-based target classification for ground surveillance Doppler radar , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[30]  David J. Edwards,et al.  Ultra-wideband : antennas and propagation for communications, radar and imaging , 2006 .

[31]  Graeme E. Smith,et al.  Through-the-Wall Sensing of Personnel Using Passive Bistatic WiFi Radar at Standoff Distances , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Visa Koivunen,et al.  Deep learning for HRRP-based target recognition in multistatic radar systems , 2016, 2016 IEEE Radar Conference (RadarConf).

[34]  Ali Cafer Gürbüz,et al.  Knowledge Exploitation for Human Micro-Doppler Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[35]  Francesco Fioranelli,et al.  Multistatic human micro-Doppler classification of armed/unarmed personnel , 2015 .

[36]  Chunping Hou,et al.  Open-set human activity recognition based on micro-Doppler signatures , 2019, Pattern Recognit..

[37]  Victor C. Chen,et al.  Analysis of radar micro-Doppler with time-frequency transform , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[38]  Francesco Fioranelli,et al.  Aspect angle dependence and multistatic data fusion for micro-Doppler classification of armed/unarmed personnel , 2015 .

[39]  Ram M. Narayanan,et al.  Classification of human motions using empirical mode decomposition of human micro-Doppler signatures , 2014 .

[40]  Antonio De Maio,et al.  Knowledge-Based recursive Least Squares techniques for heterogeneous clutter suppression , 2006, 2006 14th European Signal Processing Conference.

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  David Tahmoush,et al.  Recognizing and tracking humans and vehicles using radar , 2010, Electronic Imaging.

[43]  Tyler S. Jordan,et al.  Using convolutional neural networks for human activity classification on micro-Doppler radar spectrograms , 2016, SPIE Defense + Security.

[44]  Yuan He,et al.  Range-Doppler surface: a tool to analyse human target in ultra-wideband radar , 2015 .

[45]  Hao Ling,et al.  Human activity classification based on micro-Doppler signatures using an artificial neural network , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[46]  Cordelia Schmid,et al.  Action Recognition with Improved Trajectories , 2013, 2013 IEEE International Conference on Computer Vision.

[47]  Luc Van Gool,et al.  UntrimmedNets for Weakly Supervised Action Recognition and Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Andreas G. Andreou,et al.  Multimodal Integration of Micro-Doppler Sonar and auditory signals for Behavior Classification with convolutional Networks , 2013, Int. J. Neural Syst..

[49]  Bahri Cagliyan,et al.  Micro-Doppler-Based Human Activity Classification Using the Mote-Scale BumbleBee Radar , 2015, IEEE Geoscience and Remote Sensing Letters.

[50]  Hongwei Liu,et al.  Radar HRRP target recognition with deep networks , 2017, Pattern Recognit..

[51]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[52]  Xiang Zhang,et al.  Character-level Convolutional Networks for Text Classification , 2015, NIPS.

[53]  Francesco Fioranelli,et al.  Classification of Unarmed/Armed Personnel Using the NetRAD Multistatic Radar for Micro-Doppler and Singular Value Decomposition Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[54]  Ram M. Narayanan,et al.  Multistatic micro-doppler radar for determining target orientation and activity classification , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[55]  Ram M. Narayanan,et al.  Radar micro-Doppler signatures of various human activities , 2015 .

[56]  Michael F. Otero,et al.  Application of a continuous wave radar for human gait recognition , 2005, SPIE Defense + Commercial Sensing.

[57]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[58]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[60]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[61]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Bowen Zhang,et al.  Real-Time Action Recognition with Enhanced Motion Vector CNNs , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  Seong-Ook Park,et al.  Drone Classification Using Convolutional Neural Networks With Merged Doppler Images , 2017, IEEE Geoscience and Remote Sensing Letters.