YOLO-Based Simultaneous Target Detection and Classification in Automotive FMCW Radar Systems

This paper proposes a method to simultaneously detect and classify objects by using a deep learning model, specifically you only look once (YOLO), with pre-processed automotive radar signals. In conventional methods, the detection and classification in automotive radar systems are conducted in two successive stages; however, in the proposed method, the two stages are combined into one. To verify the effectiveness of the proposed method, we applied it to the actual radar data measured using our automotive radar sensor. According to the results, our proposed method can simultaneously detect targets and classify them with over 90% accuracy. In addition, it shows better performance in terms of detection and classification, compared with conventional methods such as density-based spatial clustering of applications with noise or the support vector machine. Moreover, the proposed method especially exhibits better performance when detecting and classifying a vehicle with a long body.

[1]  Haopeng Li,et al.  Object Detection and 3d Estimation Via an FMCW Radar Using a Fully Convolutional Network , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Igal Bilik,et al.  Application of a 24 GHz FMCW automotive radar for urban target classification , 2014, 2014 IEEE Radar Conference.

[3]  H. Rohling,et al.  OS CFAR performance in a 77 GHz radar sensor for car application , 1996, Proceedings of International Radar Conference.

[4]  Seong-Ook Park,et al.  Drone Classification Using Convolutional Neural Networks With Merged Doppler Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[5]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[6]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[7]  Murat Torlak,et al.  Automotive Radars: A review of signal processing techniques , 2017, IEEE Signal Processing Magazine.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Seong-Cheol Kim,et al.  Human–vehicle classification using feature-based SVM in 77-GHz automotive FMCW radar , 2017 .

[10]  Seong-Cheol Kim,et al.  Enhanced Performance of MUSIC Algorithm Using Spatial Interpolation in Automotive FMCW Radar Systems , 2018, IEICE Trans. Commun..

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Naoufel Werghi,et al.  Ground Moving Radar Targets Classification Based on Spectrogram Images Using Convolutional Neural Networks , 2018, 2018 19th International Radar Symposium (IRS).

[13]  Wei Ding,et al.  YOLO-RD: A lightweight object detection network for range doppler radar images , 2019, IOP Conference Series: Materials Science and Engineering.

[14]  Seong-Cheol Kim,et al.  Two-stage DOA estimation method for low SNR signals in automotive radars , 2017 .

[15]  Seong-Cheol Kim,et al.  Statistical Characteristic-Based Road Structure Recognition in Automotive FMCW Radar Systems , 2019, IEEE Transactions on Intelligent Transportation Systems.

[16]  Seong-Cheol Kim,et al.  Road structure classification through artificial neural network for automotive radar systems , 2019 .

[17]  S. Liaqat,et al.  Automatic recognition of ground radar targets based on target RCS and short time spectrum variance , 2011, 2011 International Symposium on Innovations in Intelligent Systems and Applications.

[18]  Erwin Biebl,et al.  Deep Learning Radar Object Detection and Classification for Urban Automotive Scenarios , 2019, 2019 Kleinheubach Conference.

[19]  Seong-Cheol Kim,et al.  Phase-Based Target Classification Using Neural Network in Automotive Radar Systems , 2019, 2019 IEEE Radar Conference (RadarConf).

[20]  Martin Schneider,et al.  Automotive Radar – Status and Trends , 2005 .

[21]  Seong-Cheol Kim,et al.  Modulation type classification of interference signals in automotive radar systems , 2019, IET Radar, Sonar & Navigation.

[22]  Seong-Cheol Kim,et al.  Clustering of Detected Targets Using DBSCAN in Automotive Radar Systems , 2018, 2018 19th International Radar Symposium (IRS).

[23]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  Seong-Ook Park,et al.  Experimental Analysis of Small Drone Polarimetry Based on Micro-Doppler Signature , 2017, IEEE Geoscience and Remote Sensing Letters.

[26]  Seong-Cheol Kim,et al.  Enhanced Iron-Tunnel Recognition for Automotive Radars , 2016, IEEE Transactions on Vehicular Technology.

[27]  M. Malanowski,et al.  Micro-range, micro-Doppler joint analysis of pedestrian radar echo , 2015, 2015 Signal Processing Symposium (SPSympo).

[28]  W. J. Fleming,et al.  Overview of automotive sensors , 2001 .

[29]  Seong-Cheol Kim,et al.  Logarithmic-Domain Array Interpolation for Improved Direction of Arrival Estimation in Automotive Radars , 2019, Sensors.