Road Environment Recognition for Automotive FMCW RADAR Systems Through Convolutional Neural Network

In this study, we propose a method to recognize road environments with automotive frequency-modulated continuous wave (FMCW) radar systems. For automotive radar systems on the road, diverse road environments are observed. Each road environment generates unnecessary echoes known as clutter, and the magnitude distribution of received radar signal varies depending on road structures. Therefore, it is necessary to classify the road environment and adopt a target detection algorithm suitable for each road environment characteristic. To recognize the road environment in advance, it is necessary to identify the section where the road environment changes. In this paper, we define a changed road area as a transition region, and we classify the road environment and transition regions to improve the road environment recognition performance. Road environments are recognized by applying convolutional neural networks to the frequency-domain received signals of 77 GHz FMCW automotive radar systems. Experimental results in real-road environments demonstrate that the proposed method achieves 100% recognition performance, which is better if compared with that of the conventional methods.

[1]  Klaus C. J. Dietmayer,et al.  Radar-interference-based bridge identification for collision avoidance systems , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[2]  W. D. Jones,et al.  Keeping cars from crashing , 2001 .

[3]  Seong-Cheol Kim,et al.  High-Density Clutter Recognition and Suppression for Automotive Radar Systems , 2019, IEEE Access.

[4]  Werner Wiesbeck,et al.  Impact of road surfaces on millimeter-wave propagation , 2000, IEEE Trans. Veh. Technol..

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  L. L. Nagy.  Electromagnetic reflectivity characteristics of road surfaces , 1974 .

[7]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[8]  Seong-Cheol Kim,et al.  Harmonic clutter recognition and suppression for automotive radar sensors , 2017, Int. J. Distributed Sens. Networks.

[9]  T. Zwick,et al.  Millimeter-Wave Technology for Automotive Radar Sensors in the 77 GHz Frequency Band , 2012, IEEE Transactions on Microwave Theory and Techniques.

[10]  Seong-Cheol Kim,et al.  Periodic clutter suppression in iron road structures for automotive radar systems , 2018 .

[11]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[12]  Hongqiang Wang,et al.  Enhanced Radar Imaging Using a Complex-Valued Convolutional Neural Network , 2019, IEEE Geoscience and Remote Sensing Letters.

[13]  Christian Lundquist,et al.  Tracking stationary extended objects for road mapping using radar measurements , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[14]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[15]  W. Burnside,et al.  A uniform GTD analysis of the diffraction of electromagnetic waves by a smooth convex surface , 1980 .

[16]  Erich Fuchs,et al.  Road boundary detection for run-off road prevention based on the fusion of video and radar , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[17]  Tie Jun Cui,et al.  Deep Learning of Raw Radar Echoes for Target Recognition , 2018, 2018 IEEE International Conference on Computational Electromagnetics (ICCEM).

[18]  Seong-Cheol Kim,et al.  Statistical Characteristic-Based Road Structure Recognition in Automotive FMCW Radar Systems , 2019, IEEE Transactions on Intelligent Transportation Systems.

[19]  Ville Viikari,et al.  Road-Condition Recognition Using 24-GHz Automotive Radar , 2009, IEEE Transactions on Intelligent Transportation Systems.

[20]  Seong-Cheol Kim,et al.  Road structure classification through artificial neural network for automotive radar systems , 2019 .

[21]  Seong-Cheol Kim,et al.  Enhanced Iron-Tunnel Recognition for Automotive Radars , 2016, IEEE Transactions on Vehicular Technology.

[22]  Wei Yi,et al.  Performance prediction of OS-CFAR for generalized swerling-chi fluctuating targets , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Seung-Hyun Kong,et al.  Automatic LPI Radar Waveform Recognition Using CNN , 2018, IEEE Access.

[24]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[25]  Matthew D. Zeiler.  ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Gary Minkler,et al.  Cfar: The Principles of Automatic Radar Detection in Clutter , 1990 .

[28]  Martin Schneider,et al.  Automotive Radar – Status and Trends , 2005 .

[29]  H. Rohling,et al.  Waveform design principles for automotive radar systems , 2001, 2001 CIE International Conference on Radar Proceedings (Cat No.01TH8559).