An algorithm for detecting roads and obstacles in radar images

This paper describes an algorithm for detecting roads and obstacles in radar data taken from a millimeter-wave imaging platform mounted on a stationary automobile. Such an algorithm is useful in a system that provides all-weather driving assistance. Road boundaries are detected first. The prior shape of the road boundaries is modeled as a deformable template that describes the road edges in terms of its curvature, orientation, and offset. This template is matched to the underlying gradient field of the radar data using a new criterion. The Metropolis algorithm is used to deform the template so that it "best" matches the underlying gradient field. Obstacles are detected next. The radar returns from image pixels that are identified as being part of the road are processed again, and their power levels are compared to a threshold. Pixels belonging to the road that return a significant (greater than a fixed threshold) amount of incident radar power are identified as potential obstacles. The performance of the algorithm on a large all-weather data set is documented. The road edges and obstacles detected are consistently close to ground truth over the entire data set. A new method for computing the gradient field of radar data is also reported, along with an exposition of the millimeter-wave radar imaging process from a signal-processing perspective.

[1]  Sridhar Lakshmanan,et al.  A Deformable Template Approach to Detecting Straight Edges in Radar Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[3]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Anil K. Jain,et al.  Vehicle segmentation using deformable templates , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[5]  Franz-Jose Tospann,et al.  Multifunction 35-GHz FMCW radar with frequency scanning antenna for synthetic vision applications , 1995, Defense, Security, and Sensing.

[6]  Dirk Langer,et al.  An integrated MMW radar system for outdoor navigation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[7]  E. Lissel,et al.  77 GHz radar sensor for car application , 1995, Proceedings International Radar Conference.

[8]  P. Green Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[9]  Kamal Sarabandi,et al.  Measurement and modeling of the millimeter-wave backscatter response of soil surfaces , 1996, IEEE Trans. Geosci. Remote. Sens..

[10]  Yoshio Yamaguchi,et al.  Using a van-mounted FM-CW radar to detect corner-reflector road-boundary markers , 1996 .

[11]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Anil K. Jain,et al.  Vehicle Segmentation and Classification Using Deformable Templates , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Anil K. Jain,et al.  Detecting straight edges in millimeter-wave images , 1995, Proceedings., International Conference on Image Processing.

[14]  Anil K. Jain,et al.  Object Matching Using Deformable Templates , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Karl C. Kluge,et al.  Extracting road curvature and orientation from image edge points without perceptual grouping into features , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[16]  J. D. Woll VORAD collision warning radar , 1995, Proceedings International Radar Conference.

[17]  Theodore O. Grosch,et al.  24-GHz frequency modulated/continuous wave automotive radar designed for collision warning , 1995, Other Conferences.

[18]  M. Nikolova,et al.  Segmentation of road edges from a vehicle-mounted imaging radar , 1998, Ninth IEEE Signal Processing Workshop on Statistical Signal and Array Processing (Cat. No.98TH8381).

[19]  E.S. Li,et al.  Characterization of optimum polarization for multiple target discrimination using genetic algorithms , 1997, IEEE Antennas and Propagation Society International Symposium 1997. Digest.

[20]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[21]  Sridhar Lakshmanan,et al.  CLARK: a heterogeneous sensor fusion method for finding lanes and obstacles , 2000, Image Vis. Comput..

[22]  Kamal Sarabandi,et al.  Semi-empirical model for radar backscatter from snow at 35 and 95 GHz , 1996, IEEE Trans. Geosci. Remote. Sens..

[23]  U. Grenander,et al.  Structural Image Restoration through Deformable Templates , 1991 .

[24]  L. Q. Bui,et al.  94 GHz FMCW radar for low visibility aircraft landing system , 1991, 1991 IEEE MTT-S International Microwave Symposium Digest.