A fusion system for real-time forward collision warning in automobiles

We describe a fusion system that combines vision-data from a single forward-looking camera with forward-looking radar data for real-time forward collision warning in automobiles. Our approach employs computer vision techniques to primarily perform the detection and tracking of vehicles and overhead structure. These detections are then fused using a probabilistic framework with co-registered radar data to reliably obtain vehicle azimuth and depth by minimizing false alarms. The resulting detections can then be used as input to any forward collision warning system. Experimental results are presented to illustrate the performance of the algorithm.

[1]  J.L. Lazaro,et al.  Detection and tracking vehicles using a zoom camera over a pan-and-tilt unit , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[2]  C. Laurgeau,et al.  Fade: a vehicle detection and tracking system featuring monocular color vision and radar data fusion , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[3]  Yang Chen Highway overhead structure detection using video image sequences , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[4]  S. Heinrich Fast obstacle detection using flow/depth constraint , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[5]  Thierry Fraichard,et al.  Using Bayesian Programming for Multi-Sensor Data Fusion in Automotive Applications , 2002 .