A complete U-V-disparity study for stereovision based 3D driving environment analysis

Reliable understanding of the 3D driving environment is vital for obstacle detection and adaptive cruise control (ACC) applications. Laser or millimeter wave radars have shown good performance in measuring relative speed and distance in a highway driving environment. However the accuracy of these systems decreases in an urban traffic environment as more confusion occurs due to factors such as parked vehicles, guardrails, poles and motorcycles. A stereovision based sensing system provides an effective supplement to radar-based road scene analysis with its much wider field of view and more accurate lateral information. This paper presents an efficient solution using a stereovision based road scene analysis algorithm which employs the "U-V-disparity" concept. This concept is used to classify a 3D road scene into relative surface planes and characterize the features of road pavement surfaces, roadside structures and obstacles. Real-time implementation of the disparity map calculation and the "U-V-disparity" classification is also presented.

[1]  Martin Herman,et al.  Obstacle detection for a vehicle using optical flow , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[2]  Wilfried Enkelmann,et al.  Obstacle detection by evaluation of optical flow fields from image sequences , 1990, Image Vis. Comput..

[3]  Ernst D. Dickmanns,et al.  Radar and vision data fusion for hybrid adaptive cruise control on highways , 2001, Machine Vision and Applications.

[4]  Yoshiko Kojima,et al.  Sensor Fusion for Road Environment Recognition , 2001 .

[5]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[6]  Roberto Manduchi,et al.  Fast and reliable obstacle detection and segmentation for cross-country navigation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[7]  Massimo Bertozzi,et al.  Stereo vision-based vehicle detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[8]  Changming Sun,et al.  Fast Stereo Matching Using Rectangular Subregioning and 3D Maximum-Surface Techniques , 2002, International Journal of Computer Vision.

[9]  Randal C. Nelson,et al.  Using Flow Field Divergence For Obstacle Avoidance: Towards Qualitative Vision , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[10]  Y. Tamatsu,et al.  Solid or not solid: vision for radar target validation , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[11]  Ernst D. Dickmanns,et al.  Radar and Vision Data Fusion for Hybrid Adaptive Cruise Control on Highways , 2001, ICVS.

[12]  Jitendra Malik,et al.  An integrated stereo-based approach to automatic vehicle guidance , 1995, Proceedings of IEEE International Conference on Computer Vision.