Road Surface and Obstacle Detection Based on Elevation Maps from Dense Stereo

A new approach for the detection of the road surface and obstacles is presented. The 3D data from dense stereo is transformed into a rectangular elevation map. A quadratic road surface model is first fitted, by a RANSAC approach, to the region in front of the ego vehicle. This primary solution is then refined by a region growing-like process, driven by the 3D resolution and uncertainty model of the stereo sensor. An optimal global solution for the road surface is obtained. The road surface is used for a rough discrimination between road and above-road points. Above-road points are grouped based on vicinity and false areas are rejected. Each above-road area is classified into obstacles (cars, pedestrians etc.) or traffic isles (road-parallel patches) by using criteria related to the density of the 3D points. The proposed real-time algorithm was evaluated in an urban scenario and can be used in complex applications, from ego-pose estimation to path planning.

[1]  Fadi Dornaika,et al.  Real Time Vehicle Pose Using On-Board Stereo Vision System , 2006, ICIAR.

[2]  John Iselin Woodfill,et al.  The Tyzx DeepSea G2 Vision System, ATaskable, Embedded Stereo Camera , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  R. Danescu,et al.  Increased Accuracy Stereo Approach for 3D Lane Detection , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[5]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[6]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[7]  C. Stiller,et al.  Dynamic ego-pose estimation for driver assistance in urban environments , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[8]  Alberto Broggi,et al.  The Single Frame Stereo Vision System for Reliable Obstacle Detection Used during the 2005 DARPA Grand Challenge on TerraMax , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[9]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  R. Danescu,et al.  High accuracy stereo vision system for far distance obstacle detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.