Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection

A new approach for the detection of the road surface and obstacles is presented. The high accuracy of the method allows the detection of traffic isles as a distinct class. The 3-D data inferred from dense stereo are transformed into a rectangular digital elevation map (DEM). Two classifiers are proposed, namely, density based and road surface based. The density-based obstacle classifier marks DEM cells as road or obstacles, using the density of 3-D points as a criterion. A quadratic road surface model is initially fitted by a random sample consensus (RANSAC) approach to the region in front of the ego vehicle. A region growing-like process refines this primary solution, driven by the 3-D uncertainty model of the stereo sensor. A robust global solution for the road surface is obtained. The road surface is used for discrimination between road, traffic isle, and obstacle points. Fusion and error filtering is performed on the results of the two classifiers. The proposed real-time algorithm was evaluated in an urban scenario and can be used in complex applications from collision avoidance to path planning.

[1]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Zhengyou Zhang,et al.  A stereovision system for a planetary rover: calibration, correlation, registration, and fusion , 1997, Machine Vision and Applications.

[5]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[6]  Didier Aubert,et al.  A single framework for vehicle roll, pitch, yaw estimation and obstacles detection by stereovision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[7]  R. Aufrere,et al.  Multiple sensor fusion for detecting location of curbs, walls, and barriers , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[8]  Roberto Manduchi,et al.  Visual curb localization for autonomous navigation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  Maarten Vergauwen,et al.  A stereo-vision system for support of planetary surface exploration , 2003, Machine Vision and Applications.

[10]  C. Stiller,et al.  Dynamic ego-pose estimation for driver assistance in urban environments , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[11]  R. Danescu,et al.  High accuracy stereo vision system for far distance obstacle detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[12]  Z. Hu,et al.  U-V-disparity: an efficient algorithm for stereovision based scene analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[13]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[14]  Fadi Dornaika,et al.  Real Time Vehicle Pose Using On-Board Stereo Vision System , 2006, ICIAR.

[15]  John Iselin Woodfill,et al.  The Tyzx DeepSea G2 Vision System, ATaskable, Embedded Stereo Camera , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[16]  Alberto Broggi,et al.  The Single Frame Stereo Vision System for Reliable Obstacle Detection Used during the 2005 DARPA Grand Challenge on TerraMax , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[17]  R. Danescu,et al.  Increased Accuracy Stereo Approach for 3D Lane Detection , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[18]  Roberto Manduchi,et al.  Robust curb and ramp detection for safe parking using the Canesta TOF camera , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  S. Nedevschi,et al.  D Lane Detection System Based on Stereovision , 2022 .