Stereo vision-based road estimation assisted by efficient planar patch calculation

A robust and accurate road model estimation algorithm can greatly improve the performance of many Advanced Driver Assistance Systems applications such as lane detection, obstacle detection and road marking recognition. To estimate the road model, the proposed algorithm employs a stereo vision camera system. In this paper, local planar patches are efficiently estimated in the disparity domain rather than conventionally in the Euclidean domain. Then, the estimated planar patch orientations are integrated to the fitting stage, and orientation differences are minimized along with height differences. Moreover, patch orientation differences are exploited for weighting data points. Thus, outliers become insignificant in the fitting stage, and the road model is estimated robustly and accurately without any prior knowledge of any extrinsic camera parameters. Experiments have been carried out for a free space calculation application, and the road is segmented with a true positive rate (TPR) of 88 %.

[1]  Fadi Dornaika,et al.  Road Approximation in Euclidean and v -Disparity Space: A Comparative Study , 2007, EUROCAST.

[2]  Fredrik Gustafsson,et al.  Joint road geometry estimation and vehicle tracking , 2007 .

[3]  Naim Dahnoun,et al.  Efficient disparity calculation based on stereo vision with ground obstacle assumption , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[4]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[5]  Fadi Dornaika,et al.  An Efficient Approach to Onboard Stereo Vision System Pose Estimation , 2008, IEEE Transactions on Intelligent Transportation Systems.

[6]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[7]  Z. Hu,et al.  U-V-disparity: an efficient algorithm for stereovision based scene analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[8]  Sven Loncaric,et al.  Using Gradient Orientation to Improve Least Squares Line Fitting , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[9]  Antonios Gasteratos,et al.  Review of Stereo Vision Algorithms: From Software to Hardware , 2008 .

[10]  Keiichi Uchimura,et al.  A complete U-V-disparity study for stereovision based 3D driving environment analysis , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[11]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[12]  Trevor Darrell,et al.  Motion Estimation from Disparity Images , 2001, ICCV.

[13]  Zhengyou Zhang,et al.  A stereovision system for a planetary rover: calibration, correlation, registration, and fusion , 1997, Machine Vision and Applications.

[14]  Diego Viejo,et al.  Using GNG to improve 3D feature extraction - Application to 6DoF egomotion , 2012, Neural Networks.

[15]  Ángel F. García-Fernández,et al.  Bayesian Road Estimation Using Onboard Sensors , 2014, IEEE Transactions on Intelligent Transportation Systems.

[16]  Naim Dahnoun,et al.  A novel system for robust lane detection and tracking , 2012, Signal Process..

[17]  John G. Rarity,et al.  U-V-Disparity based Obstacle Detection with 3D Camera and steerable filter , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[18]  Daniel Cremers,et al.  B-Spline Modeling of Road Surfaces With an Application to Free-Space Estimation , 2009, IEEE Transactions on Intelligent Transportation Systems.

[19]  Thomas B. Schön,et al.  Joint ego-motion and road geometry estimation , 2011, Inf. Fusion.

[20]  Jan-Michael Frahm,et al.  Variable baseline/resolution stereo , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[22]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[23]  Julian Eggert,et al.  A Two-Stage Correlation Method for Stereoscopic Depth Estimation , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[24]  John G. Rarity,et al.  Obstacle detection using U-disparity on quadratic road surfaces , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[25]  Romuald Aufrère,et al.  Accurate road following and reconstruction by computer vision , 2002, IEEE Trans. Intell. Transp. Syst..