Stereovision-based road boundary detection for intelligent vehicles in challenging scenarios

Road detection is a crucial problem for intelligent vehicles and mobile robots. Most of the methods proposed nowadays only achieve reliable results in relatively well-arranged environments. In this paper, we proposed a stereovision-based road boundary detection method by combining homography estimation and MRF-based belief propagation to cope with challenging scenarios such as unstructured roads with unhomogeneous surfaces. In the method, each pixel in the reference image is firstly labeled as “road” or “non-road” by minimizing a well defined energy function that accounts for the planar road region. Subsequently, both of the road boundaries are generated using Catmull-Rom splines based on RANdom SAmple Consensus (RANSAC) algorithm with varying road structure models to help the intelligent vehicle understand the structure as well as safe range of current road. In the suggested framework, both intensity and geometry information of road scenarios are used to contain all the regions belonging to the planar road plane, and the left and right road boundaries are generated separately using a robust fitting algorithm to handle different road structures. Therefore, more accurate as well as robust detection of the road can be expected. Experimental results on a wide variety of typical but challenging scenarios have demonstrated the effectiveness of the proposed method.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  James C. Miller,et al.  Computer graphics principles and practice, second edition , 1992, Comput. Graph..

[3]  M. Carter Computer graphics: Principles and practice , 1997 .

[4]  Seiichi Mita,et al.  Drivable road region detection based on homography estimation with road appearance and driving state models , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[5]  Massimo Bertozzi,et al.  Vision-based intelligent vehicles: State of the art and perspectives , 2000, Robotics Auton. Syst..

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Klaus Dietmayer,et al.  Lane detection and street type classification using laser range images , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[8]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  Junichi Maruyama,et al.  Robust estimation of planar regions for visual navigation using sequential stereo images , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  Gerd Wanielik,et al.  Multi-modal detection and parameter-based tracking of road borders with a laser scanner , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[11]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.

[13]  Yuriy V. Zakharov,et al.  Coordinate descent iterations in fast affine projection algorithm , 2005, IEEE Signal Processing Letters.

[14]  A. von Reyher,et al.  A lidar-based approach for near range lane detection , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[15]  David Salomon,et al.  Curves and surfaces for computer graphics , 2005 .

[16]  Sergiu Nedevschi,et al.  Efficient and robust classification method using combined feature vector for lane detection , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  P. Lombardi,et al.  Unified stereovision for ground, road, and obstacle detection , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[18]  Mathias Perrollaz,et al.  Road Scene Analysis by Stereovision: a Robust and Quasi-Dense Approach , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[19]  J. Albus,et al.  Intelligent Vehicle Systems: A 4D/RCS Approach , 2006 .

[20]  James S. Albus,et al.  Intelligent Vehicle Systems: A 4D/RCS Approach | NIST , 2006 .

[21]  Vladimir Kolmogorov,et al.  Optimizing Binary MRFs via Extended Roof Duality , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.