An illumination-invariant nonparametric model for urban road detection using monocular camera and single-line lidar

In this paper, we propose an illumination-invariant nonparametric model for urban road detection based on a monocular camera and a single-line lidar. With the monocular camera, we can accurately locate road vanishing point after removing the adverse shadowy effect by an illumination-invariant image representation. With the constraint of detected vanishing point, we propose a Dijkstra method to compute a minimum-cost map, where the minimum-cost path from the vanishing point to any other pixel can be found. With the single-line lidar, we can locate two key points in the image bottom that correspond to two road-border points. Thereafter, the two road borders can be found as the minimum-cost paths that originate from the vanishing point to the two key points, respectively. The proposed method has been tested on over 4000 images of the KITTI-Odometry Dataset [3] and the Oxford Robotcar Dataset [7]. Experimental results demonstrate that the method achieves promising performance on a variety of road scenes.

[1]  Jian Li,et al.  Robust Unstructured Road Detection: The Importance of Contextual Information , 2013 .

[2]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Guangming Xiong,et al.  Road detection using support vector machine based on online learning and evaluation , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[4]  Mario Fritz,et al.  Sequential Bayesian Model Update under Structured Scene Prior for Semantic Road Scenes Labeling , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Hui Kong,et al.  Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[6]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[7]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[9]  Ronggang Wang,et al.  A Novel Shadow-Free Feature Extractor for Real-Time Road Detection , 2016, ACM Multimedia.

[10]  Dawei Zhao,et al.  Monocular Road Detection Using Structured Random Forest , 2016 .

[11]  Paul Newman,et al.  1 year, 1000 km: The Oxford RobotCar dataset , 2017, Int. J. Robotics Res..

[12]  Wolfram Burgard,et al.  Efficient deep models for monocular road segmentation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Roberto Cipolla,et al.  MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving , 2016, 2018 IEEE Intelligent Vehicles Symposium (IV).

[14]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[15]  Uwe Franke,et al.  Low-level fusion of color, texture and depth for robust road scene understanding , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[16]  Alexander Zelinsky,et al.  Robust vision based lane tracking using multiple cues and particle filtering , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).