Monocular Road Detection Using Structured Random Forest

Road detection is a key task for autonomous land vehicles. Monocular vision-based road-detection algorithms are mostly based on machine learning approaches and are usually cast as classification problems. However, the pixel-wise classifiers are faced with the ambiguity caused by changes in road appearance, illumination and weather. An effective way to reduce the ambiguity is to model the contextual information with structured learning and prediction. Currently, the widely used structured prediction model in road detection is the Markov random field or conditional random field. However, the random field-based methods require additional complex optimization after pixel-wise classification, making them unsuitable for real-time applications. In this paper, we present a structured random forest-based road-detection algorithm which is capable of modelling the contextual information efficiently. By mapping the structured label space to a discrete label space, the test function of each split node can be trained in a similar way to that of the classical random forests. Structured random forests make use of the contextual information of image patches as well as the structural information of the labels to get more consistent results. Besides this benefit, by predicting a batch of pixels in a single classification, the structured random forest-based road detection can be much more efficient than the conventional pixel-wise random forest. Experimental results tested on the KITTI-ROAD dataset and data collected in typical unstructured environments show that structured random forest-based road detection outperforms the classical pixel-wise random forest both in accuracy and efficiency.

[1]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yann LeCun,et al.  Road Scene Segmentation from a Single Image , 2012, ECCV.

[3]  Bin Dai,et al.  Gaussian-Process-Based Real-Time Ground Segmentation for Autonomous Land Vehicles , 2013, Journal of Intelligent & Robotic Systems.

[4]  Tommy Chang,et al.  Color model-based real-time learning for road following , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[5]  Danilo Alves de Lima,et al.  A 2D/3D Vision Based Approach Applied to Road Detection in Urban Environments , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Jian Li,et al.  Robust Unstructured Road Detection: The Importance of Contextual Information , 2013 .

[7]  Guangming Xiong,et al.  Road detection using support vector machine based on online learning and evaluation , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[8]  Vincent Frémont,et al.  Fast road detection from color images , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[9]  Uwe Franke,et al.  Low-level fusion of color, texture and depth for robust road scene understanding , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[10]  Stevica Graovac,et al.  Detection of Road Image Borders Based on Texture Classification , 2012 .

[11]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[12]  Sebastian Nowozin,et al.  Structured Learning and Prediction in Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[13]  Julian Eggert,et al.  Block-matching stereo with relaxed fronto-parallel assumption , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[14]  Uwe Franke,et al.  B-spline-based road model for 3d lane recognition , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[15]  Fang Yuqiang,et al.  Unstructured road segmentation method based on dictionary learning and sparse representation , 2013 .

[16]  Mandy Eberhart,et al.  Decision Forests For Computer Vision And Medical Image Analysis , 2016 .

[17]  Liang Xiao,et al.  Fast unstructured road detection and tracking from monocular video , 2015, The 27th Chinese Control and Decision Conference (2015 CCDC).

[18]  Jun-Shik Choi,et al.  Road identification in monocular color images using random forest and color correlogram , 2012 .

[19]  Franz Kummert,et al.  Monocular road segmentation using slow feature analysis , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[20]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Liang Xiao,et al.  CRF based road detection with multi-sensor fusion , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[22]  Theo Gevers,et al.  3D Scene priors for road detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Rahul Mohan,et al.  Deep Deconvolutional Networks for Scene Parsing , 2014, ArXiv.

[24]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[25]  Patrick Y. Shinzato,et al.  Fast visual road recognition and horizon detection using multiple artificial neural networks , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[26]  Luis Miguel Bergasa,et al.  CRF-based semantic labeling in miniaturized road scenes , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[27]  Franz Kummert,et al.  Monocular Road Terrain Detection by Combining Visual and Spatial Information , 2014, IEEE Transactions on Intelligent Transportation Systems.

[28]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[29]  Amnon Shashua,et al.  Off-road Path Following using Region Classification and Geometric Projection Constraints , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  Luis Magdalena,et al.  A Color Vision-Based Lane Tracking System for Autonomous Driving on Unmarked Roads , 2004, Auton. Robots.

[31]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[32]  Jun Miura,et al.  On-line road boundary estimation by switching multiple road models using visual features from a stereo camera , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Mario Fritz,et al.  Sequential Bayesian Model Update under Structured Scene Prior for Semantic Road Scenes Labeling , 2013, 2013 IEEE International Conference on Computer Vision.

[34]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[35]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[36]  Peter Kontschieder,et al.  Structured class-labels in random forests for semantic image labelling , 2011, 2011 International Conference on Computer Vision.

[37]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).