RBNet: A Deep Neural Network for Unified Road and Road Boundary Detection

Accurately detecting road and its boundary on the images is an essential task for vision-based autonomous driving systems. However, prevailing methods either only detect road or add an extra processing stage to detect road boundary. In this work, we introduce a deep neural network, called Road and road Boundary detection Network (RBNet), that can detect both road and road boundary in a single process. In specific, we first investigate the contextual relationship between the road structure and its boundary arrangement and then model them with a Bayesian network. By implementing the Bayesian model, the RBNet can learn to simultaneously estimate the probabilities of a pixel on the image belonging to the road and road boundary. Comprehensive evaluations are carried out based on the well-known road benchmark, which can demonstrate the compelling performance of the proposed method.

[1]  Ankit Laddha,et al.  Map-supervised road detection , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[2]  Charless C. Fowlkes,et al.  Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation , 2016, ECCV.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Wei Zhang,et al.  Unsupervised Segmentation Using Cluster Ensembles , 2014, ICONIP.

[5]  Dacheng Tao,et al.  Classification with Noisy Labels by Importance Reweighting , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Guangming Xiong,et al.  Road detection using support vector machine based on online learning and evaluation , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[7]  Gregory Shakhnarovich,et al.  Feedforward semantic segmentation with zoom-out features , 2014, CVPR.

[8]  Rahul Mohan,et al.  Deep Deconvolutional Networks for Scene Parsing , 2014, ArXiv.

[9]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[10]  Ethan Fetaya,et al.  StixelNet: A Deep Convolutional Network for Obstacle Detection and Road Segmentation , 2015, BMVC.

[11]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Wolfram Burgard,et al.  Efficient deep models for monocular road segmentation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[14]  Jitendra Malik,et al.  Hypercolumns for object segmentation and fine-grained localization , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Vincent Frémont,et al.  Exploiting fully convolutional neural networks for fast road detection , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[18]  Franz Kummert,et al.  Spatial ray features for real-time ego-lane extraction , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[19]  Nick Barnes,et al.  Learning appearance models for road detection , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[20]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[21]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Dawei Zhao,et al.  Monocular Road Detection Using Structured Random Forest , 2016 .

[23]  Qi Wang,et al.  Video-based road detection via online structural learning , 2015, Neurocomputing.