Road detection via unsupervised feature learning

Computer vision based road detection is an indispensable and challenging task in many real-world applications such as obstacle detection in autonomous driving. Low-level image features (e.g., color and texture) and pre-trained models are commonly used for this task. In this paper, we propose a simple yet effective approach to detect roads from a single image, which avoids the supervised model training that typically relies on a considerable number of labeled images. The key idea is to leverage unsupervised feature learning to obtain good road representations. Specifically, we first represent an input road image as a set of image patches. The K-means clustering algorithm is then applied to these image patches (after pre-processing) to generate K cluster centroids. Thus obtained centroids will be used together with a nonlinear mapping function and a bag-of-words projection to derive the image's feature representation in pixel and region levels respectively. All pixels (of the input image) using the former mapping will be clustered by Density Peaks algorithm into several regions, and the regions represented by the latter feature will be grouped by a graph cut method into two classes: road and non-road. Experimental results on several complicated road images demonstrate the effectiveness of our proposed method.

[1]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  J.M. Alvarez,et al.  Illuminant-invariant model-based road segmentation , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[3]  Theo Gevers,et al.  Combining Priors, Appearance, and Context for Road Detection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[4]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[5]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[6]  Theo Gevers,et al.  Learning photometric invariance from diversified color model ensembles , 2009, CVPR.

[7]  Minho Lee,et al.  Robust Lane Detection Based On Convolutional Neural Network and Random Sample Consensus , 2014, ICONIP.

[8]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[9]  He Zhen,et al.  Simple road detection based on vanishing point , 2014, J. Electronic Imaging.

[10]  Fei Wang,et al.  A robust road segmentation method based on graph cut with learnable neighboring link weights , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[11]  Theo Gevers,et al.  Geographic information for vision-based road detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[12]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Theo Gevers,et al.  Vision-based road detection using road models , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[15]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Yann LeCun,et al.  Road Scene Segmentation from a Single Image , 2012, ECCV.

[17]  Quoc V. Le,et al.  Measuring Invariances in Deep Networks , 2009, NIPS.

[18]  Theo Gevers,et al.  3D Scene priors for road detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Nick Barnes,et al.  Learning appearance models for road detection , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[20]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[21]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.