Fast unstructured road detection and tracking from monocular video

In this paper, a fast particle filer based unstructured road detection and tracking algorithm is presented. We take the parameters of the road model and the relative pose of the vehicle with respect to the road as the state vector. The pixels of the test image are classified by learned boosted classifier based on rich pixel features to get a probabilistic output. For each particle, the virtual road image in the perspective view is generated according to the state vector. The particles are then weighted by the consistency of the virtual road image with the probability map. Then we can can estimate the optimal state with the particle weights. We further propose a scheme to accelerate the algorithm substantially with little degeneracy in performance by measuring the consistency with only several rows instead of the whole image. Extensive experiments show that the proposed method can detect and track the road robustly in various unstructured environments within real time.

[1]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Yann LeCun,et al.  Semantic Road Segmentation via Multi-scale Ensembles of Learned Features , 2012, ECCV Workshops.

[3]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Elli Angelopoulou,et al.  On feature templates for Particle Filter based lane detection , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Anton Osokin,et al.  Fast Approximate Energy Minimization with Label Costs , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[7]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[8]  Nick Barnes,et al.  Data-driven road detection , 2014, IEEE Winter Conference on Applications of Computer Vision.

[9]  U. Franks,et al.  Lane Recognition on Country Roads , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[10]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[11]  Amnon Shashua,et al.  Off-road Path Following using Region Classification and Geometric Projection Constraints , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Martial Hebert,et al.  Discriminative Fields for Modeling Spatial Dependencies in Natural Images , 2003, NIPS.

[13]  Theo Gevers,et al.  Vision-based road detection using road models , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  Franz Kummert,et al.  Monocular road segmentation using slow feature analysis , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[15]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[16]  Petar M. Djuric,et al.  Resampling Methods for Particle Filtering , 2015 .

[17]  Tommy Chang,et al.  Color model-based real-time learning for road following , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[18]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[19]  Stephen Gould,et al.  Multi-Class Segmentation with Relative Location Prior , 2008, International Journal of Computer Vision.

[20]  Yann LeCun,et al.  Road Scene Segmentation from a Single Image , 2012, ECCV.

[21]  Christoph Stiller,et al.  Kalman Particle Filter for lane recognition on rural roads , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[22]  Tao Wu,et al.  Robust road detection from a single image using road shape prior , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..