Road Detection Based on Illuminant Invariance

By using an onboard camera, it is possible to detect the free road surface ahead of the ego-vehicle. Road detection is of high relevance for autonomous driving, road departure warning, and supporting driver-assistance systems such as vehicle and pedestrian detection. The key for vision-based road detection is the ability to classify image pixels as belonging or not to the road surface. Identifying road pixels is a major challenge due to the intraclass variability caused by lighting conditions. A particularly difficult scenario appears when the road surface has both shadowed and nonshadowed areas. Accordingly, we propose a novel approach to vision-based road detection that is robust to shadows. The novelty of our approach relies on using a shadow-invariant feature space combined with a model-based classifier. The model is built online to improve the adaptability of the algorithm to the current lighting and the presence of other vehicles in the scene. The proposed algorithm works in still images and does not depend on either road shape or temporal restrictions. Quantitative and qualitative experiments on real-world road sequences with heavy traffic and shadows show that the method is robust to shadows and lighting variations. Moreover, the proposed method provides the highest performance when compared with hue-saturation-intensity (HSI)-based algorithms.

[1]  M. S. Bartlett,et al.  Statistical methods and scientific inference. , 1957 .

[2]  Cheng Lu,et al.  Intrinsic Images by Entropy Minimization , 2004, ECCV.

[3]  Antonio M. López,et al.  Cascade of Classifiers for Vehicle Detection , 2007, ACIVS.

[4]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jaesang Lee,et al.  Road Following in an Unstructured Desert Environment Based on the EM(Expectation-Maximization) Algorithm , 2006, 2006 SICE-ICASE International Joint Conference.

[6]  T. Ferryman,et al.  Data outlier detection using the Chebyshev theorem , 2005, 2005 IEEE Aerospace Conference.

[7]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.

[8]  Luis Magdalena,et al.  A Color Vision-Based Lane Tracking System for Autonomous Driving on Unmarked Roads , 2004, Auton. Robots.

[9]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[10]  O. Ramstrom,et al.  A method for following unmarked roads , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[11]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[12]  John A. Hendrickson Probability, Random Signals, and Statistics , 2001, Technometrics.

[13]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[15]  Konstantinos N. Plataniotis,et al.  Color Image Segmentation for Multimedia Applications , 2000, J. Intell. Robotic Syst..

[16]  Zehang Sun,et al.  On-road vehicle detection using evolutionary Gabor filter optimization , 2005, IEEE Transactions on Intelligent Transportation Systems.

[17]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[18]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[19]  Luis Magdalena,et al.  VIRTUOUS: vision-based road transportation for unmanned operation on urban-like scenarios , 2004, IEEE Transactions on Intelligent Transportation Systems.

[20]  Joan Serrat,et al.  Robust lane markings detection and road geometry computation , 2010 .

[21]  Tommy Chang,et al.  Color model-based real-time learning for road following , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[22]  Jianwei Zhang,et al.  Color image segmentation in HSI space for automotive applications , 2008, Journal of Real-Time Image Processing.

[23]  G D Finlayson,et al.  Color constancy at a pixel. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  D. W. Scott On optimal and data based histograms , 1979 .

[25]  Ho Gi Jung,et al.  A New Approach to Urban Pedestrian Detection for Automatic Braking , 2009, IEEE Transactions on Intelligent Transportation Systems.

[26]  R. A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[27]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.