Understanding Road Scenes Using Visual Cues and GPS Information

Understanding road scenes is important in computer vision with different applications to improve road safety (e.g., advanced driver assistance systems) and to develop autonomous driving systems (e.g., Google driver-less vehicle). Current vision---based approaches rely on the robust combination of different technologies including color and texture recognition, object detection, scene context understanding. However, the performance of these approaches drops---off in complex acquisition conditions with reduced visibility (e.g., dusk, dawn, night) or adverse weather conditions (e.g., rainy, snowy, foggy). In these adverse situations any prior information about the scene is relevant to constraint the process. Therefore, in this demo we show a novel approach to obtain on---line prior information about the road ahead a moving vehicle to improve road scene understanding algorithms. This combination exploits the robustness of digital databases and the adaptation of algorithms based on visual information acquired in real time. Experimental results in challenging road scenarios show the applicability of the algorithm to improve vision---based road scene understanding algorithms. Furthermore, the algorithm can also be applied to correct imprecise road information in the database.

[1]  W. F. Clocksin,et al.  Joint Optimization for Object Class Segmentation and Dense Stereo Reconstruction , 2011, International Journal of Computer Vision.

[2]  C. V. Jawahar,et al.  Scene Text Recognition using Higher Order Language Priors , 2009, BMVC.

[3]  W. F. Clocksin,et al.  Joint Optimization for Object Class Segmentation and Dense Stereo Reconstruction , 2012, International Journal of Computer Vision.

[4]  Ruigang Yang,et al.  Semantic Segmentation of Urban Scenes Using Dense Depth Maps , 2010, ECCV.

[5]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[6]  Theo Gevers,et al.  3D Scene priors for road detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.