Visibility estimation of traffic signals under rainy weather conditions for smart driving support

The aim of this work is to support a driver by notifying the information of traffic signals in accordance with their visibility. To avoid traffic accidents, the driver should detect and recognize surrounding objects, especially traffic signals. However, when driving a vehicle under rainy weather conditions, it is difficult for drivers to detect or to recognize objects existing in the road environment in comparison with fine weather conditions. Therefore, this paper proposes a method for estimating the visibility of traffic signals for drivers under rainy weather conditions by image processing. The proposed method is based on the concept of visual noise known in the field of cognitive science, and extracts two types of visual noise features which ware considered that they affect the visibility of traffic signals. We expect to improve the accuracy of visibility estimation by combining the visual noise features with the texture feature introduced in a previous work. Experimental results showed that the proposed method could estimate the visibility of traffic signals more accurately under rainy weather conditions.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  David Engel,et al.  Pedestrian detectability: Predicting human perception performance with machine vision , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[3]  T. Takahashi,et al.  Measurement of Visibility Conditions toward Smart Driver Assistance for Traffic Signals , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[4]  Hiroshi Murase,et al.  Estimation of traffic sign visibility considering temporal environmental changes for smart driver assistance , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[5]  T. Takahashi,et al.  Recognition of foggy conditions by in-vehicle camera and millimeter wave radar , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[6]  I. Ide,et al.  Rainy weather recognition from in-vehicle camera images for driver assistance , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[7]  Barry J. Richmond,et al.  Effect of visual noise on pattern recognition , 2005, Experimental Brain Research.

[8]  Gang Tao,et al.  The recognition and tracking of traffic lights based on color segmentation and CAMSHIFT for intelligent vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[9]  D. Aubert,et al.  Daytime visibility range monitoring through use of a roadside camera , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[10]  Fawzi Nashashibi,et al.  Real time visual traffic lights recognition based on Spot Light Detection and adaptive traffic lights templates , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[11]  Anton Kummert,et al.  Vision-based rain sensing with an in-vehicle camera , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[12]  Jean-Philippe Tarel,et al.  Automatic fog detection and estimation of visibility distance through use of an onboard camera , 2006, Machine Vision and Applications.

[13]  L. Thurstone.  PSYCHOPHYSICAL ANALYSIS , 2008 .

[14]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..