Rain and Fog Recognition System Using Multiple in-Vehicle Sensors*

This paper describes a system for rain and fog recognition using multiple in-vehicle sensors. Fog density was calculated from both the preceding-vehicle images captured by an in-vehicle camera and the inter-vehicle distance measured by a millimeter-wave (mm-wave) radar. Rainfall determination is achieved by detecting raindrops on the windshield using images captured by the in-vehicle camera. Experiments using in-vehicle camera images and radar data collected while driving vehicles in foggy or rainy and fair conditions demonstrated the accuracy and the applicability of our system.

[1]  N. Pettersson,et al.  Visibility Enhancement for Roads with Foggy or Hazy Scenes , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[2]  N. Hautiere,et al.  Detection of visibility conditions through use of onboard cameras , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[3]  Hiroshi Murase,et al.  Raindrop Detection from In-Vehicle Video Camera Images for Rainfall Judgment , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[4]  W. Middleton,et al.  Vision Through the Atmosphere , 1952 .

[5]  Taek Mu Kwon,et al.  Atmospheric Visibility Measurements Using Video Cameras: Relative Visibility , 2004 .

[6]  Hiroshi Murase,et al.  Subspace methods for robot vision , 1996, IEEE Trans. Robotics Autom..

[7]  T. Takahashi,et al.  Recognition of foggy conditions by in-vehicle camera and millimeter wave radar , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[8]  Hiroshi Murase,et al.  Visibility Estimation in Foggy Conditions by In-Vehicle Camera and Radar , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[9]  N. Hautiere,et al.  Simultaneous Contrast Restoration and Obstacles Detection: First Results , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[10]  Viola Cavallo,et al.  Distance Perception of Vehicle Rear Lights in Fog , 2001, Hum. Factors.

[11]  I. Ide,et al.  Rainy weather recognition from in-vehicle camera images for driver assistance , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..