Detecting Unfocused Raindrops: In-Vehicle Multipurpose Cameras

Advanced driver assistance systems (ADASs) based on video cameras are becoming pervasive in today's automotive industry. However, while most of these systems perform nicely in clear weather conditions, their performances fail drastically in adverse weather and particularly in the rain. We present two novel approaches that aim to detect unfocused raindrops on a car windshield using only images from an in-vehicle camera. Based on the photometric properties of raindrops, the algorithms rely on image processing techniques to highlight them. The results will be used to improve ADAS behavior under rainy conditions. Both approaches are compared with each other and the techniques from the literature.

[1]  Jiaya Jia,et al.  Image partial blur detection and classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Fawzi Nashashibi,et al.  Detection of unfocused raindrops on a windscreen using low level image processing , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[3]  Atsushi Yamashita,et al.  Removal of Adherent Waterdrops from Images Acquired with a Stereo Camera System , 2006, IEICE Trans. Inf. Syst..

[4]  Didier Aubert,et al.  Towards rain detection through use of in-vehicle multipurpose cameras , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[5]  Shree K. Nayar,et al.  When does a camera see rain? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Fernand Meyer,et al.  Topographic distance and watershed lines , 1994, Signal Process..

[7]  Andreas Geiger,et al.  Video-based raindrop detection for improved image registration , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[8]  Atsushi Yamashita,et al.  A virtual wiper - restoration of deteriorated images by using multiple cameras , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[10]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Xiaoming Zheng,et al.  Weather Recognition Based on Images Captured by Vision System in Vehicle , 2009, ISNN.

[12]  Anton Kummert,et al.  Vision-based rain sensing with an in-vehicle camera , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[13]  Lei Huang,et al.  Real-time modeling and rendering of raining scenes , 2008, The Visual Computer.

[14]  Shree K. Nayar,et al.  Vision and Rain , 2007, International Journal of Computer Vision.

[15]  I. Ide,et al.  Rainy weather recognition from in-vehicle camera images for driver assistance , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[16]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[17]  F. Moosmann,et al.  Classification of weather situations on single color images , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[18]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[19]  Djamchid Ghazanfarpour,et al.  Realistic real-time rain rendering , 2006, Comput. Graph..

[20]  Atsushi Yamashita,et al.  Removal of adherent noises from image sequences by spatio-temporal image processing , 2008, 2008 IEEE International Conference on Robotics and Automation.