An adherent raindrop detection method using MSER

Image processing algorithms used in surveillance systems are designed to work under good weather conditions. For example, in a rainy day, raindrops are adhered to camera lenses and windshields, resulting in partial occlusions in acquired images, and making performance of image processing algorithms significantly degraded. To improve performance of surveillance systems in a rainy day, raindrops have to be automatically detected and removed from images. Addressing this problem, this paper proposes an adherent raindrop detection method from a single image which does not need training data and special devices. The proposed method employs image segmentation using Maximally Stable Extremal Regions (MSER) and qualitative metrics to detect adherent raindrops from the result of MSER-based image segmentation. Through a set of experiments, we demonstrate that the proposed method exhibits efficient performance of adherent raindrop detection compared with conventional methods.

[1]  I. Ide,et al.  Rainy weather recognition from in-vehicle camera images for driver assistance , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[2]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[3]  Andreas Geiger,et al.  Video-based raindrop detection for improved image registration , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[4]  Nancy Chinchor,et al.  MUC-4 evaluation metrics , 1992, MUC.

[5]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Takeo Kanade,et al.  Analysis of Rain and Snow in Frequency Space , 2008, International Journal of Computer Vision.

[7]  中澤 篤志,et al.  IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR2008)報告(会議報告,アンビエント環境知能) , 2008 .

[8]  Atsushi Yamashita,et al.  Noises removal from image sequences acquired with moving camera by estimating camera motion from spatio-temporal information , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  S. Nayar,et al.  Detection and removal of rain from videos , 2004, CVPR 2004.

[10]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[11]  Atsushi Yamashita,et al.  Removal of adherent waterdrops from images acquired with stereo camera , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Martin Roser,et al.  Raindrop detection on car windshields using geometric-photometric environment construction and intensity-based correlation , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[13]  Hao Li,et al.  Rain Removal in Video by Combining Temporal and Chromatic Properties , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[14]  Qi Wu,et al.  Raindrop detection and removal using salient visual features , 2012, 2012 19th IEEE International Conference on Image Processing.

[15]  Yu-Hsiang Fu,et al.  Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition , 2012, IEEE Transactions on Image Processing.