A framework of single-image deraining method based on analysis of rain characteristics

In this paper, we propose an algorithm to remove rain streaks from single color image. Firstly, the guided filter, cooperated with rain pixels detection are used to separate a color image into low-frequency and high-frequency parts so that most rain components exist in the high-frequency part. Then, we focus on the high-frequency part to extract the non-rain details according to the characteristics of the rain in which a dictionary learning method is used. Meanwhile, to enhance the quality of the rain-removed image, the proposed principal direction of an image patch (PDIP) and the sensitivity of variance of color channels (SVCC) are employed in our work to help extract more non-rain details. Compared with the state-of-the-art works, our proposed method can remove the rain (especially heavy rain) from color images more efficiently.

[1]  Hao Li,et al.  Rain Removal in Video by Combining Temporal and Chromatic Properties , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[2]  Delu Zeng,et al.  Single image rain and snow removal via guided L0 smoothing filter , 2015, Multimedia Tools and Applications.

[3]  Jean-Luc Starck,et al.  Learning adapted dictionaries for geometry and texture separation , 2007, SPIE Optical Engineering + Applications.

[4]  S. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH 2006.

[5]  Takeo Kanade,et al.  Analysis of Rain and Snow in Frequency Space , 2008, International Journal of Computer Vision.

[6]  Shree K. Nayar,et al.  Vision and Rain , 2007, International Journal of Computer Vision.

[7]  Nianjun Liu,et al.  Using the Shape Characteristics of Rain to Identify and Remove Rain from Video , 2008, SSPR/SPR.

[8]  Jérémie Bossu,et al.  Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks , 2011, International Journal of Computer Vision.

[9]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[10]  Jing Xu,et al.  An Improved Guidance Image Based Method to Remove Rain and Snow in a Single Image , 2012, Comput. Inf. Sci..

[11]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Takeo Kanade,et al.  Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Videos , 2007 .

[13]  Chul Lee,et al.  Single-image deraining using an adaptive nonlocal means filter , 2013, 2013 IEEE International Conference on Image Processing.

[14]  Yu-Hsiang Fu,et al.  Single-frame-based rain removal via image decomposition , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Yu-Hsiang Fu,et al.  Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition , 2012, IEEE Transactions on Image Processing.

[17]  陳敦裕,et al.  Visual depth guided color image rain streaks removal using sparse coding , 2014 .

[18]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[19]  Mohamed-Jalal Fadili,et al.  Image Decomposition and Separation Using Sparse Representations: An Overview , 2010, Proceedings of the IEEE.