Rain streak removal by multi-frame-based anisotropic filtering

Dynamic weather conditions, such as rain and snow, often produce strong intensity discontinuity among frames, thus seriously degrade their visual or compression performance. How to remove these artifacts is a challenging task and has been intensively studies recently. The state-of-the-art algorithms detect these scratches before removing them from the scene. Visual effect of rain or snow is complex and difficult to be distinguished from the background; hence the precision of its detection and segmentation by hard decision is usually unsatisfactory. As an anisotropic filter performs well in structural noise removal, such as linear, planar as well as isotropic noise, it is utilized in this paper to analyze image content and suppress scratch noise simultaneously. Compared with the state-of-the-art algorithms, the proposed algorithm is better and more robust in dynamic scenes.

[1]  Li-Wei Kang,et al.  Visual Depth Guided Color Image Rain Streaks Removal Using Sparse Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[3]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[4]  Hao Li,et al.  Rain Removal in Video by Combining Temporal and Chromatic Properties , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[5]  B. N. Chatterji,et al.  Anisotropic Diffusion in Image Processing: Methods based on Physics, Statistics and Geometric Curve Evolution , 2002 .

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[8]  Shree K. Nayar,et al.  Vision and Rain , 2007, International Journal of Computer Vision.

[9]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Masaaki Yoneda,et al.  Real-time snowfall noise elimination , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[11]  Yu-Hsiang Fu,et al.  Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition , 2012, IEEE Transactions on Image Processing.

[12]  Jérémie Bossu,et al.  Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks , 2011, International Journal of Computer Vision.

[13]  Ming Zhang,et al.  Multiresolution Bilateral Filtering for Image Denoising , 2008, IEEE Transactions on Image Processing.

[14]  Achilleas S. Frangakis,et al.  Wavelet transform filtering and nonlinear anisotropic diffusion assessed for signal reconstruction performance on multidimensional biomedical data , 2001, IEEE Transactions on Biomedical Engineering.

[15]  Shree K. Nayar,et al.  When does a camera see rain? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[17]  Adrian E. Raftery,et al.  Normal uniform mixture differential gene expression detection for cDNA microarrays , 2005, BMC Bioinformatics.

[18]  Fuzhong Weng,et al.  Impact of the Vertical Variation of Cloud Droplet Size on the Estimation of Cloud Liquid Water Path and Rain Detection , 2007 .

[19]  Chen Yao,et al.  A Bayesian Probabilistic Framework for Rain Detection , 2014, Entropy.

[20]  José Jesús Fernández,et al.  An improved algorithm for anisotropic nonlinear diffusion for denoising cryo-tomograms. , 2003, Journal of structural biology.

[21]  Shree K. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH '06.

[22]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[23]  Nianjun Liu,et al.  Using the Shape Characteristics of Rain to Identify and Remove Rain from Video , 2008, SSPR/SPR.

[24]  J. Bobin,et al.  Morphological component analysis , 2005, SPIE Optics + Photonics.

[25]  Michael Elad,et al.  MCALab: Reproducible Research in Signal and Image Decomposition and Inpainting , 2010, Computing in Science & Engineering.