Snow fluff detection and removal from video images

Snow detection and removal from video images is very challenging. Normally the snowflakes affect only on a very small region of an image, hence the confusion to determine which region should be considered and which one should not. In this paper, a frame difference method with five successive frames is first presented to detect the snow pixels from image background, but the method didn't work well in the case of heavy snow. Then a new technique has been implemented which uses the L0 gradient minimization approach to remove the snow pixels. This technique can control how many non-zero gradients are resulted in the image, and is independent of local features, but instead locates important edges globally. These salient edges are preserved and the low amplitude and insignificant details are diminished. The snow pixels are then removed in this way. Experimental results show that this method is a highly efficient algorithm even under heavy snow conditions, while preserving the details of the image.

[1]  Nianjun Liu,et al.  Using the Shape Characteristics of Rain to Identify and Remove Rain from Video , 2008, SSPR/SPR.

[2]  Naoki Asada,et al.  Seeing Behind the Scene: Analysis of Photometric Properties of Occluding Edges by the Reversed Projection Blurring Model , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hai Liu,et al.  Detecting and extracting natural snow from videos , 2010, Inf. Process. Lett..

[4]  Soo-Chang Pei,et al.  Removing rain and snow in a single image using saturation and visibility features , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[5]  Jérémie Bossu,et al.  Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks , 2011, International Journal of Computer Vision.

[6]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[7]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[8]  W. Richards,et al.  Why is snow so bright , 1992 .

[9]  Takeo Kanade,et al.  Analysis of Rain and Snow in Frequency Space , 2008, International Journal of Computer Vision.

[10]  Shree K. Nayar,et al.  Vision and Rain , 2007, International Journal of Computer Vision.

[11]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[12]  Ziyou Xiong,et al.  A two-step approach to see-through bad weather for surveillance video quality enhancement , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Masaaki Yoneda,et al.  Real-time snowfall noise elimination , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[14]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[15]  Chen Yao,et al.  Rain streak removal by multi-frame-based anisotropic filtering , 2015, Multimedia Tools and Applications.