Low latency mitigation of rain induced noise in images

Sometimes, weather conditions, particularly rain and snow, makes it difficult to obtain clear image or videos. Partial occlusion by moving rain drops makes it difficult to process such videos for example in object recognition and feature tracking. The difficulty further increases in presence of camera and objects motion. Motion analysis is typically performed to avoid distortions in camera and object motion. This paper proposes an image processing procedure to carry out rain removal in image sequences without explicit motion analysis. The proposed method analysis temporal changes (with 1 frame latency) and selects rain corrupted image pixels. The selected pixels are further filtered for camera and object motion by using spatio-temporal consistency constrains. The corrupted pixels are recovered by intensity subtraction. A naive selection of algorithms shows comparable results. The proposed scheme has various applications for example outdoor surveillance, feature tracking and object recognition. (4 pages)

[1]  Shree K. Nayar,et al.  When does a camera see rain? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Takeo Kanade,et al.  Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Videos , 2007 .

[3]  M. Werman,et al.  Simulation of Rain in Videos , 2002 .

[4]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  J. Marshall,et al.  THE DISTRIBUTION OF RAINDROPS WITH SIZE , 1948 .

[6]  S. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH 2006.

[7]  R. Gunn,et al.  THE TERMINAL VELOCITY OF FALL FOR WATER DROPLETS IN STAGNANT AIR , 1949 .

[8]  C. Ulbrich Natural Variations in the Analytical Form of the Raindrop Size Distribution , 1983 .

[9]  K. Beard,et al.  A New Model for the Equilibrium Shape of Raindrops , 1987 .