The visual effects of rain are complex. Rain consists of spatially distributed drops falling at high velocities. Each drop refracts and reflects the environment, producing sharp intensity changes in an image. A group of such falling drops creates a complex time varying signal in images and videos. In addition, due to the finite exposure time of the camera, intensities due to rain are motion blurred and hence depend on the background intensities. Thus, the visual manifestations of rain are a combination of both the dynamics of rain and the photometry of the environment. In this paper, we present the first comprehensive analysis of the visual effects of rain on an imaging system. We develop a correlation model that captures the dynamics of rain and a physics-based motion blur model that explains the photometry of rain. Based on these models, we develop efficient algorithms for detecting and removing rain from videos. The effectiveness of our algorithms is demonstrated using experiments on videos of complex scenes with moving objects and time-varying textures. The techniques described in this paper can be used in a wide range of applications including video surveillance, vision based navigation, video/movie editing and video indexing/retrieval.
[1]
B. J. Mason.
Clouds, rain, and rainmaking
,
1962
.
[2]
Shree K. Nayar,et al.
Vision and the Atmosphere
,
2002,
International Journal of Computer Vision.
[3]
S. Clifford,et al.
Use of rainfall-induced optical scintillations to measure path-averaged rain parameters
,
1975
.
[4]
Stefano Soatto,et al.
Dynamic Textures
,
2003,
International Journal of Computer Vision.
[5]
A. Cantor.
Optics of the atmosphere--Scattering by molecules and particles
,
1978,
IEEE Journal of Quantum Electronics.
[6]
K. Beard,et al.
A New Model for the Equilibrium Shape of Raindrops
,
1987
.
[7]
Robert Michael Manning.
Stochastic electromagnetic image propagation : an adaptive compensation
,
1993
.
[8]
R. Gunn,et al.
THE TERMINAL VELOCITY OF FALL FOR WATER DROPLETS IN STAGNANT AIR
,
1949
.
[9]
Y. J. Tejwani,et al.
Robot vision
,
1989,
IEEE International Symposium on Circuits and Systems,.
[10]
J. Marshall,et al.
THE DISTRIBUTION OF RAINDROPS WITH SIZE
,
1948
.
[11]
M. Werman,et al.
Simulation of Rain in Videos
,
2002
.