Vision and Rain

The visual effects of rain are complex. Rain produces sharp intensity changes in images and videos that can severely impair the performance of outdoor vision systems. In this paper, we provide a comprehensive analysis of the visual effects of rain and the various factors that affect it. Based on this analysis, we develop efficient algorithms for handling rain in computer vision as well as for photorealistic rendering of rain in computer graphics. We first develop a photometric model that describes the intensities produced by individual rain streaks and a dynamic model that captures the spatio-temporal properties of rain. Together, these models describe the complete visual appearance of rain. Using these models, we develop a simple and effective post-processing algorithm for detection and removal of rain from videos. We show that our algorithm can distinguish rain from complex motion of scene objects and other time-varying textures. We then extend our analysis by studying how various factors such as camera parameters, rain properties and scene brightness affect the appearance of rain. We show that the unique physical properties of rain—its small size, high velocity and spatial distribution—makes its visibility depend strongly on camera parameters. This dependence is used to reduce the visibility of rain during image acquisition by judiciously selecting camera parameters. Conversely, camera parameters can also be chosen to enhance the visibility of rain. This ability can be used to develop an inexpensive and portable camera-based rain gauge that provides instantaneous rain-rate measurements. Finally, we develop a rain streak appearance model that accounts for the rapid shape distortions (i.e. oscillations) that a raindrop undergoes as it falls. We show that modeling these distortions allows us to faithfully render the complex intensity patterns that are visible in the case of raindrops that are close to the camera.

[1]  W. Middleton,et al.  Vision Through the Atmosphere , 1952 .

[2]  K. Beard,et al.  Laboratory Measurements of Spontaneous Oscillations for Moderate-Size Raindrops , 1993 .

[3]  J. Marshall,et al.  THE DISTRIBUTION OF RAINDROPS WITH SIZE , 1948 .

[4]  K. Beard,et al.  A New Model for the Equilibrium Shape of Raindrops , 1987 .

[5]  Michael S. Langer,et al.  A Spectral-particle hybrid method for rendering falling snow , 2004, Rendering Techniques.

[6]  S. Bradley,et al.  Measurements of Rainfall Properties Using Long Optical Path Imaging , 2000 .

[7]  E. J. Mccartney,et al.  Optics of the Atmosphere: Scattering by Molecules and Particles , 1977 .

[8]  Pat Hanrahan,et al.  Flow and changes in appearance , 2006, SIGGRAPH Courses.

[9]  S. Clifford,et al.  Use of rainfall-induced optical scintillations to measure path-averaged rain parameters , 1975 .

[10]  M. Werman,et al.  Simulation of Rain in Videos , 2002 .

[11]  Douglas Losordo,et al.  The matrix revolutions: matrix metalloproteinase, vasculogenesis, and ischemic tissue repair. , 2007, Circulation research.

[12]  Shree K. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH '06.

[13]  Karen Andsager,et al.  Laboratory Measurements of Axis Ratios for Large Raindrops , 1999 .

[14]  KokKeong Tan,et al.  Enhancement of color images in poor visibility conditions , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[15]  M. Box,et al.  Forwardscattering corrections for optical extinction measurements in aerosol media. 1: Monodispersions. , 1978, Applied optics.

[16]  J. O. Lewis,et al.  Architectural detailing, weathering and stone decay , 1994 .

[17]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[18]  Niniane Wang,et al.  Rendering falling rain and snow , 2004, SIGGRAPH '04.

[19]  K. Beard,et al.  A field study of raindrop oscillations. Part I: Observation of size spectra and evaluation of oscillation causes , 1996 .

[20]  T. Chu,et al.  Effects of precipitation on propagation at 0.63, 3.5, and 10.6 microns , 1968 .

[21]  John P. Oakley,et al.  Improving image quality in poor visibility conditions using a physical model for contrast degradation , 1998, IEEE Trans. Image Process..

[22]  Witold F. Krajewski,et al.  Sampling Errors of Tipping-Bucket Rain Gauge Measurements , 2001 .

[23]  Wladyslaw W. Szymanski,et al.  Forward scattering corrections for optical extinction measurements in aerosol media , 2000 .

[24]  R. Gunn,et al.  THE TERMINAL VELOCITY OF FALL FOR WATER DROPLETS IN STAGNANT AIR , 1949 .

[25]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[26]  M. Löffler-Mang,et al.  An Optical Disdrometer for Measuring Size and Velocity of Hydrometeors , 2000 .

[27]  A. Borovoy,et al.  Intensity fluctuations of optical radiation in scattering media. , 1975, Applied optics.

[28]  Fabio Gagliardi Cozman,et al.  Depth from scattering , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  S. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH 2006.

[31]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[32]  B Marie,et al.  Blue sky studios , 2007 .

[33]  Edmund C.C Choi,et al.  Numerical modelling of gust effect on wind-driven rain , 1997 .

[34]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.