Fast reactive control for illumination through rain and snow

During low-light conditions, drivers rely mainly on headlights to improve visibility. But in the presence of rain and snow, headlights can paradoxically reduce visibility due to light reflected off of precipitation back towards the driver. Precipitation also scatters light across a wide range of angles that disrupts the vision of drivers in oncoming vehicles. In contrast to recent computer vision methods that digitally remove rain and snow streaks from captured images, we present a system that will directly improve driver visibility by controlling illumination in response to detected precipitation. The motion of precipitation is tracked and only the space around particles is illuminated using fast dynamic control. Using a physics-based simulator, we show how such a system would perform under a variety of weather conditions. We build and evaluate a proof-of-concept system that can avoid water drops generated in the laboratory.

[1]  J. L. Monteith,et al.  The impact of weather on life: As explored in the quarterly journal of the royal meteorological society , 2002 .

[2]  Tomohiro Tanikawa,et al.  Display Composed of Water Drops for Filling Space with Materialized Virtual Three-dimensional Objects , 2006, IEEE Virtual Reality Conference (VR 2006).

[3]  J. Marshall,et al.  THE DISTRIBUTION OF RAINDROPS WITH SIZE , 1948 .

[4]  M. P. Langleben The terminal velocity of snowflakes , 1954 .

[5]  Hao Li,et al.  Rain Removal in Video by Combining Temporal and Chromatic Properties , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[6]  Takeo Kanade,et al.  Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Videos , 2007 .

[7]  Roland Bremond,et al.  Review of the Mechanisms of Visibility Reduction by Rain and Wet Road , 2009 .

[8]  Ping Dong,et al.  Analysis, modelling and robust control of automotive HID headlight systems , 2008 .

[9]  J. Marshall,et al.  THE DISTRIBUTION WITH SIZE OF AGGREGATE SNOWFLAKES , 1958 .

[10]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  John Hart,et al.  ACM Transactions on Graphics: Editorial , 2003, SIGGRAPH 2003.

[12]  Hans-Peter Seidel,et al.  A context-aware light source , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[13]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Takeo Kanade,et al.  A multi-layered display with water drops , 2010, ACM Trans. Graph..

[15]  Hai Liu,et al.  Detecting and extracting natural snow from videos , 2010, Inf. Process. Lett..

[16]  Andreas Macke,et al.  Light scattering by nonspherical raindrops: Implications for lidar remote sensing of rainrates , 1998 .

[17]  A. S. Dennis,et al.  Hailstone Size Distributions and Equivalent Radar Reflectivity Factors Computed from Hailstone Momentum Records , 1971 .

[18]  J. van Boxel,et al.  Numerical model for the fall speed of raindrops in a rainfall simulator , 1998 .

[19]  Roberto Fraile,et al.  Hailstone size distributions in southwestern France , 1994 .

[20]  R. C. Srivastava,et al.  Doppler radar characteristics of precipitation at vertical incidence , 1973 .

[21]  Shree K. Nayar,et al.  When does a camera see rain? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.