Light and Water Drops

Water drops are present throughout our daily lives. Microscopic droplets create fog and mist, and large drops fall as rain. Because of their shape and refractive properties, water drops exhibit a wide variety of visual effects. If not directly illuminated by a light source, they are difficult to see. But if they are directly illuminated, they can become the brightest objects in the environment. This thesis has two main components. First, we will show how to create two- and three-dimensional displays using water drops and a projector. Water drops act as tiny spherical lenses, refracting light into a wide angle. To a person viewing an illuminated drop, it will appear that the drop is the same color as the incident light ray. Using a valve assembly, we will fill a volume with non-occluding water drops. At any instant in time, no ray from the projector will intersect with two drops. Using a camera, we will detect the drops locations, then illuminate them with the projector. The final result is a programmable, dynamic, and three-dimensional display. Second, we will show how to reduce the effect of water drops in videos via spatio-temporal frequency analysis, and in real life, by using a projector to illuminate everything except the drops. To remove rain (and snow) from videos, we will use a streak model in frequency space to find the frequencies corresponding to rain and snow in the video. These frequencies can then be suppressed to reduce the effect of rain and snow. We will also suppress the visual effect of water drops by selectively "missing" them by not illuminating them with a projector. In light rain, this can be performed by tracking individual drops. This kind of drop-avoiding light source could be used for many nighttime applications, such as car headlights.

[1]  E. Parker,et al.  Three-dimensional cathode ray tube display , 1948 .

[2]  J. Marshall,et al.  THE DISTRIBUTION OF RAINDROPS WITH SIZE , 1948 .

[3]  A. Spilhaus RAINDROP SIZE, SHAPE AND FALLING SPEED , 1948 .

[4]  A. Best Empirical formulae for the terminal velocity of water drops falling through the atmosphere , 1950 .

[5]  D. Blanchard RAINDROP SIZE-DISTRIBUTION IN HAWAIIAN RAINS , 1953 .

[6]  M. P. Langleben The terminal velocity of snowflakes , 1954 .

[7]  H. V. Hulst Light Scattering by Small Particles , 1957 .

[8]  J. Marshall,et al.  THE DISTRIBUTION WITH SIZE OF AGGREGATE SNOWFLAKES , 1958 .

[9]  B. J. Mason,et al.  Drop‐size distributions from various types of rain , 1960 .

[10]  C. Magono,et al.  Aerodynamic Studies of Falling Snowflakes , 1965 .

[11]  T. Ohtake Preliminary observations of size distribution of snowflakes and raindrops at just above and below the melting layer (国際雲物理学会議議事録〔英文〕) , 1965 .

[12]  G. Foote,et al.  Terminal Velocity of Raindrops Aloft , 1969 .

[13]  A. H. Auer,et al.  The Dimension of Ice Crystals in Natural Clouds , 1970 .

[14]  H. Pruppacher,et al.  A Semi-Empirical Determination of the Shape of Cloud and Rain Drops , 1971 .

[15]  A. H. Auer Distribution of Graupel and Hail With Size , 1972 .

[16]  K. Beard Terminal Velocity and Shape of Cloud and Precipitation Drops Aloft , 1976 .

[17]  Measurement of rain parameters by optical scintillation. , 1977, Applied optics.

[18]  L. R. Koenig,et al.  A Short Course in Cloud Physics , 1979 .

[19]  Optical rain gauge using a divergent beam. , 1980, Applied optics.

[20]  J. Klett,et al.  Microphysics of Clouds and Precipitation , 1978, Nature.

[21]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[23]  C. Ulbrich Natural Variations in the Analytical Form of the Raindrop Size Distribution , 1983 .

[24]  William T. Reeves,et al.  Particle systems—a technique for modeling a class of fuzzy objects , 1983, International Conference on Computer Graphics and Interactive Techniques.

[25]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .

[26]  G. Feingold,et al.  The Lognormal Fit to Raindrop Spectra from Frontal Convective Clouds in Israel , 1986 .

[27]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[28]  C. Stow,et al.  THe arrival rate of raindrops at the ground , 1987 .

[29]  H. Böhm A General Equation for the Terminal Fall Speed of Solid Hydrometeors. , 1989 .

[30]  D. Bailey Raster Based Region Growing , 1991 .

[31]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[32]  R. D. Veaux,et al.  A stochastic model relating rainfall intensity to raindrop processes , 1994 .

[33]  Theodore O. Grosch Radar sensors for automotive collision warning and avoidance , 1995, Defense, Security, and Sensing.

[34]  K. Beard,et al.  A field study of raindrop oscillations. Part I: Observation of size spectra and evaluation of oscillation causes , 1996 .

[35]  D. Mitchell Use of Mass- and Area-Dimensional Power Laws for Determining Precipitation Particle Terminal Velocities , 1996 .

[36]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[37]  Fabio Gagliardi Cozman,et al.  Depth from scattering , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Edward Hoare,et al.  Trials of automotive radar and lidar performance in road spray , 1998 .

[39]  H. Le,et al.  Progress and Trends in Ink-jet Printing Technology , 1998, Journal of Imaging Science and Technology.

[40]  Hiroshi Ishii,et al.  Water lamp and pinwheels: ambient projection of digital information into architectural space , 1998, CHI Conference Summary.

[41]  Hiroshi Ishii,et al.  Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information , 1998, CoBuild.

[42]  J. Lavergnat,et al.  A Stochastic Raindrop Time Distribution Model , 1998 .

[43]  P. Hobbs,et al.  Microstructures of low and middle‐level clouds over the Beaufort Sea , 1998 .

[44]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[45]  Hiroshi Ishii,et al.  ambientROOM: integrating ambient media with architectural space , 1998, CHI Conference Summary.

[46]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[47]  Masaaki Yoneda,et al.  Real-time snowfall noise elimination , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[48]  R. Uijlenhoet,et al.  Parameterization of rainfall microstructure for radar meteorology and hydrology , 1999 .

[49]  Richard Szeliski,et al.  An integrated Bayesian approach to layer extraction from image sequences , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[50]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[51]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[52]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[53]  R. Uijlenhoet,et al.  Towards a stochastic model of rainfall for radar hydrology : testing the poisson homogeneity hypothesis , 1999 .

[54]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[55]  Scott E. Hudson,et al.  The information percolator: ambient information display in a decorative object , 1999, UIST '99.

[56]  Shree K. Nayar,et al.  Chromatic framework for vision in bad weather , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[57]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[58]  Y. Chisti,et al.  Dynamics of Droplets , 2000 .

[59]  Glenn R. Widmann,et al.  Comparison of Lidar-Based and Radar-Based Adaptive Cruise Control Systems , 2000 .

[60]  M. Löffler-Mang,et al.  An Optical Disdrometer for Measuring Size and Velocity of Hydrometeors , 2000 .

[61]  A. R. Jameson,et al.  On the Spatial Distribution of Cloud Particles , 2000 .

[62]  Christian Onof,et al.  Rainfall modelling using Poisson-cluster processes: a review of developments , 2000 .

[63]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[64]  Manuela M. Veloso,et al.  Fast and inexpensive color image segmentation for interactive robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[65]  Charles E. Thorpe,et al.  Side collision warning systems for transit buses , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[66]  Shree K. Nayar,et al.  Removing weather effects from monochrome images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[67]  Dariu Gavrila,et al.  Sensor-Based Pedestrian Protection , 2001, IEEE Intell. Syst..

[68]  Frank P. Ferrie,et al.  A model-based road sign identification system , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[69]  Michael J. Black,et al.  Robust Principal Component Analysis for Computer Vision , 2001, ICCV.

[70]  A. R. Jameson,et al.  What is a Raindrop Size Distribution , 2001 .

[71]  D. Schertzer,et al.  The HYDROP experiment: an empirical method for the determination of the continuum limit in rain , 2001 .

[72]  Shree K. Nayar,et al.  Instant dehazing of images using polarization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[73]  C. Schmid,et al.  Indexing based on scale invariant interest points , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[74]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[75]  Rahul Sukthankar,et al.  Smarter Presentations: Exploiting Homography in Camera-Projector Systems , 2001, ICCV.

[76]  V. Larson,et al.  Observed Microphysical Structure of Midlevel, Mixed-Phase Clouds , 2002 .

[77]  A. R. Jameson,et al.  When is Rain Steady , 2002 .

[78]  O. Basaran,et al.  Drop formation from a capillary tube: Comparison of one-dimensional and two-dimensional analyses and occurrence of satellite drops , 2002 .

[79]  E. D. Dickmanns,et al.  The development of machine vision for road vehicles in the last decade , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[80]  Kuldip K. Paliwal,et al.  Polynomial features for robust face authentication , 2002, Proceedings. International Conference on Image Processing.

[81]  Takeo Kanade,et al.  A robust subspace approach to layer extraction , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[82]  M. Werman,et al.  Simulation of Rain in Videos , 2002 .

[83]  D. Schertzer,et al.  Large particle number limit in rain. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[84]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[85]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[86]  M. Langer,et al.  Rendering Falling Snow Using an Inverse Fourier Transform , 2003 .

[87]  S. Nayar,et al.  Detection and removal of rain from videos , 2004, CVPR 2004.

[88]  Ismo Rakkolainen,et al.  Interactive digital FogScreen , 2004, NordiCHI '04.

[89]  Shree K. Nayar,et al.  Programmable imaging using a digital micromirror array , 2004, CVPR 2004.

[90]  Ramesh Raskar,et al.  Automatic projector calibration with embedded light sensors , 2004, UIST '04.

[91]  Michael S. Langer,et al.  A Spectral-particle hybrid method for rendering falling snow , 2004, Rendering Techniques.

[92]  H.-M. Rein,et al.  Fully integrated SiGe VCOs with powerful output buffer for 77-GHz automotive Radar systems and applications around 100 GHz , 2004, IEEE Journal of Solid-State Circuits.

[93]  Hae-Seung Lee,et al.  Analog VLSI systems for image acquisition and fast early vision processing , 1992, International Journal of Computer Vision.

[94]  J. Wenger,et al.  Automotive radar - status and perspectives , 2005, IEEE Compound Semiconductor Integrated Circuit Symposium, 2005. CSIC '05..

[95]  Atsushi Yamashita,et al.  Removal of adherent waterdrops from images acquired with stereo camera , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[96]  Shree K. Nayar,et al.  When does a camera see rain? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[97]  Lihi Zelnik-Manor,et al.  Multi-body Factorization with Uncertainty: Revisiting Motion Consistency , 2005, International Journal of Computer Vision.

[98]  Ismo Rakkolainen,et al.  Laser scanning for the interactive walk-through fogScreen , 2005, VRST '05.

[99]  Jinxiang Dong,et al.  Real-Time Rain Simulation , 2005, CSCWD.

[100]  Ralph Helmar Rasshofer,et al.  Automotive Radar and Lidar Systems for Next Generation Driver Assistance Functions , 2005 .

[101]  Hao Li,et al.  Rain Removal in Video by Combining Temporal and Chromatic Properties , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[102]  Taro Uchiyama,et al.  Laser produced 3D display in the air , 2006, SIGGRAPH '06.

[103]  Richard G. Baraniuk,et al.  A new compressive imaging camera architecture using optical-domain compression , 2006, Electronic Imaging.

[104]  Junichi Hoshino,et al.  bubble cosmos , 2006, SIGGRAPH '06.

[105]  Tomohiro Tanikawa,et al.  Display Composed of Water Drops for Filling Space with Materialized Virtual Three-dimensional Objects , 2006, IEEE Virtual Reality Conference (VR 2006).

[106]  Tomohiro Tanikawa,et al.  Controllable water particle display , 2006, ACE '06.

[107]  B.E. Digregorio Safer driving in the dead of night [infrared vision systems] , 2006, IEEE Spectrum.

[108]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[109]  Richard G. Baraniuk,et al.  Random Filters for Compressive Sampling and Reconstruction , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[110]  Natalya Tatarchuk,et al.  Artist-directable real-time rain rendering in city environments , 2006, NPH.

[111]  S. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH 2006.

[112]  Seth J. Teller,et al.  Particle Video: Long-Range Motion Estimation Using Point Trajectories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[113]  J. Wenger Short range radar - Being on the market , 2007, 2007 European Microwave Conference.

[114]  W. Randeu,et al.  One decade of imaging precipitation measurement by 2D-video-distrometer , 2007 .

[115]  S. Anna,et al.  Microfluidic methods for generating continuous droplet streams , 2007 .

[116]  J. Wenger,et al.  Long Range and Ultra-Wideband Short Range Automotive Radar , 2007, 2007 IEEE International Conference on Ultra-Wideband.

[117]  Takeo Kanade,et al.  Analysis of Rain and Snow in Frequency Space , 2008, International Journal of Computer Vision.

[118]  Nianjun Liu,et al.  Using the Shape Characteristics of Rain to Identify and Remove Rain from Video , 2008, SSPR/SPR.

[119]  S. Nayar,et al.  Contrast restoration of weather degraded images , 2008, SIGGRAPH 2008.

[120]  Mei Chen,et al.  Local quality assessment for optical coherence tomography , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[121]  Andrew Vande Moere,et al.  Beyond the Tyranny of the Pixel: Exploring the Physicality of Information Visualization , 2008, 2008 12th International Conference Information Visualisation.

[122]  Lei Huang,et al.  Real-time modeling and rendering of raining scenes , 2008, The Visual Computer.

[123]  Makoto Iida,et al.  "ephemeral melody": music played with wind and bubbles , 2008, SIGGRAPH '08.

[124]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[125]  G. Wollstein,et al.  Pathology Insensitive Quality Assessment for Optical Coherence Tomography , 2008 .

[126]  S. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[127]  Atsushi Yamashita,et al.  Removal of adherent noises from image sequences by spatio-temporal image processing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[128]  C.N. Padole,et al.  Image restoration using Wigner distribution for night vision system , 2008, 2008 9th International Conference on Signal Processing.

[129]  이정호,et al.  Fundamentals of Fluid Mechanics, 6th Edition , 2009 .

[130]  Miguel Chover,et al.  Creation and control of rain in virtual environments , 2009, The Visual Computer.

[131]  Jing Xu,et al.  Pixel Based Temporal Analysis Using Chromatic Property for Removing Rain from Videos , 2009, Comput. Inf. Sci..

[132]  Takeo Kanade,et al.  Dynamic seethroughs: Synthesizing hidden views of moving objects , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[133]  Tomohiro Tanikawa,et al.  Study on design of controllable particle display using water drops suitable for light environment , 2009, VRST '09.

[134]  Andreas Geiger,et al.  Video-based raindrop detection for improved image registration , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[135]  W. Petersen,et al.  Rain microstructure retrievals using 2-D video disdrometer and C-band polarimetric radar , 2009 .

[136]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[137]  Takeo Kanade,et al.  A projector-camera system for creating a display with water drops , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[138]  Hideo Saito,et al.  Removal of Glare Caused by Water Droplets , 2009 .

[139]  Ashok Veeraraghavan,et al.  Flexible Voxels for Motion-Aware Videography , 2010, ECCV.

[140]  Takeo Kanade,et al.  A multi-layered display with water drops , 2010, ACM Trans. Graph..

[141]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[142]  Sudipta Mukhopadhyay,et al.  A Probabilistic Approach for Detection and Removal of Rain from Videos , 2011 .

[143]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[144]  Erik Oberg,et al.  Machinery's Handbook , 2012 .