Raindrop Complement based on Epipolar Geometry and Spatiotemporal Patches

In this paper, we propose detection and complement of raindrops on mirrors and windows onto cars. Raindrops on windows and mirrors disturb view of drivers. In general, they were removed using wiper and special devices. However, the devices cannot be used for general case. In our proposed method, images of mirrors and windows are taken by camera and raindrops are complemented on the images, virtually. The method is based on auto-epipolar geometry and concept of spatiotemporal image. By using the method, we can observe clear windows and mirrors only if we can take them by camera.

[1]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[2]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Masaaki Yoneda,et al.  Real-time snowfall noise elimination , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[4]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Xiaochun Cao,et al.  Video Completion for Perspective Camera Under Constrained Motion , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[7]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[8]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Stefano Soatto,et al.  Inpainting from multiple views , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.