What does motion reveal about transparency?

The perception of transparent objects from images is known to be a very hard problem in vision. Given a single image, it is difficult to even detect the presence of transparent objects in the scene. In this paper, we explore what can be said about transparent objects by a moving observer. We show how features that are imaged through a transparent object behave differently from those that are rigidly attached to the scene. We present a novel model-based approach to recover the shapes and the poses of transparent objects from known motion. The objects can be complex in that they may be composed of multiple layers with different refractive indices. We have conducted numerous simulations to verify the practical feasibility of our algorithm. We have applied it to real scenes that include transparent objects and recovered the shapes of the objects with high accuracy.

[1]  Katsushi Ikeuchi,et al.  Measurement of surface orientations of transparent objects using polarization in highlight , 2001, Systems and Computers in Japan.

[2]  Wojciech Matusik,et al.  Acquisition and Rendering of Transparent and Refractive Objects , 2002, Rendering Techniques.

[3]  Hans-Gerd Maas,et al.  New developments in Multimedia Photogrammetry , 2001 .

[4]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[5]  Seiji Hata,et al.  Shape extraction of transparent object using genetic algorithm , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[6]  S. Cornbleet,et al.  Microwave and Geometric Optics , 1994 .

[7]  Hiroshi Murase,et al.  Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  E. D. Cyan.  Handbook of Chemistry and Physics , 1970 .

[9]  David Salesin,et al.  Environment matting extensions: towards higher accuracy and real-time capture , 2000, SIGGRAPH.

[10]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[11]  Young Kee Ryu,et al.  Development of a noncontact optical sensor for measuring the shape of a surface and thickness of transparent objects , 2001 .

[12]  Neil A. Dodgson,et al.  Proceedings Ninth IEEE International Conference on Computer Vision , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  D. Lide.  Handbook of Chemistry and Physics , 1992 .

[14]  Andrew W. Fitzgibbon,et al.  Image-based environment matting , 2002, SIGGRAPH '02.