Adequate reconstruction of transparent objects on a shoestring budget

Reconstructing transparent objects is a challenging problem. While producing reasonable results for quite complex objects, existing approaches require custom calibration or somewhat expensive labor to achieve high precision. On the other hand, when an overall shape preserving salient and fine details is sufficient, we show in this paper a significant step toward solving the problem on a shoestring budget, by using only a video camera, a moving spotlight, and a small chrome sphere. Specifically, the problem we address is to estimate the normal map of the exterior surface of a given solid transparent object, from which the surface depth can be integrated. Our technical contribution lies in relating this normal reconstruction problem to one of graph-cut segmentation. Unlike conventional formulations, however, our graph is dual-layered, since we can see a transparent object's foreground as well as the background behind it. Quantitative and qualitative evaluation are performed to verify the efficacy of this practical solution.

[1]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[2]  R. Gray Entropy and Information Theory , 1990, Springer New York.

[3]  Katsushi Ikeuchi,et al.  Transparent surface modeling from a pair of polarization images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Katsushi Ikeuchi,et al.  Transparent surface modeling from a pair of polarization images , 2004 .

[6]  R. Zabih,et al.  What energy functions can be minimized via graph cuts , 2004 .

[7]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[8]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[9]  Hans-Peter Seidel,et al.  Ridge-valley lines on meshes via implicit surface fitting , 2004, ACM Trans. Graph..

[10]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[11]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Kiriakos N. Kutulakos,et al.  A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation , 2005, ICCV.

[13]  Kiriakos N. Kutulakos,et al.  Dynamic Refraction Stereo , 2005, ICCV.

[14]  Hans-Peter Seidel,et al.  Mesostructure from Specularity , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Kiriakos N. Kutulakos,et al.  Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter-Trace Photography , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Ieee Transactions Shape Estimation of Transparent Objects by Using Inverse Polarization Ray Tracing , 2007 .

[17]  Katsushi Ikeuchi,et al.  Shape Estimation of Transparent Objects by Using Inverse Polarization Ray Tracing , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  H. Seidel,et al.  Fluorescent immersion range scanning , 2008, ACM Trans. Graph..

[19]  Tai-Pang Wu,et al.  Surface-from-Gradients without Discrete Integrability Enforcement: A Gaussian Kernel Approach , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.