Multiview specular stereo reconstruction of large mirror surfaces

In deflectometry, the shape of mirror objects is recovered from distorted images of a calibrated scene. While remarkably high accuracies are achievable, state-of-the-art methods suffer from two distinct weaknesses: First, for mainly constructive reasons, these can only capture a few square centimeters of surface area at once. Second, reconstructions are ambiguous i.e. infinitely many surfaces lead to the same visual impression. We resolve both of these problems by introducing the first multiview specular stereo approach, which jointly evaluates a series of overlapping deflectometric images. Two publicly available benchmarks accompany this paper, enabling us to numerically demonstrate viability and practicability of our approach.

[1]  Sang Uk Lee,et al.  Multiview normal field integration using level set methods , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  J. Balzer,et al.  Principles of Shape from Specular Reflection , 2010 .

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, SIGGRAPH 2004.

[5]  Jürgen Beyerer,et al.  Optimization on Shape Curves with Application to Specular Stereo , 2010, DAGM-Symposium.

[6]  T. Banchoff,et al.  Differential Geometry of Curves and Surfaces , 2010 .

[7]  Timothy A. Davis,et al.  Dynamic Supernodes in Sparse Cholesky Update/Downdate and Triangular Solves , 2009, TOMS.

[8]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[9]  Aswin C. Sankaranarayanan,et al.  Specular surface reconstruction from sparse reflection correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Gerd Hirzinger,et al.  More accurate camera and hand-eye calibrations with unknown grid pattern dimensions , 2008, 2008 IEEE International Conference on Robotics and Automation.

[11]  Leif Kobbelt,et al.  OpenMesh: A Generic and Efficient Polygon Mesh Data Structure , 2002 .

[12]  Peter F. Sturm,et al.  Voxel carving for specular surfaces , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Zengfu Wang,et al.  Determining Shape of Specular Surfaces , 2007 .

[14]  Lee E. Weiss,et al.  Structured Highlight Inspection of Specular Surfaces , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jürgen Beyerer,et al.  Shape from Specular Reflection and Optical Flow , 2008, International Journal of Computer Vision.

[16]  Michael J. Black,et al.  Specular Flow and the Recovery of Surface Structure , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Gang Xu,et al.  Dense 3D Reconstruction of Specular and Transparent Objects Using Stereo Cameras and Phase-Shift Method , 2007, ACCV.

[19]  Ohad Ben-Shahar,et al.  Dense specular shape from multiple specular flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.