Estimating the unknown poses of a reference plane for specular shape recovery

This paper addresses the problem of recovering the unknown poses of a moving reference plane for specular shape recovery. Given the initial pose of the reference plane with respect to the camera, a closed form solution is derived to recover its subsequent poses directly from its reflections on the specular surface observed in the image sequence. With the estimated poses of the reference plane, the specular surface can then be easily recovered using any existing ray triangulation method. The proposed method greatly simplifies the calibration problem in specular shape recovery. Experimental results on both synthetic and real data are presented, which demonstrate the effectiveness of the proposed method.

[1]  P. Perona,et al.  Local analysis for 3D reconstruction of specular surfaces , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Pietro Perona,et al.  Local Analysis for 3D Reconstruction of Specular Surfaces - Part II , 2002, ECCV.

[3]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[4]  Peter F. Sturm,et al.  How to Compute the Pose of an Object Without a Direct View? , 2006, ACCV.

[5]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[6]  Aswin C. Sankaranarayanan,et al.  Specular surface reconstruction from sparse reflection correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Michael J. Black,et al.  Specular Flow and the Recovery of Surface Structure , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[9]  Pau Gargallo,et al.  General Specular Surface Triangulation , 2006, ACCV.

[10]  Kiriakos N. Kutulakos,et al.  A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[12]  Peter F. Sturm,et al.  Voxel carving for specular surfaces , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Bill Triggs,et al.  Factorization methods for projective structure and motion , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Zhenwen Dai,et al.  Specular Surface Recovery from Reflections of a Planar Pattern Undergoing an Unknown Pure Translation , 2010, ACCV.

[16]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[17]  Andrew Blake,et al.  Geometry From Specularities , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[18]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[19]  Tim Weyrich,et al.  Dense 3D reconstruction from specularity consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[21]  Ohad Ben-Shahar,et al.  Toward a Theory of Shape from Specular Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Ohad Ben-Shahar,et al.  A linear formulation of shape from specular flow , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.