Reconstruction of a Complex Mirror Surface from a Single Image

In this work, we propose a method to recover the shape of a complex mirror surface from a single image with un-calibrated environment. A complex mirror surface reflects the same environment feature at multiple surface points. These static reflection correspondences (SRCs) can be detected with SIFT (or its variations) and provide important visual cue of the surface shape. The detected SRCs are clustered by a bipartite graph partition method so that each cluster of SRCs is within either elliptic or hyperbolic surface regions. The surface region is then further segmented by a Voronoi diagram of the SRCs. Within each Voronoi cell, the surface is approximated by a local quadric model. Assuming orthographic projection and distant environment, the SRCs of an environment feature share the same surface gradient, which provides a major constraint to the surface shape. Along with the smoothness constraints, the surface shape can be recovered with an optimization method. Synthesized and physical experiments support our proposed method.

[1]  Zhenwen Dai,et al.  Pose estimation from reflections for specular surface recovery , 2011, 2011 International Conference on Computer Vision.

[2]  Kiriakos N. Kutulakos,et al.  A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[4]  D. B. Davis,et al.  Intel Corp. , 1993 .

[5]  Ohad Ben-Shahar,et al.  Shape from Specular Flow , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Brian A. Barsky,et al.  Reconstructing curved surfaces from specular reflection patterns using spline surface fitting of normals , 1996, SIGGRAPH.

[7]  Jürgen Beyerer,et al.  Multiview specular stereo reconstruction of large mirror surfaces , 2011, CVPR 2011.

[8]  Ohad Ben-Shahar,et al.  Dense specular shape from multiple specular flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Min Chen,et al.  Local Shape from Mirror Reflections , 2005, International Journal of Computer Vision.

[10]  Richard Held,et al.  Increased accommodation following adaptation to image blur in myopes. , 2004, Journal of Vision.

[11]  Rama Chellappa,et al.  Surface Reconstruction from Gradient Fields via Gradient Transformations , 2009, International Journal of Computer Vision.

[12]  Aswin C. Sankaranarayanan,et al.  Specular surface reconstruction from sparse reflection correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[14]  Marshall F. Tappen Recovering shape from a single image of a mirrored surface from curvature constraints , 2011, CVPR 2011.

[15]  Michael Lindenbaum,et al.  Dense Mirroring Surface Recovery from 1D Homographies and Sparse Correspondences , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Peter F. Sturm,et al.  Voxel carving for specular surfaces , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Tim Weyrich,et al.  Dense 3D reconstruction from specularity consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Aswin C. Sankaranarayanan,et al.  Image Invariants for Smooth Reflective Surfaces , 2010, ECCV.

[19]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[20]  P. Giblin,et al.  Curves and singularities : a geometrical introduction to singularity theory , 1992 .

[21]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[22]  Hans-Peter Seidel,et al.  3D acquisition of mirroring objects using striped patterns , 2005, Graph. Model..

[23]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[24]  A. Heyden,et al.  A variational analysis of shape from specularities using sparse data , 2004 .