Second order local analysis for 3D reconstruction of specular surfaces

We analyze the problem of recovering the shape of a mirror surface. A calibrated scene composed of lines passing through a point is assumed. The lines are reflected by the mirror surface onto the image plane of a calibrated camera, where the intersection, orientation and curvature of such reflections are measured. The relationship between the local geometry of the surface around the point of reflection and the measurements is analyzed. We extend the analysis in Savarese and Perona. (2001, 2002), where we recovered positions and normals and second order local geometry of a specular surface up to one unknown parameter. We show that, provided that we work in a neighborhood of a surface whose third order surface terms can be neglected, the second order parameter ambiguity can be solved by equating the curvatures observed for the reflected lines with those computed from analytical differentiation followed by a perspective projection.

[1]  Min Chen,et al.  Theory and application of specular path perturbation , 2000, TOGS.

[2]  Pietro Perona,et al.  Local Analysis for 3D Reconstruction of Specular Surfaces - Part II , 2002, ECCV.

[3]  Andrew Blake,et al.  Geometry From Specularities , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[4]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[5]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[6]  Brian A. Barsky,et al.  Reconstructing curved surfaces from specular reflection patterns using spline surface fitting of normals , 1996, SIGGRAPH.

[7]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[8]  Roberto Cipolla,et al.  The visual motion of curves and surfaces , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[9]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image and Vision Computing.

[10]  P. Perona,et al.  Local analysis for 3D reconstruction of specular surfaces , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[13]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[14]  Jiang Yu Zheng,et al.  Acquiring a Complete 3D Model from Specular Motion under the Illumination of Circular-Shaped Light Sources , 2000, IEEE Trans. Pattern Anal. Mach. Intell..