Mirror symmetry => 2-view stereo geometry

Abstract We address the problem of 3D reconstruction from a single perspective view of a mirror symmetric scene. We establish the fundamental result that it is geometrically equivalent to observing the scene with two cameras, the cameras being symmetrical with respect to the unknown 3D symmetry plane. All traditional tools of classical 2-view stereo can then be applied, and the concepts of fundamental/essential matrix, epipolar geometry, rectification and disparity hold. However, the problems are greatly simplified here, as the rectification process and the computation of epipolar geometry can be easily performed from the original view only. If the camera is calibrated, we show how to synthesize the symmetric image generated by the same physical camera. A Euclidean reconstruction of the scene can then be computed from the resulting stereo pair. To validate this novel formulation, we have processed many real images, and show examples of 3D reconstruction.

[1]  Hung-Tat Tsui,et al.  3D reconstruction from a single view of an object and its image in a plane mirror , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[2]  Vishvjit S. Nalwa Line-Drawing Interpretation: Bilateral Symmetry , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Terrance E. Boult,et al.  Analyzing skewed symmetries , 1994, International Journal of Computer Vision.

[4]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[5]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[6]  Tieniu Tan,et al.  Monocular Reconstruction of 3-D Bilateral Symmetrical Objects , 1996, BMVC.

[7]  Ramakant Nevatia,et al.  Constraints for interpretation of line drawings under perspective projection , 1991, CVGIP Image Underst..

[8]  Du Q. Huynh,et al.  Affine reconstruction from monocular vision in the presence of a symmetry plane , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Yutaka Fukui,et al.  3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[11]  David A. Forsyth,et al.  Extracting projective structure from single perspective views of 3D point sets , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[13]  Gérard G. Medioni,et al.  Interactive 3D model extraction from a single image , 2001, Image Vis. Comput..

[14]  Michael Lindenbaum,et al.  Shape Reconstruction of 3D Bilaterally Symmetric Surfaces , 2000, International Journal of Computer Vision.