Stereo with mirrors

In this paper, we propose the use of mirrors and a single camera for computational stereo. When compared to conventional stereo systems that use two cameras, our method has a number of significant advantages such as wide field of view, single viewpoint projection, identical camera parameters and ease of calibration. We propose four stereo systems that use a single camera pointed towards planar, ellipsoidal, hyperboloidal, and paraboloidal mirrors. In each case, we present a derivation of the epipolar constraints. Next, we attempt to understand what can be seen by each system, and formalize the notion of field of view. We conclude with two experiments to obtain 3-D structure. In the first we use a pair of planar mirrors, and in the second a pair of paraboloidal mirrors. The results of our experiments demonstrate the viability of stereo using mirrors.

[1]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[2]  S. Nayar,et al.  Catadioptric Image Formation , 1997 .

[3]  Murat Draman,et al.  A Robotic Vision System , 1984 .

[4]  Shree K. Nayar,et al.  Generation of Perspective and Panoramic Video from Omnidirectional Video , 1997 .

[5]  S. Nayar Omnidirectional Video Camera , 1997 .

[6]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Shree K. Nayar,et al.  Telecentric Optics for Computational Vision , 1996, ECCV.

[8]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[9]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Yutaka Fukui,et al.  3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[12]  A. Ardeshir Goshtasby,et al.  Design of a single-lens stereo camera system , 1993, Pattern Recognit..

[13]  Konstantinos A. Tarabanis,et al.  Dynamic sensor planning , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[14]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Yasushi Yagi,et al.  Omnidirectional imaging with hyperboloidal projection , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).