Catadioptric Stereo Using Planar Mirrors

By using mirror reflections of a scene, stereo images can be captured with a single camera (catadioptric stereo). In addition to simplifying data acquisition single camera stereo provides both geometric and radiometric advantages over traditional two camera stereo. In this paper, we discuss the geometry and calibration of catadioptric stereo with two planar mirrors. In particular, we will show that the relative orientation of a catadioptric stereo rig is restricted to the class of planar motions thus reducing the number of external calibration parameters from 6 to 5. Next we derive the epipolar geometry for catadioptric stereo and show that it has 6 degrees of freedom rather than 7 for traditional stereo. Furthermore, we show how focal length can be recovered from a single catadioptric image solely from a set of stereo correspondences. To test the accuracy of the calibration we present a comparison to Tsai camera calibration and we measure the quality of Euclidean reconstruction. In addition, we will describe a real-time system which demonstrates the viability of stereo with mirrors as an alternative to traditional two camera stereo.

[1]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[2]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  Naokazu Yokoya,et al.  Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[4]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[5]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[6]  Martin Neil Armstrong,et al.  Self-Calibration from Image Sequences , 1996 .

[7]  Amnon Shashua,et al.  Omni-Rig sensors: what can be done with a non-rigid vision platform? , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[8]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[9]  豊岡 了,et al.  Optics, E. Hecht & A. Zajac, Addison-Wesley Publ. Co., 1974 , 1984 .

[10]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[11]  Thierry Viéville,et al.  Using Singular Displacements for Uncalibrated Monocular Visual Systems , 1996, ECCV.

[12]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Rajiv Gupta,et al.  Computing matched-epipolar projections , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[15]  O. Faugeras,et al.  Camera Self-Calibration from Video Sequences: the Kruppa Equations Revisited , 1996 .

[16]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[17]  W. Teoh,et al.  An inexpensive stereoscopic vision system for robots , 1984, ICRA.

[18]  Takeo Kanade,et al.  A stereo machine for video-rate dense depth mapping and its new applications , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[20]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Shree K. Nayar,et al.  Planar catadioptric stereo: geometry and calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[23]  Murat Draman,et al.  A Robotic Vision System , 1984 .

[24]  William H. Press,et al.  Numerical recipes in C , 2002 .

[25]  Frederic Devernay,et al.  Système de miroirs pour la stéréoscopie , 1995 .

[26]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[27]  Larry H. Matthies,et al.  Stereo vision for planetary rovers: Stochastic modeling to near real-time implementation , 1991, Optics & Photonics.

[28]  Hung-Tat Tsui,et al.  3D reconstruction from a single view of an object and its image in a plane mirror , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[29]  David W. Murray.  Recovering Range Using Virtual Multicamera Stereo , 1995, Comput. Vis. Image Underst..

[30]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[31]  S. Nayar,et al.  Catadioptric Image Formation , 1997 .

[32]  Yutaka Fukui,et al.  3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  A. Ardeshir Goshtasby,et al.  Design of a single-lens stereo camera system , 1993, Pattern Recognit..

[34]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[35]  Masayuki Inaba,et al.  A stereo viewer based on a single camera with view-control mechanisms , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).