Catadioptric Projective Geometry

Catadioptric sensors are devices which utilize mirrors and lenses to form a projection onto the image plane of a camera. Central catadioptric sensors are the class of these devices having a single effective viewpoint. In this paper, we propose a unifying model for the projective geometry induced by these devices and we study its properties as well as its practical implications. We show that a central catadioptric projection is equivalent to a two-step mapping via the sphere. The second step is equivalent to a stereographic projection in the case of parabolic mirrors. Conventional lens-based perspective cameras are also central catadioptric devices with a virtual planar mirror and are, thus, covered by the unifying model. We prove that for each catadioptric projection there exists a dual catadioptric projection based on the duality between points and line images (conics). It turns out that planar and parabolic mirrors build a dual catadioptric projection pair. As a practical example we describe a procedure to estimate focal length and image center from a single view of lines in arbitrary position for a parabolic catadioptric system.

[1]  Michael F. Land,et al.  Optics and Vision in Invertebrates , 1981 .

[2]  G. Toomer,et al.  DIOCLES On Burning Mirrors , 1976 .

[3]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[4]  Sing Bing Kang,et al.  Catadioptric self-calibration , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  H. Ishiguro,et al.  Panoramic Vision , 2001, Monographs in Computer Science.

[6]  Pal Greguss.  The tube-peeper: A new concept in endoscopy Optics and Laser Technology , 1985 .

[7]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[9]  Shree K. Nayar,et al.  Folded catadioptric cameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Terrance E. Boult.  Remote Reality Demonstration , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[11]  P. Sturm.  A method for 3D reconstruction of piecewise planar objects from single panoramic images , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[12]  Tomás Svoboda,et al.  Epipolar Geometry of Panoramic Cameras , 1998, ECCV.

[13]  Ruzena Bajcsy,et al.  Catadioptric sensors that approximate wide-angle perspective projections , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Jake K. Aggarwal,et al.  Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation , 1996, Pattern Recognit..

[15]  Tristan Needham,et al.  Visual Complex Analysis , 1997 .

[16]  Edward M. Riseman,et al.  Image-based homing , 1991, IEEE Control Systems.

[17]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  W. Brent Seales,et al.  Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery , 1999, MULTIMEDIA '99.

[19]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[20]  R. Penrose,et al.  Spinors and Space–Time: Subject and author index , 1984 .

[21]  E. Riseman,et al.  Panoramic virtual stereo vision of cooperative mobile robots for localizing 3D moving objects , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[22]  Leno S. Pedrotti,et al.  Optics and Vision , 1997 .

[23]  A. Leonardis,et al.  Robust localization using eigenspace of spinning-images , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[24]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[25]  Shree K. Nayar,et al.  Non-metric calibration of wide-angle lenses and polycameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  R. Benosman,et al.  A new catadioptric sensor for the panoramic vision of mobile robots , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[27]  Camillo J. Taylor.  Video Plus , 2000 .

[28]  Jorge Stolfi,et al.  Oriented projective geometry , 1987, SCG '87.

[29]  Naokazu Yokoya,et al.  Telepresence by Real-Time View-Dependent Image Generation from Omnidirectional Video Streams , 1998, Comput. Vis. Image Underst..

[30]  Kostas Daniilidis,et al.  Catadioptric camera calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[31]  S. L. Bogner.  An introduction to panospheric imaging , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[32]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[33]  Alfred M. Bruckstein,et al.  Omniview cameras with curved surface mirrors , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[34]  Olivier D. Faugeras,et al.  Oriented Projective Geometry for Computer Vision , 1996, ECCV.

[35]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[36]  Yasushi Yagi,et al.  Real-time omnidirectional image sensor (COPIS) for vision-guided navigation , 1994, IEEE Trans. Robotics Autom..