A Theory of Single-Viewpoint Catadioptric Image Formation

Conventional video cameras have limited fields of view which make them restrictive for certain applications in computational vision. A catadioptric sensor uses a combination of lenses and mirrors placed in a carefully arranged configuration to capture a much wider field of view. One important design goal for catadioptric sensors is choosing the shapes of the mirrors in a way that ensures that the complete catadioptric system has a single effective viewpoint. The reason a single viewpoint is so desirable is that it is a requirement for the generation of pure perspective images from the sensed images. In this paper, we derive the complete class of single-lens single-mirror catadioptric sensors that have a single viewpoint. We describe all of the solutions in detail, including the degenerate ones, with reference to many of the catadioptric systems that have been proposed in the literature. In addition, we derive a simple expression for the spatial resolution of a catadioptric sensor in terms of the resolution of the cameras used to construct it. Moreover, we include detailed analysis of the defocus blur caused by the use of a curved mirror in a catadioptric sensor.

[1]  S. Nayar.  Omnidirectional Video Camera , 1997 .

[2]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[3]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  Maria Isabel Ribeiro.  Obstacle Avoidance , 2005 .

[5]  Yasushi Yagi,et al.  Real-time generation of environmental map and obstacle avoidance using omnidirectional image sensor with conic mirror , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  A. Ardeshir Goshtasby,et al.  Design of a single-lens stereo camera system , 1993, Pattern Recognit..

[7]  Masayuki Inaba,et al.  A stereo viewer based on a single camera with view-control mechanisms , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[8]  Shree K. Nayar,et al.  Generation of Perspective and Panoramic Video from Omnidirectional Video , 1997 .

[9]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Yasushi Yagi,et al.  Real-time omnidirectional image sensor (COPIS) for vision-guided navigation , 1994, IEEE Trans. Robotics Autom..

[11]  Yasushi Yagi,et al.  Panorama scene analysis with conic projection , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[12]  Yasushi Yagi,et al.  Obstacle detection with omnidirectional image sensor HyperOmni Vision , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[13]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[14]  Edward M. Riseman,et al.  Image-based homing , 1992 .

[15]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[16]  J. R. Murphy.  Application of panospheric imaging to a teleoperated lunar rover , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[17]  S. A. Stoeter,et al.  Proceedings - IEEE International Conference on Robotics and Automation , 2003 .

[18]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Yasushi Yagi,et al.  Omnidirectional imaging with hyperboloidal projection , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[20]  Javaan Chahl,et al.  Reflective surfaces for panoramic imaging: errata , 1999 .

[21]  Daniel Drucker,et al.  A Natural Classification of Curves and Surfaces With Reflection Properties , 1996 .

[22]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[23]  S. Nayar,et al.  Catadioptric Image Formation , 1997 .

[24]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .