Single-viewpoint, catadioptric cone mirror omnidirectional imaging theory and analysis.

A family of catadioptric imaging systems has been developed that can achieve omnidirectional viewing with a single planar imager while still being able to recover perspective images, provided that they satisfy the single-viewpoint (SVP) constraint. It has been shown that the only mirror shapes that can have SVP when paired with a sole focusing planar imager camera are the surfaces of revolution of conic section curves. However, the special case of such a surface, the cone-shaped mirror itself, has not been deemed a viable SVP mirror shape. We present a comprehensive imaging theory of the cone mirror in its SVP configuration. We show that the SVP, cone mirror catadioptric system not only is practical but also has unique advantages for certain applications. The detailed theory explains why and how a practical SVP cone configuration can be set up, the merits and weaknesses of such systems, and how one can remedy the weaknesses to create a workable imaging system. We also derive the tolerance formula for estimating effects of alignment errors. A prototype has been constructed, and experimental results validate our theory.

[1]  Hiroshi Ishiguro.  Development of low-cost compact omnidirectional vision sensors , 2001 .

[2]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  David W. Murray.  Recovering Range Using Virtual Multicamera Stereo , 1995, Comput. Vis. Image Underst..

[6]  Yasushi Yagi,et al.  Real-Time Omnidirectional Image Sensors , 2004, International Journal of Computer Vision.

[7]  Ruzena Bajcsy,et al.  True single view point cone mirror omni-directional catadioptric system , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Narendra Ahuja,et al.  Panoramic image acquisition , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Ruzena Bajcsy,et al.  High resolution catadioptric omni-directional stereo sensor for robot vision , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  Ryad Benosman,et al.  Panoramic stereovision sensor , 1998 .

[11]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[12]  Shree K. Nayar,et al.  A perspective on distortions , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  R. Andrew Hicks,et al.  Geometric distributions for catadioptric sensor design , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Narendra Ahuja,et al.  A high-resolution panoramic camera , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Ruzena Bajcsy,et al.  Single-view-point omnidirectional catadioptric cone mirror imager , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yasushi Yagi,et al.  Real-time omnidirectional image sensor (COPIS) for vision-guided navigation , 1994, IEEE Trans. Robotics Autom..

[17]  Warren D. Smith,et al.  Modern Optical Engineering: The Design of Optical Systems, Fourth Edition , 1966 .

[18]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Max Born,et al.  Principles of optics - electromagnetic theory of propagation, interference and diffraction of light (7. ed.) , 1999 .

[20]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[21]  Yasushi Yagi,et al.  Omnidirectional imaging with hyperboloidal projection , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[22]  Tomás Svoboda,et al.  Epipolar Geometry of Panoramic Cameras , 1998, ECCV.

[23]  Anup Basu,et al.  Panoramic stereo , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[24]  Shih-Schon Lin.  Omnidirectional 3D stereo computer vision sensor using reflective cone mirror , 2003 .

[25]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[26]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[27]  Anup Basu,et al.  A conical mirror pipeline inspection system , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[28]  Yasushi Yagi,et al.  Resolution improving method for a 3D environment modeling using omnidirectional image sensor , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[29]  Ruzena Bajcsy,et al.  Reflective surfaces as computational sensors , 2001, Image Vis. Comput..