Extrinsic Camera Parameter Recovery from Multiple Image Sequences Captured by an Omni-Directional Multi-camera System

Recently, many types of omni-directional cameras have been developed and attracted much attention in a number of different fields. Especially, the multi-camera type of omni-directional camera has advantages of high-resolution and almost uniform resolution for any direction of view. In this paper, an extrinsic camera parameter recovery method for a moving omni-directional multi-camera system (OMS) is proposed. First, we discuss a perspective n-point (PnP) problem for an OMS, and then describe a practical method for estimating extrinsic camera parameters from multiple image sequences obtained by an OMS. The proposed method is based on using the shape-from-motion and the PnP techniques.

[1]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Radha Krishnan,et al.  Monocular pose of a rigid body using point landmarks , 1991, CVGIP Image Underst..

[3]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  金谷 健一.  Statistical optimization for geometric computation : theory and practice , 2005 .

[6]  Hideki Tanahashi,et al.  Development of a stereo omnidirectional imaging system (SOS) , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[7]  Wen-Yan Chang,et al.  Pose estimation for generalized imaging device via solving non-perspective N point problem , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[8]  Naokazu Yokoya,et al.  High-resolution panoramic movie generation from video streams acquired by an omnidirectional multi-camera system , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[9]  Paul A. Beardsley,et al.  Sequential Updating of Projective and Affine Structure from Motion , 1997, International Journal of Computer Vision.

[10]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Joseph S.-C. Yuan.  A general photogrammetric method for determining object position and orientation , 1989, IEEE Trans. Robotics Autom..

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Yasushi Yagi,et al.  Omnidirectional imaging with hyperboloidal projection , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[14]  Naokazu Yokoya,et al.  Dense 3-D Reconstruction of an Outdoor Scene by Hundreds-Baseline Stereo Using a Hand-Held Video Camera , 2004, International Journal of Computer Vision.

[15]  Kenro Miyamoto,et al.  Fish Eye Lens , 1964 .

[16]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[17]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Reinhard Klette,et al.  Computer vision - three-dimensional data from images , 1998 .

[19]  Naokazu Yokoya,et al.  Construction and presentation of a virtual environment using panoramic stereo images of a real scene and computer graphics models , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[20]  Minoru Etoh,et al.  Estimation of structure and motion parameters for a roaming robot that scans the space , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Reinhard Koch,et al.  Three-dimensional scene reconstruction from images , 2000, Electronic Imaging.