Measurement of Three-Dimensional Environment with a Fish-Eye Camera Based on Structure from Motion - Error Analysis

This paper proposes a method for measuring 3dimensional (3D) environment and estimating camera movement with two fish-eye images. This method deals with large distortion of images from a fish-eye camera to calibrate internal and external camera parameters precisely by simultaneous estimation. In this paper, we analyze 3D measurement accuracy based on a theoretical model and evaluate it in practical analysis in experimental and real environments. These analyses show that the theoretical measurement error model works over a wide range of fish-eye views.

[1]  Kazunori Umeda,et al.  Development of Obstacle Recognition System of Humanoids Using Relative Disparity Maps from Small Range Image Sensors , 2007, J. Robotics Mechatronics.

[2]  Shigang Li,et al.  Lane marking detection by side Fisheye Camera , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Xiaoming Deng,et al.  Automatic spherical panorama generation with two fisheye images , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[4]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[5]  Kazunori Umeda,et al.  A 200Hz small range image sensor using a multi-spot laser projector , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  Atsushi Yamashita,et al.  Construction of 3D Environment Model from an Omni-Directional Image Sequence , 2008 .

[7]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[8]  Clemens Rabe,et al.  6D Vision Goes Fisheye for Intersection Assistance , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[9]  Jun Ota,et al.  Grasp strategy when experiencing hands of various size , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[10]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Shigang Li,et al.  Monitoring Around a Vehicle by a Spherical Image Sensor , 2006, IEEE Transactions on Intelligent Transportation Systems.

[15]  William H. Press,et al.  Numerical recipes in C , 2002 .

[16]  Ben J. A. Kröse,et al.  Robust scene reconstruction from an omnidirectional vision system , 2003, IEEE Trans. Robotics Autom..

[17]  T. Nishimoto,et al.  Three dimensional measurement using fisheye stereo vision , 2007, SICE Annual Conference 2007.

[18]  Kenji Terabayashi,et al.  Generation of Overhead View Images by Estimating Intrinsic and Extrinsic Camera Parameters of Multiple Fish-Eye Cameras , 2009, MVA.