Stitching Images with Arbitrary Lens Distortions

In this paper, we propose a new method to compensate for lens distortions in image stitching. Lens distortions that arise from the nonlinearity of a lens are the main cause for mismatches in stitching images. We estimate the distortion factors for each image using the Division Model and linearize the projected relationships between matching distorted feature points. Because our method works at the RANSAC stage, the estimated distortion factors are further refined during the bundle adjustment phase and thus accurate distortion factors are obtained. Applications based on estimated lens distortion factors show that our method is more efficient and that the stitched results are more accurate than other previous methods.

[1]  Matthew N. Dailey,et al.  Robust Radial Distortion from a Single Image , 2010, ISVC.

[2]  Matthew A. Brown,et al.  Minimal Solutions for Panoramic Stitching with Radial Distortion , 2009, BMVC.

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  R. Hartley,et al.  A Non-iterative Method for Correcting Lens Distortion from Nine Point Correspondences , 2005 .

[5]  Junhee Park,et al.  Lens distortion correction using ideal image coordinates , 2009, IEEE Transactions on Consumer Electronics.

[6]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[7]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  Hailin Jin.  A three-point minimal solution for panoramic stitching with lens distortion , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Marc Pollefeys,et al.  Radial Distortion Self-Calibration , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[13]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hang-Bong Kang,et al.  A New Simple Method to Stitch Images with Lens Distortion , 2010, ISVC.

[15]  Johan Ernest Mebius.  Derivation of the Euler-Rodrigues formula for three-dimensional rotations from the general formula for four-dimensional rotations , 2007 .

[16]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[17]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Klas Josephson,et al.  Pose estimation with radial distortion and unknown focal length , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .