Estimation of the Lens Distortion Model by Minimizing a Line Reprojection Error

Most techniques for camera calibration that use planar calibration patterns require the computation of a lens distortion model and a homography. Both are simultaneously refined using a bundle adjustment that minimizes the reprojection error of a collection of points when projected from the scene onto the camera sensor. These points are usually the corners of the rectangles of a calibration pattern. However, if the lens shows a significant distortion, the location and matching of the corners can be difficult and inaccurate. To cope with this problem, instead of point correspondences, we propose to use line correspondences to compute the reprojection error. We have designed a fully automatic algorithm to estimate the lens distortion model and the homography by computing line correspondences and minimizing the line reprojection error. In the experimental setup, we focus on the analysis of the quality of the obtained lens distortion model. We present some experiments that show that the proposed method outperforms the results obtained by standard methods to compute lens distortion models based on line rectification.

[1]  Suping Fang,et al.  Correcting large lens radial distortion using epipolar constraint. , 2014, Applied optics.

[2]  J. Rafael Sendra,et al.  Algebraic Lens Distortion Model Estimation , 2010, Image Process. Line.

[3]  Edward Jones,et al.  Review of geometric distortion compensation in fish-eye cameras , 2008 .

[4]  Daniel Santana-Cedrés,et al.  Invertibility and Estimation of Two-Parameter Polynomial and Division Lens Distortion Models , 2015, SIAM J. Imaging Sci..

[5]  T. Ueda,et al.  Analysis of Radially Restored Images for Spherical Single Lens Cellphone Camera , 2011, IEEE Sensors Journal.

[6]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[7]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Pascal Monasse,et al.  High-precision camera distortion measurements with a "calibration harp". , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  J. Rafael Sendra,et al.  An Algebraic Approach to Lens Distortion by Line Rectification , 2009, Journal of Mathematical Imaging and Vision.

[10]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[11]  Pascal Monasse,et al.  Lens distortion correction with a calibration harp , 2011, ICIP.

[12]  Carlos Ricolfe-Viala,et al.  Using the camera pin-hole model restrictions to calibrate the lens distortion model , 2011 .

[13]  Carlos Ricolfe-Viala,et al.  Lens distortion models evaluation. , 2010, Applied optics.

[14]  Matthew N. Dailey,et al.  Automatic Radial Distortion Estimation from a Single Image , 2012, Journal of Mathematical Imaging and Vision.

[15]  Daniel Santana-Cedrés,et al.  Automatic Lens Distortion Correction Using One-Parameter Division Models , 2014, Image Process. Line.

[16]  Carlos Ricolfe-Viala,et al.  Robust metric calibration of non-linear camera lens distortion , 2010, Pattern Recognit..

[17]  Reimar Lenz,et al.  Linsenfehlerkorrigierte Eichung von Halbleiterkameras mit Standarobjektiven für hochgenaue 3D-Messungen in Echtzeit , 1987, DAGM-Symposium.

[18]  A. Valera,et al.  Efficient Lens Distortion Correction for Decoupling in Calibration of Wide Angle Lens Cameras , 2013, IEEE Sensors Journal.

[19]  Carlos Ricolfe-Viala,et al.  Accurate calibration with highly distorted images. , 2012, Applied optics.

[20]  J. Rafael Sendra,et al.  Accurate Depth Dependent Lens Distortion Models: An Application to Planar View Scenarios , 2010, Journal of Mathematical Imaging and Vision.

[21]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[22]  Pascal Monasse,et al.  Towards high-precision lens distortion correction , 2010, ICIP.

[23]  Zuzana Kukelova,et al.  Radial distortion homography , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Daniel Santana-Cedrés,et al.  An Iterative Optimization Algorithm for Lens Distortion Correction Using Two-Parameter Models , 2016, Image Process. Line.

[25]  Luis Álvarez,et al.  Camera calibration in sport event scenarios , 2014, Pattern Recognit..

[26]  J. Morel,et al.  Self-consistency and universality of camera distortion models , 2012 .

[27]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Daniel Santana-Cedrés,et al.  Automatic Corner Matching in Highly Distorted Images of Zhang's Calibration Pattern , 2014, CIARP.

[29]  D Gonzalez-Aguilera,et al.  An Automatic Approach for Radial Lens Distortion Correction From a Single Image , 2011, IEEE Sensors Journal.