A Precision Analysis of Camera Distortion Models

This paper addresses the question of identifying the right camera direct or inverse distortion model, permitting a high subpixel precision to fit to real camera distortion. Five classic camera distortion models are reviewed and their precision is compared for direct or inverse distortion. By definition, the three radially symmetric models can only model a distortion radially symmetric around some distortion center. They can be extended to deal with non-radially symmetric distortions by adding tangential distortion components, but still may be too simple for very accurate modeling of real cameras. The polynomial and the rational models instead miss a physical or optical interpretation, but can cope equally with radially and non-radially symmetric distortions. Indeed, they do not require the evaluation of a distortion center. When requiring high precisions, we found that the distortion modeling must also be evaluated primarily as a numerical problem. Indeed, all models except the polynomial involve a non-linear minimization, which increases the numerical risk. The estimation of a polynomial distortion model leads instead to a linear problem, which is secure and much faster. We concluded by extensive numerical experiments that, although high degree polynomials were required to reach a high precision of 1/100 pixels, such polynomials were easily estimated and produced a precise distortion modeling without overfitting. Our conclusion is validated by three independent experimental setups: the models were compared first on the lens distortion database of the Lensfun library by their distortion simulation and inversion power; second by fitting real camera distortions estimated by a non parametric algorithm; and finally by the absolute correction measurement provided by the photographs of tightly stretched strings, warranting a high straightness.

[1]  Daniel Santana-Cedrés,et al.  An Iterative Optimization Algorithm for Lens Distortion Correction Using Two-Parameter Models , 2016, Image Process. Line.

[2]  Jose Sasian,et al.  Accurate determination of distortion for smartphone cameras. , 2014, Applied optics.

[3]  P. Monasse,et al.  Camera Matrix Calibration Using Circular Control Points and Separate Correction of the Geometric Distortion Field , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[4]  J. Morel,et al.  High-precision camera distortion measurements with a "calibration harp" , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  J. Morel,et al.  Towards high-precision lens distortion correction , 2010, 2010 IEEE International Conference on Image Processing.

[6]  J. Rafael Sendra,et al.  Algebraic Lens Distortion Model Estimation , 2010, Image Process. Line.

[7]  Zuzana Kukelova,et al.  Fast and robust numerical solutions to minimal problems for cameras with radial distortion , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  J. Rafael Sendra,et al.  An Algebraic Approach to Lens Distortion by Line Rectification , 2009, Journal of Mathematical Imaging and Vision.

[9]  Zuzana Kukelova,et al.  Automatic Generator of Minimal Problem Solvers , 2008, ECCV.

[10]  Zuzana Kukelova,et al.  A minimal solution to the autocalibration of radial distortion , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Sing Bing Kang,et al.  Parameter-Free Radial Distortion Correction with Center of Distortion Estimation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Marc Pollefeys,et al.  Multi-view geometry of 1D radial cameras and its application to omnidirectional camera calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  Andrew W. Fitzgibbon,et al.  A rational function lens distortion model for general cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[15]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  O. Faugeras,et al.  Straight lines have to be straight , 2001, Machine Vision and Applications.

[17]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[18]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  X. Wang,et al.  The Principal Point and CCD Cameras , 1998 .

[20]  Michel Dhome,et al.  Do We Really Need an Accurate Calibration Pattern to Achieve a Reliable Camera Calibration? , 1998, ECCV.

[21]  Gideon P. Stein,et al.  Lens distortion calibration using point correspondences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Zhengyou Zhang,et al.  On the epipolar geometry between two images with lens distortion , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Frederic Devernay A Non-Maxima Suppression Method for Edge Detection with Sub-Pixel Accuracy , 1995 .

[24]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[26]  Einari Kilpelä,et al.  Compensation of systematic errors of image and model coordinates , 1981 .

[27]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[29]  Andrew W. Fitzgibbon,et al.  A Plumbline Constraint for the Rational Function Lens Distortion Model , 2005, BMVC.

[30]  R. Hartley,et al.  A Non-iterative Method for Correcting Lens Distortion from Nine Point Correspondences , 2005 .

[31]  Richard Hartley,et al.  A non-iterative method for lens distortion correction from nine point correspondences , 2005, ICCV 2005.

[32]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[33]  R. Hartley,et al.  The Cubic Rational Polynomial Camera Model , 2001 .

[34]  G. F. McLean,et al.  Line-Based Correction of Radial Lens Distortion , 1997, CVGIP Graph. Model. Image Process..

[35]  Toms Pajdla,et al.  Correcting Radial Lens Distortion without Knowledge of 3-D Structure , 1997 .

[36]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .