A Minimal Solution to Radial Distortion Autocalibration

Simultaneous estimation of radial distortion, epipolar geometry, and relative camera pose can be formulated as a minimal problem and solved from a minimal number of image points. Finding the solution to this problem leads to solving a system of algebraic equations. In this paper, we provide two different solutions to the problem of estimating radial distortion and epipolar geometry from eight point correspondences in two images. Unlike previous algorithms which were able to solve the problem from nine correspondences only, we enforce the determinant of the fundamental matrix be zero. This leads to a system of eight quadratic and one cubic equation in nine variables. We first simplify this system by eliminating six of these variables and then solve the system by two alternative techniques. The first one is based on the Gröbner basis method and the second one on the polynomial eigenvalue computation. We demonstrate that our solutions are efficient, robust, and practical by experiments on synthetic and real data.

[1]  Zuzana Kukelova,et al.  Polynomial Eigenvalue Solutions to the 5-pt and 6-pt Relative Pose Problems , 2008, BMVC.

[2]  Karl Johan Åström,et al.  Solutions to Minimal Generalized Relative Pose Problems , 2005 .

[3]  Henrik Stewenius,et al.  Gröbner Basis Methods for Minimal Problems in Computer Vision , 2005 .

[4]  Marc Pollefeys,et al.  Multi-view geometry of 1D radial cameras and its application to omnidirectional camera calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  Frederik Schaffalitzky,et al.  A minimal solution for relative pose with unknown focal length , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Peter F. Sturm,et al.  Plane-based self-calibration of radial distortion , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Marc Pollefeys,et al.  The radial trifocal tensor: a tool for calibrating the radial distortion of wide-angle cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Klas Josephson,et al.  Pose estimation with radial distortion and unknown focal length , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  David A. Cox,et al.  Using Algebraic Geometry , 1998 .

[11]  Donald B. Gennery,et al.  Generalized Camera Calibration Including Fish-Eye Lenses , 2006, International Journal of Computer Vision.

[12]  Gideon P. Stein,et al.  Lens distortion calibration using point correspondences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Peter F. Sturm,et al.  Automatic Camera Calibration Applied to Medical Endoscopy , 2009, BMVC.

[14]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[15]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  R. Hartley,et al.  A Non-iterative Method for Correcting Lens Distortion from Nine Point Correspondences , 2005 .

[18]  Zhengyou Zhang,et al.  On the epipolar geometry between two images with lens distortion , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[19]  Christopher O. Jaynes,et al.  Overconstrained Linear Estimation of Radial Distortion and Multi-view Geometry , 2006, ECCV.

[20]  Gideon P. Stein.  Accurate internal camera calibration using rotation, with analysis of sources of error , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  J. Faugère.  A new efficient algorithm for computing Gröbner bases (F4) , 1999 .

[22]  Zuzana Kukelova,et al.  Automatic Generator of Minimal Problem Solvers , 2008, ECCV.

[23]  Kostas Daniilidis,et al.  Fundamental matrix for cameras with radial distortion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[24]  Ernst W. Mayr,et al.  Exponential space computation of Gröbner bases , 1996, ISSAC '96.

[25]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[26]  Zuzana Kukelova,et al.  New Efficient Solution to the Absolute Pose Problem for Camera with Unknown Focal Length and Radial Distortion , 2010, ACCV.

[27]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[29]  Zuzana Kukelova,et al.  A minimal solution to the autocalibration of radial distortion , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[31]  David Nister,et al.  Recent developments on direct relative orientation , 2006 .

[32]  Sing Bing Kang,et al.  Parameter-Free Radial Distortion Correction with Center of Distortion Estimation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Andrew W. Fitzgibbon,et al.  A rational function lens distortion model for general cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Zuzana Kukelova,et al.  A general solution to the P4P problem for camera with unknown focal length , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Carlo Traverso,et al.  Gröbner Trace Algorithms , 1988, ISSAC.

[36]  Hongdong Li.  A Simple Solution to the Six-Point Two-View Focal-Length Problem , 2006, ECCV.

[37]  Zuzana Kukelova,et al.  Fast and robust numerical solutions to minimal problems for cameras with radial distortion , 2008, CVPR.

[38]  Matthew A. Brown,et al.  Minimal Solutions for Panoramic Stitching with Radial Distortion , 2009, BMVC.

[39]  Hongdong Li,et al.  Five-Point Motion Estimation Made Easy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[40]  Tomás Pajdla,et al.  Structure from motion with wide circular field of view cameras , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Christopher Geyer,et al.  A Nine-point Algorithm for Estimating Para-Catadioptric Fundamental Matrices , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Jack Dongarra,et al.  Templates for the Solution of Algebraic Eigenvalue Problems , 2000, Software, environments, tools.

[43]  Martin Byröd,et al.  Improving Numerical Accuracy of Gröbner Basis Polynomial Equation Solvers , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[44]  Michael Brady,et al.  Self-calibration of the intrinsic parameters of cameras for active vision systems , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Eric Hayman,et al.  Correcting Radial Distortion by Circle Fitting , 2005, BMVC.

[46]  Christian Bräuer-Burchardt,et al.  A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[47]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Sing Bing Kang,et al.  Radial Distortion Snakes , 2001, MVA.

[49]  Zuzana Kukelova,et al.  Fast and robust numerical solutions to minimal problems for cameras with radial distortion , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[51]  Zuzana Kukelova,et al.  Robust Focal Length Estimation by Voting in Multi-view Scene Reconstruction , 2009, ACCV.

[52]  Sing Bing Kang,et al.  Catadioptric self-calibration , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[53]  Zuzana Kukelova,et al.  Two Minimal Problems for Cameras with Radial Distortion , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[54]  Peter F. Sturm,et al.  Minimal solutions for generic imaging models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Hans J. Stetter,et al.  Numerical polynomial algebra , 2004 .