A flexible technique based on fundamental matrix for camera self-calibration with variable intrinsic parameters from two views

Self-calibrate cameras with varying focal length.Automatic estimation of the intrinsic parameters of the camera.Works freely in the domain of self-calibration without any prior knowledge about the scene or on the cameras. We propose a new self-calibration technique for cameras with varying intrinsic parameters that can be computed using only information contained in the images themselves. The method does not need any a priori knowledge on the orientations of the camera and is based on the use of a 3 D scene containing an unknown isosceles right triangle. The importance of our approach resides at minimizing constraints on the self-calibration system and the use of only two images to estimate these parameters. This method is based on the formulation of a nonlinear cost function from the relationship between two matches which are the projection of two points representing vertices of an isosceles right triangle, and the relationship between the images of the absolute conic. The resolution of this function enables us to estimate the cameras intrinsic parameters. The algorithm is implemented and validated on several sets of synthetic and real image data.

[1]  S. Bougnoux,et al.  From projective to Euclidean space under any practical situation, a criticism of self-calibration , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[3]  Ian D. Reid,et al.  Linear auto-calibration for ground plane motion , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[5]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[6]  Roger Mohr,et al.  Epipole and fundamental matrix estimation using virtual parallax , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Ian D. Reid,et al.  Self-Calibration of a Rotating Camera with Varying Intrinsic Parameters , 1998, BMVC.

[8]  Quang-Tuan Luong.  Matrice fondamentale et autocalibration en vision par ordinateur , 1992 .

[9]  Roberto Cipolla,et al.  Multi-view Constraints between Collineations: Application to Self-Calibration from Unknown Planar Structures , 2000, ECCV.

[10]  Khalid Satori,et al.  Camera self-calibration with varying intrinsic parameters by an unknown three-dimensional scene , 2013, The Visual Computer.

[11]  Sanchao Liu,et al.  Self-calibration of Varying Internal Camera Parameters Algorithm Based on Quasi-affine Reconstruction , 2012, J. Comput..

[12]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[13]  Jun-Sik Kim,et al.  Geometric and algebraic constraints of projected concentric circles and their applications to camera calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Andrea Fusiello,et al.  Globally convergent autocalibration using interval analysis , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Rudolf Mester,et al.  The Role of Total Least Squares in Motion Analysis , 1998, ECCV.

[16]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[18]  Yongdong Zhang,et al.  A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors , 2014, IEEE Signal Processing Letters.

[19]  Andrew Zisserman,et al.  Combining scene and auto-calibration constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  O. Faugeras,et al.  Camera Self-Calibration from Video Sequences: the Kruppa Equations Revisited , 1996 .

[21]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[22]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Richard I. Hartley,et al.  Euclidean Reconstruction from Uncalibrated Views , 1993, Applications of Invariance in Computer Vision.

[24]  Long Quan,et al.  Quasi-Dense Reconstruction from Image Sequence , 2002, ECCV.

[25]  Richard I. Hartley,et al.  Linear self-calibration of a rotating and zooming camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2004 .

[28]  Akram Halli,et al.  Self-Calibration Using a Planar Scene and Parallelogram , 2009 .

[29]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[30]  Peter F. Sturm,et al.  Translation of "Zur Ermittlung eines Objektes aus zwei Perspektiven mit innerer Orientierung" by Erwin Kruppa (1913) , 2018, ArXiv.

[31]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[32]  Roberto Cipolla,et al.  Self-calibration of zooming cameras observing an unknown planar structure , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[33]  Richard I. Hartley.  Self-Calibration from Multiple Views with a Rotating Camera , 1994, ECCV.

[34]  Radu Horaud,et al.  Self-calibration and Euclidean reconstruction using motions of a stereo rig , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[35]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[36]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  David J. Kriegman,et al.  Globally Optimal Algorithms for Stratified Autocalibration , 2010, International Journal of Computer Vision.

[38]  A. Heyden,et al.  Euclidean reconstruction from constant intrinsic parameters , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[39]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[40]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[41]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[42]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[44]  Ian D. Reid,et al.  Self-Calibration of Rotating and Zooming Cameras , 2002, International Journal of Computer Vision.

[45]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[46]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[47]  Andrew Zisserman,et al.  Robust Parameterization and Computation of the Trifocal Tensor , 1996, BMVC.

[48]  Hu Zhan-Yi.  A Linear Camera Self-Calibration Technique Based on Projective Reconstruction , 2002 .

[49]  Roberto Cipolla,et al.  Camera Self-Calibration from Unknown Planar Structures Enforcing the Multiview Constraints between Collineations , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Zhi-Gang Zheng,et al.  A region based stereo matching algorithm using cooperative optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[52]  Luc Van Gool,et al.  A stratified approach to metric self-calibration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  Gideon P. Stein.  Accurate internal camera calibration using rotation, with analysis of sources of error , 1995, Proceedings of IEEE International Conference on Computer Vision.

[54]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[55]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.