Fundamental matrix estimation: A study of error criteria

The fundamental matrix (FM) describes the geometric relations that exist between two images of the same scene. Different error criteria are used for estimating FMs from an input set of correspondences. In this paper, the accuracy and efficiency aspects of the different error criteria are studied. We mathematically and experimentally proved that the most popular error criterion, the symmetric epipolar distance, is biased. It was also shown that despite the similarity between the algebraic expressions of the symmetric epipolar distance and Sampson distance, they have different accuracy properties. In addition, a new error criterion, Kanatani distance, was proposed and proved to be the most effective for use during the outlier removal phase from accuracy and efficiency perspectives. To thoroughly test the accuracy of the different error criteria, we proposed a randomized algorithm for Reprojection Error-based Correspondence Generation (RE-CG). As input, RE-CG takes an FM and a desired reprojection error value d. As output, RE-CG generates a random correspondence having that error value. Mathematical analysis of this algorithm revealed that the success probability for any given trial is 1-(2/3)^2 at best and is 1-(6/7)^2 at worst while experiments demonstrated that the algorithm often succeeds after only one trial.

[1]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[2]  R. Hartley.  Triangulation, Computer Vision and Image Understanding , 1997 .

[3]  Kenichi Kanatani,et al.  Triangulation from Two Views Revisited: Hartley-Sturm vs. Optimal Correction , 2008, BMVC.

[4]  Andrew Zisserman,et al.  Performance characterization of fundamental matrix estimation under image degradation , 1997, Machine Vision and Applications.

[5]  Manuel Menezes de Oliveira Neto.  Image-Based Modeling and Rendering Techniques: A Survey , 2002, RITA.

[6]  Søren I. Olsen,et al.  Epipolar Line Estimation , 1992, ECCV.

[7]  Andrew Zisserman,et al.  Robust Detection of Degenerate Configurations while Estimating the Fundamental Matrix , 1998, Comput. Vis. Image Underst..

[8]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[9]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[10]  Brian Gough,et al.  GNU Scientific Library Reference Manual - Third Edition , 2003 .

[11]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[12]  Amnon Shashua,et al.  Projective Structure from Uncalibrated Images: Structure From Motion and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Wojciech Chojnacki,et al.  A new constrained parameter estimator for computer vision applications , 2004, Image Vis. Comput..

[14]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[15]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[16]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[17]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[18]  Xavier Armangué,et al.  Overall view regarding fundamental matrix estimation , 2003, Image Vis. Comput..