A method for the evaluation of projective geometric consistency in weakly calibrated stereo with application to point matching

We present a novel method that evaluates the geometric consistency of putative point matches in weakly calibrated settings, i.e. when the epipolar geometry but not the camera calibration is known, using only the point coordinates as information. The main idea behind our approach is the fact that each point correspondence in our data belongs to one of two classes (inliers/outlier). The classification of each point match relies on the histogram of a quantity representing the difference between cross ratios derived from a construction involving 6-tuples of point matches. Neither constraints nor scenario dependent parameters/thresholds are needed. Even for few candidate point matches the ensemble of 6-tuples containing each of them turns to provide statistically reliable histograms that prove to discriminate between inliers and outliers. In fact, in most cases a random sampling among this population is sufficient. Nevertheless, the accuracy of the method is positively correlated to its sampling density leading to an accuracy versus resulting computational complexity trade-off. Theoretical analysis and experiments are given that show the consistent performance of the proposed classification method when applied in inlier/outlier discrimination. The achieved accuracy is favourably evaluated against established methods that employ geometric only information, i.e. those relying on the Sampson, the algebraic and the symmetric epipolar distances. Finally, we also present an application of our scheme in uncalibrated stereo inside a RANSAC framework and compare it to the same as above methods.

[1]  Manolis I. A. Lourakis,et al.  Estimating the Jacobian of the Singular Value Decomposition: Theory and Applications , 2000, ECCV.

[2]  Lionel Moisan,et al.  A Probabilistic Criterion to Detect Rigid Point Matches Between Two Images and Estimate the Fundamental Matrix , 2004, International Journal of Computer Vision.

[3]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[4]  Olivier D. Faugeras,et al.  On the Determination of Epipoles Using Cross-Ratios , 1998, Comput. Vis. Image Underst..

[5]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[6]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[7]  David Suter,et al.  Robust adaptive-scale parametric model estimation for computer vision , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jan Flusser,et al.  Point-based projective invariants , 2000, Pattern Recognit..

[9]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Fang-Hsuan Cheng,et al.  Fast algorithm for point pattern matching: Invariant to translations, rotations and scale changes , 1997, Pattern Recognit..

[11]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Tomás Werner,et al.  Constraint on five points in two images , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[15]  James V. Miller,et al.  MUSE: robust surface fitting using unbiased scale estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Charles V. Stewart,et al.  MINPRAN: A New Robust Estimator for Computer Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[18]  In-So Kweon,et al.  Robust feature point matching by preserving local geometric consistency , 2009, Comput. Vis. Image Underst..

[19]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[20]  Isaac Weiss,et al.  Geometric invariants and object recognition , 1993, International Journal of Computer 11263on.

[21]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[22]  Jiri Matas,et al.  Epipolar geometry estimation via RANSAC benefits from the oriented epipolar constraint , 2004, ICPR 2004.

[23]  O. Faugeras Stratification of three-dimensional vision: projective, affine, and metric representations , 1995 .

[24]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[26]  Roberto Manduchi,et al.  Rotational Invariant Operators Based on Steerable Filter Banks , 2006, IEEE Signal Processing Letters.

[27]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[28]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[29]  Zhengyou Zhang,et al.  On the Optimization Criteria Used in Two-View Motion Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Reiner Lenz,et al.  Efficient Invariant Representations , 1998, International Journal of Computer Vision.

[31]  Olivier D. Faugeras,et al.  Characterizing the Uncertainty of the Fundamental Matrix , 1997, Comput. Vis. Image Underst..

[32]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[33]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[34]  Manolis I. A. Lourakis,et al.  Using geometric constraints for matching disparate stereo views of 3D scenes containing planes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[35]  Gerard Medioni,et al.  StaRSaC: Stable random sample consensus for parameter estimation , 2009, CVPR.

[36]  Manolis I. A. Lourakis,et al.  Matching disparate views of planar surfaces using projective invariants , 2000, Image Vis. Comput..

[37]  Alan Hanjalic,et al.  A Combined RANSAC-Hough Transform Algorithm for Fundamental Matrix Estimation , 2007, BMVC.

[38]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.