Method for fundamental matrix estimation combined with feature lines

Fundamental matrix estimation has been studied extensively in the area of computer vision and previously proposed techniques include those that only use feature points. In this study, we propose a new technique for calculating the fundamental matrix combined with feature lines, which is based on the epipolar geometry of horizontal and vertical feature lines. First, a method for parameterizing the fundamental matrix is introduced, where the camera orientation elements and relative orientation elements are used as the parameters of the fundamental matrix, and the equivalent relationships are deduced based on the horizontal and vertical feature lines. Next, the feature lines are used as the interior points by the RANSAC algorithm to search for the optimal feature point subset, before determining the weight of each factor using the M-estimators algorithm and building a unified adjustment model to estimate the fundamental matrix. The experimental results obtained using simulated images and real images demonstrate that the proposed approach is feasible in practice and it can greatly reduce the dependency on feature points in the traditional method, while the introduction of feature lines can improve the accuracy and stability of the results to some extent.

[1]  叶东 Ye Dong,et al.  On-Line Calibration of Stereo Vision Measurement System Based on Optical Reference Bar , 2008 .

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[4]  Yiguang Liu,et al.  Estimating the fundamental matrix based on least absolute deviation , 2011, Neurocomputing.

[5]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[6]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Carsten Steger,et al.  Estimating the fundamental matrix under pure translation and radial distortion , 2012 .

[9]  R. Haralick,et al.  A robust linear least-squares estimation of camera exterior orientation using multiple geometric features , 2000 .

[10]  Heping Pan,et al.  A Direct Closed-Form Solution to General Relative Orientation of Two Stereo Views , 1999, Digit. Signal Process..

[11]  John W. Tukey,et al.  Data Analysis and Regression: A Second Course in Statistics , 1977 .

[12]  Ioannis Brilakis,et al.  On-Site 3D Vision Tracking of Construction Personnel , 2008 .

[13]  Philip H. S. Torr,et al.  Bayesian Model Estimation and Selection for Epipolar Geometry and Generic Manifold Fitting , 2002, International Journal of Computer Vision.

[14]  Ioannis K. Brilakis,et al.  Automated computation of the fundamental matrix for vision based construction site applications , 2011, Adv. Eng. Informatics.

[15]  Zhengyou Zhang,et al.  On the epipolar geometry between two images with lens distortion , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[16]  Yongjun Zhang,et al.  Relative orientation based on multi-features , 2011 .

[17]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[18]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[21]  Marcelo Ricardo Stemmer,et al.  A new robust algorithmic for multi-camera calibration with a 1D object under general motions without prior knowledge of any camera intrinsic parameter , 2012, Pattern Recognit..

[22]  Xavier Armangué,et al.  Overall view regarding fundamental matrix estimation , 2003, Image Vis. Comput..

[23]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[24]  Mohamed F. Tolba,et al.  Fundamental matrix estimation: A study of error criteria , 2017, Pattern Recognit. Lett..

[25]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[26]  Richard I. Hartley,et al.  Euclidean Reconstruction from Uncalibrated Views , 1993, Applications of Invariance in Computer Vision.

[27]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[28]  Roger Mohr,et al.  It can be done without camera calibration , 1991, Pattern Recognit. Lett..

[29]  Patricio A. Vela,et al.  Personnel tracking on construction sites using video cameras , 2009, Adv. Eng. Informatics.

[30]  Roger Mohr,et al.  Epipole and fundamental matrix estimation using virtual parallax , 1995, Proceedings of IEEE International Conference on Computer Vision.

[31]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[32]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[33]  Adrien Bartoli,et al.  Nonlinear estimation of the fundamental matrix with minimal parameters , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[35]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.