Prior Knowledge About Camera Motion for Outlier Removal in Feature Matching

The search of corresponding points in between images of the same scene is a well known problem in many computer vision applications. In particular most structure from motion techniques depend heavily on the correct estimation of corresponding image points. Most commonly used approaches make neither assumptions about the 3D scene nor about the relative positions of the cameras and model both as completely unknown. This general model results in a brute force comparison of all keypoints in one image to all points in all other images. In reality this model is often far too general because coarse prior knowledge about the cameras is often available. For example, several imaging systems are equipped with positioning devices which deliver pose information of the camera. Such information can be used to constrain the subsequent point matching not only to reduce the computational load, but also to increase the accuracy of path estimation and 3D reconstruction. This study presents Guided Matching as a new matching algorithm towards this direction. The proposed algorithm outperforms brute force matching in speed as well as number and accuracy of correspondences, given well estimated priors.

[1]  Michael Unger,et al.  A new evaluation criterion for point correspondences in stereo images , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Kenneth I. Joy,et al.  Path-based constraints for accurate scene reconstruction from aerial video , 2012, 2012 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[4]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Emmanuel P. Baltsavias,et al.  Multiphoto geometrically constrained matching , 1991 .

[6]  Andreas Wendel,et al.  Scalable Visual Navigation for Micro Aerial Vehicles using Geometric Prior Knowledge , 2013 .

[7]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[8]  Sanjiv Singh,et al.  Motion Estimation from Image and Inertial Measurements , 2004, Int. J. Robotics Res..

[9]  Michel Barlaud,et al.  Fast k nearest neighbor search using GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Marinos Ioannides,et al.  In the wild image retrieval and clustering for 3D cultural heritage landmarks reconstruction , 2014, Multimedia Tools and Applications.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Richard Szeliski,et al.  Geometrically Constrained Structure from Motion: Points on Planes , 1998, SMILE.

[14]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[16]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[17]  D. Lowe,et al.  Fast Matching of Binary Features , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[18]  Sami S. Brandt On the Probabilistic Epipolar Geometry , 2004, BMVC.