Evaluation of Interest Point Matching Methods for Projective Reconstruction of 3D Scenes

This work evaluates the application of different state-of-the-art methods for interest point matching, aiming the robust and efficient projective reconstruction of three-dimensional scenes. Projective reconstruction refers to the computation of the structure of a scene from images taken with uncalibrated cameras. To achieve this goal, it is essential the usage of an effective point matching algorithm. Even though several point matching methods have been proposed in the literature, their impacts in the projective reconstruction task have not yet been carefully studied. Our evaluation uses as criterion the estimated epipolar, reprojection and reconstruction errors, as well as the running times of the algorithms. Specifically, we compare five different techniques: SIFT, SURF, ORB, BRISK and FREAK. Our experiments show that binary algorithms such as, ORB and BRISK, are so accurate as float point algorithms like SIFT and SURF, nevertheless, with smaller computational cost.

[1]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[2]  Jan-Michael Frahm,et al.  Comparative Evaluation of Binary Features , 2012, ECCV.

[3]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Peirong Ji StereoScan : Dense 3 D Reconstruction in Real-time , 2016 .

[6]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[7]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[8]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  A. Kääb,et al.  Evaluation of existing image matching methods for deriving glacier surface displacements globally from optical satellite imagery , 2011 .

[10]  Joachim Denzler,et al.  Intrinsic and extrinsic active self-calibration of multi-camera systems , 2013, Machine Vision and Applications.

[11]  Carsten Griwodz,et al.  Evaluating performance of feature extraction methods for practical 3D imaging systems , 2012, IVCNZ '12.

[12]  Xun Li,et al.  Image matching techniques for vision-based indoor navigation systems: performance analysis for 3D map based approach , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[13]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  Gian Luca Foresti,et al.  Stereo Localization Based on Network's Uncalibrated Camera Pairs , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  M. Pierrot-Deseilligny,et al.  A MULTIRESOLUTION AND OPTIMIZATION-BASED IMAGE MATCHING APPROACH : AN APPLICATION TO SURFACE RECONSTRUCTION FROM SPOT 5-HRS STEREO IMAGERY , 2006 .

[17]  K. Wenzel,et al.  A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs , 2013 .

[18]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[20]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[21]  Jean Ponce,et al.  Accurate camera calibration from multi-view stereo and bundle adjustment , 2008, CVPR.

[22]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Yong Liu,et al.  Performance evaluation of feature detection and matching in stereo visual odometry , 2013, Neurocomputing.

[25]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[26]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[27]  Michael S. Brown,et al.  As-Projective-As-Possible Image Stitching with Moving DLT , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).