Fast and Accurate Structure and Motion Estimation

This paper describes a system for structure-and-motion estimation for real-time navigation and obstacle avoidance. We demonstrate a technique to increase the efficiency of the 5-point solution to the relative pose problem. This is achieved by a novel sampling scheme, where we add a distance constraint on the sampled points inside the RANSAC loop, before calculating the 5-point solution. Our setup uses the KLT tracker to establish point correspondences across time in live video. We also demonstrate how an early outlier rejection in the tracker improves performance in scenes with plenty of occlusions. This outlier rejection scheme is well suited to implementation on graphics hardware. We evaluate the proposed algorithms using real camera sequences with fine-tuned bundle adjusted data as ground truth. To strenghten our results we also evaluate using sequences generated by a state-of-the-art rendering software. On average we are able to reduce the number of RANSAC iterations by half and thereby double the speed.

[1]  Slawomir J. Nasuto,et al.  NAPSAC: High Noise, High Dimensional Robust Estimation - it's in the Bag , 2002, BMVC.

[2]  David Nister,et al.  Bundle Adjustment Rules , 2006 .

[3]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[4]  Jiri Matas,et al.  Randomized RANSAC with Td, d test , 2004, Image Vis. Comput..

[5]  Yakup Genc,et al.  GPU-based Video Feature Tracking And Matching , 2006 .

[6]  Stefano Soatto,et al.  Moving Forward in Structure From Motion , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Manolis I. A. Lourakis,et al.  The design and implementation of a generic sparse bundle adjustment software package based on the Le , 2004 .

[8]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[9]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  David Nistér,et al.  Preemptive RANSAC for live structure and motion estimation , 2005, Machine Vision and Applications.

[11]  John Mark Bishop,et al.  NAPSAC: high noise, high dimensional model parameterisation - it's in the bag , 2002 .

[12]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Rama Chellappa,et al.  Robust Visual Tracking Using the Time-Reversibility Constraint , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Michael Felsberg,et al.  KLT Tracking Implementation on the GPU , 2007 .

[16]  Wei Zhang,et al.  A New Inlier Identification Scheme for Robust Estimation Problems , 2006, Robotics: Science and Systems.

[17]  Mads Nielsen,et al.  Computer Vision — ECCV 2002 , 2002, Lecture Notes in Computer Science.

[18]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Jiri Matas,et al.  Randomized RANSAC with T(d, d) test , 2002, BMVC.

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Sanjiv Singh,et al.  Editorial : [for the Special issue on the 2007 DARPA Urban Challenge, Part I] , 2008 .

[22]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[23]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[24]  David W. Murray,et al.  Guided Sampling and Consensus for Motion Estimation , 2002, ECCV.

[25]  Erik Ringaby,et al.  Optical Flow Computation on Compute Unified Device Architecture , 2008 .

[26]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[27]  J.-E. Kallhammer,et al.  Near Zone Pedestrian Detection using a Low-Resolution FIR Sensor , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[28]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.