Student's t robust bundle adjustment algorithm

Bundle adjustment (BA) is the problem of refining viewing and structure estimates in multi-view scene reconstruction subject to a scene model (e.g. a set of geometric constraints). Mismatched interest points cause serious problems for the standard least squares approach, as a single mismatch (i.e. outlier) will affect the entire reconstruction. We propose a novel robust Student's t BA algorithm (RST-BA), using the heavy tailed t-distribution to model reprojection errors. We design a custom algorithm to find the maximum a posteriori (MAP) estimates of the camera and viewing parameters. The algorithm exploits the same structure as L2-BA, matching the performance of fast L2 implementations. RST-BA is more accurate than either L2-BA or L2-BA with a σ-edit outlier removal rule for a range of simulated error generation scenarios. RST-BA also achieved better median reproduction error recovery than SBA [1] or SBA with outlier removal for large publicly available datasets.

[1]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[2]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[3]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[4]  Kaj Madsen,et al.  Methods for Non-Linear Least Squares Problems , 1999 .

[5]  Mark S. Robinson,et al.  The Apollo Digtal Image Archive: New Research and Data Products , 2008 .

[6]  Sami S. Brandt,et al.  Robust Alignment of Transmission Electron Microscope Tilt Series , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Aldo Cumani,et al.  Visual odometry for robust rover navigation by binocular stereo , 2006 .

[8]  Michel Dhome,et al.  Generic and real-time structure from motion using local bundle adjustment , 2009, Image Vis. Comput..

[9]  Andrej Pázman,et al.  Nonlinear Regression , 2019, Handbook of Regression Analysis With Applications in R.

[10]  Michael Broxton,et al.  A bayesian formulation for sub-pixel refinement in stereo orbital imagery , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Takeo Kanade,et al.  Quasiconvex Optimization for Robust Geometric Reconstruction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  R. Fletcher Practical Methods of Optimization , 1988 .

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[15]  Helmut Mayer 3D Reconstruction and Visualization of Urban Scenes from Uncalibrated Wide-Baseline Image Sequences , 2008 .

[16]  Felix J. Herrmann,et al.  Robust inversion, dimensionality reduction, and randomized sampling , 2012, Math. Program..

[17]  Jennifer A. Scott,et al.  Algorithm 891: A Fortran virtual memory system , 2009, TOMS.

[18]  Michael Broxton,et al.  Lunar Terrain and Albedo Reconstruction from Apollo Imagery , 2010, CIDU.

[19]  Taehee Lee,et al.  Robust 3D street-view reconstruction using sky motion estimation , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[20]  Pascal Fua,et al.  From synthesis to analysis: fitting human animation models to image data , 1999, 1999 Proceedings Computer Graphics International.

[21]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[22]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[23]  Kurt Konolige,et al.  Visual Odometry Using Sparse Bundle Adjustment on an Autonomous Outdoor Vehicle , 2006, AMS.

[24]  H. Mayer ROBUST LEAST-SQUARES ADJUSTMENT BASED ORIENTATION AND AUTO-CALIBRATION OF WIDE-BASELINE IMAGE SEQUENCES , 2005 .

[25]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[27]  Helmut Mayera,et al.  COMPARISON OF PHOTOGRAMMETRIC AND COMPUTER VISION TECHNIQUES-3 D RECONSTRUCTION AND VISUALIZATION OF WARTBURG CASTLE , 2003 .

[28]  Daniel G. Aliaga,et al.  Robust Bundle Adjustment for Structure from Motion , 2006, 2006 International Conference on Image Processing.