Efficient Algorithms for Maximum Consensus Robust Fitting

Maximum consensus robust fitting is a fundamental problem in many computer vision applications, such as vision-based robotic navigation and mapping. While exact search algorithms are computationally demanding, randomized algorithms are cheap but the solution quality is not guaranteed. Deterministic algorithms fill the gap between these two kinds of algorithms, which have better solution quality than randomized algorithms while being much faster than exact algorithms. In this article, we develop two highly efficient deterministic algorithms based on the alternating direction method of multipliers (ADMM) and proximal block coordinate descent (BCD) frameworks. Particularly, the proposed BCD algorithm is guaranteed convergent. Furthermore, on the slack variable in the BCD algorithm, which indicates the inliers and outliers, we establish some meaningful properties, such as support convergence within finite iterations and convergence to restricted strictly local minimizer. Compared with state-of-the-art algorithms, the new algorithms with initialization from a randomized or convex relaxed algorithm can achieve improved solution quality while being much more efficient (e.g., more than an order of magnitude faster). An application of the new ADMM algorithm in simultaneous localization and mapping (SLAM) has also been provided to demonstrate its effectiveness. Code for reproducing the results is available online.1

[1]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Stephen J. Wright Coordinate descent algorithms , 2015, Mathematical Programming.

[3]  Hongdong Li,et al.  Consensus set maximization with guaranteed global optimality for robust geometry estimation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[5]  Carl Olsson,et al.  A polynomial-time bound for matching and registration with outliers , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[7]  David W. Murray,et al.  Guided-MLESAC: faster image transform estimation by using matching priors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Anders P. Eriksson,et al.  Outlier removal using duality , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[11]  Sang Wook Lee,et al.  Outlier Removal by Convex Optimization for L-Infinity Approaches , 2009, PSIVT.

[12]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  R. Mifflin Semismooth and Semiconvex Functions in Constrained Optimization , 1977 .

[14]  Edwin Olson,et al.  Inference on networks of mixtures for robust robot mapping , 2013, Int. J. Robotics Res..

[15]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[16]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[17]  Peter Meer,et al.  ROBUST TECHNIQUES FOR COMPUTER VISION , 2004 .

[18]  Huu Le,et al.  An Exact Penalty Method for Locally Convergent Maximum Consensus , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Anders P. Eriksson,et al.  Efficient Globally Optimal Consensus Maximisation with Tree Search , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Anders P. Eriksson,et al.  Guaranteed Outlier Removal with Mixed Integer Linear Programs , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[22]  Fredrik Kahl,et al.  Robust Fitting for Multiple View Geometry , 2012, ECCV.

[23]  Anders P. Eriksson,et al.  Maximum Consensus Parameter Estimation by Reweighted \ell _1 ℓ 1 Methods , 2017, EMMCVPR.

[24]  Peilin Liu,et al.  A Survey on Nonconvex Regularization-Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learning , 2018, IEEE Access.

[25]  Anders P. Eriksson,et al.  Deterministic Approximate Methods for Maximum Consensus Robust Fitting , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Giuseppe C. Calafiore,et al.  Convex Relaxations for Pose Graph Optimization With Outliers , 2018, IEEE Robotics and Automation Letters.

[27]  Sunglok Choi,et al.  Performance Evaluation of RANSAC Family , 2009, BMVC.

[28]  Anders P. Eriksson,et al.  Maximum Consensus Parameter Estimation by Reweighted ℓ1 Methods , 2018, ArXiv.

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Masatoshi Okutomi,et al.  Deterministically maximizing feasible subsystem for robust model fitting with unit norm constraint , 2011, CVPR 2011.

[31]  Takeo Kanade,et al.  Quasiconvex Optimization for Robust Geometric Reconstruction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Tat-Jun Chin,et al.  Robust Fitting in Computer Vision: Easy or Hard? , 2018, ECCV.

[33]  R. Hartley,et al.  Multiple-View Geometry under the L 1-Norm , 2007 .

[34]  Anders P. Eriksson,et al.  Non-smooth M-estimator for Maximum Consensus Estimation , 2018, BMVC.

[35]  Richard I. Hartley,et al.  Removing Outliers Using The L\infty Norm , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[36]  Richard I. Hartley,et al.  Multiple-View Geometry Under the {$L_\infty$}-Norm , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[38]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[39]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[40]  Richard I. Hartley,et al.  Convergence of Iteratively Re-weighted Least Squares to Robust M-Estimators , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[41]  Steven M. Seitz,et al.  Fast algorithms for L∞ problems in multiview geometry , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Danping Zou,et al.  Efficient Outlier Removal for Large Scale Global Structure-from-Motion , 2018, ArXiv.