A Graduated Filter Method for Large Scale Robust Estimation

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper, we introduce a novel solver for robust estimation that possesses a strong ability to escape poor local minima. Our algorithm is built upon the class of traditional graduated optimization techniques, which are considered state-of-the-art local methods to solve problems having many poor minima. The novelty of our work lies in the introduction of an adaptive kernel (or residual) scaling scheme, which allows us to achieve faster convergence rates. Like other existing methods that aim to return good local minima for robust estimation tasks, our method relaxes the original robust problem, but adapts a filter framework from non-linear constrained optimization to automatically choose the level of relaxation. Experimental results on real large-scale datasets such as bundle adjustment instances demonstrate that our proposed method achieves competitive results.

[1]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[4]  Christopher Zach,et al.  Multiplicative vs. Additive Half-Quadratic Minimization for Robust Cost Optimization , 2018, BMVC.

[5]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jörg Fliege,et al.  Newton's Method for Multiobjective Optimization , 2009, SIAM J. Optim..

[7]  Dianne P. O'Leary,et al.  Homotopy optimization methods for global optimization. , 2005 .

[8]  Heng Yang,et al.  Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejection , 2020, IEEE Robotics and Automation Letters.

[9]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[10]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[12]  Huu Le,et al.  An Exact Penalty Method for Locally Convergent Maximum Consensus , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Hossein Mobahi,et al.  On the Link between Gaussian Homotopy Continuation and Convex Envelopes , 2015, EMMCVPR.

[14]  Clóvis C. Gonzaga,et al.  Global Convergence of Filter Methods for Nonlinear Programming , 2008, SIAM J. Optim..

[15]  David Nister,et al.  Bundle Adjustment Rules , 2006 .

[16]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[17]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[18]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[19]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[21]  Christopher Zach,et al.  Pareto Meets Huber: Efficiently Avoiding Poor Minima in Robust Estimation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[22]  Christopher Zach,et al.  Descending, Lifting or Smoothing: Secrets of Robust Cost Optimization , 2018, ECCV.

[23]  Anders P. Eriksson,et al.  Efficient Globally Optimal Consensus Maximisation with Tree Search , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[25]  Sven Leyffer,et al.  Nonlinear programming without a penalty function , 2002, Math. Program..

[26]  Hossein Mobahi,et al.  Seeing through the blur , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[28]  Christopher Zach,et al.  Robust Bundle Adjustment Revisited , 2014, ECCV.

[29]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[30]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[31]  Huu Le,et al.  Deterministic consensus maximization with biconvex programming , 2018, ECCV.

[32]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[33]  P. Green Iteratively reweighted least squares for maximum likelihood estimation , 1984 .