Guaranteed Outlier Removal with Mixed Integer Linear Programs

The maximum consensus problem is fundamentally important to robust geometric fitting in computer vision. Solving the problem exactly is computationally demanding, and the effort required increases rapidly with the problem size. Although randomized algorithms are much more efficient, the optimality of the solution is not guaranteed. Towards the goal of solving maximum consensus exactly, we present guaranteed outlier removal as a technique to reduce the runtime of exact algorithms. Specifically, before conducting global optimization, we attempt to remove data that are provably true outliers, i.e., those that do not exist in the maximum consensus set. We propose an algorithm based on mixed integer linear programming to perform the removal. The result of our algorithm is a smaller data instance that admits a much faster solution by subsequent exact algorithms, while yielding the same globally optimal result as the original problem. We demonstrate that overall speedups of up to 80% can be achieved on common vision problems1.

[1]  Kristy Sim,et al.  Removing outliers using the L∞ Norm , 2006, CVPR 2006.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Carl Olsson,et al.  A polynomial-time bound for matching and registration with outliers , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Masatoshi Okutomi,et al.  Deterministically maximizing feasible subsystem for robust model fitting with unit norm constraint , 2011, CVPR 2011.

[5]  M. Padberg Linear Optimization and Extensions , 1995 .

[6]  Fredrik Kahl,et al.  Robust Fitting for Multiple View Geometry , 2012, ECCV.

[7]  Andrew Zisserman,et al.  Efficient image retrieval for 3D structures , 2010, BMVC.

[8]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[9]  Hongdong Li,et al.  Consensus set maximization with guaranteed global optimality for robust geometry estimation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  L. S. Kazarinov,et al.  Determining the committee of a system of weighted inequalities , 1981, Cybernetics.

[11]  John W. Chinneck,et al.  Feasibility and Infeasibility in Optimization:: Algorithms and Computational Methods , 2007 .

[12]  Anders P. Eriksson,et al.  An Adversarial Optimization Approach to Efficient Outlier Removal , 2011, Journal of Mathematical Imaging and Vision.

[13]  Marc E. Pfetsch,et al.  Konrad-zuse-zentrum F ¨ Ur Informationstechnik Berlin Branch-and-cut for the Maximum Feasible Subsystem Problem Branch-and-cut for the Maximum Feasible Subsystem Problem , 2022 .

[14]  Anders P. Eriksson,et al.  Efficient Globally Optimal Consensus Maximisation with Tree Search , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  R. Greer Trees and Hills: Methodology for Maximizing Functions of Systems of Linear Relations , 1984 .

[16]  G. Nemhauser,et al.  Integer Programming , 2020 .

[17]  Anders P. Eriksson,et al.  Outlier removal using duality , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Ching-Wei Wang,et al.  Improved image alignment method in application to X-ray images and biological images , 2013, Bioinform..

[19]  Fredrik Kahl,et al.  Accurate Localization and Pose Estimation for Large 3D Models , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Tat-Jun Chin,et al.  Guaranteed Outlier Removal for Rotation Search , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  Richard I. Hartley,et al.  Multiple-View Geometry Under the {$L_\infty$}-Norm , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  R. Hartley,et al.  Multiple-View Geometry under the L 1-Norm , 2007 .

[23]  Richard I. Hartley,et al.  L-8Minimization in Geometric Reconstruction Problems , 2004, CVPR.

[24]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .