DGSAC: Density Guided Sampling and Consensus

In this paper, we present an automatic multi-model fitting pipeline that can robustly fit multiple geometric models present in the corrupted and noisy data. Our approach can handle large data corruption and requires no user input, unlike most state-of-the-art approaches. The pipeline can be used as an independent block in many geometric vision applications like 3D reconstruction, motion and planar segmentation. We use residual density as the primary tool to guide hypothesis generation, estimate the fraction of inliers, and perform model selection. We show results for a diverse set of geometric models like planar homographies, fundamental matrices and vanishing points, which often arise in various computer vision applications. Despite being fully automatic, our approach achieves competitive performance compared to state-of-the-art approaches in terms of accuracy and computational time.

[1]  Andrea Fusiello,et al.  Structure-and-motion pipeline on a hierarchical cluster tree , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[2]  Tat-Jun Chin,et al.  A global optimization approach to robust multi-model fitting , 2011, CVPR 2011.

[3]  Ronald Fagin,et al.  Comparing top k lists , 2003, SODA '03.

[4]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Anders P. Eriksson,et al.  Efficient Globally Optimal Consensus Maximisation with Tree Search , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Andrea Fusiello,et al.  Multiple Models Fitting as a Set Coverage Problem , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Tat-Jun Chin,et al.  A simultaneous sample-and-filter strategy for robust multi-structure model fitting , 2013, Comput. Vis. Image Underst..

[8]  Torsten Sattler,et al.  SCRAMSAC: Improving RANSAC's efficiency with a spatial consistency filter , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  David W. Murray,et al.  Guided-MLESAC: faster image transform estimation by using matching priors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Guillermo Sapiro,et al.  Nonnegative Matrix Underapproximation for Robust Multiple Model Fitting , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yan Yan,et al.  A unified hypothesis generation framework for multi-structure model fitting , 2017, Neurocomputing.

[12]  Tat-Jun Chin,et al.  Simultaneously Fitting and Segmenting Multiple-Structure Data with Outliers , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Haesun Park,et al.  SymNMF: nonnegative low-rank approximation of a similarity matrix for graph clustering , 2014, Journal of Global Optimization.

[14]  Tat-Jun Chin,et al.  Accelerated Hypothesis Generation for Multistructure Data via Preference Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  D. Gleich TRUST REGION METHODS , 2017 .

[16]  David Suter,et al.  Robust adaptive-scale parametric model estimation for computer vision , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Andrea Fusiello,et al.  T-Linkage: A Continuous Relaxation of J-Linkage for Multi-model Fitting , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Sushil Mittal,et al.  Robust Multi-Model Fitting Using Density and Preference Analysis , 2016, ACCV.

[19]  Andrea Fusiello,et al.  Scale Estimation in Multiple Models Fitting via Consensus Clustering , 2015, CAIP.

[20]  James H. Elder,et al.  Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery , 2008, ECCV.

[21]  B. S. Manjunath,et al.  The multiRANSAC algorithm and its application to detect planar homographies , 2005, IEEE International Conference on Image Processing 2005.

[22]  Zhenwei Cao,et al.  Robust Model Fitting Using Higher Than Minimal Subset Sampling , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Tat-Jun Chin,et al.  The Random Cluster Model for robust geometric fitting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Jiri Matas,et al.  Progressive-X: Efficient, Anytime, Multi-Model Fitting Algorithm , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  Vincent Charvillat,et al.  The toulouse vanishing points dataset , 2015, MMSys.

[26]  Jiri Matas,et al.  MAGSAC: Marginalizing Sample Consensus , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Andrea Fusiello,et al.  Robust Multiple Model Fitting with Preference Analysis and Low-rank Approximation , 2015, BMVC.

[28]  Hanzi Wang,et al.  AMSAC: An adaptive robust estimator for model fitting , 2013, 2013 IEEE International Conference on Image Processing.

[29]  Slawomir J. Nasuto,et al.  NAPSAC: High Noise, High Dimensional Robust Estimation - it's in the Bag , 2002, BMVC.

[30]  Tat-Jun Chin,et al.  Dynamic and hierarchical multi-structure geometric model fitting , 2011, 2011 International Conference on Computer Vision.

[31]  Andrea Fusiello,et al.  Robust Multiple Structures Estimation with J-Linkage , 2008, ECCV.

[32]  Yan Yan,et al.  Efficient guided hypothesis generation for multi-structure epipolar geometry estimation , 2017, Comput. Vis. Image Underst..

[33]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..

[34]  WangHanzi,et al.  Robust Adaptive-Scale Parametric Model Estimation for Computer Vision , 2004 .

[35]  Guillermo Sapiro,et al.  Fast L1-NMF for Multiple Parametric Model Estimation , 2016, ArXiv.

[36]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[37]  Matthew Turk,et al.  EVSAC: Accelerating Hypotheses Generation by Modeling Matching Scores with Extreme Value Theory , 2013, 2013 IEEE International Conference on Computer Vision.