Message Passing on the Two-Layer Network for Geometric Model Fitting

In this paper, we propose a novel model fitting method to recover multiple geometric structures from data corrupted by noises and outliers. Instead of analyzing each model hypothesis or each data point separately, the proposed method combines both the consensus information in all model hypotheses and the preference information in all data points into a two-layer network, in which the vertices in the first layer represent the data points and the vertices in the second layer represent the model hypotheses. Based on this formulation, the clusters in the second layer of the network, corresponding to the true structures, are detected by using an effective Two-Stage Message Passing (TSMP) algorithm. TSMP can not only accurately detect multiple structures in data without specifying the number of structures, but also handle data even with a large number of outliers. Experimental results on both synthetic data and real images further demonstrate the superiority of the proposed method over several state-of-the-art fitting methods.

[1]  Andrea Fusiello,et al.  Robust Multiple Structures Estimation with J-Linkage , 2008, ECCV.

[2]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[3]  Andrea Fusiello,et al.  T-Linkage: A Continuous Relaxation of J-Linkage for Multi-model Fitting , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Tat-Jun Chin,et al.  A global optimization approach to robust multi-model fitting , 2011, CVPR 2011.

[5]  Hiroshi Kawakami,et al.  Detection of Planar Regions with Uncalibrated Stereo using Distributions of Feature Points , 2004, BMVC.

[6]  Tat-Jun Chin,et al.  Robust fitting of multiple structures: The statistical learning approach , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Tat-Jun Chin,et al.  Simultaneously Fitting and Segmenting Multiple-Structure Data with Outliers , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Brendan J. Frey,et al.  FLoSS: Facility location for subspace segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Tat-Jun Chin,et al.  Clustering with Hypergraphs: The Case for Large Hyperedges , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Peter Meer,et al.  Generalized Projection-Based M-Estimator , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jan-Michael Frahm,et al.  USAC: A Universal Framework for Random Sample Consensus , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[15]  Andrea Fusiello,et al.  Robust Multiple Model Fitting with Preference Analysis and Low-rank Approximation , 2015, BMVC.

[16]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[17]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[18]  Jan-Michael Frahm,et al.  RANSAC for (Quasi-)Degenerate data (QDEGSAC) , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Yan Yan,et al.  Mode-Seeking on Hypergraphs for Robust Geometric Model Fitting , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  É. Vincent,et al.  Detecting planar homographies in an image pair , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[21]  Tat-Jun Chin,et al.  Dynamic and hierarchical multi-structure geometric model fitting , 2011, 2011 International Conference on Computer Vision.