Multi-H: Efficient recovery of tangent planes in stereo images

Multi-H – an efficient method for the recovery of the tangent planes of a set of point correspondences satisfying the epipolar constraint is proposed. The problem is formulated as a search for a labeling minimizing an energy that includes a data and spatial regularization terms. The number of planes is controlled by a combination of MeanShift [6] and α-expansion [3]. Experiments on the fountain-P11 3D dataset show that Multi-H provides highly accurate tangent plane estimates. It also outperforms all state-of-the-art techniques for multihomography estimation on the publicly available AdelaideRMF dataset. Since Multi-H achieves nearly error-free performance, we introduce and make public a more challenging dataset for multi-plane fitting evaluation.

[1]  Andrea Fusiello,et al.  Robust Multiple Structures Estimation with J-Linkage , 2008, ECCV.

[2]  Jiri Matas,et al.  Accurate Closed-form Estimation of Local Affine Transformations Consistent with the Epipolar Geometry , 2016, BMVC.

[3]  Andrea Fusiello,et al.  T-Linkage: A Continuous Relaxation of J-Linkage for Multi-model Fitting , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Brendan J. Frey,et al.  FLoSS: Facility location for subspace segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Baoxin Li,et al.  Robust Ground Plane Detection with Normalized Homography in Monocular Sequences from a Robot Platform , 2006, 2006 International Conference on Image Processing.

[6]  Levente Hajder,et al.  Novel Ways to Estimate Homography from Local Affine Transformations , 2016, VISIGRAPP.

[7]  É. Vincent,et al.  Detecting planar homographies in an image pair , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[8]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  C. V. Jawahar,et al.  Geometric Structure Computation from Conics , 2004, ICVGIP.

[10]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[11]  Andrea Fusiello,et al.  Robust Multiple Model Fitting with Preference Analysis and Low-rank Approximation , 2015, BMVC.

[12]  P. J. Narayanan,et al.  Solving Multilabel MRFs Using Incremental alpha-Expansion on the GPUs , 2009, ACCV.

[13]  Jiri Matas,et al.  MODS: Fast and robust method for two-view matching , 2015, Comput. Vis. Image Underst..

[14]  Zhangy,et al.  3 D Reconstruction Based on Homography Mapping Zhongfei , 1996 .

[15]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[16]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Tat-Jun Chin,et al.  Simultaneous Sampling and Multi-Structure Fitting with Adaptive Reversible Jump MCMC , 2011, NIPS.

[19]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[20]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Tat-Jun Chin,et al.  The Random Cluster Model for robust geometric fitting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Andrea Fusiello,et al.  Multiple Models Fitting as a Set Coverage Problem , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Yuri Boykov,et al.  Energy-Based Geometric Multi-model Fitting , 2012, International Journal of Computer Vision.

[24]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Fumiaki Tomita,et al.  Plane-based calibration algorithm for multi-camera systems via factorization of homography matrices , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[26]  Akihiro Sugimoto A Linear Algorithm for Computing the Homography from Conics in Correspondence , 2004, Journal of Mathematical Imaging and Vision.

[27]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Zoltan Kato,et al.  Recovering planar homographies between 2D shapes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[29]  Tat-Jun Chin,et al.  A global optimization approach to robust multi-model fitting , 2011, CVPR 2011.

[30]  Hiroshi Kawakami,et al.  Detection of Planar Regions with Uncalibrated Stereo using Distributions of Feature Points , 2004, BMVC.

[31]  B. S. Manjunath,et al.  The multiRANSAC algorithm and its application to detect planar homographies , 2005, IEEE International Conference on Image Processing 2005.

[32]  Zhu Feng,et al.  A planar homography estimation method for camera calibration , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[33]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[34]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.