Stereo matching based on segmented B-spline surface fitting and accelerated region belief propagation

The authors propose a new stereo matching algorithm based on an iterative optimisation framework including bi-cubic B-spline surface fitting and accelerated region belief propagation (BP). They first compute the initial cost and disparity map by the adaptive support-weight approach and then launch the iterative process in which the disparity space image is refined via the bi-cubic B-spline fitting and optimised via the accelerated region BP. Two innovations are contained in the algorithm: (i) disparity space image refinement based on segmented bi-cubic B-spline surface fitting; and (ii) an accelerated region message passing approach for BP. The algorithm is verified on the Middlebury benchmark and experimental results show the algorithm is effective and achieves the state-of-the-art accuracy.

[1]  Gauthier Lafruit,et al.  Cross-Based Local Stereo Matching Using Orthogonal Integral Images , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Narendra Ahuja,et al.  A constant-space belief propagation algorithm for stereo matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Zhi-Gang Zheng,et al.  A region based stereo matching algorithm using cooperative optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Andrew W. Fitzgibbon,et al.  Global stereo reconstruction under second order smoothness priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Liang-Gee Chen,et al.  Hardware-Efficient Belief Propagation , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[8]  William T. Freeman,et al.  Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Jesús M. Pérez,et al.  Real-time stereo matching using memory-efficient Belief Propagation for high-definition 3D telepresence systems , 2011, Pattern Recognit. Lett..

[12]  Tianli Yu,et al.  Efficient Message Representations for Belief Propagation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Pau-Choo Chung,et al.  Efficient Disparity Estimation Using Hierarchical Bilateral Disparity Structure Based Graph Cut Algorithm With a Foreground Boundary Refinement Mechanism , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Pushmeet Kohli,et al.  Surface stereo with soft segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Geoffrey Egnal,et al.  Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Carlo Tomasi,et al.  Surfaces with occlusions from layered stereo , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hyojin Kim,et al.  Piecewise Planar Scene Reconstruction and Optimization for Multi-view Stereo , 2012, ACCV.

[19]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Federico Tombari,et al.  Segmentation-Based Adaptive Support for Accurate Stereo Correspondence , 2007, PSIVT.

[21]  Angel Domingo Sappa,et al.  Multispectral piecewise planar stereo using Manhattan-world assumption , 2013, Pattern Recognit. Lett..

[22]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Xiaofeng Li,et al.  A homography transform based higher-order MRF model for stereo matching , 2014, Pattern Recognit. Lett..

[24]  William T. Freeman,et al.  On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs , 2001, IEEE Trans. Inf. Theory.

[25]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Changming Sun,et al.  Cross Image Inference Scheme for Stereo Matching , 2012, ACCV.

[27]  Siu-Yeung Cho,et al.  Stereo correspondence using efficient hierarchical belief propagation , 2012, Neural Computing and Applications.