Multi-Scale Gabor Phase-Based Stereo Matching using Graph Cuts

In this paper, we present a multi-scale Gabor phase-based stereo matching scheme. Unlike the mechanism in the existing phase-based stereo matching methods, where disparity is formulated as the ratio of phase difference between two views to the local frequency at the given position, we set up a robust data measure from multi-scale Gabor phases to greatly alleviate the negative effect of phase singularity. A cost function is then advanced based on this robust data measure. To further improve the accuracy of disparity estimation, we formulate the cost function as three coupled Markov Random Field (MRF) cost terms in frequency domain. To obtain globally optimized disparity map in wide range, graph cut is employed to perform the minimization of the cost function. Compared with the state-of-the-art stereo matching methods, experimental results demonstrate that our approach gets comparable matching performance in indoor scenes and achieves much better results in aerial scenes.

[1]  Djemel Ziou,et al.  Phase-based disparity estimation: a spatial approach , 1997, Proceedings of International Conference on Image Processing.

[2]  Gyung-bum Kim,et al.  An accurate and robust stereo matching algorithm with variable windows for 3D measurements , 2004 .

[3]  Peter Meer,et al.  Point matching under large image deformations and illumination changes , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  David J. Fleet,et al.  Stability of phase information , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[5]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[6]  William T. Freeman,et al.  Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Vladimir Kolmogorov,et al.  Computing visual correspondence with occlusions using graph cuts , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  T. Sanger,et al.  Stereo disparity computation using Gabor filters , 1988, Biological Cybernetics.

[9]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[10]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[11]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[12]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[13]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..