Dense Stereo Correspondence with Slanted Surface using Phase-based Algorithm

The model of local spatial frequency provides a powerful analytical for image analysis. In this paper we explore the application of this representation to long-standing problem in stereovision "the foreshortening problem". We develop phase difference-based algorithm that use an adaptive scale selection process at the corresponding points in the two views. This takes into account surface perspective distortion (foreshortening). Challenges arise from the fact that stereo images are acquired from a slightly different view. Therefore, the projection of the surface in the images is more compressed and occupied a smaller area in one view. Instead of matching intensities directly, a Gabor scale-space expansion (scalogram) is used. The phase difference at corresponding points in the two images is used to estimate the disparity. The suggested algorithm provides an analytical closed-form expression for the effect of perspective foreshortening. It also demonstrates a novel solution to the phase-wraparound problem that has limited the application of other phase-based method. The efficiency and performance is confirmed on the basis of analysis of rectified real images. Hence, our proposed method has a superior performance in comparison with other methods.

[1]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[2]  José Tribolet,et al.  A new phase unwrapping algorithm , 1977 .

[3]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[4]  David J. Fleet,et al.  Stability of phase information , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[5]  Jitendra Malik,et al.  Determining Three-Dimensional Shape from Orientation and Spatial Frequency Disparities , 1991, ECCV.

[6]  Louis A. Romero,et al.  Robust two-dimensional weighted and unweighted phase unwrapping that uses fast transforms and iterative methods , 1994 .

[7]  Bernd Michaelis,et al.  Improvement of the spatial resolution of an optical 3-D measurement procedure , 1998, IEEE Trans. Instrum. Meas..

[8]  Udo Zölzer,et al.  FFT-Based Disparity Estimation for Stereo Image Coding , 2003, DAGM-Symposium.

[9]  T. Sanger,et al.  Stereo disparity computation using Gabor filters , 1988, Biological Cybernetics.

[10]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[11]  Udo Zölzer,et al.  Inclusion of Magnitude Information for Improved Phase-Based Disparity Estimation in Stereoscopic Image Pairs , 2005, VISION.

[12]  Juyang Weng,et al.  Image matching using the windowed Fourier phase , 1993, International Journal of Computer Vision.

[13]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ruigang Yang,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling , 2006, CVPR.

[15]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ayoub Al-Hamadi,et al.  Dense depth map reconstruction by phase difference-based algorithm under influence of perspective distortion , 2006 .

[17]  S. El-Etriby,et al.  Phase-based Disparity Estimation with Implicit Foreshortening Correction , 2006 .

[18]  Heiko Hirschmüller,et al.  Stereo Vision in Structured Environments by Consistent Semi-Global Matching , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Luc Van Gool,et al.  Combined Depth and Outlier Estimation in Multi-View Stereo , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).