New disparity estimation scheme based on adaptive matching windows for intermediate view reconstruction

A new intermediate view reconstruction technique based on the adaptive disparity estimation algorithm is proposed. First, the feature values indicating the local image complexity are extracted from the input stereo image pair by using edge detection and matching algorithms. Then, the matching window size for disparity estimation is adaptively selected depending on the magnitude of these feature values. That is, for the region having larger feature values, the smaller matching window size is selected, while for the opposite case, the larger matching window size is selected by comparison with a predetermined threshold value. This new approach is not only able to reduce the mismatch of the disparity vector, which occurs in conventional fine disparity estimation with a small matching window size, but also can reduce the blocking effect, which occurs in coarse disparity estimation with a large matching window size. Some experimental results show that the proposed algorithm improves the peak signal-to-noise of the reconstructed intermediate view up to 2.93 to 4.09 dB and reduces the execution time to 39.34 to 65.62% on average in comparison with those of conventional algorithms.

[1]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Patrick Bouthemy,et al.  Multimodal Estimation of Discontinuous Optical Flow using Markov Random Fields , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Wolfgang Niem,et al.  Camera viewpoint control for the automatic reconstruction of 3D objects , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[6]  Jeffrey S. McVeigh,et al.  Intermediate view synthesis considering occluded and ambiguously referenced image regions , 1996, Signal Process. Image Commun..

[7]  K. Muller,et al.  Incomplete 3-D multiview representation of video objects , 1999 .

[8]  Aggelos K. Katsaggelos,et al.  Dense Disparity Estimation with a Divide-and-Conquer Disparity Space Image Technique , 1999, IEEE Trans. Multim..

[9]  An Luo,et al.  An intensity-based cooperative bidirectional stereo matching with simultaneous detection of discontinuities and occlusions , 1995, International Journal of Computer Vision.