Three-view dense disparity estimation with occlusion detection

An algorithm for disparity estimation with energy-based variational regularization using three image views is presented. In the new algorithm, dense disparity maps, including the disparity values for feature points, are first estimated by phase-based methods. Then a set of coupled partial differential equations (PDEs) are solved to refine these disparity maps together with the feature information. The visual appearance of the refined disparity is better than that of the results using similar variational regularization involving only one stereo pair of images. In addition, a new effective occlusion detection scheme is presented with good results.

[1]  David J. Fleet.  Disparity from local weighted phase-correlation , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[2]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Luc Van Gool,et al.  Dense matching of multiple wide-baseline views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Richard Szeliski,et al.  Handling occlusions in dense multi-view stereo , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Rachid Deriche,et al.  Dense Disparity Map Estimation Respecting Image Discontinuities: A PDE and Scale-Space BasedApproach , 2002, MVA.

[6]  Eric Dubois,et al.  Disparity estimation for the intermediate view interpolation of stereoscopic images , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..