Block-Based MAP Disparity Estimation Under Alpha-Channel Constraints

Disparity estimation belongs to the most important, but difficult, problems in image processing and computer vision. Its importance stems from a wide range of applications, while its difficulty is related to ill-posedness. To date, numerous disparity estimation algorithms have been developed. In this paper, we consider a particular case of disparity estimation based on two views and a known alpha channel partitioning each view into foreground and background. The main idea is to use this partitioning in order to enhance disparity estimation in the foreground object close to its boundary. We propose a block-based disparity model with two alpha-channel constraints: a photometric one, disabling invalid intensity/color matches, and a geometric one, preventing disparity smoothing between foreground and background. We incorporate these constraints into a Bayesian framework using the maximum a posteriori probability criterion. We experimentally demonstrate improvements in the estimated disparities at foreground object boundaries, and show examples of image relighting using these disparities

[1]  Rachid Deriche,et al.  Dense Disparity Map Estimation Respecting Image Discontinuities: A PDE and Scale-Space BasedApproach , 2002, MVA.

[2]  M. Omair Ahmad,et al.  Comparison of wavelets for multiresolution motion estimation , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[4]  Richard Szeliski,et al.  Stereo Matching with Transparency and Matting , 1999, International Journal of Computer Vision.

[5]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  José M. N. Leitão,et al.  Simulated tearing: an algorithm for discontinuity-preserving visual surface reconstruction , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Eyal Ofek,et al.  Depth keying , 2003, IS&T/SPIE Electronic Imaging.

[8]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Viet Anh Nguyen,et al.  Efficient block-matching motion estimation based on Integral frame attributes , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Riccardo March,et al.  Computation of stereo disparity using regularization , 1988, Pattern Recognit. Lett..

[11]  Eric Dubois,et al.  Bayesian Estimation of Motion Vector Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Janusz Konrad,et al.  Robust quadtree-based disparity estimation for the reconstruction of intermediate stereoscopic images , 1998, Electronic Imaging.

[14]  Augusto Sarti,et al.  Multi-camera systems , 1999 .

[15]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  David W. Murray,et al.  Scene Segmentation from Visual Motion Using Global Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.