Alpha matte estimation of natural images using local and global template correspondence

Natural image matting is an interesting and difficult problem of computer vision because of its under-constrained nature. It often requires a user interaction, a trimap, to aid the algorithm in identifying the initial definite foreground and background regions. Current techniques use local or global image statistics of these definite regions to estimate the alpha matte for the undefined region. In this paper we propose a novel non-parametric template correspondence approach to estimate the alpha matte. This technique alleviates the problem of previous parametric algorithms that rely solely on colour information and hence are unable to exploit the image structure to their advantage. The proposed technique uses global and local template correspondence, to the definite know regions, to construct the background and foreground layers. Once the foreground and background colours are estimated, the final alpha matte is computed. According to the quantitative analysis against the ground truth, the proposed algorithm outperforms the current state-of-the-art parametric matting techniques.

[1]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[2]  Carlo Tomasi,et al.  Alpha estimation in natural images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  John M. Hannah,et al.  Alpha channel estimation in high resolution images and image sequences , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[6]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[9]  Jiaya Jia,et al.  Poisson matting , 2004, SIGGRAPH 2004.

[10]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  James F. Blinn,et al.  Blue screen matting , 1996, SIGGRAPH.

[12]  Guillermo Sapiro,et al.  Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting , 2009, International Journal of Computer Vision.

[13]  Andrew W. Fitzgibbon,et al.  Image-Based Rendering Using Image-Based Priors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.