Natural image matting for multiple wide-baseline views

In this paper we present a novel approach to estimate the alpha mattes of a foreground object captured by a wide-baseline circular camera rig provided a single key frame trimap. Bayesian inference coupled with camera calibration information are used to propagate high confidence trimaps labels across the views. Recent techniques have been developed to estimate an alpha matte of an image using multiple views but they are limited to narrow baseline views with low foreground variation. The proposed wide-baseline trimap propagation is robust to inter-view foreground appearance changes, shadows and similarity in foreground/background appearance for cameras with opposing views enabling high quality alpha matte extraction using any state-of-the-art image matting algorithm.

[1]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[2]  Roberto Cipolla,et al.  Automatic 3D object segmentation in multiple views using volumetric graph-cuts , 2007, Image Vis. Comput..

[3]  Yo-Sung Ho,et al.  Multi-View Image Matting and Compositing Using Trimap Sharing for Natural 3-D Scene Generation , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[4]  Andrew W. Fitzgibbon,et al.  Bayesian Estimation of Layers from Multiple Images , 2002, ECCV.

[5]  Wojciech Matusik,et al.  Natural video matting using camera arrays , 2006, SIGGRAPH '06.

[6]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[7]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Richard Szeliski,et al.  Boundary Matting for View Synthesis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Harry Shum,et al.  Background Cut , 2006, ECCV.

[10]  Kwang Hee Won,et al.  Natural Image Matting Based on Neighbor Embedding , 2007, MIRAGE.

[11]  Jiaya Jia,et al.  Poisson matting , 2004, SIGGRAPH 2004.

[12]  Jean-Yves Guillemaut,et al.  Non-parametric natural image matting , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).