A novel framework for automatic trimap generation using the Gestalt laws of grouping

In this paper, we are concerned with unsupervised natural image matting. Due to the under-constrained nature of the problem, image matting algorithms are usually provided with user interactions, such as scribbles or trimaps. This is a very tedious task and may even become impractical for some applications. For unsupervised matte calculation, we can either adopt a technique that supports an unsupervised mode for alpha map calculation, or we may automate the process of acquiring user interactions provided for a matting algorithm. Our proposed technique contributes to both approaches and is based on spectral matting. The latter is the only technique in the literature that supports automatic matting but it suffers from critical limitations among which is the unreliable unsupervised operation. Stressing on that drawback, spectral matting may produce erroneous mattes in the absence of guiding scribbles or trimaps. Using the Gestalt laws of grouping, we propose a method that automatically produces more truthful mattes than spectral matting. In addition, it can be used to generate trimaps, eliminating the required user interactions and making it possible to harness the powers of matting techniques that are better than spectral matting but don't support unsupervised operation. The main contribution of this research is the introduction of the Gestalt laws of grouping to the matting problem.

[1]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[2]  Jue Wang,et al.  Towards Temporally-Coherent Video Matting , 2011, MIRAGE.

[3]  Pushmeet Kohli,et al.  A perceptually motivated online benchmark for image matting , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Jue Wang,et al.  A perceptually motivated online benchmark for image matting , 2009, CVPR.

[5]  Chi-Keung Tang,et al.  Motion-Aware KNN Laplacian for Video Matting , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Anand Singh Jalal,et al.  Automatic trimap and alpha-matte generation for digital image matting , 2013, 2013 Sixth International Conference on Contemporary Computing (IC3).

[7]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007 .

[8]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[9]  Dani Lischinski,et al.  Spectral Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Kyoung-Rok Lee Learning-based trimap generation for video matting , 2010 .

[11]  N. S. Mendelsohn,et al.  Coverings of Bipartite Graphs , 1958, Canadian Journal of Mathematics.

[12]  Thomas Deselaers,et al.  What is an object? , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Guillermo Sapiro,et al.  Video SnapCut: robust video object cutout using localized classifiers , 2009, SIGGRAPH 2009.

[14]  Yu-Wing Tai,et al.  Video Matting Using Multi-frame Nonlocal Matting Laplacian , 2012, ECCV.

[15]  David Salesin,et al.  Video matting of complex scenes , 2002, SIGGRAPH.

[16]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[17]  Ruigang Yang,et al.  Automatic Natural Video Matting with Depth , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[18]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Carsten Rother,et al.  Improving Color Modeling for Alpha Matting , 2008, BMVC.

[20]  Yao Lu,et al.  Salient Object Detection using concavity context , 2011, 2011 International Conference on Computer Vision.

[21]  Matthew R. Arnison,et al.  Depth from defocus using the mean spectral ratio , 2014, Electronic Imaging.