A novel image matting method using sparse manual clicks

Traditional image matting methods often have strict requirements on user input. This paper proposes a new matting method based on spectral clustering, which generates a well matte using a sparse user input. Firstly, connected components are obtained using spectral clustering, which actually utilizes a linear transformation of the smallest eigenvectors of the matting Laplacian matrix. An accurate trimap is obtained via user input and threshold segmentation. Secondly, sample sets are gathered by two-level hierarchical clustering and Fast Approximate Nearest Neighbors algorithm and unknown pixels are evaluated by the samples. Finally, an optimal matte is obtained by constructing an energy function with local smoothness constraint. Experiments show that the proposed method outperforms most of the state-of-the-art methods with a sparse user input and our method has fewer requirements to get a robust matte.

[1]  Rüdiger Westermann,et al.  RANDOM WALKS FOR INTERACTIVE ALPHA-MATTING , 2005 .

[2]  Sheng-Jyh Wang,et al.  A cell-based matting Laplacian for contrast enhancement , 2012, 2012 19th IEEE International Conference on Image Processing.

[3]  Jian Sun,et al.  Fast matting using large kernel matting Laplacian matrices , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[5]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Jian Sun,et al.  Poisson matting , 2004, ACM Trans. Graph..

[7]  Qinping Zhao,et al.  Image Matting with Local and Nonlocal Smooth Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Deepu Rajan,et al.  Improving Image Matting Using Comprehensive Sampling Sets , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Woo-Jin Song,et al.  Local and Nonlocal Color Line Models for Image Matting , 2014, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[10]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Carsten Rother,et al.  Improving Color Modeling for Alpha Matting , 2008, BMVC.

[12]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[14]  Wei Chen,et al.  Easy Matting ‐ A Stroke Based Approach for Continuous Image Matting , 2006, Comput. Graph. Forum.

[15]  Ying Wu,et al.  Nonlocal matting , 2011, CVPR 2011.

[16]  Guijin Wang,et al.  Local matting based on sample-pair propagation and iterative refinement , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[18]  Jue Wang,et al.  A perceptually motivated online benchmark for image matting , 2009, CVPR.

[19]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[20]  Pushmeet Kohli,et al.  A spatially varying PSF-based prior for alpha matting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Yuanjie Zheng,et al.  Learning based digital matting , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Deepu Rajan,et al.  Sparse codes as Alpha Matte , 2014, BMVC.

[23]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[24]  Zhanpeng Zhang,et al.  Learning based alpha matting using support vector regression , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Feiping Nie,et al.  Semi-Supervised Classification via Local Spline Regression , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Guijin Wang,et al.  Iterative transductive learning for alpha matting , 2013, 2013 IEEE International Conference on Image Processing.

[27]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[28]  Dani Lischinski,et al.  Spectral Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.