KNN Matting

We are interested in a general alpha matting approach for the simultaneous extraction of multiple image layers; each layer may have disjoint segments for material matting not limited to foreground mattes typical of natural image matting. The estimated alphas also satisfy the summation constraint. Our approach does not assume the local colorline model, does not need sophisticated sampling strategies, and generalizes well to any color or feature space in any dimensions. Our matting technique, aptly called KNN matting, capitalizes on the nonlocal principle by usingK nearest neighbors (KNN) in matching nonlocal neighborhoods, and contributes a simple and fast algorithm giving competitive results with sparse user markups. KNN matting has a closed-form solution that can leverage on the preconditioned conjugate gradient method to produce an efficient implementation. Experimental evaluation on benchmark datasets indicates that our matting results are comparable to or of higher quality than state of the art methods.

[1]  Jian Sun,et al.  Fast matting using large kernel matting Laplacian matrices , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Jian Sun,et al.  Poisson matting , 2004, ACM Trans. Graph..

[4]  Pushmeet Kohli,et al.  A perceptually motivated online benchmark for image matting , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Deepu Rajan,et al.  Weighted color and texture sample selection for image matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Wei Chen,et al.  Easy Matting ‐ A Stroke Based Approach for Continuous Image Matting , 2006, Comput. Graph. Forum.

[7]  Zhanpeng Zhang,et al.  Learning based alpha matting using support vector regression , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  Ying Wu,et al.  Nonlocal matting , 2011, CVPR 2011.

[9]  James F. Blinn,et al.  Blue screen matting , 1996, SIGGRAPH.

[10]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[12]  Jason Lawrence,et al.  Material matting , 2011, ACM Trans. Graph..

[13]  Michael S. Brown,et al.  Motion Regularization for Matting Motion Blurred Objects , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Michael F. Cohen,et al.  Image and Video Matting , 2008 .

[15]  Yuanjie Zheng,et al.  Learning based digital matting , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[17]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[18]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Pushmeet Kohli,et al.  A spatially varying PSF-based prior for alpha matting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Wojciech Matusik,et al.  Inverse shade trees for non-parametric material representation and editing , 2006, SIGGRAPH 2006.

[21]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[23]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[24]  Dani Lischinski,et al.  Spectral Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Michael D. McCool,et al.  Homomorphic factorization of BRDFs for high-performance rendering , 2001, SIGGRAPH.

[26]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[27]  Forrester Cole,et al.  Automatic BRDF Factorization , 2002 .

[28]  Carsten Rother,et al.  Improving Color Modeling for Alpha Matting , 2008, BMVC.

[29]  René Vidal,et al.  Estimation of Alpha Mattes for Multiple Image Layers , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[31]  Wojciech Matusik,et al.  Inverse shade trees for non-parametric material representation and editing , 2006, ACM Trans. Graph..